Legacy-2017 Analysis (Private)
Purpose of this page.
This page collects useful information to be aware of when performing analysis or producing ntuples for analysis. Guidelines are collected on which release, detector conditions, and datasets. We also keep track of special filters or tools useful to remove atypical and problematic events.
Last updated: 7 June 2020
Analysis Recipe
Release
Recommended release: CMSSW_10_6_20
- This release is good for analysis and also any private production for all Legacy-16/17/18.
*Important note
- With CMSSW_10_6_20, Run2-Legacy MiniAODv2
- With CMSSW_10_6_20, NanoAODv8
- Missing MuonReducedTrackExtra in data AOD, MiniAOD
- Available in MC (Summer20 campaign)
Conditions
- Data
- recommended GT for analysis: 106X_dataRun2_v33
- As of 2020-04-29: JEC/JER, please use text and database files provided by JERC (see link to JetMET below)
- v28 GT is good for all Legacy analysis, including special runs.
- GT used in AOD production: 106X_dataRun2_v20
- GT used in (Re) MiniAODv2 production: 106X_dataRun2_v33
- MC
- recommended GT for analysis: 106X_mc2017_realistic_v9
- include UL17 JEC (v8) and low-pT EGM tags (v9)
- GT used in production: 106X_mc2017_realistic_v9
- GT used in production ReNanoAOD (v9): To be updated
Trigger (MC)
- CMSSW_9_4_14_UL_patch1 with HLT:2e34v40 is used for trigger simulation.
Validation
Target (CMSSW_10_6_1)
With special Ecal GT: 106X_mc2017_realistic_forECAL_v6 (CMSSW_10_6_1)
Reference (CMSSW_9_4_14_UL)
Target (CMSSW_10_6_0) for HLT (trigger simulation in 94X)
Data High Statistics rereco: datasets and Conditions
ZeroBias
DoubleMuon
MET
JetHT
SingleElectron
2017C (299481,299480,299479,299478,299477, 299593, 299594, 299595, 299597),
2017F (306459,306456,305064, 306125)
DQM,
AlCa and SKIM following UL2017 proposal
CMSSW_10_6_1 with GT 106X_dataRun2_v15
https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?prep_id=ReReco-Run2017C-ZeroBias-29Jun2019_UL2017validation-0001
https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?prep_id=ReReco-Run2017C-ZeroBias-29Jun2019_UL2017validation-0001
https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?prep_id=ReReco-Run2017C-MET-29Jun2019_UL2017validation-0004
https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?prep_id=ReReco-Run2017C-JetHT-29Jun2019_UL2017validation-0002
https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?prep_id=ReReco-Run2017C-DoubleMuon-29Jun2019_UL2017validation-0003
https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?prep_id=ReReco-Run2017F-ZeroBias-29Jun2019_UL2017validation-0002
https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?prep_id=ReReco-Run2017F-SingleElectron-29Jun2019_UL2017validation-0001
https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?prep_id=ReReco-Run2017F-MET-29Jun2019_UL2017validation-0003
https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?prep_id=ReReco-Run2017F-JetHT-29Jun2019_UL2017validation-0005
https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?prep_id=ReReco-Run2017F-DoubleMuon-29Jun2019_UL2017validation-0004
Available Datasets in DAS (DQMIO)
https://cmsweb.cern.ch/das/request?view=list&limit=50&instance=prod%2Fglobal&input=dataset+dataset%3D%2F*%2F*29Jun2019*%2FDQMIO
Physics objects
Datasets: Data
Example of cmsDriver
- AOD, MiniAOD: CMSSW_10_6_20
cmsDriver.py RECO -s RAW2DIGI,L1Reco,RECO,SKIM:JetHTJetPlusHOFilter,ALCA:HcalCalIsoTrkFilter+HcalCalIsolatedBunchFilter+TkAlMinBias,EI,PAT,DQM:@rerecoCommon --runUnscheduled --nThreads 8 --data --era Run2_2017 --scenario pp --conditions 106X_dataRun2_v28 --eventcontent AOD,MINIAOD,DQM --datatier AOD,MINIAOD,DQMIO --customise Configuration/DataProcessing/RecoTLR.customisePostEra_Run2_2017 --filein file:pippo.root -n 100 --python_filename=recoskim_Run2017F_JetHT.py --no_exec
cmsDriver.py NANO -s NANO --nThreads 2 --data --era Run2_2017 --conditions 106X_dataRun2_v28 --eventcontent NANOEDMAOD --datatier NANOAOD --filein file:pippo.root -n 100 --python_filename=nano_Run2017.py --no_exec
Data Certification
Detail for Legacy-2017 DC can be found in
CMS.DQMULReRecoCertificationRules2017;
Presentation
/afs/cern.ch/cms/CAF/CMSCOMM/COMM_DQM/certification/Collisions17/13TeV/Legacy_2017/Cert_294927-306462_13TeV_UL2017_Collisions17_GoldenJSON.txt
/afs/cern.ch/cms/CAF/CMSCOMM/COMM_DQM/certification/Collisions17/13TeV/Legacy_2017/Cert_294927-306462_13TeV_UL2017_Collisions17_MuonJSON.txt
Datasets: Monte Carlo
- Search for datasets using DAS
- Premixing library:
/Neutrino_E-10_gun/RunIISummer19ULPrePremix-UL17_106X_mc2017_realistic_v6-v1/PREMIX
Example of cmsDriver
Quick MC without MC trigger information
- From GEN to RAW: CMSSW_10_6_20
- Please consider to use the last version of CMSSW_10_6 for this step if you need to use the latest generator setting
- Grid environment is needed to pick up list of file. It will take 10-15 min to pick up the list of PU
cmsDriver.py SingleNuE10_cfi.py --fileout file:RAW.root --mc --eventcontent PREMIXRAW --datatier GEN-SIM-RAW --conditions 106X_mc2017_realistic_v6 --step GEN,SIM,DIGI,DATAMIX,L1,DIGI2RAW,HLT:@fake2 --beamspot Realistic25ns13TeVEarly2017Collision --procModifiers premix_stage2 --datamix PreMix --era Run2_2017 --nThreads 8 --geometry DB:Extended --pileup_input "dbs:/Neutrino_E-10_gun/RunIISummer19ULPrePremix-UL17_106X_mc2017_realistic_v6-v1/PREMIX" --python_filename GENToHLT_2017_cfg.py -n 10 --no_exec
- From RAW to MiniAOD: CMSSW_10_6_20
cmsDriver.py step2 --filein file:RAW.root --fileout file:MiniAODSIM.root --mc --eventcontent MINIAODSIM --datatier MINIAODSIM --runUnscheduled --conditions 106X_mc2017_realistic_v6 --step RAW2DIGI,L1Reco,RECO,RECOSIM,PAT --nThreads 8 --geometry DB:Extended --era Run2_2017 --python_filename RECOToPAT_2017_cfg.py -n 10 --no_exec
- To produce NanoAOD: CMSSW_10_6_20 (NanoAODv6
)
- To create private flat ntuple, please use
--eventcontent NANOAODSIM --datatier NANOAODSIM --customise_commands="process.add_(cms.Service('InitRootHandlers', EnableIMT = cms.untracked.bool(False)))"
to create flat ntuple. See instruction here
.
cmsDriver.py step3 --filein file:MiniAODSIM.root --fileout file:NanoAODSIM.root --mc --eventcontent NANOEDMAODSIM --datatier NANOAODSIM --conditions 106X_mc2017_realistic_v6 --step NANO --nThreads 8 --era Run2_2017 --python_filename NanoAOD_2017_cfg.py -n 10 --no_exec
Using production recipe (with MC HLT information)
Example:
McM - TTJets_TuneCP5_13TeV-amcatnloFXFX-pythia8
One can consider to merge (i) GEN, SIM, DIGI and/or (ii) RECO, MiniAOD as above recipe.
- GEN: CMSSW_10_6_20
- Please consider to use the last version of CMSSW_10_6 for generator
cmsDriver.py SingleNuE10_cfi.py --fileout file:GEN.root --mc --eventcontent RAWSIM --datatier GEN --conditions 106X_mc2017_realistic_v6 --beamspot Realistic25ns13TeVEarly2017Collision --step GEN --geometry DB:Extended --era Run2_2017 --python_filename GEN_2017_cfg.py -n 10 --no_exec
cmsDriver.py step2 --filein file:GEN.root --fileout file:SIM.root --mc --eventcontent RAWSIM --runUnscheduled --datatier GEN-SIM --conditions 106X_mc2017_realistic_v6 --beamspot Realistic25ns13TeVEarly2017Collision --step SIM --nThreads 8 --geometry DB:Extended --era Run2_2017 --python_filename SIM_2017_cfg.py -n 10 --no_exec
- DIGI (premix): CMSSW_10_6_20
- Grid environment is needed to pick up list of file. It will take 10-15 min to pick up the list of PU
- For standard premixing setting, you can get the cfg file from
/afs/cern.ch/user/s/srimanob/public/ForRun2LegacyProduction/DIGIPremix_2017_cfg.py
to save time.
cmsDriver.py step3 --filein file:SIM.root --fileout file:DIGIPremix.root --pileup_input "dbs:/Neutrino_E-10_gun/RunIISummer19ULPrePremix-UL17_106X_mc2017_realistic_v6-v1/PREMIX" --mc --eventcontent PREMIXRAW --runUnscheduled --datatier GEN-SIM-DIGI --conditions 106X_mc2017_realistic_v6 --step DIGI,DATAMIX,L1,DIGI2RAW --procModifiers premix_stage2 --nThreads 8 --geometry DB:Extended --datamix PreMix --era Run2_2017 --python_filename DIGIPremix_2017_cfg.py -n 10 --no_exec
- HLT: CMSSW_9_4_14_UL_patch1
- runUnscheduled is not supported in the HLT step
cmsDriver.py step4 --filein file:DIGIPremix.root --fileout file:HLT.root --mc --eventcontent RAWSIM --datatier GEN-SIM-RAW --conditions 94X_mc2017_realistic_v15 --customise_commands 'process.source.bypassVersionCheck = cms.untracked.bool(True)' --step HLT:2e34v40 --nThreads 8 --geometry DB:Extended --era Run2_2017 --python_filename HLT_2017_cfg.py -n 10 --no_exec
cmsDriver.py step5 --filein file:HLT.root --fileout file:RECO.root --mc --eventcontent AODSIM --runUnscheduled --datatier AODSIM --conditions 106X_mc2017_realistic_v6 --step RAW2DIGI,L1Reco,RECO,RECOSIM --nThreads 8 --geometry DB:Extended --era Run2_2017 --python_filename RECO_2017_cfg.py -n 10 --no_exec
cmsDriver.py step6 --filein file:RECO.root --fileout file:MiniAOD.root --mc --eventcontent MINIAODSIM --runUnscheduled --datatier MINIAODSIM --conditions 106X_mc2017_realistic_v6 --step PAT --nThreads 8 --geometry DB:Extended --era Run2_2017 --python_filename MINIAOD_2017_cfg.py -n 10 --no_exec
- NanoAOD: CMSSW_10_6_20 (NanoAODv6
)
- To create private flat ntuple, please use
--eventcontent NANOAODSIM --datatier NANOAODSIM --customise_commands="process.add_(cms.Service('InitRootHandlers', EnableIMT = cms.untracked.bool(False)))"
to create flat ntuple. See instruction here
.
cmsDriver.py step7 --filein file:MiniAOD.root --fileout file:NanoAOD.root --mc --eventcontent NANOEDMAODSIM --datatier NANOAODSIM --conditions 106X_mc2017_realistic_v6 --step NANO --nThreads 8 --era Run2_2017 --python_filename NANOAOD_2017_cfg.py -n 10 --no_exec
--
PhatSrimanobhas - 2020-12-24