Legacy-2017 Analysis (Private)

Purpose of this page.

This page collects useful information to be aware of when performing analysis or producing ntuples for analysis. Guidelines are collected on which release, detector conditions, and datasets. We also keep track of special filters or tools useful to remove atypical and problematic events.

Last updated: 7 June 2020

Analysis Recipe

Release

Recommended release: CMSSW_10_6_20

• This release is good for analysis and also any private production for all Legacy-16/17/18.

*Important note

• With CMSSW_10_6_20, Run2-Legacy MiniAODv2
• With CMSSW_10_6_20, NanoAODv8
• Missing MuonReducedTrackExtra in data AOD, MiniAOD
  • Available in MC (Summer20 campaign)

Conditions

• Data
  • recommended GT for analysis: 106X_dataRun2_v33
    • As of 2020-04-29: JEC/JER, please use text and database files provided by JERC (see link to JetMET below)
    • v28 GT is good for all Legacy analysis, including special runs.
  • GT used in AOD production: 106X_dataRun2_v20
  • GT used in (Re) MiniAODv2 production: 106X_dataRun2_v33

• MC
  • recommended GT for analysis: 106X_mc2017_realistic_v9
    • include UL17 JEC (v8) and low-pT EGM tags (v9)
  • GT used in production: 106X_mc2017_realistic_v9
  • GT used in production ReNanoAOD (v9): To be updated

Trigger (MC)

• CMSSW_9_4_14_UL_patch1 with HLT:2e34v40 is used for trigger simulation.

Validation

Physics objects

• EGamma: CMS.EgammaUL2016To2018 (Presentation)
• Muon: CMS.MuonReferenceEffsRun2Legacy (Presentation) | Rochester Correction
• JetMET: Quick links to current recommendations
• Tau: SFs will be provided centrally based on the reMiniAOD campaign planned for Summer 2020. In urgent need of SFs please contact the Tau POG conveners and Tau ID sub-group conveners directly.
• BTag:
• Luminosity: CMS.TWikiLUM
• Tagged proton: CMS.TaggedProtonsGettingStarted

Datasets: Data

• Search for datasets using DAS (AOD, MiniAOD, NanoAOD): /*/Run2017*09Aug2019_UL2017*/*AOD
• Detail of reprocessing: CMS.PdmVDataReprocessingUL2017

Example of cmsDriver

• AOD, MiniAOD: CMSSW_10_6_20

cmsDriver.py RECO -s RAW2DIGI,L1Reco,RECO,SKIM:JetHTJetPlusHOFilter,ALCA:HcalCalIsoTrkFilter+HcalCalIsolatedBunchFilter+TkAlMinBias,EI,PAT,DQM:@rerecoCommon --runUnscheduled --nThreads 8 --data --era Run2_2017 --scenario pp --conditions 106X_dataRun2_v28 --eventcontent AOD,MINIAOD,DQM --datatier AOD,MINIAOD,DQMIO --customise Configuration/DataProcessing/RecoTLR.customisePostEra_Run2_2017 --filein file:pippo.root -n 100 --python_filename=recoskim_Run2017F_JetHT.py --no_exec

• NanoAOD: CMSSW_10_6_20 (NanoAODv6)

cmsDriver.py NANO -s NANO --nThreads 2 --data --era Run2_2017 --conditions 106X_dataRun2_v28 --eventcontent NANOEDMAOD --datatier NANOAOD --filein file:pippo.root -n 100 --python_filename=nano_Run2017.py --no_exec

Data Certification

Detail for Legacy-2017 DC can be found in CMS.DQMULReRecoCertificationRules2017; Presentation

• Golden JSON (41.48 /fb)

/afs/cern.ch/cms/CAF/CMSCOMM/COMM_DQM/certification/Collisions17/13TeV/Legacy_2017/Cert_294927-306462_13TeV_UL2017_Collisions17_GoldenJSON.txt 

• Muon JSON (42.02 /fb)

/afs/cern.ch/cms/CAF/CMSCOMM/COMM_DQM/certification/Collisions17/13TeV/Legacy_2017/Cert_294927-306462_13TeV_UL2017_Collisions17_MuonJSON.txt

Datasets: Monte Carlo

• Search for datasets using DAS
  • AOD: /*/RunIISummer19UL17RECO-*/*
  • MiniAOD: /*/RunIISummer19UL17MiniAOD-*/*
  • NanoAOD: /*/RunIISummer19UL17NanoAOD-*/*
• Premixing library: /Neutrino_E-10_gun/RunIISummer19ULPrePremix-UL17_106X_mc2017_realistic_v6-v1/PREMIX
  • Pileup profile: 2017_25ns_UltraLegacy_PoissonOOTPU

Example of cmsDriver

Quick MC without MC trigger information

• From GEN to RAW: CMSSW_10_6_20
  • Please consider to use the last version of CMSSW_10_6 for this step if you need to use the latest generator setting
  • Grid environment is needed to pick up list of file. It will take 10-15 min to pick up the list of PU

cmsDriver.py SingleNuE10_cfi.py --fileout file:RAW.root --mc --eventcontent PREMIXRAW --datatier GEN-SIM-RAW --conditions 106X_mc2017_realistic_v6 --step GEN,SIM,DIGI,DATAMIX,L1,DIGI2RAW,HLT:@fake2 --beamspot Realistic25ns13TeVEarly2017Collision --procModifiers premix_stage2 --datamix PreMix --era Run2_2017 --nThreads 8 --geometry DB:Extended --pileup_input "dbs:/Neutrino_E-10_gun/RunIISummer19ULPrePremix-UL17_106X_mc2017_realistic_v6-v1/PREMIX" --python_filename GENToHLT_2017_cfg.py -n 10 --no_exec

• From RAW to MiniAOD: CMSSW_10_6_20

cmsDriver.py step2 --filein file:RAW.root --fileout file:MiniAODSIM.root --mc --eventcontent MINIAODSIM --datatier MINIAODSIM --runUnscheduled --conditions 106X_mc2017_realistic_v6 --step RAW2DIGI,L1Reco,RECO,RECOSIM,PAT --nThreads 8 --geometry DB:Extended --era Run2_2017 --python_filename RECOToPAT_2017_cfg.py -n 10 --no_exec

• To produce NanoAOD: CMSSW_10_6_20 (NanoAODv6)
  • To create private flat ntuple, please use --eventcontent NANOAODSIM --datatier NANOAODSIM --customise_commands="process.add_(cms.Service('InitRootHandlers', EnableIMT = cms.untracked.bool(False)))" to create flat ntuple. See instruction here.

cmsDriver.py step3 --filein file:MiniAODSIM.root --fileout file:NanoAODSIM.root --mc --eventcontent NANOEDMAODSIM --datatier NANOAODSIM --conditions 106X_mc2017_realistic_v6 --step NANO --nThreads 8 --era Run2_2017 --python_filename NanoAOD_2017_cfg.py -n 10 --no_exec

Using production recipe (with MC HLT information)

Example: McM - TTJets_TuneCP5_13TeV-amcatnloFXFX-pythia8

One can consider to merge (i) GEN, SIM, DIGI and/or (ii) RECO, MiniAOD as above recipe.

• GEN: CMSSW_10_6_20
  • Please consider to use the last version of CMSSW_10_6 for generator

cmsDriver.py SingleNuE10_cfi.py --fileout file:GEN.root --mc --eventcontent RAWSIM --datatier GEN --conditions 106X_mc2017_realistic_v6 --beamspot Realistic25ns13TeVEarly2017Collision --step GEN --geometry DB:Extended --era Run2_2017 --python_filename GEN_2017_cfg.py -n 10 --no_exec

• SIM: CMSSW_10_6_20

cmsDriver.py step2 --filein file:GEN.root --fileout file:SIM.root --mc --eventcontent RAWSIM --runUnscheduled --datatier GEN-SIM --conditions 106X_mc2017_realistic_v6 --beamspot Realistic25ns13TeVEarly2017Collision --step SIM --nThreads 8 --geometry DB:Extended --era Run2_2017 --python_filename SIM_2017_cfg.py -n 10 --no_exec

• DIGI (premix): CMSSW_10_6_20
  • Grid environment is needed to pick up list of file. It will take 10-15 min to pick up the list of PU
  • For standard premixing setting, you can get the cfg file from /afs/cern.ch/user/s/srimanob/public/ForRun2LegacyProduction/DIGIPremix_2017_cfg.py to save time.

cmsDriver.py step3 --filein file:SIM.root --fileout file:DIGIPremix.root  --pileup_input "dbs:/Neutrino_E-10_gun/RunIISummer19ULPrePremix-UL17_106X_mc2017_realistic_v6-v1/PREMIX" --mc --eventcontent PREMIXRAW --runUnscheduled --datatier GEN-SIM-DIGI --conditions 106X_mc2017_realistic_v6 --step DIGI,DATAMIX,L1,DIGI2RAW --procModifiers premix_stage2 --nThreads 8 --geometry DB:Extended --datamix PreMix --era Run2_2017 --python_filename DIGIPremix_2017_cfg.py -n 10 --no_exec

• HLT: CMSSW_9_4_14_UL_patch1
  • runUnscheduled is not supported in the HLT step

cmsDriver.py step4 --filein file:DIGIPremix.root --fileout file:HLT.root --mc --eventcontent RAWSIM --datatier GEN-SIM-RAW --conditions 94X_mc2017_realistic_v15 --customise_commands 'process.source.bypassVersionCheck = cms.untracked.bool(True)' --step HLT:2e34v40 --nThreads 8 --geometry DB:Extended --era Run2_2017 --python_filename HLT_2017_cfg.py -n 10 --no_exec

• RECO: CMSSW_10_6_20

cmsDriver.py step5 --filein file:HLT.root --fileout file:RECO.root --mc --eventcontent AODSIM --runUnscheduled --datatier AODSIM --conditions 106X_mc2017_realistic_v6 --step RAW2DIGI,L1Reco,RECO,RECOSIM --nThreads 8 --geometry DB:Extended --era Run2_2017 --python_filename RECO_2017_cfg.py -n 10 --no_exec

• MiniAOD: CMSSW_10_6_20

cmsDriver.py step6 --filein file:RECO.root --fileout file:MiniAOD.root --mc --eventcontent MINIAODSIM --runUnscheduled --datatier MINIAODSIM --conditions 106X_mc2017_realistic_v6 --step PAT --nThreads 8 --geometry DB:Extended --era Run2_2017 --python_filename MINIAOD_2017_cfg.py -n 10 --no_exec

• NanoAOD: CMSSW_10_6_20 (NanoAODv6)
  • To create private flat ntuple, please use --eventcontent NANOAODSIM --datatier NANOAODSIM --customise_commands="process.add_(cms.Service('InitRootHandlers', EnableIMT = cms.untracked.bool(False)))" to create flat ntuple. See instruction here.

cmsDriver.py step7 --filein file:MiniAOD.root --fileout file:NanoAOD.root --mc --eventcontent NANOEDMAODSIM --datatier NANOAODSIM --conditions 106X_mc2017_realistic_v6 --step NANO --nThreads 8 --era Run2_2017 --python_filename NANOAOD_2017_cfg.py -n 10 --no_exec

-- PhatSrimanobhas - 2020-12-24