Eventcontent SIML1RAW and Re-emulating L1

Complete: 4

Motivation

In MC production one starts from GEN-SIM eventcontent and runs in one step DIGI + L1T (simulation) + HLT + RAW , etc. One might want to separate this in 2 steps: Step1: run DIGI + L1, saving a "minimal eventcontent" needed; Step2: re-run L1T (improved) + HLT + RAW A reason for this could be an improved L1T simulation code, and/or new L1T menu, and/or new HLT menu available. The "minimal eventcontent" needs to be small enough so not to use otherwise huge resources, and it needs to be sufficient for re-run L1T either completely re-emulating it or only re-emulating parts of it. SIML1RAW eventcontent satisfies these requirements.

SIML1RAW eventcontent

  • Obtained from GEN-SIM by running DIGI + L1T + DIGI2RAW.
  • Saving RAW plus FEVTDEBUG of SimMuon, SimCalo, and L1Trigger.

SIML1RAW event content with L1T Stage2

L1T Re-Emulation MC Production Workflow (CMSSW_8_0_X)

The two step procedure consists of (step1) and (step2).


(step1) emulate entire L1T, pack products and save eventcontent SIML1RAW.
(step2) re-emulate L1T (whole or parts of it), re-pack products of newly re-emulated parts and save them to eventconent SIML1RAW.
In step2 one can run HLT after L1, making sure that correct (L1REPACK) collections are used as inputs for HLT. The examples provided below do not run HLT in step2, but this can be easily extended.

Use your favourite CMSSW_8_0_X release prior to CMSSW_8_0_3_patch1 and merge code from cms-l1t-offline/mcprod-l1t-reemul-80x branch.

cmsrel CMSSW_8_0_3_patch1
cd CMSSW_8_0_3_patch1/src
cmsenv
git cms-init

## Add new eventcontent SIML1RAW and a workflow of configurable re-emulation of L1T
## ######################################################################
git remote add cms-l1t-offline git@github.com:cms-l1t-offline/cmssw.git
git fetch cms-l1t-offline
git cms-merge-topic -u  cms-l1t-offline:mcprod-l1t-reemul-80x

scram build

Example1 recipe for MC production: re-emulate L1T Calo + uGT

Re-emulate Calo Layer-2 and uGT

Run the job on 10 events in two parts: (step1) emulate entire L1T, pack products and save eventcontent SIML1RAW (step2) re-emulate Calo Layer-1 and Layer-2 and uGT while using HCAL TPs, ECAL TPs and uGMT emulated in step1, re-pack products of Calo Layer-2 and uGT and save to eventconent SIML1RAW

  • Step1: from GEN-SIM run DIGI, L1, DIGI2RAW and save SIML1RAW eventcontent in output
cmsDriver.py L1TEST -s DIGI,L1,DIGI2RAW --era Run2_2016 --eventcontent=SIML1RAW --conditions=auto:run2_mc  --datatier GEN-SIM-RAW -n 10  --mc  --filein=/store/relval/CMSSW_7_6_0_pre7/RelValTTbar_13/GEN-SIM/76X_mcRun2_asymptotic_v9_realBS-v1/00000/0A812333-427C-E511-A80A-0025905964A2.root 

  • Step2: from SIML1RAW run L1REPACK:CALOuGT
cmsDriver.py L1TEST -s L1REPACK:CALOuGT --era=Run2_2016 --eventcontent=SIML1RAW  --conditions=auto:run2_mc -n -1 --mc --filein=file:L1TEST_DIGI_L1_DIGI2RAW.root

To see the products in the output file of the (step2) here, do

edmDumpEventContent L1TEST_L1REPACK.root
Note that only the products of uGT and of Calo (Layer-1 and Layer-2) are re-packed (L1REPACK)

How good is our re-emulation in Example1

It is interesting to compare the trigger results of L1T re-emulation and compare them to the results of the originally emulated L1T. A comparison of Example1 step1 and step2 results is made after running on 500 events of TTbar MC shows absolute agreement between emulated and re-emulated trigger decisions.

Example2 recipe for MC production: re-emulate entire L1T

If one wants to re-emulate the full L1T one only has to run (step2) above with "-s L1REPACK:Full". In this case the all L1-input data objects are unpacked from RAW format, and L1 is re-emulated from scratch.

  • Step2: from SIML1RAW run L1REPACK:Full
       cmsDriver.py L1TEST -s L1REPACK:Full --era=Run2_2016 --eventcontent=SIML1RAW  --conditions=auto:run2_mc -n -1 --mc --filein=file:L1TEST_DIGI_L1_DIGI2RAW.root

Data products in the output file of the (step2) are available here. Note that now all the products of uGT, uGMT, and Calo (Layer-1 and Layer-2) are re-packed (L1REPACK)

Tables of Event Size of SIML1RAW Eventcontent in TTbar

Product Label Average Uncompressed Size(Bytes/Event) Average Compressed Size (Bytes/Event)
rawDataCollector (FEDRawDataCollection) 576829 170378
simHcalUnsuppressedDigis (HBHEDataFramesSorted) 591049 47669.6
simEcalDigis ebDigis(EBDigiCollection) 55320.6 17203.9
simHcalUnsuppressedDigis (HODataFramesSorted) 246312 16375.4
simHcalTriggerPrimitiveDigis (HcalTriggerPrimitiveDigisSorted) 516750 14865.5
simEcalTriggerPrimitiveDigis (EcalTriggerPrimitiveDigisSorted) 258134 10930.4
simHcalUnsuppressedDigis (HFDataFramesSorted) 197064 10750.1
simHcalDigis (HFDataFramesSorted) 197060 10746.1
simGtStage2Digis (L1GlobalTriggerObjectMapRecord) 354692 8201.02
simEcalDigis ebSrFlags(EBSrFlagsSorted) 41686 5776.06
simHcalDigis (HBHEDataFramesSorted) 64016.2 5583.64
simEcalPreshowerDigis (ESDigiCollection) 8765.57 5069.81
simEcalDigis eeDigis(EEDigiCollection) 11512.5 3999.42
simCaloStage2Layer1Digis (l1tCaloTowerBXVector) 791383 3553.47
simCaloStage2Digis MP(l1tCaloTowerBXVector) 791381 3550.8
simMuonCSCDigis MuonCSCStripDigi(CSCDetIdCSCStripDigiMuonDigiCollection) 31090.8 3309.49
simMuonRPCDigis RPCDigiSimLink(RPCDigiSimLinkedmDetSetVector) 22664.7 1389.28
simHcalDigis (HODataFramesSorted) 15449.9 1242.62
simEcalDigis eeSrFlags(EESrFlagsSorted) 10678 512.692
simCaloStage2Digis MP(l1tCaloClusterBXVector) 3919.55 387.048
simMuonCSCDigis MuonCSCStripDigiSimLinks(StripDigiSimLinkedmDetSetVector) 2002.46 288.252
simCaloStage2Digis MP(l1tJetBXVector) 1038.78 209.67
simCaloStage2Digis (l1tJetBXVector) 1038.25 207.158
simMuonDTDigis (DTLayerIdDTDigiSimLinkMuonDigiCollection) 1011.73 195.098
simCaloStage2Digis (l1tTauBXVector) 933.762 193.294
simCaloStage2Digis MP(l1tTauBXVector) 934.226 191.44
simMuonDTDigis (DTLayerIdDTDigiMuonDigiCollection) 747.018 167.684
simMuonCSCDigis MuonCSCWireDigiSimLinks(StripDigiSimLinkedmDetSetVector) 542.532 142.892
simCaloStage2Digis MP(l1tEtSumBXVector) 1411.8 140.882
simMuonCSCDigis MuonCSCWireDigi(CSCDetIdCSCWireDigiMuonDigiCollection) 522.606 118.08
EventProductProvenance   801.424 103.798
simHcalUnsuppressedDigis (ZDCDataFramesSorted) 2576.57 97.93
simGtStage2Digis (GlobalAlgBlkBXVector) 1676.82 96.938
simMuonCSCDigis MuonCSCComparatorDigi(CSCDetIdCSCComparatorDigiMuonDigiCollection) 355.112 96.344
simMuonRPCDigis (RPCDetIdRPCDigiMuonDigiCollection) 310.29 91.892
simCaloStage2Digis (l1tEGammaBXVector) 378.41 91.068
simCaloStage2Digis MP(l1tEGammaBXVector) 378.73 90.61
simCaloStage2Digis (l1tEtSumBXVector) 512.242 81.886
simGmtStage2Digis (l1tMuonBXVector) 184.38 62.03
simCscTriggerPrimitiveDigis MPCSORTED(CSCDetIdCSCCorrelatedLCTDigiMuonDigiCollection) 126.834 58.214
simCscTriggerPrimitiveDigis (CSCDetIdCSCCorrelatedLCTDigiMuonDigiCollection) 125.674 56.37
simCscTriggerPrimitiveDigis (CSCDetIdCSCCLCTDigiMuonDigiCollection) 118.57 53.04
simCscTriggerPrimitiveDigis (CSCDetIdCSCALCTDigiMuonDigiCollection) 123.818 51.392
simGmtStage2Digis imdMuonsBMTF(l1tMuonBXVector) 134.87 49.258
simDtTriggerPrimitiveDigis (L1MuDTChambPhContainer) 106.25 49.178
simCscTriggerPrimitiveDigis (CSCDetIdintMuonDigiCollection) 80.538 42.564
simGmtStage2Digis imdMuonsEMTFPos(l1tMuonBXVector) 110.608 41.844
simGmtStage2Digis imdMuonsEMTFNeg(l1tMuonBXVector) 107.828 41.462
simDtTriggerPrimitiveDigis (L1MuDTChambThContainer) 88.99 41.456
simHcalUnsuppressedDigis HFQIE10DigiCollection(QIE10DataFrameHcalDataFrameContainer) 79.906 38.03
simGmtStage2Digis imdMuonsOMTFPos(l1tMuonBXVector) 97.82 37.44
simGmtStage2Digis imdMuonsOMTFNeg(l1tMuonBXVector) 96.43 37.168
simHcalUnsuppressedDigis HBHEUpgradeDigiCollection(HcalUpgradeDataFramesSorted) 53.522 36.498
simHcalUnsuppressedDigis HFUpgradeDigiCollection(HcalUpgradeDataFramesSorted) 53.202 36.178
simHcalDigis HFQIE10DigiCollection(QIE10DataFrameHcalDataFrameContainer) 77.986 36.11
simGtStage2Digis (GlobalExtBlkBXVector) 338.578 35.662
simCscTriggerPrimitiveDigis (CSCDetIdGEMCSCLCTDigiMuonDigiCollection) 53.538 34.718
simCscTriggerPrimitiveDigis (GEMDetIdGEMCoPadDigiMuonDigiCollection) 53.37 34.55
simHcalDigis HBHEUpgradeDigiCollection(HcalUpgradeDataFramesSorted) 51.602 34.512
simHcalDigis HFUpgradeDigiCollection(HcalUpgradeDataFramesSorted) 51.282 34.258
TriggerResults (edmTriggerResults) 106.746 33.06
TriggerResults (edmTriggerResults) 99.946 31.72

Branch Name Average Uncompressed Size (Bytes/Event) Average Compressed Size (Bytes/Event)
FEDRawDataCollection_rawDataCollector__DIGI2RAW. 576829 170378
HBHEDataFramesSorted_simHcalUnsuppressedDigis__DIGI2RAW. 591049 47669.6
EBDigiCollection_simEcalDigis_ebDigis_DIGI2RAW. 55320.6 17203.9
HODataFramesSorted_simHcalUnsuppressedDigis__DIGI2RAW. 246312 16375.4
HcalTriggerPrimitiveDigisSorted_simHcalTriggerPrimitiveDigis__DIGI2RAW. 516750 14865.5
EcalTriggerPrimitiveDigisSorted_simEcalTriggerPrimitiveDigis__DIGI2RAW. 258134 10930.4
HFDataFramesSorted_simHcalUnsuppressedDigis__DIGI2RAW. 197064 10750.1
HFDataFramesSorted_simHcalDigis__DIGI2RAW. 197060 10746.1
L1GlobalTriggerObjectMapRecord_simGtStage2Digis__DIGI2RAW. 354692 8201.02
EBSrFlagsSorted_simEcalDigis_ebSrFlags_DIGI2RAW. 41686 5776.06
HBHEDataFramesSorted_simHcalDigis__DIGI2RAW. 64016.2 5583.64
ESDigiCollection_simEcalPreshowerDigis__DIGI2RAW. 8765.57 5069.81
EEDigiCollection_simEcalDigis_eeDigis_DIGI2RAW. 11512.5 3999.42
l1tCaloTowerBXVector_simCaloStage2Layer1Digis__DIGI2RAW. 791383 3553.47
l1tCaloTowerBXVector_simCaloStage2Digis_MP_DIGI2RAW. 791381 3550.8
CSCDetIdCSCStripDigiMuonDigiCollection_simMuonCSCDigis_MuonCSCStripDigi_DIGI2RAW. 31090.8 3309.49
RPCDigiSimLinkedmDetSetVector_simMuonRPCDigis_RPCDigiSimLink_DIGI2RAW. 22664.7 1389.28
HODataFramesSorted_simHcalDigis__DIGI2RAW. 15449.9 1242.62
EESrFlagsSorted_simEcalDigis_eeSrFlags_DIGI2RAW. 10678 512.692
l1tCaloClusterBXVector_simCaloStage2Digis_MP_DIGI2RAW. 3919.55 387.048
StripDigiSimLinkedmDetSetVector_simMuonCSCDigis_MuonCSCStripDigiSimLinks_DIGI2RAW. 2002.46 288.252
l1tJetBXVector_simCaloStage2Digis_MP_DIGI2RAW. 1038.78 209.67
l1tJetBXVector_simCaloStage2Digis__DIGI2RAW. 1038.25 207.158
DTLayerIdDTDigiSimLinkMuonDigiCollection_simMuonDTDigis__DIGI2RAW. 1011.73 195.098
l1tTauBXVector_simCaloStage2Digis__DIGI2RAW. 933.762 193.294
l1tTauBXVector_simCaloStage2Digis_MP_DIGI2RAW. 934.226 191.44
DTLayerIdDTDigiMuonDigiCollection_simMuonDTDigis__DIGI2RAW. 747.018 167.684
StripDigiSimLinkedmDetSetVector_simMuonCSCDigis_MuonCSCWireDigiSimLinks_DIGI2RAW. 542.532 142.892
l1tEtSumBXVector_simCaloStage2Digis_MP_DIGI2RAW. 1411.8 140.882
CSCDetIdCSCWireDigiMuonDigiCollection_simMuonCSCDigis_MuonCSCWireDigi_DIGI2RAW. 522.606 118.08
EventProductProvenance 801.424 103.798
ZDCDataFramesSorted_simHcalUnsuppressedDigis__DIGI2RAW. 2576.57 97.93
GlobalAlgBlkBXVector_simGtStage2Digis__DIGI2RAW. 1676.82 96.938
CSCDetIdCSCComparatorDigiMuonDigiCollection_simMuonCSCDigis_MuonCSCComparatorDigi_DIGI2RAW. 355.112 96.344
RPCDetIdRPCDigiMuonDigiCollection_simMuonRPCDigis__DIGI2RAW. 310.29 91.892
l1tEGammaBXVector_simCaloStage2Digis__DIGI2RAW. 378.41 91.068
l1tEGammaBXVector_simCaloStage2Digis_MP_DIGI2RAW. 378.73 90.61
l1tEtSumBXVector_simCaloStage2Digis__DIGI2RAW. 512.242 81.886
l1tMuonBXVector_simGmtStage2Digis__DIGI2RAW. 184.38 62.03
CSCDetIdCSCCorrelatedLCTDigiMuonDigiCollection_simCscTriggerPrimitiveDigis_MPCSORTED_DIGI2RAW. 126.834 58.214
CSCDetIdCSCCorrelatedLCTDigiMuonDigiCollection_simCscTriggerPrimitiveDigis__DIGI2RAW. 125.674 56.37
CSCDetIdCSCCLCTDigiMuonDigiCollection_simCscTriggerPrimitiveDigis__DIGI2RAW. 118.57 53.04
CSCDetIdCSCALCTDigiMuonDigiCollection_simCscTriggerPrimitiveDigis__DIGI2RAW. 123.818 51.392
l1tMuonBXVector_simGmtStage2Digis_imdMuonsBMTF_DIGI2RAW. 134.87 49.258
L1MuDTChambPhContainer_simDtTriggerPrimitiveDigis__DIGI2RAW. 106.25 49.178
CSCDetIdintMuonDigiCollection_simCscTriggerPrimitiveDigis__DIGI2RAW. 80.538 42.564
l1tMuonBXVector_simGmtStage2Digis_imdMuonsEMTFPos_DIGI2RAW. 110.608 41.844
l1tMuonBXVector_simGmtStage2Digis_imdMuonsEMTFNeg_DIGI2RAW. 107.828 41.462
L1MuDTChambThContainer_simDtTriggerPrimitiveDigis__DIGI2RAW. 88.99 41.456
QIE10DataFrameHcalDataFrameContainer_simHcalUnsuppressedDigis_HFQIE10DigiCollection_DIGI2RAW. 79.906 38.03
l1tMuonBXVector_simGmtStage2Digis_imdMuonsOMTFPos_DIGI2RAW. 97.82 37.44
l1tMuonBXVector_simGmtStage2Digis_imdMuonsOMTFNeg_DIGI2RAW. 96.43 37.168
HcalUpgradeDataFramesSorted_simHcalUnsuppressedDigis_HBHEUpgradeDigiCollection_DIGI2RAW. 53.522 36.498
HcalUpgradeDataFramesSorted_simHcalUnsuppressedDigis_HFUpgradeDigiCollection_DIGI2RAW. 53.202 36.178
QIE10DataFrameHcalDataFrameContainer_simHcalDigis_HFQIE10DigiCollection_DIGI2RAW. 77.986 36.11
GlobalExtBlkBXVector_simGtStage2Digis__DIGI2RAW. 338.578 35.662
CSCDetIdGEMCSCLCTDigiMuonDigiCollection_simCscTriggerPrimitiveDigis__DIGI2RAW. 53.538 34.718
GEMDetIdGEMCoPadDigiMuonDigiCollection_simCscTriggerPrimitiveDigis__DIGI2RAW. 53.37 34.55
HcalUpgradeDataFramesSorted_simHcalDigis_HBHEUpgradeDigiCollection_DIGI2RAW. 51.602 34.512
HcalUpgradeDataFramesSorted_simHcalDigis_HFUpgradeDigiCollection_DIGI2RAW. 51.282 34.258
edmTriggerResults_TriggerResults__DIGI2RAW. 106.746 33.06
edmTriggerResults_TriggerResults__SIM. 99.946 31.72
EventAuxiliary 141.216 26.512
EventSelections 64.292 14.216
BranchListIndexes 26.444 11.03

-- VladimirRekovic - 2016-03-26

Edit | Attach | Watch | Print version | History: r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r3 - 2016-03-30 - VladimirRekovic
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback