WORFLOW DQM FORMAT FIRST STEP SECOND STEP CORRECT? SUPPORTED? NOTES
Book@ Reset LS-histos@ MEtoEDM@ DQMStore ForceReset? EDMtoME@ Book@ Reset LS@ DQMStore Collate?
Test1:
1RUN 1FILE
EDM CTOR BLS E{L,R} No E{L,R} ER   No Yes / Done  
BJ BLS E{L,R} No E{L,R} ER   No Yes / Done  
BR BLS E{L,R} No E{L,R} ER   No Yes / Done  
DQMIO CTOR BLS -- No -- ER   No Yes / Done  
BJ BLS -- No -- ER   No Yes / Done  
BR BLS -- No -- ER   No Yes / Done  
Test2:
1RUN 2FILE
EDM CTOR BLS E{L,R} No E{L,R} ER   No Patch needed ~rovere/public/MEtoEDMConverter.cc.patch
BJ BLS E{L,R} No E{L,R} ER   No Patch needed
BR BLS E{L,R} No E{L,R} ER   No Patch needed
DQMIO CTOR BLS -- No -- ER   No Yes / Done  
BJ BLS -- No -- ER   No Yes / Done  
BR BLS -- No -- ER   No Yes / Done  
Test3:
1RUN 2FILE Merged
EDM CTOR BLS E{L,R} No E{L,R} ER   No Patch needed ~rovere/public/MEtoEDMConverter.cc.patch
BJ BLS E{L,R} No E{L,R} ER   No Patch needed
BR BLS E{L,R} No E{L,R} ER   No Patch needed
DQMIO CTOR BLS -- No -- ER   No Yes / Done  
BJ BLS -- No -- ER   No Yes / Done  
BR BLS -- No -- ER   No Yes / Done  
Test4:
2RUN 1FILE
[2 runs produced together in the emptysource --> 2 runs in input to the first step]
EDM CTOR BLS E{L,R} No E{L,R} ER   No No Crash expected.
BJ BLS E{L,R} No E{L,R} ER   No No
BR BLS E{L,R} No E{L,R} ER   No Yes / Done
DQMIO CTOR BLS -- No -- ER   No No  
BJ BLS -- No -- ER   No No  
BR BLS -- No -- ER   No Yes / Done  
Test5:
2RUN 1FILE FORCE RESET
[2 runs produced together in the emptysource --> 2 runs in input to the first step]
EDM CTOR BLS E{L,R} Yes / Done E{L,R} ER   No No Crash expected.
BJ BLS E{L,R} Yes / Done E{L,R} ER   No No
BR BLS E{L,R} Yes / Done E{L,R} ER   No Yes / Done
DQMIO CTOR BLS -- Yes / Done -- ER   No Yes / Done  
BJ BLS -- Yes / Done -- ER   No Yes / Done  
BR BLS -- Yes / Done -- ER   No Yes / Done  
Test6:
2RUN 2FILE
[2 runs produced separately in 2 different files --> 2 runs in input to the second step only step]
EDM CTOR BLS E{L,R} No E{L,R} ER   No Yes / Done Only 2 files as an input to the harvesting step --> not ordering dependent, but it is working by chance. See test8.
BJ BLS E{L,R} No E{L,R} ER   No Yes / Done
BR BLS E{L,R} No E{L,R} ER   No Yes / Done
DQMIO CTOR BLS -- No -- ER   No Yes / Done
BJ BLS -- No -- ER   No Yes / Done
BR BLS -- No -- ER   No Yes / Done
Test7:
2RUN 2FILE COLLATE (multirun harvesting)
[2 runs produced separately in 2 different files --> 2 runs in input to the second step only step]
EDM CTOR BLS E{L,R} No E{L,R} ER   Yes / Done No After the harvesting, the second run is the sum of the stat of runs 1+2. Not really optimal. Move the files saving from endrun to endjob.
BJ BLS E{L,R} No E{L,R} ER   Yes / Done No
BR BLS E{L,R} No E{L,R} ER   Yes / Done No
DQMIO CTOR BLS -- No -- ER   Yes / Done No Reset called automatically in FwkIO. Patch to make it working on top of 620_pre5: ~deguio/public/DQM/bookingPolicy/DQMServices.patch
BJ BLS -- No -- ER   Yes / Done No
BR BLS -- No -- ER   Yes / Done No
Test8:
2RUN 3FILE
EDM CTOR BLS E{L,R} No E{L,R} ER   No No It works only if a merging step is performed before the harvesting. Otherwise the result is ordering dependent and it works only if the runs are given in input to the harvesting step in ascending order.
BJ BLS E{L,R} No E{L,R} ER   No No
BR BLS E{L,R} No E{L,R} ER   No No
DQMIO CTOR BLS -- No -- ER   No No
BJ BLS -- No -- ER   No No
BR BLS -- No -- ER   No No
Test9:
2RUN 3FILE COLLATE (multirun harvesting)
EDM CTOR BLS E{L,R} No E{L,R} ER   Yes / Done No After the harvesting, the second run is the sum of the stat of runs 1+2. Not really optimal. Move the files saving from endrun to endjob.
BJ BLS E{L,R} No E{L,R} ER   Yes / Done No
BR BLS E{L,R} No E{L,R} ER   Yes / Done No
DQMIO CTOR BLS -- No -- ER   Yes / Done No Reset called automatically in FwkIO. EVEN WITH THE PATCH IS NOT OPTIMAL. Patch to make it working on top of 620_pre5: ~deguio/public/DQM/bookingPolicy/DQMServices.patch
BJ BLS -- No -- ER   Yes / Done No
BR BLS -- No -- ER   Yes / Done No
Test10:
2RUN 3FILE COLLATE (multirun harvesting) with DQMFileSaver options
EDM CTOR BLS E{L,R} No E{L,R} ER   Yes / Done Yes / Done With options: process.dqmSaver.saveByRun = cms.untracked.int32(-1) process.dqmSaver.saveAtJobEnd = cms.untracked.bool(True) process.dqmSaver.forceRunNumber = cms.untracked.int32(999999)
BJ BLS E{L,R} No E{L,R} ER   Yes / Done Yes / Done
BR BLS E{L,R} No E{L,R} ER   Yes / Done Yes / Done
DQMIO CTOR BLS -- No -- ER   Yes / Done No Reset called automatically in FwkIO. SUPPORTED WITH PATCH. Patch to make it working on top of 620_pre5: ~deguio/public/DQM/bookingPolicy/DQMServices.patch
BJ BLS -- No -- ER   Yes / Done No
BR BLS -- No -- ER   Yes / Done No
Test11:
filterOnRunOption in DQMRootOutputModule and DQMRootSource
EDM CTOR BLS E{L,R} No E{L,R} ER   No No Option not available.
BJ BLS E{L,R} No E{L,R} ER   No No
BR BLS E{L,R} No E{L,R} ER   No No
DQMIO CTOR BLS -- No -- ER   No Yes / Done Allows to filter on the run passed via config: filterOnRun = cms.untracked.uint32(runNum) tested in the merging step. Not working if set in the DQMInputSource in the harvesting step because the endRun of the harvester is called for all the runs anyway.
BJ BLS -- No -- ER   No Yes / Done
BR BLS -- No -- ER   No Yes / Done
Edit | Attach | Watch | Print version | History: r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r2 - 2013-05-17 - EdgarEduardoRosalesRosero
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Sandbox All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback