Tracking Studies with DataMixer
Setup
Currently working on 4_4_0.
cvs co -d edwenger/HiVertexAnalyzer UserCode/edwenger/HiVertexAnalyzer
cvs co -d edwenger/HiTrkEffAnalyzer UserCode/edwenger/HiTrkEffAnalyzer
cvs co -d MitHig/PixelTrackletAnalyzer UserCode/MitHig/PixelTrackletAnalyzer/
cvs co -r hi44X_04 -d SimGeneral/DataMixingModule UserCode/yetkin/SimGeneral/DataMixingModule
cvs co HeavyIonsAnalysis/Configuration
cvs co -d CmsHi/Analysis2010 UserCode/CmsHi/Analysis2010
cvs co -d PbPbTrackingTools/HiTrackValidator UserCode/ASYoon/PbPbTrackingTools/HiTrackValidator
cvs co -d PbPbTrackingTools/VertexConstraintProducer UserCode/ASYoon/PbPbTrackingTools/VertexConstraintProducer
Problematic python configuration: /net/hisrv0001/home/yetkin/hidsk0001/mix/calo01_d1123/notWorkingCfg_withHcal.py
Samples (with parentage)
Mother of All : RAW (MIT, Global)
- /HICorePhysics/StoreResults-HICorePhysics_Skim_MinimumBias_RAW-a606dc809a29a92e17749e5652319ad0-SD_MBHI/USER
- /pnfs/cmsaf.mit.edu/t2bat/cms/store/results/heavy-ions/HICorePhysics/StoreResults-HICorePhysics_Skim_MinimumBias_RAW-a606dc809a29a92e17749e5652319ad0-SD_MBHI/HICorePhysics/USER/StoreResults-HICorePhysics_Skim_MinimumBias_RAW-a606dc809a29a92e17749e5652319ad0-SD_MBHI
PreMix Min Bias (MIT, ph_analysis_01)
- /HICorePhysics/yilmaz-MinBias_PreMix_440_test26-2a3fd0a01656fd762e353d50bd946d2c/USER
- /pnfs/cmsaf.mit.edu/t2bat/cms/store/user/yilmaz/HICorePhysics/MinBias_PreMix_440_test28/2a3fd0a01656fd762e353d50bd946d2c
- Scripts: svmithi01:/d101/yetkin/prod/test29_mbPreMix
Pion Flat pt = 0 - 200 GeV (MIT, Private)
- /pnfs/cmsaf.mit.edu/t2bat/cms/store/user/yetkin/mix/pions1_HICorePhysics_MinBiasSkim_440_test26_DBS_evt20_test02
- Scripts: /net/hisrv0001/home/yetkin/hidsk0001/mix/pion1_DBS_d0931
Ntuples & Histograms
- /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks1_DBS_d0931/test.root
- Scripts : /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks1_DBS_d0931
- /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks1_DBS_d0931/signal01/signal.root
- Scripts : /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks1_DBS_d0931/signal01
Pythia pthat > 170 GeV (MIT, Private) : Submitted
- /pnfs/cmsaf.mit.edu/t2bat/cms/store/user/yetkin/mix/pythia170_HICorePhysics_MinBiasSkim_440_test28_DBS_evt20_test01
- Scripts : /net/hisrv0001/home/yetkin/hidsk0001/mix/pythia170_d0931
Ntuples & Histograms
- /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks_pythia170_d1009/test.root
- Scripts : /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks_pythia170_d1009
- /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks_pythia170_d1009/signal01/signal.root
- Scripts : /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks_pythia170_d1009/signal01
PreMix HLT_HIJet50U, 0 - 10%
- /HICorePhysics/yilmaz-Jet50U_0to10_PreMix_440_test32-f17fd2ed8b87d0940b5b303282977643/USER
- Scripts: /d101/yetkin/prod/test32_Jet50U_0to10_preMix
Pion Flat pt = 0 - 200 GeV (MIT, Private), pion pt < jet pt, for jets in all acceptance and all pt.
- /pnfs/cmsaf.mit.edu/t2bat/cms/store/user/yetkin/mix/probeJet50U_0to10_PreMix_440_test32v01
- Scripts: /net/hisrv0001/home/yetkin/hidsk0001/mix/probeJet_d1008
Ntuples & Histograms
- /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks_probeJet_d1009/trees_*.root
- Scripts : /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks_probeJet_d1009
- /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks_probeJet_d1009/signal01/signal_*.root
- Scripts : /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks_probeJet_d1009/signal01
Pion Flat pt = 0 - 200 GeV (MIT, Private), pion pt not limited by jet pt, jets |eta| < 2.8 , pt > 30 GeV
- /pnfs/cmsaf.mit.edu/t2bat/cms/store/user/yetkin/mix/probeJet50U_0to10_PreMix_440_test32v02
- Scripts: /net/hisrv0001/home/yetkin/hidsk0001/mix/probeJet_d1010
Ntuples & Histograms
- /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks_probeJet_d1010/trees_*.root
- Scripts : /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks_probeJet_d1010
- /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks_probeJet_d1010/signal01/signal_*.root
- Scripts : /net/hisrv0001/home/yetkin/hidsk0001/mix/tracks_probeJet_d1010/signal01
PreMix HLT_HIJet50U
Not ready
Not ready
Progress Log
pt distribution of MC input : Unresolved
Currently we embed pions with flat pt. How good is this, when we want to make comparisons with data?
We can start embedding pythia events, however, if the embedding is done in the direction of the jet, embedding another full jet into it may not be good.
If we want a realistic pt distribution in particle gun events, should we use the
PtYDistributorGun, or should we keep producing flat and reweight in analysis?
If we will use the
PtYDistributorGun, Andre has to generate a text input file such as:
http://cmssw.cvs.cern.ch/cgi-bin/cmssw.cgi/CMSSW/GeneratorInterface/Pythia6Interface/data/jpsipbpb.txt?revision=1.1&view=markup
ProbeGenerator : Track into jet or bad APV mixing : Unresolved
Yetkin will implement a generator that creates the pion in the direction of the jet or an interesting APV.
Sanity of results : Unresolved
We need to compare the track parameter distributions (particularly those related to vertex compatibility) and check how realistic they are.
High pT efficiency : October 6, 2011 : Unresolved
The tracking efficiency (by rough pt spectrum comparison) drops very rapidly at highest pt in the flat pt pion sample. The pt resolution is not sufficient to explain the effect:
- Need to plot efficiency properly.
- Need to investigate issues with vertexing.
Memory Problem : October 6, 2011 : Unresolved
Currently running pion gun with more than 20 events per job causes a crash. Sometimes crash is explicitly reporting std::bad_alloc, sometimes not as clear.
The
VectorInputSource implementation in 440 was promising better performance. Is there a leak somewhere?
Note: It is crucial how many events per job are run, because one input file can be only consumed by single job.
Status : October 6, 2011
Slides
HBHE crash : September 2011 : Solved by removing the ZDC part and use digi mixing
- configuration : /net/hidsk0001/d00/scratch/jazzitup/eventMixing/CMSSW_4_4_2_patch5/test/test1/notWorkingCfg_withHcal.py
23-Nov-2011 10:40:01 EST Successfully opened file file:/mnt/hadoop/cms/store/user/yilmaz/HICorePhysics/MinBias_PreMix_440_test26/2a3fd0a01656fd762e353d50bd946d2c/MinBias_PreMix_185_1_sNh.root
shared pointer ok
pointer ok
done
isource 1
isource 2
isource 3
%MSG-e FatalSystemSignal: DataMixingModule:mixData 23-Nov-2011 10:40:02 EST Run: 152047 Event: 61104
A fatal system signal has occurred: segmentation violation
%MSG
A fatal system signal has occurred: segmentation violation
The following is the call s
#0 0x0000003f5289a115 in waitpid () from /lib64/libc.so.6
#1 0x0000003f5283c481 in do_system () from /lib64/libc.so.6
#2 0x00002b899b01a2a2 in TUnixSystem::StackTrace() ()
from /afs/cern.ch/cms/slc5_amd64_gcc434/cms/cmssw/CMSSW_4_4_0/external/slc5_amd64_gcc434/lib/libCore.so
#3 0x00002b899c594b33 in sig_dostack_then_abort ()
from /afs/cern.ch/cms/slc5_amd64_gcc434/cms/cmssw/CMSSW_4_4_0/lib/slc5_amd64_gcc434/libFWCoreServices.so
#4
#5 0x00002b89aecee2fe in CaloTDigitizer::run(MixCollection&, edm::SortedCollection >&) ()
from /afs/cern.ch/cms/slc5_amd64_gcc434/cms/cmssw/CMSSW_4_4_0/lib/slc5_amd64_gcc434/libSimCalorimetryHcalSimProducers.so
#6 0x00002b89aece460b in HcalDigitizer::produce(edm::Event&, edm::EventSetup const&) ()
from /afs/cern.ch/cms/slc5_amd64_gcc434/cms/cmssw/CMSSW_4_4_0/lib/slc5_amd64_gcc434/libSimCalorimetryHcalSimProducers.so
#7 0x00002b89af0dc202 in edm::DataMixingModule::put(edm::Event&, edm::EventSetup const&) ()
from /home/yilmaz/CMSSW_4_4_0_B/lib/slc5_amd64_gcc434/pluginSimGeneralDataMixingModulePlugins.so
#8 0x00002b899955d55b in edm::EDProducer::doEvent(edm::EventPrincipal&, edm::EventSetup const&, edm::CurrentProcessingContext const*) ()
ESDigiCollection_ecalPreShowerDigis : September 2011 : Unresolved
The standard event content of datamixing (
DATAMIXEREventContent) has:
'keep ESDataFramesSorted_ecalPreshowerDigis_*_*',
but datamixer asks for:
ESDigiCollection_ecalPreShowerDigis
I added keep of the
DigiCollection as well to my cfg.
The parameter passed into the bind should be the number of events, not the bunch crossing:
boost::bind(&DataMixingModule::pileWorker, boost::ref(*this),
_1, bunchCrossing, _2, boost::cref(ES)),
Temporarily this works:
boost::bind(&DataMixingModule::pileWorker, boost::ref(*this),
_1, 1, _2, boost::cref(ES)),
Changing the main loop that produces the output rawDigis
At the moment the code is generating as output the collection of the data and on top of that is simply added the signal of MC. This creates inconsistency in the reco using the MC GT. The code should be able to do the opposite and add on top of the MC modules, the data modules adcs.
|
Looping over |
adding |
to produce |
Previously the code was |
Data rawDigis |
MC Digis |
MC rawDigis |
Now we want |
MC Digis |
Data rawDigis |
MC rawDigis |
Memory optimization of temporary vectors and maps : Resolved
The changes that were made to provide the above introduced big memory problem. It produces huge vectors and maps. We have to optimize the code.
The problem was due to forgetting to increment the iterator and filling up infinitely!
In any case, we made the code more efficient by using
DetSetVector properly instead of homemade map.
ZDC change : Resolved
Head of
DataMixingModule can only be used with 4_4_X due to
ZDCRecHit dataformat change.
Production
Input RAW sample : September 2011 : Resolved
We use minimum bias skim of
HICorePhysics. The reason I couldn't find the RAW before is I only looked for
AllPhysics out of habit.
Preparing crab jobs : September 2011 : Testing
In interactive jobs, we guarantee the equality of the primary and secondary source by adding the line:
process.mixData.input.fileNames = process.source.fileNames
into the cfg file.
However, crab executes the input cfg file only in the job preparation, and the input file name actually changes later for the job in the working node. One has to add this line back again to the final cfg that crab creates.
Solution: When preparing crab jobs execute:
http://cmssw.cvs.cern.ch/cgi-bin/cmssw.cgi/UserCode/yetkin/HIProdAlgos/scripts/setMix.sh?view=markup
Debugging with all sub-detectors included
- Working directory : /d101/kimy/cmssw/photonStudy/CMSSW_5_0_0_pre6/src
- Configuration is divided into two step ( as last year)
- GEN-SIM-Digi : /d101/kimy/cmssw/photonStudy/CMSSW_4_4_2_patch5/test/mix/cfg.py <= working fine
- MIX-DIGI-RECO : /d101/kimy/cmssw/photonStudy/CMSSW_4_4_2_patch5/test/reco/cfg.py <<= not working * Problem not resolved in running MIX level.
ecmsRun: /build/zafar/442/slc5_amd64_gcc434/cms/cmssw/CMSSW_4_4_2/src/SimCalorimetry/HcalTrigPrimAlgos/src/HcalTriggerPrimitiveAlgo.cc:255: void HcalTriggerPrimitiveAlgo::analyzeHF(IntegerCaloSamples&, HcalTrigg\
erPrimitiveDigi&, float): Assertion `shift >= 0' failed.
detector condition coustomization
- New detector condition cutomization file
http://cmssw.cvs.cern.ch/cgi-bin/cmssw.cgi/UserCode/EYKim/DataMixer/DataMixer_DataConditions_4_4_X_data2011.py?view=log