Status of VECBOS production 2011

Which json file to use

Data are processed with DCS only json file. The luminosity quoted in the table refers to this json file. The actual luminosity is smaller, due to the fraction of files rejected by DQM validation. The luminosity for analysis is obtained from the OR of the json file returned by CRAB and the validation json file. This value is indicated in a separate column in the tables. Due to the fact that good/bad flags can change with time, these values are subject to change. The json files currently used are
         Cert_160404-163869_7TeV_May10ReReco_Collisions11_JSON.txt
         Cert_160404-167151_7TeV_PromptReco_Collisions11_JSON.txt
         
The files are committed in VecbosApp under
         VecBosApp/config/vecbos/json/42X/
         
IMPORTANT: when running VecbosApp you should use THESE FILES and not the DCS-only json files returned by CRAB (otherwise you will bypass the DQM validation)

"Lepton-Photon 2011" production

Production status

Dataset Responsible Good Lumi (/pb) Complete (%) list json comments
DoubleElectron Emanuele 1.55 fb-1 100% DoubleElectron.list certification json done
SingleElectron Emanuele 1.55 fb-1 100% SingleElectron.list certification json done
DoubleMu Emanuele 1.55 fb-1 100% DoubleMu.list certification json done
SingleMu Emanuele 1.55 fb-1 100% SingleMu.list certification json done
MuEG Emanuele 1.55 fb-1 100% MuEG.list certification json done
Photon Maurizio ? ? ? ?  
PhotonHad Maurizio ? ? ? ?  
MuHad Maurizio 1.55 fb-1 99% MuHadRun2011Av4_Aug05v1_Run2011AV6.list certification json done
Jet Maurizio ? ? ? ?  
HT Artur ? ? ? ?  
ElectronHad Maurizio 1.55 fb-1 99% ElectronHadRun2011Av4_Aug05v1_Run2011AV6.list certification json done

The datasets are always the same, for different run periods:

dataset start run end run certified lumi
dataset/Run2011A-May10ReReco-v1/AOD 160329 163869 215.3 pb-1
dataset/Run2011A-PromptReco-v4/AOD 165071 168437 927.9 pb-1
dataset/Run2011A-05Aug2011-v1/AOD 170053 172619 310.9 pb-1
dataset/Run2011A-PromptReco-v6/AOD 172620 173688 551.1 pb-1

prepared a new JSON from the official DQM certification of Aug. 26 which excludes the di-electron HLT problems and CSC problems, and includes the runs with preshower problems recovered in May10 re-reco:

Cert_160404-173664_7TeV_Golden_Collisions11_JSON.txt
for a luminosity: L = 1.99 fb-1.

CMSSW recipe

cvs co -r V22-4_2_X -d HiggsAnalysis/HiggsToWW2e UserCode/HiggsAnalysis/HiggsToWW2e
cvs co -r V00-4_1_X -d MyAnalysis/IsolationTools UserCode/emanuele/MyAnalysis/IsolationTools
cvs co -r V02-04-17 RecoJets/Configuration
cvs co -r V04-01-00 RecoJets/JetAlgorithms
cvs co -r V05-05-03 RecoJets/JetProducers
cvs co -r V00-03-30 RecoEgamma/ElectronIdentification
cvs co -r R42X_S1_V05_S2_V02_S3_V00 -d WWAnalysis/DataFormats UserCode/Mangano/WWAnalysis/DataFormats
cvs co -r R42X_S1_V05_S2_V02_S3_V00 -d WWAnalysis/Tools UserCode/Mangano/WWAnalysis/Tools
cvs co -r R42X_S1_V05_S2_V02_S3_V00 -d WWAnalysis/Filters UserCode/Mangano/WWAnalysis/Filters

Data Vecbos Production V4 [as V3, added CaloJetID, added L2L3 jet energy, fix Voronoi jet bug]

  • CMSSW release: CMSSW_4_2_4
  • plus extra tags:

cvs co -r V07-4_2_X -d HiggsAnalysis/HiggsToWW2e UserCode/HiggsAnalysis/HiggsToWW2e
cvs co -r V00-4_1_X -d MyAnalysis/IsolationTools UserCode/emanuele/MyAnalysis/IsolationTools
cvs co -r V02-04-17 RecoJets/Configuration
cvs co -r V04-01-00 RecoJets/JetAlgorithms
cvs co -r V05-05-03 RecoJets/JetProducers
cvs co -r V00-03-30 RecoEgamma/ElectronIdentification
cvs co -r R42X_S1_V02_S2_V00_S3_V00 -d WWAnalysis/DataFormats UserCode/Mangano/WWAnalysis/DataFormats
cvs co -r R42X_S1_V02_S2_V00_S3_V00 -d WWAnalysis/Tools UserCode/Mangano/WWAnalysis/Tools
cvs co -r R42X_S1_V02_S2_V00_S3_V00 -d WWAnalysis/Filters UserCode/Mangano/WWAnalysis/Filters

May10 re-reco

Dataset Responsible Lumi (/pb) Good Lumi (/pb) Complete (%) list json comments
/DoubleElectron/Run2011A-May10ReReco-v1/AOD Emanuele 215 pb-1 203 pb-1 93% DoubleElectronMay10ReRecov1.list DoubleElectronMay10ReRecov1.json resubmitting aborted
/SingleElectron/Run2011A-May10ReReco-v1/AOD Emanuele 226 pb-1 204 pb-1 95% SingleElectronMay10ReRecov1.list SingleElectronMay10ReRecov1.json done
/DoubleMu/Run2011A-May10ReReco-v1/AOD Emanuele 224 pb-1 203 pb-1 95% DoubleMuMay10ReRecov1.list DoubleMuMay10ReRecov1.json done
/SingleMu/Run2011A-May10ReReco-v1/AOD Emanuele 225 pb-1   95% SingleMuMay10ReRecov1.list SingleMuMay10ReRecov1.lumi done
/MuEG/Run2011A-May10ReReco-v1/AOD Emanuele 241 pb-1 203 pb-1 100% MuEGMay10ReRecov1.list MuEGMay10ReRecov1.lumi done
/Photon/Run2011A-May10ReReco-v1/AOD Maurizio 232 pb-1 201 pb-1 99% PhotonMay10ReRecov1.list PhotonMay10ReRecov1.lumi done
/PhotonHad/Run2011A-May10ReReco-v1/AOD Maurizio 231 pb-1 203 pb-1 99% PhotonHadMay10ReRecov1.list PhotonHadMay10ReRecov1.lumi done
/MuHad/Run2011A-May10ReReco-v1/AOD Maurizio 225 pb-1 196 pb-1 99% MuHadMay10ReRecov1.list MuHadMay10ReRecov1.json done
/Jet/Run2011A-May10ReReco-v1/AOD Maurizio 234 pb-1 204 pb-1 100% JetMay10ReRecov1.list JetMay10ReRecov1.json done
/HT/Run2011A-May10ReReco-v1/AOD Maurizio 231 pb-1 203 pb-1 99% HTMay10ReRecov1.list HTMay10ReRecov1.json done
/ElectronHad/Run2011A-May10ReReco-v1/AOD Maurizio 206 pb-1 180 pb-1 93% ElectronMay10ReRecov1.list ElectronMay10ReRecov1.json done

After tech stop Prompt Reco v4

Dataset Run range Responsible Lumi (/pb) Good Lumi (/pb) Complete (%) list json comments
/DoubleElectron/Run2011A-PromptReco-v4/AOD Emanuele 165071-166863   501 pb-1 97% DoubleElectronRun2011Av4.list DoubleElectronRun2011Av4.json done
/SingleElectron/Run2011A-PromptReco-v4/AOD Emanuele 165071-166863   465 pb-1 95% SingleElectronRun2011Av4.list SingleElectronRun2011Av4.json done
/DoubleMu/Run2011A-PromptReco-v4/AOD Emanuele 165071-166863 442 pb-1 395 pb-1 79% DoubleMuRun2011Av4.list DoubleMuRun2011Av4.json resubmitting aborted
/SingleMu/Run2011A-PromptReco-v4/AOD Emanuele 165071-166863 563 pb-1 504 pb-1 98% SingleMuRun2011Av4.list SingleMuRun2011Av4.json done
/MuEG/Run2011A-PromptReco-v4/AOD Emanuele 165071-166863 569 pb-1 510 pb-1 100% MuEGRun2011Av4.list MuEGRun2011Av4.json done
/Photon/Run2011A-PromptReco-v4/AOD Maurizio 165071-167746 683 pb-1 643 pb-1 99% PhotonRun2011Av4.list PhotonRun2011Av4.json done
/PhotonHad/Run2011A-PromptReco-v4/AOD Maurizio 165071-167746 681 pb-1 641 pb-1 99% PhotonHadRun2011Av4.list PhotonHadRun2011Av4.json done
/MuHad/Run2011A-PromptReco-v4/AOD Yi 165071-166863 568 pb+1 769 pb-1 98% MuHadRun2011Av4.list MuHadRun2011Av4.json done
  Yi 166864-167746 279 pb-1   100% MuHadRun2011Av4_166864_167746.list (Merged with above) done
/Jet/Run2011A-PromptReco-v4/AOD Artur 165071-168437   X pb-1 93% JetPromptRecov4.list JetRun2011Av4.json done
/HT/Run2011A-PromptReco-v4/AOD Artur 165071-168437   X pb-1 (to be updated for 167747_168437) 99% HTRun2011Av4.list HTRun2011Av4.json done
/ElectronHad/Run2011A-PromptReco-v4/AOD Yi 165071-166863 532 pb-1 736 pb-1 93% EleHadRun2011Av4.list EleHadRun2011Av4.json done
  Yi 166864-167746 278 pb-1   99% EleHadRun2011Av4_166864_167746.list (Merged with above) done

Dataset Run range Responsible Lumi (/pb) Good Lumi (/pb) Complete (%) list json comments
/HT/Run2011A-05Aug2011-v1/AOD Artur 170053_172619     100% HTRun2011A_05Aug2011v1.list HTRun2011A_05Aug2011v1.json done

Dataset Run range Responsible Lumi (/pb) Good Lumi (/pb) Complete (%) list json comments
/HT/Run2011A-PromptReco-v6/AOD Artur 172620-173439     98% HTPromptRecov6_172620_173439.list HTPromptRecov6_172620_173439.json done

MC (Spring 11, 41X) Vecbos Production V4 [as V3, added CaloJetID, added L2L3 jet energy, fix Voronoi jet bug]

The following recipe is a backport of the recipe for V4 data production for Spring 11 MC (which is based on 41X). Release is CMSSW_4_1_6 plus the following tags:

cvs co -r V00-01-01-02   CommonTools/ParticleFlow                         
cvs co -r V09-09-04      DataFormats/TrackReco
cvs co -r branch-41X-V01 -d HiggsAnalysis/HiggsToWW2e UserCode/HiggsAnalysis/HiggsToWW2e
cvs co -r V00-4_1_X -d MyAnalysis/IsolationTools UserCode/emanuele/MyAnalysis/IsolationTools
cvs co -r R42X_S1_V02_S2_V00_S3_V00 -d WWAnalysis/DataFormats UserCode/Mangano/WWAnalysis/DataFormats
cvs co -r R42X_S1_V02_S2_V00_S3_V00 -d WWAnalysis/Tools UserCode/Mangano/WWAnalysis/Tools
cvs co -r R42X_S1_V02_S2_V00_S3_V00 -d WWAnalysis/Filters UserCode/Mangano/WWAnalysis/Filters
cvs co -r V06-04-07-01   TrackingTools/TrajectoryState
cvs co -r V01-04-07      RecoVertex/PrimaryVertexProducer
cvs co -r V00-03-30      RecoEgamma/ElectronIdentification
cvs co -r V08-11-09      RecoEgamma/EgammaTools
cvs co -r V02-04-16 RecoJets/Configuration
cvs co -r V04-01-00 RecoJets/JetAlgorithms
cvs co -r V05-05-03-00 RecoJets/JetProducers

Data Vecbos Production V3 [removed PF Candidtes, added particle-based isolation]

Trees are produced with the following recipe of the dumper:

  • CMSSW release: CMSSW_4_2_4
  • plus extra tags:

cvs co -r V06-4_2_X -d HiggsAnalysis/HiggsToWW2e UserCode/HiggsAnalysis/HiggsToWW2e
cvs co -r V00-4_1_X -d MyAnalysis/IsolationTools UserCode/emanuele/MyAnalysis/IsolationTools
cvs co -r V02-04-16 RecoJets/Configuration
cvs co -r V04-01-00 RecoJets/JetAlgorithms
cvs co -r V05-05-03 RecoJets/JetProducers
cvs co -r edm-20May2011 -d WWAnalysis/DataFormats UserCode/Mangano/WWAnalysis/DataFormats
cvs co -r R42X_S1_V00_S2_V00_S3_V00 -d WWAnalysis/Tools UserCode/Mangano/WWAnalysis/Tools
cvs co -r WW_414_SKIM_V05 -d WWAnalysis/Filters UserCode/Mangano/WWAnalysis/Filters
cvs co -r V00-03-30      RecoEgamma/ElectronIdentification

The lists and json refer to directories in CVS of VecbosApp:

  • json: config/vecbos/json/42X
  • list of files: cmst3_42X/Data7TeV/
  • lumi files correspondent to the full list (only DCS json applied): cmst3_42X/Data7TeV/lumi

This production is considered a REPLACEMENT of V2, so the new lists will overwrite the old ones.

In green are the datasets that can be copied (>=98% done).

In blue are the datasets copied on CMST3.

May10 re-reco

Dataset Responsible Lumi (/pb) Good Lumi (/pb) Complete (%) list json comments
/DoubleElectron/Run2011A-May10ReReco-v1/AOD Emanuele 240.3 203 100% DoubleElectronMay10ReRecov1.list DoubleElectronMay10ReRecov1_DCSONLY_160404_165558.json done
/SingleElectron/Run2011A-May10ReReco-v1/AOD Emanuele 241.3 204 100% SingleElectronMay10ReRecov1.list SingleElectronMay10ReRecov1_DCSONLY_160404_165558.json done
/DoubleMu/Run2011A-May10ReReco-v1/AOD Emanuele 240.2 203 100% DoubleMuMay10ReRecov1.list DoubleMuMay10ReRecov1_DCSONLY_160404_165558.json done
/SingleMu/Run2011A-May10ReReco-v1/AOD Emanuele 228.8 193 95% SingleMuMay10ReRecov1.list SingleMuMay10ReRecov1_DCSONLY_160404_165558.json running the aborted
/MuEG/Run2011A-May10ReReco-v1/AOD Emanuele 240.2 145 100% MuEGMay10ReRecov1.list MuEGMay10ReRecov1_DCSONLY_160404_165558.json done
/Photon/Run2011A-May10ReReco-v1/AOD Emanuele 239.7 203 100% PhotonMay10ReRecov1.list PhotonMay10ReRecov1_DCSONLY_160404_165558.json.list done
/PhotonHad/Run2011A-May10ReReco-v1/AOD Maurizio 230 201 99% PhotonHadMay10ReRecov1.list PhotonHadMay10ReRecov1.json done
/MuHad/Run2011A-May10ReReco-v1/AOD Maurizio 89 76 99% MuHadMay10ReRecov1.list MuHadMay10ReRecov1.json done
/Jet/Run2011A-May10ReReco-v1/AOD              
/HT/Run2011A-May10ReReco-v1/AOD              
/ElectronHad/Run2011A-May10ReReco-v1/AOD Maurizio     90%      

After tech stop Prompt Reco v4

Dataset Run range Responsible Lumi (/pb) Good Lumi (/pb) Complete (%) list json comments
/DoubleElectron/Run2011A-PromptReco-v4/AOD 165071 - 166401 Emanuele 251 191 99% DoubleElectronRun2011Av4.list DoubleElectronRun2011Av4.json done
/SingleElectron/Run2011A-PromptReco-v4/AOD 165071 - 166401 Emanuele 252.5 192 100% SingleElectronRun2011Av4.list SingleElectronRun2011Av4.json done
/DoubleMu/Run2011A-PromptReco-v4/AOD 165071 - 166401 Emanuele 239.4   95.2% DoubleMuRun2011Av4.list DoubleMuRun2011Av4.json resubmitting aborted
/SingleMu/Run2011A-PromptReco-v4/AOD 165071 - 166401 Emanuele 252.5 189 100% SingleMuRun2011Av4.list SingleMuRun2011Av4.json done
/MuEG/Run2011A-PromptReco-v4/AOD 165071 - 166401 Emanuele 252.5 192 100% MuEGRun2011Av4.list MuEGRun2011Av4.json done
/Photon/Run2011A-PromptReco-v4/AOD 165071 - 166502 Maurizio 266 144 99% PhotonRun2011Av4.list PhotonRun2011Av4.json done
/PhotonHad/Run2011A-PromptReco-v4/AOD 165071 - 166502 Maurizio 263 215 98% PhotonHadRun2011Av4.list PhotonHadRun2011Av4.json done
/MuHad/Run2011A-PromptReco-v4/AOD 165071 - 166502 Maurizio 270 220 100% MuHadRun2011Av4.list MuHadRun2011Av4.json done
/Jet/Run2011A-PromptReco-v4/AOD              
/HT/Run2011A-PromptReco-v4/AOD 165071 - 166502 Maurizio 301 252 99% HTRun2011Av4.list HTRun2011Av4.json done
/ElectronHad/Run2011A-PromptReco-v4/AOD 165071 - 166502 Maurizio   49%      

Data Vecbos Production V2 [added PF Candidates, only relevant tracks kept]

Trees are produced with the following recipe of the dumper:

  • CMSSW release: CMSSW_4_2_3
  • plus extra tags:

cvs co -r V05-4_2_X -d HiggsAnalysis/HiggsToWW2e UserCode/HiggsAnalysis/HiggsToWW2e
cvs co -r V00-4_1_X -d MyAnalysis/IsolationTools UserCode/emanuele/MyAnalysis/IsolationTools
cvs co -r V02-04-16 RecoJets/Configuration
cvs co -r V04-01-00 RecoJets/JetAlgorithms
cvs co -r V05-05-03 RecoJets/JetProducers
cvs co -r edm-20May2011 -d WWAnalysis/DataFormats UserCode/Mangano/WWAnalysis/DataFormats
cvs co -r R42X_S1_V00_S2_V00_S3_V00 -d WWAnalysis/Tools UserCode/Mangano/WWAnalysis/Tools
cvs co -r WW_414_SKIM_V05 -d WWAnalysis/Filters UserCode/Mangano/WWAnalysis/Filters
cvs co -r V00-03-30      RecoEgamma/ElectronIdentification

The lists and json refer to directoties in CVS of VecbosApp:

  • json: config/vecbos/json/42X
  • list of files: cmst3_42X/Data7TeV/
  • lumi files correspondent to the full list (only DCS json applied): cmst3_42X/Data7TeV/lumi

In green are the datasets that can be copied (>=98% done).

In blue are the datasets copied on CMST3.

May10 re-reco

Dataset Responsible Lumi (/pb) Complete (%) list json comments
/DoubleElectron/Run2011A-May10ReReco-v1/AOD Emanuele 218.6 91% DoubleElectronMay10ReRecov1.list DoubleElectronMay10ReRecov1_DCSONLY_160404_165558.json  
/SingleElectron/Run2011A-May10ReReco-v1/AOD Emanuele 234.2 98% SingleElectronMay10ReRecov1.list SingleElectronMay10ReRecov1_DCSONLY_160404_165558.json  
/DoubleMu/Run2011A-May10ReReco-v1/AOD Emanuele 214.6 91% DoubleMuMay10ReRecov1.list DoubleMuMay10ReRecov1_DCSONLY_160404_165558.json  
/SingleMu/Run2011A-May10ReReco-v1/AOD Emanuele 216.2 91% DoubleElectronMay10ReRecov1.list SingleMuMay10ReRecov1_DCSONLY_160404_165558.json  
/MuEG/Run2011A-May10ReReco-v1/AOD Emanuele 240.2 100% MuEGMay10ReRecov1.list MuEGMay10ReRecov1_DCSONLY_160404_165558.json  
/Photon/Run2011A-May10ReReco-v1/AOD Emanuele 236.2 98% PhotonMay10ReRecov1.list PhotonMay10ReRecov1_DCSONLY_160404_165558.json  
/PhotonHad/Run2011A-May10ReReco-v1/AOD          
/MuHad/Run2011A-May10ReReco-v1/AOD Yi   60%     Ongoing....
/Jet/Run2011A-May10ReReco-v1/AOD            
/HT/Run2011A-May10ReReco-v1/AOD Artur   97%     Submitted on June1, ongoing...
/ElectronHad/Run2011A-May10ReReco-v1/AOD            

After tech stop Prompt Reco v4

Dataset Run range Responsible Lumi (/pb) Complete (%) list json comments
/DoubleElectron/Run2011A-PromptReco-v4/AOD 165071 - 165627 Emanuele 89 16% DoubleElectronRun2011Av4.list DoubleElectronRun2011Av4.json  
/SingleElectron/Run2011A-PromptReco-v4/AOD 165071 - 165627 Emanuele 141 100% SingleElectronRun2011Av4.list SingleElectronRun2011Av4.json  
/DoubleMu/Run2011A-PromptReco-v4/AOD 165071 - 165627 Emanuele 89 64% DoubleMuRun2011Av4.list DoubleMuRun2011Av4.json Will resubmit all
/SingleMu/Run2011A-PromptReco-v4/AOD 165071 - 165627 Emanuele 141 100% SingleMuonRun2011Av4.list SingleMuRun2011Av4.json  
/MuEG/Run2011A-PromptReco-v4/AOD 165071 - 165627 Emanuele 11 8% MuEGRun2011Av4.list MuEGRun2011Av4.json Will resubmit all
/Photon/Run2011A-PromptReco-v4/AOD 165071 - 165922 Emanuele 122 85% PhotonRun2011Av4.list PhotonRun2011Av4.json  
/PhotonHad/Run2011A-PromptReco-v4/AOD 165071 - 166164 Maurizio 185 100% PhotonHadRun2011Av4.list PhotonHadRun2011Av4.json  
/MuHad/Run2011A-PromptReco-v4/AOD 165071 - 166164 Maurizio 185 100% MuHadRun2011Av4.list MuHadRun2011Av4.json  
/Jet/Run2011A-PromptReco-v4/AOD              
/HT/Run2011A-PromptReco-v4/AOD 165071 - 166164 Artur   96%     Submitted on June 2, ongoing...
/ElectronHad/Run2011A-PromptReco-v4/AOD 165071 - 166164 Maurizio 185 80% ElectronHadRun2011Av4.list ElectronHadRun2011Av4.json  

MC production

Vecbos Production V3 [removed PF Candidtes, added particle-based isolation]

cmsrel CMSSW_4_1_6
cd CMSSW_4_1_6/src
cmsenv
cvs co -r V00-01-01-02   CommonTools/ParticleFlow                         
cvs co -r V09-09-04      DataFormats/TrackReco
cvs co -r branch-41X-V01 -d HiggsAnalysis/HiggsToWW2e UserCode/HiggsAnalysis/HiggsToWW2e
cvs co -r V00-4_1_X -d MyAnalysis/IsolationTools UserCode/emanuele/MyAnalysis/IsolationTools
cvs co -r WW_414_SKIM_V05 -d WWAnalysis/DataFormats UserCode/Mangano/WWAnalysis/DataFormats
cvs co -r WW_414_SKIM_V05 -d WWAnalysis/Tools UserCode/Mangano/WWAnalysis/Tools
cvs co -r WW_414_SKIM_V05 -d WWAnalysis/Filters UserCode/Mangano/WWAnalysis/Filters
cvs co -r V06-04-07-01   TrackingTools/TrajectoryState
cvs co -r V01-04-07      RecoVertex/PrimaryVertexProducer
cvs co -r V00-03-30      RecoEgamma/ElectronIdentification
cvs co -r V08-11-09      RecoEgamma/EgammaTools
cvs co -r V02-04-16 RecoJets/Configuration
cvs co -r V04-01-00 RecoJets/JetAlgorithms
cvs co -r V05-05-03-00 RecoJets/JetProducers

-- EmanueleDiMarco - 01-Jun-2011

Edit | Attach | Watch | Print version | History: r81 < r80 < r79 < r78 < r77 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r81 - 2011-09-25 - EmanueleDiMarco
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback