Here is some info and useful tips for the SYNTMaker ntuples for those that intend to use them for the SMP analysis results aimed for the summer conferences of 2010.

May reprocessed ESDs

The below sections lists some useful info about the SYNT datasets for data and MC from the May reprocessing.

Datasets for data

All runs processed in May reprocessing with > 1M recorded events have been processed (MuonswBeam, L1Calo and debugrec_hltacc streams). A skimming was done, requiring an offline muon (of any type) with GeV. The skimming efficiencies vary a little with the instantaneous luminosity for the L1Calo stream since I think L1_EM2 was prescaled at some point, but typical values are 5-7% and 25% for L1Calo and MuonswBeam, respectively. The top job options used to process the data is available on CERN AFS ~cohm/public/ICHEP2010/jobOptions/jobOptions_data10_7TeV_minbias_grid.py and the following little bash script will download them all from the grid (but make sure to write the log to a file and check it for errors!!!):

for DS in \
group.phys-susy.data10_7TeV.00155112.physics_L1Calo.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155073.physics_L1Calo.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155160.physics_L1Calo.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155116.physics_L1Calo.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152994.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152845.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152933.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153030.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152221.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00154810.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152441.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152166.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152345.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152878.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153599.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153565.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152508.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153134.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152409.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153159.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00154817.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100603-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152777.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00154813.physics_L1Calo.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100603-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00154822.physics_L1Calo.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00154822.physics_MuonswBeam.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155112.physics_MuonswBeam.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155073.physics_MuonswBeam.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155160.physics_MuonswBeam.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155116.physics_MuonswBeam.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152994.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152845.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152933.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153030.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152777.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152221.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00154810.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152441.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152166.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152345.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152878.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153599.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153565.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152508.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00154813.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153134.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152409.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153159.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00154817.physics_MuonswBeam.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00154822.debugrec_hltacc.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155112.debugrec_hltacc.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155073.debugrec_hltacc.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155160.debugrec_hltacc.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155116.debugrec_hltacc.merge.ESD.r1299_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152994.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152845.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152933.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153030.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152777.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152221.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00154810.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152441.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152166.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152345.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152878.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153599.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153565.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152508.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00154813.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153134.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00152409.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00153159.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00154817.debugrec_hltacc.merge.ESD.r1297_p161.SYNTr104.15.6.9.8.100530-1.ICHEP2010 

do
   echo "Will now download $DS"
   dq2-get -f "*.root" $DS
done

In all of the runs listed above, L1_J5 and L1_MU0 were unprescaled, thus they can be used for the analysis.

Update 2010-06-21: we now also have some runs from Period C (however, I believe some of these runs had L1_J5 prescaled - be aware!), cut and paste them into the script above:

group.phys-susy.data10_7TeV.00155569.debugrec_hltacc.recon.ESD.f260.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155569.physics_L1Calo.recon.ESD.f260.SYNTr122.15.6.10.4.100620-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155569.physics_MuonswBeam.recon.ESD.f260.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155634.debugrec_hltacc.recon.ESD.f260.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155634.physics_L1Calo.recon.ESD.f260.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155634.physics_MuonswBeam.recon.ESD.f260.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155669.debugrec_hltacc.recon.ESD.f260.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155669.physics_L1Calo.recon.ESD.f260.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155669.physics_MuonswBeam.recon.ESD.f260.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155678.debugrec_hltacc.recon.ESD.f261.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155678.physics_L1Calo.recon.ESD.f261.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155678.physics_MuonswBeam.recon.ESD.f261.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155697.debugrec_hltacc.recon.ESD.f261.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155697.physics_L1Calo.recon.ESD.f261.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00155697.physics_MuonswBeam.recon.ESD.f261.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00156682.debugrec_hltacc.recon.ESD.f265.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00156682.physics_L1Calo.recon.ESD.f265.SYNTr122.15.6.10.4.100619-1.ICHEP2010 \
group.phys-susy.data10_7TeV.00156682.physics_MuonswBeam.recon.ESD.f265.SYNTr122.15.6.10.4.100620-1.ICHEP2010

and this one merges the ntuples into one file per run/stream (to improve performance of ROOT-level analysis!):

for d in /tmp/cohm/group.phys-susy.data10_7TeV.*ICHEP2010 # <= change the path to wherever you downloaded the SYNTs!
do
 echo $d
 inputFiles=""
 for f in ${d}/*AANT*root*
 do
   #echo "Processing $f file..."
   inputFiles="${inputFiles} $f"
 done
 #echo "hadd ${d%AANT*}.merged.root $inputFiles"
 hadd ${d%AANT*}.merged.root $inputFiles
done

(I thought differently at first, but hadd seems to work for datasets with up to 1000 files..! If you generalize the script to deal with even more files, feel free to edit the above..)

The GRL used only requires stable beam, DQ flags should be required at ROOT-level. The query used was:

find run 152166+ and events 1000k+ and lhc stablebeams true and lhc beamenergy 3400+

The total size of these datasets is approximately 29 GB.

Datasets for MC

Minbias

The full May reprocessed minbias dataset of 20M events has been SYNTified with the same skimming criteria as the data, and is available on the grid in the dataset group.phys-susy.mc09_7TeV.105001.pythia_minbias.recon.ESD.e517_s764_s767_r1302.SYNTr122.15.6.10.4.100619-1.ICHEP2010. The job options used for this is available on CERN AFS ~cohm/public/ICHEP2010/jobOptions/jobOptions_mc09_7TeV_minbias_grid.py

Signal

The two official gluino R-hadron samples have been processed, and so has two of my May reprocessing-like low-mass gluino samples. You can find them on the grid:

group.phys-susy.group10.phys-susy.mc09_7TeV.106415.Pythia_R-Hadron_gluino_100GeV.r1302-like.100614.reco.SYNTr122.15.6.10.4.100619-1.ICHEP2010
group.phys-susy.group10.phys-susy.mc09_7TeV.106416.Pythia_R-Hadron_gluino_200GeV.r1302-like.100614.reco.SYNTr122.15.6.10.4.100619-1.ICHEP2010
group.phys-susy.mc09_7TeV.106418.Pythia_R-Hadron1_gluino_300GeV.recon.ESD.e532_s810_s767_r1310.SYNTr122.15.6.10.4.100619-1.ICHEP2010
group.phys-susy.mc09_7TeV.106419.Pythia_R-Hadron2_gluino_600GeV.recon.ESD.e540_s815_s767_r1311.SYNTr122.15.6.10.4.100619-1.ICHEP2010

Datasets for other MC processes

The idea is to wait for the DESDM_RPVLL datasets for the MC, since this will make larger statistics ESD-level contents available. The production should be started any day now (2010-06-09), and announced to the RPV/LL list.

GRL for DQ requirements at ROOT level

Since the DQ flags can be changed, it's convenient to apply the DQ requirements at ROOT level such that we don't have to re-generate all the SYNTs. Based on what's used in the EtMiss-based analyses, I made two GRLs for periods A-B and C, and they're available as part of the analysis code in SVN. I also made a merged one to easily run over all runs with the same analysis code without any problems.

Outlook

In the future we should make the SYNTs from the DESDM_RPVLL stream, both for data and MC. I would really appreciate if some people who use these ntuples would volunteer to help out with the production and validation, since it's quite time consuming. Let me (Christian) know!

-- ChristianOhm - 09-Jun-2010