Single Muon Production

Request

Single particle request:

500K x 5 points: 3-5 ; 10 ; 50 ; 100 ; 500 GeV

rel 20.1.0.3

THESE 5 SINGLE MUON SETS HAVE BEEN DELETED FROM THE GRID. MORE ARE BEING PRODUCED !

group.perf-muons.SingleMuon3to5GeV_20150216_rel20103_v02/
group.perf-muons.SingleMuon10GeV_20150216_rel20103_v01/
group.perf-muons.SingleMuon50GeV_20150216_rel20103_v01/
group.perf-muons.SingleMuon100GeV_20150216_rel20103_v01/
group.perf-muons.SingleMuon500GeV_20150216_rel20103_v01/

Note: Both RDOs and AODs available

eg

RDOs: group.perf-muons.SingleMuon10GeV_20150216_rel20103_v01_EXT0/

AODs: group.perf-muons.SingleMuon10GeV_20150216_rel20103_v01_EXT1/

Datasets to be (partially) redone:

mc12_8TeV.147807.PowhegPythia8_AU2CT10_Zmumu.evgen.EVNT.e1852/
mc12_8TeV.208001.Pythia8B_AU2_CTEQ6L1_pp_Jpsimu4mu4.evgen.EVNT.e1331/
mc12_8TeV.208010.Pythia8B_AU2_CTEQ6L1_pp_Jpsimu6p5mu6p5.evgen.EVNT.e1966/
mc12_8TeV.158027.Pythia8_AU2MSTW2008LO_Zprime_mumu_SSM1500.evgen.EVNT.e1242/
mc12_8TeV.158028.Pythia8_AU2MSTW2008LO_Zprime_mumu_SSM2000.evgen.EVNT.e1242/
mc12_8TeV.158029.Pythia8_AU2MSTW2008LO_Zprime_mumu_SSM2500.evgen.EVNT.e1242/
 
no RDOs available, but (unmerged) HITS can be found: site
 
mc14_8TeV.147807.PowhegPythia8_AU2CT10_Zmumu.simul.HITS.e1852_s1896/ BNL-OSG2_DATADISK, FZK-LCG2_DATADISK, INFN-T1_DATADISK, TRIUMF-LCG2_DATADISK
mc14_8TeV.208001.Pythia8B_AU2_CTEQ6L1_pp_Jpsimu4mu4.simul.HITS.e1331_s1896/ BNL-OSG2_DATADISK, TRIUMF-LCG2_DATADISK, FZK-LCG2_DATADISK, RAL-LCG2_DATADISK
mc14_8TeV.208010.Pythia8B_AU2_CTEQ6L1_pp_Jpsimu6p5mu6p5.simul.HITS.e1966_s1933/ RAL-LCG2_DATADISK
mc14_8TeV.158027.Pythia8_AU2MSTW2008LO_Zprime_mumu_SSM1500.simul.HITS.e1242_s1933/ PIC_DATADISK, SARA-MATRIX_DATADISK, TAIWAN-LCG2_DATADISK
mc14_8TeV:mc14_8TeV.158028.Pythia8_AU2MSTW2008LO_Zprime_mumu_SSM2000.simul.HITS.e1242_s1933/ INFN-T1_DATADISK, PIC_DATADISK, TRIUMF-LCG2_DATADISK
mc14_8TeV.158029.Pythia8_AU2MSTW2008LO_Zprime_mumu_SSM2500.simul.HITS.e1242_s1933/ BNL-OSG2_DATADISK, INFN-T1_DATADISK, TRIUMF-LCG2_DATADISK
 
mc12_13TeV.147407.PowhegPythia8_AZNLO_Zmumu.evgen.EVNT.e3059/
mc12_13TeV.208001.Pythia8B_AU2_CTEQ6L1_pp_Jpsimu4mu4.evgen.EVNT.e2743/
 
(unmerged) HITS can be found: site
 
mc14_13TeV.147407.PowhegPythia8_AZNLO_Zmumu.simul.HITS.e3059_a266/ INFN-T1_DATADISK
mc14_13TeV.147407.PowhegPythia8_AZNLO_Zmumu.simul.HITS.e3059_s2067/ TRIUMF-LCG2_DATADISK
mc14_13TeV.208001.Pythia8B_AU2_CTEQ6L1_pp_Jpsimu4mu4.simul.HITS.e2743_s2045/ SARA-MATRIX_DATADISK
 
RDOs can be found: site
 
mc14_13TeV.147407.PowhegPythia8_AZNLO_Zmumu.recon.RDO.e3059_s2045_s2008_r5989/ TRIUMF-LCG2_DATADISK
mc14_13TeV.147407.PowhegPythia8_AZNLO_Zmumu.recon.RDO.e3059_s2044_s2008_r5988/ BNL-OSG2_DATADISK
mc14_13TeV.208001.Pythia8B_AU2_CTEQ6L1_pp_Jpsimu4mu4.recon.RDO.e2743_s2044_s2008_r5988/ BNL-OSG2_DATADISK
 
mc12_13TeV.182920.Pythia8_AU2MSTW2008LO_Zprime_NoInt_mumu_E6Chi2000.evgen.EVNT.e3150/
mc12_13TeV.182921.Pythia8_AU2MSTW2008LO_Zprime_NoInt_mumu_E6Chi3000.evgen.EVNT.e3150/
mc12_13TeV.182922.Pythia8_AU2MSTW2008LO_Zprime_NoInt_mumu_E6Chi4000.evgen.EVNT.e3150/
mc12_13TeV.182923.Pythia8_AU2MSTW2008LO_Zprime_NoInt_mumu_E6Chi5000.evgen.EVNT.e3150/
mc12_13TeV.158028.Pythia8_AU2MSTW2008LO_Zprime_mumu_SSM2000.evgen.EVNT.e2743/
 
no RDOs available, but (unmerged) HITS can be found: site
 
mc14_13TeV.182920.Pythia8_AU2MSTW2008LO_Zprime_NoInt_mumu_E6Chi2000.simul.HITS.e3150_s1982/ BNL-OSG2_DATADISK
mc14_13TeV.182921.Pythia8_AU2MSTW2008LO_Zprime_NoInt_mumu_E6Chi3000.simul.HITS.e3150_s1982/ RAL-LCG2_DATADISK
mc14_13TeV.182922.Pythia8_AU2MSTW2008LO_Zprime_NoInt_mumu_E6Chi4000.simul.HITS.e3150_s1982/ RAL-LCG2_DATADISK
mc14_13TeV.182923.Pythia8_AU2MSTW2008LO_Zprime_NoInt_mumu_E6Chi5000.simul.HITS.e3150_s1982/ INFN-T1_DATADISK
mc14_13TeV.158028.Pythia8_AU2MSTW2008LO_Zprime_mumu_SSM2000.simul.HITS.e2743_s1982/ TRIUMF-LCG2_DATADISK

official DC14 sample IOV (DataRunNumber) geometry initial condDB
mc14_8TeV.147807.PowhegPythia8_AU2CT10_Zmumu.merge.AOD.e1852_s1896_s1912_r5591_r5625/ 212272 ATLAS-R1-2012-02-00-00 OFLCOND-RUN12-SDR-06
mc14_8TeV.208001.Pythia8B_AU2_CTEQ6L1_pp_Jpsimu4mu4.merge.AOD.e1331_s1896_s1912_r5591_r5625/ 212272 ATLAS-R1-2012-02-00-00 OFLCOND-RUN12-SDR-06
mc14_8TeV.208010.Pythia8B_AU2_CTEQ6L1_pp_Jpsimu6p5mu6p5.merge.AOD.e1966_s1933_s1911_r5591_r5625/ 212272 ATLAS-R1-2012-02-00-00 OFLCOND-RUN12-SDR-06
mc14_8TeV.158027.Pythia8_AU2MSTW2008LO_Zprime_mumu_SSM1500.merge.AOD.e1242_s1933_s1911_r5591_r5625/ 212272 ATLAS-R1-2012-02-00-00 OFLCOND-RUN12-SDR-06
mc14_8TeV.158029.Pythia8_AU2MSTW2008LO_Zprime_mumu_SSM2500.merge.AOD.e1242_s1933_s1911_r5591_r5625/ 212272 ATLAS-R1-2012-02-00-00 OFLCOND-RUN12-SDR-06
mc14_8TeV.158028.Pythia8_AU2MSTW2008LO_Zprime_mumu_SSM2000.merge.AOD.e1242_s1933_s1911_r5591_r5625/ 212272 ATLAS-R1-2012-02-00-00 OFLCOND-RUN12-SDR-06
mc14_13TeV.147407.PowhegPythia8_AZNLO_Zmumu.merge.AOD.e3059_s2067_s2008_r5907_r5853/ 222222 ATLAS-R2-2015-01-03-00 OFLCOND-RUN12-SDR-14
mc14_13TeV.147407.PowhegPythia8_AZNLO_Zmumu.merge.AOD.e3059_a266_a265_r5853/ 222222 ATLAS-R2-2015-01-01-00 OFLCOND-RUN12-SDR-14
mc14_13TeV.208001.Pythia8B_AU2_CTEQ6L1_pp_Jpsimu4mu4.merge.AOD.e2743_s2045_s2008_r5989_r5853/ 222222 ATLAS-R2-2015-01-05-00 OFLCOND-RUN12-SDR-16
mc14_13TeV.182920.Pythia8_AU2MSTW2008LO_Zprime_NoInt_mumu_E6Chi2000.merge.AOD.e3150_s1982_s2008_r5787_r5853/ 222222 ATLAS-R2-2015-01-01-00 OFLCOND-RUN12-SDR-14
mc14_13TeV.182921.Pythia8_AU2MSTW2008LO_Zprime_NoInt_mumu_E6Chi3000.merge.AOD.e3150_s1982_s2008_r5787_r5853/ 222222 ATLAS-R2-2015-01-01-00 OFLCOND-RUN12-SDR-14
mc14_13TeV.182922.Pythia8_AU2MSTW2008LO_Zprime_NoInt_mumu_E6Chi4000.merge.AOD.e3150_s1982_s2008_r5787_r5853/ 222222 ATLAS-R2-2015-01-01-00 OFLCOND-RUN12-SDR-14
mc14_13TeV.182923.Pythia8_AU2MSTW2008LO_Zprime_NoInt_mumu_E6Chi5000.merge.AOD.e3150_s1982_s2008_r5787_r5853/ 222222 ATLAS-R2-2015-01-01-00 OFLCOND-RUN12-SDR-14
mc14_13TeV.158028.Pythia8_AU2MSTW2008LO_Zprime_mumu_SSM2000.merge.AOD.e2743_s1982_s2008_r5787_r5853/ 222222 ATLAS-R2-2015-01-01-00 OFLCOND-RUN12-SDR-14

Setup

Simulation: One should follow the latest recommendations by the sim group:

https://indico.cern.ch/event/365287/contribution/0/material/slides/0.pdf

and use the release 19.2.1.6 (hit merging is for us currently not an issue). Please find the sites that support the release here:

http://pandamon.cern.ch/releaseinfo?release=19.2.1:%20x86_64-slc6-gcc47-opt

UPDATE FROM SIMULATION STEERING

The simulation group updated their recommendation on the simulation release 19.2.3.3: https://indico.cern.ch/event/365290/contribution/1/material/slides/0.pdf

Digitization + Reconstruction: The latest/greatest should be use which is either 20.1.0.3 or nightly.

Sites which hold the release are available here (it has to be figured out if the nightly is indeed working somewhere):

http://pandamon.cern.ch/releaseinfo?release=20.1.0:%20x86_64-slc6-gcc48-opt

As soon as 20.1.2 is release this one should be used.

For the moment problems had been experience running digi+reco on other sites than CERN-PROD.

Data Run Number

https://its.cern.ch/jira/browse/ATLASSIM-1695

DataRunNumber = 222500 MC15 50ns, new R2 geo tag (mu=0) )

known issues

It turned out that the preInclude of SimulationJobOptions/preInclude.CalHits.py causes about 5% of the jobs crashing (see ticket https://its.cern.ch/jira/browse/ATLASSIM-1873 ). In future large scale production one should refrain from using it.

https://its.cern.ch/jira/browse/ATLASRECTS-1762 report an issue with the truth if the particle gun is used. This issues should be remembered when the samples are analyzed.

Simulation

asetup 19.2.1.6,here *updated (see above): 19.2.3.3*
export PATHENA_GRID_SETUP_SH=/dev/null
source /afs/cern.ch/atlas/offline/external/GRID/DA/panda-client/latest/etc/panda/panda_setup.sh

on-the-fly evgen

Locally:

N.B SingleMuon50GeV.py is attached below with crazy file extension .txt

or here: /afs/cern.ch/user/c/cheatham/public/G4

UPDATE ON LAYOUT: ATLAS-R2-2015-03-01-00_VALIDATION is new baseline

AtlasG4_tf.py \
--outputHITSFile OUT.HITS.root \
--preInclude SimulationJobOptions/preInclude.CalHits.py,SingleMuon50GeV.py \
--maxEvents 10 \
--randomSeed=2674 \
--geometryVersion ATLAS-R2-2015-02-01-00_VALIDATION \
--conditionsTag OFLCOND-RUN12-SDR-22 \
--DataRunNumber 222500 

On the grid:

pathena --trf "AtlasG4_tf.py  \
--preInclude SimulationJobOptions/preInclude.CalHits.py,SingleMuon50GeV.py \
--conditionsTag OFLCOND-RUN12-SDR-22 \
--DataRunNumber 222500 \
--randomSeed %RNDM:100 \
--geometryVersion ATLAS-R2-2015-02-01-00_VALIDATION \
--outputHITSFile %OUT.HITS.pool.root \
--maxEvents 1000 \
--physicsList FTFP_BERT" \
--outDS user.cheatham.SingleMuon50GeV_20150209_rel19216_v02.HITS \
--split 2 \
--site CERN-PROD \
--extFile SingleMuon50GeV.py \
--nEventsPerFile 1000 

REMARK: Before CERN-PROD was chosen because problems had been experience with DB look-up tables begin not up-to-date elsewhere or not available at all. Other sides can be used with the following approch:

Browse the directory /cvmfs/atlas.cern.ch/repo/sw/database/DBRelease to figure out what is the most recent DBRelease (in this example it's 28.1.1) and adjust the submission accordingly to sth like:

pathena --trf "AtlasG4_tf.py \
 --preInclude SimulationJobOptions/preInclude.CalHits.py,SingleMuon500GeV.py \
 --conditionsTag OFLCOND-RUN12-SDR-22 \
 --DataRunNumber 222500 \
 --randomSeed %RNDM:100 \
 --geometryVersion ATLAS-R2-2015-03-01-00_VALIDATION \
 --outputHITSFile %OUT.HITS.pool.root \
 --maxEvents 1000 \
 --DBRelease current \
 --postInclude PyJobTransforms/UseFrontier.py \
 --physicsList FTFP_BERT" \
 --outDS group.det-muon.SingleMuon500GeV_20150305_rel19233_v01.HITS \
 --split 500 \
 --extFile SingleMuon500GeV.py \
 --dbRelease ddo.000001.Atlas.Ideal.DBRelease.v280101:DBRelease-28.1.1.tar.gz \
 --official --voms=atlas:/atlas/det-muon/Role=production

Another good site was found to be e.g. MPPMU.

using EVNT input from dataset

Locally:

AtlasG4_tf.py \
--outputHITSFile OUT.HITS.root \
--inputEvgenFile EVNT.IN.pool.root.1 \
--preInclude SimulationJobOptions/preInclude.CalHits.py \
--maxEvents 10 \
--randomSeed=2674 \
--geometryVersion ATLAS-R2-2015-02-01-00_VALIDATION \
--conditionsTag OFLCOND-RUN12-SDR-22 \
--DataRunNumber 222500 

On the grid (under testing):

pathena --trf "AtlasG4_tf.py  \
--preInclude SimulationJobOptions/preInclude.CalHits.py \
--conditionsTag OFLCOND-RUN12-SDR-22 \
--DataRunNumber 222500 \
--randomSeed %RNDM:100 \
--geometryVersion ATLAS-R2-2015-02-01-00_VALIDATION \
--outputHITSFile %OUT.HITS.pool.root \
--inputEvgenFile %IN \
--maxEvents 1000 \
--physicsList FTFP_BERT" \
--outDS user.cheatham.SingleMuon50GeV_20150209_rel19215_v02.HITS \
--site CERN-PROD \
--nEventsPerFile 5000 \
--nEventsPerJob 1000 \
--nFiles=100

Atlfast using EVNT input from dataset

(Keep in mind: In Atlfast muons are still treated by Geant4, only other particles may be simulated fast)

Locally:

Sim_tf.py \
--outputHITSFile OUT.HITS.root \
--inputEvgenFile EVNT.01209338._001763.pool.root.1 \
--maxEvents 10 \
--randomSeed=2674 \
--geometryVersion ATLAS-R2-2015-02-01-00_VALIDATION \
--conditionsTag OFLCOND-RUN12-SDR-22 \
--DataRunNumber 222500

On the grid (to be posted)

Digitisation

asetup 20.1.0.3,here,slc6,gcc48,opt,64,AtlasProduction

A good test to check things are working locally:

Reco_tf.py --inputBSFile /afs/cern.ch/work/g/graemes/ddm/pmb/data12_8TeV.00209109.physics_JetTauEtmiss.merge.RAW._lb0186._SFO-1._0001.1 --outputESDFile my.ESD.pool.root --autoConfiguration everything --maxEvents 10

Locally:

UPDATE ON LAYOUT: ATLAS-R2-2015-03-01-00_VALIDATION is new baseline

using the latest conditions data for masking (currently the only chamber masked is: EMS4C16):

--postExec 'from IOVDbSvc.CondDB import conddb;conddb.addOverride("/MDT/DCS/PSLVCHSTATE","MDTDCSPSLVCHSTATE_RUN12_MC15_02")'

completely disabling masking:

--postExec 'ToolSvc.MdtDigitizationTool.UseDeadChamberSvc=False'

Digi_tf.py \
--inputHITSFile OUT.HITS.root \
--outputRDOFile OUT.RDO.root \
--ignoreErrors True --DataRunNumber 222500 \
--maxEvents 10 \
--geometryVersion ATLAS-R2-2015-02-01-00 --conditionsTag OFLCOND-RUN12-SDR-22 \
--postInclude PyJobTransforms/UseFrontier.py \
--digiSeedOffset1 123 --digiSeedOffset2 321

On the grid:

pathena --trf "Digi_tf.py \
--inputHITSFile %IN \
--outputRDOFile %OUT.RDO.root \
--ignoreErrors=True \
--DataRunNumber 222500 \
--maxEvents -1 \
--geometryVersion ATLAS-R2-2015-02-01-00 --conditionsTag OFLCOND-RUN12-SDR-22 \
--postInclude PyJobTransforms/UseFrontier.py \
--digiSeedOffset1 %RNDM:200 --digiSeedOffset2 %RNDM:200 " \
--inDS user.cheatham.SingleMuon50GeV_20150209_rel19215_v02.HITS_EXT0/ \
--outDS user.cheatham.SingleMuon50GeV_20150209_rel20.1.0.3_v02_RDO \
--nFilesPerJob=1 \
--site CERN-PROD \
--dbRelease ddo.000001.Atlas.Ideal.DBRelease.v270701:DBRelease-27.7.1.tar.gz \
--noSubmit

Reconstruction

UPDATE ON LAYOUT: ATLAS-R2-2015-03-01-00_VALIDATION is new baseline

using the latest conditions data for masking (currently the only chamber masked is: EMS4C16):

--postExec 'from IOVDbSvc.CondDB import conddb;conddb.addOverride("/MDT/DCS/PSLVCHSTATE","MDTDCSPSLVCHSTATE_RUN12_MC15_02")'

Locally:

Reco_tf.py \
--inputRDOFile OUT.RDO.root \
--outputAODFile OUT.AOD.root \
--ignoreErrors=True \
--autoConfiguration everything \
--geometryVersion ATLAS-R2-2015-02-01-00 \
--conditionsTag OFLCOND-RUN12-SDR-22 \
--DataRunNumber 222500 \
--maxEvents -1

On the grid:

pathena --trf "Reco_tf.py \
--inputRDOFile %IN \
--outputAODFile %OUT.AOD.root \
--ignoreErrors=True \
--autoConfiguration everything \
--geometryVersion ATLAS-R2-2015-02-01-00 \
--conditionsTag OFLCOND-RUN12-SDR-22 \
--DataRunNumber 222500 \
--maxEvents -1" \
--inDS user.cheatham.SingleMuon50GeV_20150209_rel20.1.0.3_v02_RDO_EXT0/ \
--outDS user.cheatham.SingleMuon50GeV_20150210_rel20.1.0.3_v02_ADO \
--site CERN-PROD \
--dbRelease ddo.000001.Atlas.Ideal.DBRelease.v270701:DBRelease-27.7.1.tar.gz \
--nFilesPerJob 1 \

Digitization + Reconstruction in one step

UPDATE ON LAYOUT: ATLAS-R2-2015-03-01-00_VALIDATION is new baseline

using the latest conditions data for masking (currently the only chamber masked is: EMS4C16):

--postExec 'from IOVDbSvc.CondDB import conddb;conddb.addOverride("/MDT/DCS/PSLVCHSTATE","MDTDCSPSLVCHSTATE_RUN12_MC15_02")'

completely disabling masking:

--postExec 'HITtoRDO:ToolSvc.MdtDigitizationTool.UseDeadChamberSvc=False'

Locally:

Reco_tf.py \
--inputHITSFile OUT.HITS.root \
--outputRDOFile OUT.RDO.root \
--outputAODFile OUT.AOD.root \
--ignoreErrors=True \
--autoConfiguration everything \
--geometryVersion ATLAS-R2-2015-02-01-00 \
--conditionsTag OFLCOND-RUN12-SDR-22 \
--DataRunNumber 222500 \
--maxEvents -1 \
--postInclude PyJobTransforms/UseFrontier.py \
--digiSeedOffset1 4321 --digiSeedOffset2 1234

On the grid:

pathena --trf "Reco_tf.py \
--inputHITSFile %IN \
--outputRDOFile %OUT.RDO.root \
--outputAODFile %OUT.AOD.root \
--ignoreErrors=True \
--autoConfiguration everything \
--geometryVersion ATLAS-R2-2015-02-01-00 --conditionsTag OFLCOND-RUN12-SDR-22 \
--DataRunNumber 222500 \
--maxEvents -1 \
--postInclude PyJobTransforms/UseFrontier.py \
--digiSeedOffset1 %RNDM:200 --digiSeedOffset2 %RNDM:200 " \
--inDS user.cheatham.SingleMuon50GeV_20150209_rel19215_v02.HITS_EXT0/ \
--outDS user.cheatham.SingleMuon50GeV_20150211_rel20.1.0.3_v01 \
--site CERN-PROD \
--dbRelease ddo.000001.Atlas.Ideal.DBRelease.v270701:DBRelease-27.7.1.tar.gz \
--nEventsPerJob 1000 --nEventsPerFile 1000 --nFiles 500 \

Files

Panda

http://bigpanda.cern.ch/tasks/?username=Susan%20Cheatham

DQ2

export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase
source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh
localSetupDQ2Client

EOS

source /afs/cern.ch/project/eos/installation/atlas/etc/setup.sh
eos ls /eos/atlas/atlasscratchdisk/rucio/user/cheatham/d0/a2/user.cheatham.4814523.EXT0._000001.HITS.pool.root
xrdcp root://eosatlas.cern.ch//eos/atlas/atlasscratchdisk/rucio/user/cheatham/d0/a2/user.cheatham.4814523.EXT0._000001.HITS.pool.root .

Remarks

If you have privileges append to the grid submission command the following (example)

 --official --voms=atlas:/atlas/det-muon/Role=production

or (depending upon role)

--official --voms=atlas:/atlas/perf-muons/Role=production

and keep in mind that your output dataset name has to follow the pattern

group.det-muon.*
or
group.perf-muons.*
(appreciated is that the dataset name includes 1/ date 2/ release 3/ output format [hits, rdos, xaod] 4/ some kind of versioning).

-- SueCheatham - 2015-01-28

Edit | Attach | Watch | Print version | History: r25 < r24 < r23 < r22 < r21 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r25 - 2015-03-05 - JochenMeyer
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Sandbox All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback