HammerCloud configuration for CSA14

This page documents how HC has been set up to provide additional load during the CSA14 analysis challenge by submitting CRAB3 jobs.

Test parameters

Below all users, sites and datasets to be used are listed; the ordering has been randomised.

User number User DN User name
1 /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=mmascher/CN=720897/CN=Marco Mascheroni mmascher
2 /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=sciaba/CN=430796/CN=Andrea Sciaba sciaba
3 /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=jbalcas/CN=751133/CN=Justas Balcas jbalcas

Dataset number Dataset name Sites on which Dataset exists
1 /TBarToLeptons_t-channel_Tune4C_CSA14_13TeV-aMCatNLO-tauola/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T0_CH_CERN T1_IT_CNAF T2_CN_Beijing
2 /QCD_Pt-15to3000_Leading2Jets_MaxAbsEtagt2p7PTgt25_Tune4C_Flat_13TeV_pythia8/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T0_CH_CERN T1_US_FNAL T2_CH_CERN T2_US_Caltech
3 /TTJets_MSDecaysCKM_central_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T0_CH_CERN T1_US_FNAL T2_DE_DESY T2_UK_London_Brunel T3_KR_KISTI T3_KR_UOS
4 /WJetsToLNu_HT-600toInf_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_UK_RAL T2_PT_NCG_Lisbon
5 /GJet_Pt40_doubleEMEnriched_TuneZ2star_13TeV-pythia6/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T1_ES_PIC T2_DE_DESY T2_US_Nebraska T3_TW_NCU
6 /TToLeptons_t-channel-CSA14_Tune4C_13TeV-aMCatNLO-tauola/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T0_CH_CERN T1_IT_CNAF T2_IT_Rome
7 /QCD_Pt-15to3000_Tune4C_Flat_13TeV_pythia8/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_FR_CCIN2P3 T1_IT_CNAF T2_US_UCSD
8 /DYJetsToLL_M-50_13TeV-madgraph-pythia8/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T1_IT_CNAF T1_UK_RAL T2_IT_Pisa T3_TW_NCU
9 /TTbarH_HToZZ_4LFilter_M-125_13TeV_pythia6/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_FR_CCIN2P3 T1_UK_RAL T2_FR_GRIF_LLR
10 /W1234JetsToLNu_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T0_CH_CERN T1_FR_CCIN2P3 T2_IT_Rome
11 /WJetsToLNu_HT-600toInf_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T1_UK_RAL T2_UK_London_IC
12 /Neutrino_Pt-2to20_gun/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_US_FNAL T2_BR_SPRACE
13 /TT_Tune4C_13TeV-pythia8-tauola/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_US_FNAL T2_CH_CERN
14 /GJets_HT-100to200_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_UK_RAL T2_RU_ITEP T2_US_Purdue
15 /WJetsToLNu_HT-200to400_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T1_ES_PIC T2_RU_IHEP
16 /TTbarH_HToZZ_4LFilter_M-125_13TeV_pythia6/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T1_FR_CCIN2P3 T1_UK_RAL T2_DE_DESY
17 /TToLeptons_t-channel-CSA14_Tune4C_13TeV-aMCatNLO-tauola/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T0_CH_CERN T1_IT_CNAF T2_US_MIT
18 /DYJetsToLL_M-50_HT-400to600_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_UK_RAL T2_IT_Pisa
19 /QCD_Pt-15to3000_Tune4C_Flat_13TeV_pythia8/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T1_FR_CCIN2P3 T1_IT_CNAF T2_FR_IPHC
20 /WminusToMuNu_CT10_13TeV-powheg-pythia8/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T0_CH_CERN T1_UK_RAL T2_PT_NCG_Lisbon
21 /QCD_Pt-15to3000_Leading2Jets_MaxAbsEtagt2p7PTgt25_Tune4C_Flat_13TeV_pythia8/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T0_CH_CERN T1_US_FNAL T2_RU_INR
22 /WJetsToLNu_HT-100to200_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T0_CH_CERN T1_UK_RAL T2_DE_RWTH T2_IT_Bari
23 /MinBias_TuneA2MB_13TeV-pythia8/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T1_US_FNAL T2_US_Florida
24 /GJet_Pt20to40_doubleEMEnriched_TuneZ2star_13TeV-pythia6/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_IT_CNAF T1_UK_RAL T2_TW_Taiwan T2_UA_KIPT T3_TW_NCU
25 /GJets_HT-400to600_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T1_UK_RAL T2_CH_CSCS
26 /GJet_Pt-15to3000_Tune4C_13TeV_pythia8/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T1_FR_CCIN2P3 T2_DE_DESY T2_TW_Taiwan T3_TW_NCU T2_US_Purdue
27 /TTJets_MSDecaysCKM_central_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T0_CH_CERN T1_US_FNAL T2_FR_GRIF_IRFU
28 /WJetsToLNu_HT-100to200_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T0_CH_CERN T1_UK_RAL T2_DE_DESY T2_DE_RWTH
29 /W1234JetsToLNu_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T0_CH_CERN T1_FR_CCIN2P3 T2_AT_Vienna
30 /ChicToJpsiGamma_MuFilter_13TeV_Pythia6-evtgen/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T0_CH_CERN T1_IT_CNAF
31 /GJets_HT-100to200_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T1_UK_RAL T2_US_Florida
32 /QCD_Pt-50to80_MuEnrichedPt5_Tune4C_13TeV_pythia8/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_US_FNAL T2_IT_Legnaro
33 /GJet_Pt40_doubleEMEnriched_TuneZ2star_13TeV-pythia6/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_ES_PIC T2_TW_Taiwan T2_US_MIT T3_TW_NCU
34 /WJetsToLNu_HT-200to400_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_ES_PIC T2_US_UCSD
35 /DYJetsToLL_M-50_13TeV-madgraph-pythia8/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_UK_RAL T2_FR_GRIF_LLR T2_US_UCSD T3_TW_NCU
36 /MinBias_TuneA2MB_13TeV-pythia8/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_US_FNAL T2_ES_IFCA
37 /WplusToMuNu_CT10_13TeV-powheg-pythia8/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T0_CH_CERN T1_ES_PIC T2_EE_Estonia
38 /WminusToTauNu_CT10_13TeV-powheg-pythia8-tauola/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T1_ES_PIC T2_PT_NCG T2_US_Purdue
39 /TBarToLeptons_t-channel_Tune4C_CSA14_13TeV-aMCatNLO-tauola/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T0_CH_CERN T1_IT_CNAF T2_BE_UCL
40 /GJets_HT-400to600_Tune4C_13TeV-madgraph-tauola/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_UK_RAL T2_FR_GRIF_LLR
41 /Neutrino_Pt-2to20_gun/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T1_US_FNAL T2_IT_Pisa
42 /GJet_Pt-15to3000_Tune4C_13TeV_pythia8/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_FR_CCIN2P3 T2_IT_Bari T3_TW_NCU T3_US_Rutgers
43 /ChicToJpsiGamma_MuFilter_13TeV_Pythia6-evtgen/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T0_CH_CERN T1_IT_CNAF T2_TW_Taiwan
44 /QCD_Pt-50to80_MuEnrichedPt5_Tune4C_13TeV_pythia8/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T0_CH_CERN T1_US_FNAL T2_RU_JINR
45 /WplusToMuNu_CT10_13TeV-powheg-pythia8/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T0_CH_CERN T1_ES_PIC T2_IT_Legnaro
46 /WminusToMuNu_CT10_13TeV-powheg-pythia8/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T0_CH_CERN T1_UK_RAL T2_RU_JINR
47 /GJet_Pt20to40_doubleEMEnriched_TuneZ2star_13TeV-pythia6/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T1_IT_CNAF T1_UK_RAL T2_TW_Taiwan T3_TW_NCU
48 /QCD_Pt-30to50_MuEnrichedPt5_Tune4C_13TeV_pythia8/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T0_CH_CERN T1_US_FNAL T2_US_Nebraska
49 /WminusToTauNu_CT10_13TeV-powheg-pythia8-tauola/Spring14dr-PU20bx25_POSTLS170_V5-v1/AODSIM T1_ES_PIC T2_US_UCSD
50 /TT_Tune4C_13TeV-pythia8-tauola/Spring14dr-PU_S14_POSTLS170_V6-v1/AODSIM T1_US_FNAL T2_CH_CERN T2_UA_KIPT

Site number Site name
1 T2_US_Nebraska
2 T2_US_Purdue
3 T2_RU_JINR
4 T2_IN_TIFR
5 T2_US_Wisconsin
6 T2_US_Vanderbilt
7 T2_UK_London_IC
8 T2_US_Florida
9 T2_ES_IFCA
10 T2_BR_Sprace
11 T2_UK_Brunel
12 T2_AT_Vienna
13 T2_US_Caltech

Templates

It is planned to reach the full load (20K running jobs from HC) by having one functional test per dataset, so 50 in total. Therefore each functional test should run around 400 concurrent jobs. The load will be ramped up by creating one functional test per site to begin with, and adding one more functional test per site at each increase. Datasets will be uniquely assigned to sites and sites will be uniquely assigned to users. The association is planned as in the following table, where templates are ordered by time of creation:

Template name User name Site name Dataset number (<ds>)
CSA14_U1_S1_D<ds> mmascher T2_US_Nebraska 1 13 25 37  
CSA14_U1_S2_D<ds> mmascher T2_US_Purdue 2 14 26 38  
CSA14_U1_S3_D<ds> mmascher T2_RU_JINR 3 15 27 39  
CSA14_U1_S4_D<ds> mmascher T2_IN_TIFR 4 16 28 40  
CSA14_U2_S5_D<ds> sciaba T2_US_Wisconsin 5 17 29 41  
CSA14_U2_S6_D<ds> sciaba T2_US_Vanderbilt 6 18 30 42  
CSA14_U2_S7_D<ds> sciaba T2_UK_London_IC 7 19 31 43  
CSA14_U2_S8_D<ds> sciaba T2_US_Florida 8 20 32 44  
CSA14_U3_S9_D<ds> jbalcas T2_ES_IFCA 9 21 33 45  
CSA14_U3_S10_D<ds> jbalcas T2_BR_Sprace 10 22 34 46  
CSA14_U3_S11_D<ds> jbalcas T2_UK_Brunel 11 23 35 47  
CSA14_U3_S12_D<ds> jbalcas T2_AT_Vienna 12 24 36 48  
CSA14_U3_S13_D<ds> jbalcas T2_US_Caltech 50 49 3 35  

-- AndreaSciaba - 11 Jul 2014

Edit | Attach | Watch | Print version | History: r7 < r6 < r5 < r4 < r3 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r7 - 2014-07-22 - JustasBalcas
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback