TMD Recipes

%COMPLETE1%

Ntuplizing multiple datasets at FNAL (OpenHlt)

Code

a bunch of scripts and template files brew.py makeJobs.sh getDS.sh submitJobs.sh Run_JSON.txt.template crab.cfg.template HLTAnalysis_cfg.py.template

Ntuplizing

  • create a working area in a CMSSW release (357 works)
  • copy the above code /checkout the scripts and templates from cvs
cvs co ....
  • edit crab.cfg.template and modify the storage_path to point to your dCache area (resilient/yourusername/yoursubdirectory)
  • pick a run you want to ntuplize (run list : cmswbm, https://cmswbm.web.cern.ch/ , run summary )
  • choose which datasets you want to ntuplize
getDS.sh contains a dbssql commands that queries for ALL the DS available, you can run the script separately ./getDS.sh RUNNUMBER. This produces two outputs : one, dbsql_rrunnumber, with the full list of available datasets for the run you chose, second, brewInput, the list of dataset to be ntuplized. You can modify this list by editing getDS.sh :
for dataset in Cosmics Commissioning EG EGMonitor JetMETTau JetMETTauMonitor MinimumBias Mu MuMonitor; do 
->for dataset in [your list of datasets]; do
./makeJobs.sh ${RUNNUMBER}
This runs getDS.sh, then brew.py, and creates a subdirectory called r${RUNNUMBER} where you should then submit the jobs :
cd r${RUNNUMBER}
submitJobs.sh ${RUNNUMBER}
This does NOT submit the jobs, just prints you the commands you have to copy and paste.
  • when the jobs are done, you can copy them to CERN : edit copyFilesToCern.sh, change resilient/lucieg/Commish2010 to resilient/yourusername/yoursubdirectory and user/l to user/first letter of your user name (assuming you have the same username at fnal and cern) and ./copyFilesToCern.sh ${RUNNUMBER}

Troubleshooting :

-- LucieGAUTHIER - 10-Jun-2010

Edit | Attach | Watch | Print version | History: r7 < r6 < r5 < r4 < r3 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r5 - 2010-06-14 - LucieGAUTHIER
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback