Setting up the test
download the test jobs:
cd src/
mkdir Tests
cd Tests/
cvs co -d TestJobs UserCode/leo/Utilities/PerfToolkit/TestJobs/
cd TestJobs/
scram b
Testing
CRAB+CMSSW+SYS
Check that in your test dir the following files are available:
jobscript_cmssw.sh net.sh
Then, create a crab cfg like:
[CRAB]
jobtype = cmssw
scheduler = glite
[CMSSW]
datasetpath=/RelValProdTTbar/JobRobot-MC_3XY_V24_JobRobot-v1/GEN-SIM-DIGI-RECO
pset=JPE.py
total_number_of_events=-1
events_per_job = 50000
output_file = cmssw_net.log, cmssw_vmstat.log, cmssw.xml, cmssw.stdout
[USER]
return_data = 1
ui_working_dir = Site.T2_CH_CSCS-Cfg.JPE-Dataset.RelValProdTTbarJobRobotMC_3XY_V24_JobRobotv1-EventsJo\
b.50000-Sw.CMSSW_3_6_0_pre5-Date.201005041858
additional_input_files = net.sh
script_exe=jobscript_cmssw.sh
copy_data = 0
publish_data=0
publish_data_name = name_you_prefer
[GRID]
rb = CERN
se_black_list = T0,T1
If you want to use some scripts, use the
crab.template
file and the
crab_LaunchIOTestJobs.py
file, like:
crab_LaunchIOTestJobs.py T3_CH_PSI CMSSW_3_7_0_pre4_Brian2nd JPE.py 50000 /RelValProdTTbar/JobRobot-MC_3XY_V24_JobRobot-v1/GEN-SIM-DIGI-RECO
TODO: update the script on
CVS
CMSSW+SYS
If you want to test single jobs (eg from a dedicated WN), then crab is not an option. Use, instead, the
jobscript_standalone_cmssw.sh
script, eg:
./jobscript_standalone_cmssw.sh JPE
please check the
EVENTS
and
SW
variables:
$ cat jobscript_standalone_cmssw.sh
#!/bin/bash
CFG=$1
SW=CMSSW_3_7_0_pre4_Brian2nd
LOG="cmssw"
EVENTS=50000
DIR=Site.T3_CH_PSI-Cfg.${CFG}-Dataset.RelValProdTTbarJobRobotMC_3XY_V24_JobRobotv1-EventsJob.${EVENTS}-Sw.${SW}-Date.`date +%Y%m%d%H%M`-Label.SingleJob
mkdir $DIR
#eval `scram ru -sh`
vmstat -nd 10 &> ${DIR}/${LOG}_vmstat_1.log &
PIDSTAT=$!
./net.sh ${DIR}/${LOG}_net_1.log &
PIDWATCH=$!
sleep 60
( /usr/bin/time cmsRun -j ${DIR}/${LOG}_1.xml ${CFG}.py ) &> ${DIR}/${LOG}_1.stdout
kill -9 $PIDSTAT $PIDWATCH
--
LeonardoSala - 17-May-2010
Topic revision: r2 - 2010-05-17
- unknown