This twiki explains how to use the preparelocal CRAB command (https://twiki.cern.ch/twiki/bin/view/CMSPublic/CRAB3Commands#crab_preparelocal) to send jobs to the CERN condor pool (http://batchdocs.web.cern.ch/batchdocs/local/submit.html)

cmsrel CMSSW_8_0_29 #CMSSW version taken from https://cmsweb.cern.ch/crabserver/ui
cd CMSSW_8_0_29
cmsenv
source /cvmfs/cms.cern.ch/crab3/crab.sh
mkdir ~/wf/test
cd ~/wf/test
crab remake --task=180522_171053:atittert_crab_nmssmP1SignalCascadeV01_13TeV2016_processMc01_ed80X_P1_v1_1600sq_1610go_180X2
crab preparelocal crab_nmssmP1SignalCascadeV01_13TeV2016_processMc01_ed80X_P1_v1_1600sq_1610go_180X2
cd /afs/cern.ch/user/m/mmascher/wf/test/crab_nmssmP1SignalCascadeV01_13TeV2016_processMc01_ed80X_P1_v1_1600sq_1610go_180X2/local
mkdir out; mkdir err; mkdir log

Create the following condor JDL file (maybe it can be automated by the preparelocal?):

Universe = vanilla

Executable = run_job.sh
Arguments = $(I)

Log = log/job.$(Cluster).$(Process).log
Output = out/job.out.$(Cluster).$(Process)
Error = err/job.err.$(Cluster).$(Process)
transfer_input_files = CMSRunAnalysis.sh, CMSRunAnalysis.tar.gz, InputArgs.txt, Job.submit, cmscp.py, gWMS-CMSRunAnalysis.sh, input_files.tar.gz, run_and_lumis.tar.gz, sandbox.tar.gz

should_transfer_files = YES
RequestCpus = 1
RequestMemory = 2000

when_to_transfer_output = ON_EXIT

+JobFlavour = "workday"

Queue I from (
1
2
3
4
)

This will only submit the first 4 jobs of the task.

Add #!/bin/bash at the beginning of run_job.sh and make it executable.

Submit the task with:

condor_submit task.jdl

And check the status with:

condor_q -nobatch

-- MarcoMascheroni - 2018-06-06

Edit | Attach | Watch | Print version | History: r5 | r4 < r3 < r2 < r1 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r1 - 2018-06-06 - MarcoMascheroni
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback