MC Production for LCWS07

Samples for 2006 CERN testbeam data, generated April/May 2007 for use in LCWS07 analyses.

Job submission was using simple edg-job-submit commands, repeatedly submitting the same script to generate additional lcio files for each testbeam run to be simulated. The shell script to run Mokka used the process id of the process running the script to seed the G4 random number generator, by cat'ing this into the Mokka macro immediately before starting to run the binary on each grid CE.

The code used can be found in the world readable directory
/afs/rl.ac.uk/user/w/watson/public/mygrid/MOKKA_GRID_RUNS

Job submission was via the scripts, such as:
rwxr-xr-x 1 watson 34607 4384 Apr 19 2007 submit_mokka_ecal_apr18.perl
-rwxr-xr-x 1 watson 34607 4667 Apr 19 2007 submit_mokka_ecal_test.perl
-rwxr-xr-x 1 watson 34607 4389 Apr 19 2007 submit_mokka_ecal_apr19.perl
-rwxr-xr-x 1 watson 34607 4470 Apr 20 2007 submit_mokka_ecal_apr20.perl
-rwxr-xr-x 1 watson 34607 4461 May 17 2007 submit_mokka_ecal_apr24.perl

The script used to run each individual Mokka job can be found at:
-rwxr-xr-x 1 watson 7.6K Apr 20 2007 run_mokka4.sh


The Mokka steering files and macros can be found at:
-rw-r--r-- 1 watson 799 Apr 18 2007 r300195.steer
-rw-r--r-- 1 watson 666 Apr 18 2007 r300670.steer
-rw-r--r-- 1 watson 1.1K Apr 18 2007 r300365.steer
-rw-r--r-- 1 watson 1.1K Apr 18 2007 r300317.steer
-rw-r--r-- 1 watson 802 Apr 18 2007 r300207.steer
-rw-r--r-- 1 watson 1.1K Apr 18 2007 r300303.steer
-rw-r--r-- 1 watson 664 Apr 18 2007 r230252.steer
-rw-r--r-- 1 watson 717 Apr 18 2007 r300676.steer
-rw-r--r-- 1 watson 717 Apr 18 2007 r300672.steer
-rw-r--r-- 1 watson 666 Apr 18 2007 r230248.steer
-rw-r--r-- 1 watson 662 Apr 18 2007 r230243.steer

The Mokka macros used are in the same directory, as:
-rw-r--r-- 1 watson 259 Apr 17 2007 r300670.mac
-rw-r--r-- 1 watson 258 Apr 17 2007 r300365.mac
-rw-r--r-- 1 watson 258 Apr 17 2007 r300317.mac
-rw-r--r-- 1 watson 258 Apr 17 2007 r300303.mac
-rw-r--r-- 1 watson 258 Apr 17 2007 r300207.mac
-rw-r--r-- 1 watson 258 Apr 17 2007 r300195.mac
-rw-r--r-- 1 watson 254 Apr 17 2007 r230248.mac
-rw-r--r-- 1 watson 259 Apr 17 2007 r300676.mac
-rw-r--r-- 1 watson 260 Apr 17 2007 r300672.mac
-rw-r--r-- 1 watson 257 Apr 17 2007 r230252.mac
-rw-r--r-- 1 watson 252 May 15 2007 r230243.mac


The lcio output and stdout from the jobs are available on the grid at:
/grid/calice/watson/prodsamples/lcio
/grid/calice/watson/prodsamples/logs

After the difficulty experienced trying to monitor jobs on the grid by hand using native edg commands, I quickly changed to using Ganga for job submission, much more intuitive, gives sensible and straightforward monitoring of job status, retrieval of job output, and support for multiple sets of related jobs, i.e. job splitting mechanisms to allow you to run high statistics by separating jobs into smaller sub-samples. The slightly modified scripts I used since then to run Mokka via Ganga can be found in this same afs directory, e.g.:
-rwxr-xr-x 1 watson 34607 7963 Oct 30 16:19 grun_mokka5_tb.sh
-rwxr-xr-x 1 watson 34607 7993 Jun 21 2007 grun_mokka4_maps.sh

The .perl scripts are replaced by defining the .steer, .mac, and .sh for each job via the Ganga gui (I always run ganga --gui).



-- NigelWatson - 20 Dec 2007

Edit | Attach | Watch | Print version | History: r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r2 - 2007-12-21 - NigelWatson
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CALICE All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback