Temporary Tool to Replicate SampleA Events

  • This tool is used as a temporrary solution for data replication. One should use DDM when it will be in production.

  • The tool was tested on lxplus.cern.ch and used to replicate files from the official MC production onto CERN Castor. It should be easy to use it on, at least, other Castor sites.

  • It runs interactively and copies files (not already available on the target directory) from the 3 grids (OSG, Nordugrid and LCG). Only LCG files are registered on the LCG Grid (as it was already done) .

Installation and configuration

  1. Sources of the program are placed in ~jezequel/public/copy_phys_validation
  2. Copy the directory /afs/cern.ch/home/j/jezequel/public/copy_phys_validation on your account
  3. The files samples_0x.txt contain the list of datasets to be copied. The 0x refers to the subversion of transformation (see createCastorDir.py). The list of dataset is available here
  4. Edit the python script createCastorDir.py and set the following variables
    • Main_version: Athena version
      • Example : 110003
    • sub_version: value of the subversion transformation
      • Example: 01
    • basedir: Initiator of the castor directory
      • Example: /castor/cern.ch/atlas/csc/valiprod/sampleA
    • jobtype: recon or simul
    • filetype : AOD or ESD or CBNT for recon , RDO or HITS for simul

Proceed

  1. Initialize your Grid Certificate (grid-proxy-init)
  2. Run : ./run_copy.csh (sets the LFC variables and start the python command createCastorDir.py)
  3. Files are copied on : basedir/mc11/dataset/jobtype/main_version+sub_version/
    • Example: /castor/cern.ch/atlas/csc/valiprod/sampleA/mc11/004861.pyt_WH120_munuuu/recon/v11000301
  4. Results are filled in output/dataset.jobtype.filetype.xxx.log
    • Example: output/004201.ZeeJimmy.recon.AOD.17349.log.
The output lists succeeded and unsucceeded transfers. In case of problems, the location of the original file is given.

Any comment or request to : jezequel@lappNOSPAMPLEASE.in2p3.fr

-- StephaneJezequel - 19 Jan 2006

Edit | Attach | Watch | Print version | History: r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r2 - 2020-08-19 - TWikiAdminUser
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Sandbox/SandboxArchive All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2023 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback