- This tool is used as a temporrary solution for data replication. One should use DDM when it will be in production.
- The tool was tested on lxplus.cern.ch and used to replicate files from the official MC production onto CERN Castor. It should be easy to use it on, at least, other Castor sites.
- It runs interactively and copies files (not already available on the target directory) from the 3 grids (OSG, Nordugrid and LCG). Only LCG files are registered on the LCG Grid (as it was already done) .
Installation and configuration
- Sources of the program are placed in ~jezequel/public/copy_phys_validation
- Copy the directory /afs/cern.ch/home/j/jezequel/public/copy_phys_validation on your account
- The files samples_0x.txt contain the list of datasets to be copied. The 0x refers to the subversion of transformation (see createCastorDir.py). The list of dataset is available here
- Edit the python script createCastorDir.py and set the following variables
- Main_version: Athena version
- sub_version: value of the subversion transformation
- basedir: Initiator of the castor directory
- Example: /castor/cern.ch/atlas/csc/valiprod/sampleA
- jobtype: recon or simul
- filetype : AOD or ESD or CBNT for recon , RDO or HITS for simul
Proceed
- Initialize your Grid Certificate (grid-proxy-init)
- Run : ./run_copy.csh (sets the LFC variables and start the python command createCastorDir.py)
- Files are copied on : basedir/mc11/dataset/jobtype/main_version+sub_version/
- Example: /castor/cern.ch/atlas/csc/valiprod/sampleA/mc11/004861.pyt_WH120_munuuu/recon/v11000301
- Results are filled in output/dataset.jobtype.filetype.xxx.log
- Example: output/004201.ZeeJimmy.recon.AOD.17349.log.
The output lists succeeded and unsucceeded transfers. In case of problems, the location of the original file is given.
Any comment or request to :
jezequel@lappNOSPAMPLEASE.in2p3.fr
--
StephaneJezequel - 19 Jan 2006