How to submit a FTS job.
This procedure gives the new Data Manager some low level tools in order to verify his capability to interact with FTS grid services. Please not that the updated list of FTS endpoints is available in the DIRAC CS section /Resources/FTSEndpoints. For sake of simplicity we reported here hard-coded endpoints.
- Create a valid grid environment
source /afs/cern.ch/project/gd/LCG-share/sl5/etc/profile.d/grid-env.sh
- Create a valid voms proxy with production capability
voms-proxy-init --voms lhcb:/lhcb/Role=production
- Delegate you proxy to the FTS endpoints that you want to test
glite-delegation-init -e 600 -f -s https://fts.grid.sara.nl:8443/glite-data-transfer-fts/services/gridsite-delegation
glite-delegation-init -e 600 -f -s https://fts-fzk.gridka.de:8443/glite-data-transfer-fts/services/gridsite-delegation
glite-delegation-init -e 600 -f -s https://fts.cr.cnaf.infn.it:8443/glite-data-transfer-fts/services/gridsite-delegation
glite-delegation-init -e 600 -f -s https://lcgfts.gridpp.rl.ac.uk:8443/glite-data-transfer-fts/services/gridsite-delegation
glite-delegation-init -e 600 -f -s https://fts.pic.es:8443/glite-data-transfer-fts/services/gridsite-delegation
glite-delegation-init -e 600 -f -s https://cclcgftsprod.in2p3.fr:8443/glite-data-transfer-fts/services/gridsite-delegation
glite-delegation-init -e 600 -f -s https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/gridsite-delegation
- Submit your jobs against the 7 FTS servers currently in use by LHCb
glite-transfer-submit -s https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer -t LHCb_DST -f /tmp/inputfile
d8ca5dd6-fee9-11df-ae99-fb422e02068f
where the file inputfile contains the pairs "source destination" of the test files you want to transfer. Note that FTS services outside CERN manage all incoming transfers. This means that in order to test other FTS servers the input file describing the pairs will look different. To ease the life I report at the end of this document some examples of input files to be used per each FTS server at T1.
$ cat /tmp/inputfile
srm://srm-lhcb.cern.ch/castor/cern.ch/grid/lhcb/test/zz_zz.f srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/temp/CERN_NewDataManager
The submission returns back a guid that identifies the transfer job and that can be used for the subsequent query status.
- Query the status of your transfer as in the example below
glite-transfer-status -l -s https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer d8ca5dd6-fee9-11df-ae99-fb422e02068f
Finished
Source: srm://srm-lhcb.cern.ch/castor/cern.ch/grid/lhcb/test/zz_zz.f
Destination: srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/temp/CERN_NewDataManager
State: Finished
Retries: 0
Reason: (null)
Duration: 15
- Iterate the above points for all FTS endpoints listed below:
export FTS_FZK="https://fts-fzk.gridka.de:8443/glite-data-transfer-fts/services/FileTransfer"
export FTS_IN2P3="https://cclcgftsprod.in2p3.fr:8443/glite-data-transfer-fts/services/FileTransfer"
export FTS_CNAF="https://fts.cr.cnaf.infn.it:8443/glite-data-transfer-fts/services/FileTransfer"
export FTS_RAL="https://lcgfts.gridpp.rl.ac.uk:8443/glite-data-transfer-fts/services/FileTransfer"
export FTS_SARA="https://fts.grid.sara.nl:8443/glite-data-transfer-fts/services/FileTransfer"
export FTS_PIC="https://fts.pic.es:8443/glite-data-transfer-fts/services/FileTransfer"
using the respective input files
> cat input4FZK
srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/zz_zz.f srm://gridka-dCache.fzk.de/pnfs/gridka.de/lhcb/test/roberto/temp/IN2P3_1.30123
> cat input4IN2P3
srm://srmlhcb.pic.es/pnfs/pic.es/data/lhcb/test/roberto/zz_zz.f srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/temp/PIC_1.30123
> cat input4CNAF
srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/zz_zz.f srm://storm-fe-lhcb.cr.cnaf.infn.it/t0d1/lhcb/test/roberto/temp/IN2P3_1.30123
> cat input4RAL
srm://gridka-dCache.fzk.de/pnfs/gridka.de/lhcb/test/roberto/zz_zz.f srm://srm-lhcb.gridpp.rl.ac.uk/castor/ads.rl.ac.uk/prod/lhcb/test/roberto/temp/FZK_1.30123
> cat input4SARA
srm://srm-lhcb.gridpp.rl.ac.uk/castor/ads.rl.ac.uk/prod/lhcb/test/roberto/zz_zz.f srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lhcb/test/roberto/temp/RAL_1.30123
> cat input4PIC
srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lhcb/test/roberto/zz_zz.f srm://srmlhcb.pic.es/pnfs/pic.es/data/lhcb/test/roberto/temp/SARA_1.30123
--
RobertoSantinel - 03-Dec-2010
Topic revision: r1 - 2010-12-03
- unknown