How to submit a FTS job.

This procedure gives the new Data Manager some low level tools in order to verify his capability to interact with FTS grid services. Please not that the updated list of FTS endpoints is available in the DIRAC CS section /Resources/FTSEndpoints. For sake of simplicity we reported here hard-coded endpoints.

• Create a valid grid environment

   source /afs/cern.ch/project/gd/LCG-share/sl5/etc/profile.d/grid-env.sh 

• Create a valid voms proxy with production capability

   voms-proxy-init --voms lhcb:/lhcb/Role=production

• Delegate you proxy to the FTS endpoints that you want to test

  glite-delegation-init  -e 600 -f -s  https://fts.grid.sara.nl:8443/glite-data-transfer-fts/services/gridsite-delegation
  glite-delegation-init  -e 600 -f -s https://fts-fzk.gridka.de:8443/glite-data-transfer-fts/services/gridsite-delegation
  glite-delegation-init  -e 600 -f -s https://fts.cr.cnaf.infn.it:8443/glite-data-transfer-fts/services/gridsite-delegation
  glite-delegation-init  -e 600 -f -s https://lcgfts.gridpp.rl.ac.uk:8443/glite-data-transfer-fts/services/gridsite-delegation
  glite-delegation-init  -e 600 -f -s https://fts.pic.es:8443/glite-data-transfer-fts/services/gridsite-delegation
  glite-delegation-init  -e 600 -f -s https://cclcgftsprod.in2p3.fr:8443/glite-data-transfer-fts/services/gridsite-delegation
  glite-delegation-init  -e 600 -f -s https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/gridsite-delegation
   

• Submit your jobs against the 7 FTS servers currently in use by LHCb

  glite-transfer-submit -s https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer -t LHCb_DST -f /tmp/inputfile
  d8ca5dd6-fee9-11df-ae99-fb422e02068f
  

  where the file inputfile contains the pairs "source destination" of the test files you want to transfer. Note that FTS services outside CERN manage all incoming transfers. This means that in order to test other FTS servers the input file describing the pairs will look different. To ease the life I report at the end of this document some examples of input files to be used per each FTS server at T1.

   $ cat /tmp/inputfile 
  srm://srm-lhcb.cern.ch/castor/cern.ch/grid/lhcb/test/zz_zz.f srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/temp/CERN_NewDataManager
  

  The submission returns back a guid that identifies the transfer job and that can be used for the subsequent query status.
• Query the status of your transfer as in the example below

  glite-transfer-status -l -s https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer d8ca5dd6-fee9-11df-ae99-fb422e02068f
  Finished
    Source:      srm://srm-lhcb.cern.ch/castor/cern.ch/grid/lhcb/test/zz_zz.f
    Destination: srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/temp/CERN_NewDataManager
    State:       Finished
    Retries:     0
    Reason:      (null)
    Duration:    15
  

• Iterate the above points for all FTS endpoints listed below:

  export FTS_FZK="https://fts-fzk.gridka.de:8443/glite-data-transfer-fts/services/FileTransfer"
  export FTS_IN2P3="https://cclcgftsprod.in2p3.fr:8443/glite-data-transfer-fts/services/FileTransfer"
  export FTS_CNAF="https://fts.cr.cnaf.infn.it:8443/glite-data-transfer-fts/services/FileTransfer"
  export FTS_RAL="https://lcgfts.gridpp.rl.ac.uk:8443/glite-data-transfer-fts/services/FileTransfer"
  export FTS_SARA="https://fts.grid.sara.nl:8443/glite-data-transfer-fts/services/FileTransfer"
  export FTS_PIC="https://fts.pic.es:8443/glite-data-transfer-fts/services/FileTransfer"
  

  using the respective input files

  
  > cat input4FZK
  srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/zz_zz.f srm://gridka-dCache.fzk.de/pnfs/gridka.de/lhcb/test/roberto/temp/IN2P3_1.30123
  
  > cat input4IN2P3
  srm://srmlhcb.pic.es/pnfs/pic.es/data/lhcb/test/roberto/zz_zz.f srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/temp/PIC_1.30123
  
  > cat input4CNAF
  srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/zz_zz.f srm://storm-fe-lhcb.cr.cnaf.infn.it/t0d1/lhcb/test/roberto/temp/IN2P3_1.30123
  
  > cat input4RAL
  srm://gridka-dCache.fzk.de/pnfs/gridka.de/lhcb/test/roberto/zz_zz.f srm://srm-lhcb.gridpp.rl.ac.uk/castor/ads.rl.ac.uk/prod/lhcb/test/roberto/temp/FZK_1.30123
  
  > cat input4SARA
  srm://srm-lhcb.gridpp.rl.ac.uk/castor/ads.rl.ac.uk/prod/lhcb/test/roberto/zz_zz.f srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lhcb/test/roberto/temp/RAL_1.30123
  
  > cat input4PIC
  srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lhcb/test/roberto/zz_zz.f srm://srmlhcb.pic.es/pnfs/pic.es/data/lhcb/test/roberto/temp/SARA_1.30123
  

-- RobertoSantinel - 03-Dec-2010