How to submit a FTS job.

This procedure gives the new Data Manager some low level tools in order to verify his capability to interact with FTS grid services. Please not that the updated list of FTS endpoints is available in the DIRAC CS section /Resources/FTSEndpoints. For sake of simplicity we reported here hard-coded endpoints.
  • Create a valid grid environment
     source /afs/cern.ch/project/gd/LCG-share/sl5/etc/profile.d/grid-env.sh 
  • Create a valid voms proxy with production capability
     voms-proxy-init --voms lhcb:/lhcb/Role=production
  • Delegate you proxy to the FTS endpoints that you want to test
    glite-delegation-init  -e 600 -f -s  https://fts.grid.sara.nl:8443/glite-data-transfer-fts/services/gridsite-delegation
    glite-delegation-init  -e 600 -f -s https://fts-fzk.gridka.de:8443/glite-data-transfer-fts/services/gridsite-delegation
    glite-delegation-init  -e 600 -f -s https://fts.cr.cnaf.infn.it:8443/glite-data-transfer-fts/services/gridsite-delegation
    glite-delegation-init  -e 600 -f -s https://lcgfts.gridpp.rl.ac.uk:8443/glite-data-transfer-fts/services/gridsite-delegation
    glite-delegation-init  -e 600 -f -s https://fts.pic.es:8443/glite-data-transfer-fts/services/gridsite-delegation
    glite-delegation-init  -e 600 -f -s https://cclcgftsprod.in2p3.fr:8443/glite-data-transfer-fts/services/gridsite-delegation
    glite-delegation-init  -e 600 -f -s https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/gridsite-delegation
     
  • Submit your jobs against the 7 FTS servers currently in use by LHCb
    glite-transfer-submit -s https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer -t LHCb_DST -f /tmp/inputfile
    d8ca5dd6-fee9-11df-ae99-fb422e02068f
    
    where the file inputfile contains the pairs "source destination" of the test files you want to transfer. Note that FTS services outside CERN manage all incoming transfers. This means that in order to test other FTS servers the input file describing the pairs will look different. To ease the life I report at the end of this document some examples of input files to be used per each FTS server at T1.
     $ cat /tmp/inputfile 
    srm://srm-lhcb.cern.ch/castor/cern.ch/grid/lhcb/test/zz_zz.f srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/temp/CERN_NewDataManager
    
    The submission returns back a guid that identifies the transfer job and that can be used for the subsequent query status.
  • Query the status of your transfer as in the example below
    glite-transfer-status -l -s https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer d8ca5dd6-fee9-11df-ae99-fb422e02068f
    Finished
      Source:      srm://srm-lhcb.cern.ch/castor/cern.ch/grid/lhcb/test/zz_zz.f
      Destination: srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/temp/CERN_NewDataManager
      State:       Finished
      Retries:     0
      Reason:      (null)
      Duration:    15
    
  • Iterate the above points for all FTS endpoints listed below:
    export FTS_FZK="https://fts-fzk.gridka.de:8443/glite-data-transfer-fts/services/FileTransfer"
    export FTS_IN2P3="https://cclcgftsprod.in2p3.fr:8443/glite-data-transfer-fts/services/FileTransfer"
    export FTS_CNAF="https://fts.cr.cnaf.infn.it:8443/glite-data-transfer-fts/services/FileTransfer"
    export FTS_RAL="https://lcgfts.gridpp.rl.ac.uk:8443/glite-data-transfer-fts/services/FileTransfer"
    export FTS_SARA="https://fts.grid.sara.nl:8443/glite-data-transfer-fts/services/FileTransfer"
    export FTS_PIC="https://fts.pic.es:8443/glite-data-transfer-fts/services/FileTransfer"
    
    using the respective input files
    
    > cat input4FZK
    srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/zz_zz.f srm://gridka-dCache.fzk.de/pnfs/gridka.de/lhcb/test/roberto/temp/IN2P3_1.30123
    
    > cat input4IN2P3
    srm://srmlhcb.pic.es/pnfs/pic.es/data/lhcb/test/roberto/zz_zz.f srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/temp/PIC_1.30123
    
    > cat input4CNAF
    srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/test/roberto/zz_zz.f srm://storm-fe-lhcb.cr.cnaf.infn.it/t0d1/lhcb/test/roberto/temp/IN2P3_1.30123
    
    > cat input4RAL
    srm://gridka-dCache.fzk.de/pnfs/gridka.de/lhcb/test/roberto/zz_zz.f srm://srm-lhcb.gridpp.rl.ac.uk/castor/ads.rl.ac.uk/prod/lhcb/test/roberto/temp/FZK_1.30123
    
    > cat input4SARA
    srm://srm-lhcb.gridpp.rl.ac.uk/castor/ads.rl.ac.uk/prod/lhcb/test/roberto/zz_zz.f srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lhcb/test/roberto/temp/RAL_1.30123
    
    > cat input4PIC
    srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/lhcb/test/roberto/zz_zz.f srm://srmlhcb.pic.es/pnfs/pic.es/data/lhcb/test/roberto/temp/SARA_1.30123
    

Verifying the administrator role of the Data Manager.

Only the Data Manager, once granted the administrative role on the FTS, can run this command that lists the administrators of the channel
> source /afs/cern.ch/project/gd/LCG-share/sl5/etc/profile.d/grid-env.sh
> voms-proxy-init --voms lhcb:/lhcb/Role=production
> glite-transfer-listvomanagers -s https://fts22-t0-export.cern.ch:8443/glite-data-transfer-fts/services/FileTransfer lhcb

-- RobertoSantinel - 03-Dec-2010


This topic: LHCb > WebHome > LHCbComputing > ProductionProcedures > HowToChangeDataManager > HowToSubmitFTSJobs
Topic revision: r2 - 2010-12-03 - unknown
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback