T2-D Commissioning procedure

This page outlines the administrative and technical steps needed to commission a site as a T2-D ("a Tier-2 with Data").

  • The site agrees to meet the requirements for being an LHCb T2-D: 100 TB to start with, moving up to 300 TB within a year.
  • The site nominates a Tier-2 contact and deputy, who join the lhcb-tier2 mailing list
  • Hardware configuration:
    • Disk storage (dCache, DPM or other) with an SRM service
    • LHCb-Disk SRM space token (LHCb_USER is optional and not counted in the T2-D pledge. It may be used by local users who want to use it as local Grid storage.)
    • As much as possible provide an xrootd access, through SRM with WAN access (in order to be able to federate storage elements)


T2DCriteria lists the metrics and criteria which T2-D sites agree to meet in the LHCb internal note on T2-D sites.

LHCbDirac configuration

  • The DIRAC SEs use the DIRAC site name as their prefix (eg Manchester, or RAL-HEP), and -DST or _MC-DST as their suffix. Let's call it #Site#. They are placed in /Resources/StorageElements/#Site#-DST and /Resources/StorageElements/#Site#_MC-DST The existing and inconsistent hyphen vs undescore naming is followed! The site should be able to supply the options about their storage system (eg file paths) but they can also be discovered from the BDII. Find the site's LCG name (#LCGSiteName#) from the CS Name= option (or from the GOCDB if absent, and then insert it in CS), and then use something like ldapsearch -x -H ldap://lcg-bdii.gridpp.ac.uk:2170 -b 'Mds-Vo-name=#LCGSiteName#,Mds-Vo-name=local,o=grid' and look at the LHCb-Disk section. In particular, the value of Path in the CS can be found from GlueVOInfoPath in the BDII. If the site is publishing a path ending in "lhcb" we remove that. Any trailing slash should be removed too. The Port option in the CS can be found by examining the BDII section with GlueServiceType: SRM and then looking at the GlueServiceEndpoint.

  • In the site's section under /Resources/Sites/LCG/LCG.#Site#.xx the SEs defined above are listed as the value of the SE option.

  • After allowing this new configuration to be picked up (couple of minutes) it can be tested with dirac-dms-add-file and dirac-dms-replicate-lfn. Errors should be ignored for non-production files as they are a "feature" of using the BK as catalog. Should be fixed soon..
Uploading and removing a file (replace by your LFC directory name and a local file):

[lxplus421] ~ $ dirac-dms-add-file /lhcb/user/p/phicharp/myTestFile.txt myTestFile.txt CBPF-DST

Uploading /lhcb/user/p/phicharp/myTestFile.txt 
putAndRegister: Failed to register file. /lhcb/user/p/phicharp/myTestFile.txt {'BookkeepingDB': 'File does not exist'}
Successfully uploaded file to CBPF-DST 
[lxplus421] ~ $ dirac-dms-lfn-replicas /lhcb/user/p/phicharp/myTestFile.txt
Successful : 
    /lhcb/user/p/phicharp/myTestFile.txt : 
        CBPF-DST : srm://se.cat.cbpf.br/dpm/cat.cbpf.br/home/lhcb/user/p/phicharp/myTestFile.txt
[lxplus421] ~ $ dirac-dms-remove-files /lhcb/user/p/phicharp/myTestFile.txt
Successfully removed 1 files 
Failed to remove 1 files with error: No such file or directory 

Replicating a production file and removing the replica (use a production proxy!):

[localhost, Patch] ~ $ dirac-dms-replicate-lfn /lhcb/MC/2012/ALLSTREAMS.DST/00024404/0000/00024404_00000067_1.allstreams.dst CBPF_MC-DST
Successful : 
    CBPF_MC-DST : 
        /lhcb/MC/2012/ALLSTREAMS.DST/00024404/0000/00024404_00000067_1.allstreams.dst : 
             register : 0.381062030792
            replicate : 274.729695082

[localhost, Patch] ~ $ dirac-dms-lfn-replicas /lhcb/MC/2012/ALLSTREAMS.DST/00024404/0000/00024404_00000067_1.allstreams.dst
Successful : 
    /lhcb/MC/2012/ALLSTREAMS.DST/00024404/0000/00024404_00000067_1.allstreams.dst : 
         CBPF_MC-DST : srm://se.cat.cbpf.br/dpm/cat.cbpf.br/home/lhcb/MC/2012/ALLSTREAMS.DST/00024404/0000/00024404_00000067_1.allstreams.dst
        IN2P3_MC-DST : srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/MC/2012/ALLSTREAMS.DST/00024404/0000/00024404_00000067_1.allstreams.dst

[localhost, Patch] ~ $ dirac-dms-lfn-accessURL /lhcb/MC/2012/ALLSTREAMS.DST/00024404/0000/00024404_00000067_1.allstreams.dst CBPF_MC-DST
Successful : 
    CBPF_MC-DST : 
        /lhcb/MC/2012/ALLSTREAMS.DST/00024404/0000/00024404_00000067_1.allstreams.dst : root://something.cat.cpbf.br:1094/home/lhcb/MC/2012/ALLSTREAMS.DST/00024404/0000/00024404_00000067_1.allstreams.dst

[localhost, Patch] ~ $ dirac-dms-remove-replicas /lhcb/MC/2012/ALLSTREAMS.DST/00024404/0000/00024404_00000067_1.allstreams.dst CBPF_MC-DST
Successfully removed 1 files from CBPF_MC-DST 

To be included in the list of replicas from dirac-dms-lfn-replicas, the SE must be enabled ReadAccess when the SEs are listed with dirac-dms-show-se-status

  • The new site should be configured in the FTS transfer system and FTS transfer tested.
For testing you can run those commands, choosing an LFN and replace CERN-DST-EOS by a site at which it is not. For MC, use names like RAL_MC-DST and CERN_MC-DST:

dirac-dms-replicate-and-register-request certifyT2D #LFN# #Site#-DST
dirac-rms-request #ReqID#

  • The #Site#-DST SE is added in the CS to /Operations/Defaults/TransformationPlugins/LHCbDSTBroadcast/SecondarySEs
  • The #Site#_MC-DST SE is added in the CS to /Operations/Defaults/TransformationPlugins/LHCbMCDSTBroadcastRandom/SecondarySEs

Edit | Attach | Watch | Print version | History: r26 < r25 < r24 < r23 < r22 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r26 - 2018-12-19 - ChristopheHaen
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LHCb All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback