Notes on grid stuff


  • example grid commands:
    • lcg-ls command for a file at Caltech:
      lcg-ls -l -b -D srmv2 'srm://cit-se.ultralight.org:8443/srm/v2/server?SFN=/mnt/hadoop/store/mc/Summer09/MinBias/GEN-SIM-RAW/MC_31X_V3-v1/0002/D623BA18-DE7E-DE11-9AE0-001AA00AA049.root'
  • lcg-cp command example for this file at Caltech:
    lcg-cp  -b -D srmv2 'srm://cit-se.ultralight.org:8443/srm/v2/server?SFN=/mnt/hadoop/store/mc/Summer09/MinBias/GEN-SIM-RAW/MC_31X_V3-v1/0002/D623BA18-DE7E-DE11-9AE0-001AA00AA049.root' file:///tmp/ah/D623BA18-DE7E-DE11-9AE0-001AA00AA049.root

Examples of LFN to PFN mappings:

LFN is the logical file name (of an official CMS production file) starting with /store/... in the following table.

Site lcg-ls command tested on
T2_ES_CIEMAT lcg-ls -b -D srmv2 "srm://srm.ciemat.es:8443/srm/managerv2?SFN=/pnfs/ciemat.es/data/cms/prod/$LFN" 2010-08-24
T1_US_FNAL lcg-ls -b -D srmv2 "srm://cmssrm.fnal.gov:8443/srm/managerv2?SFN=/11/$LFN" 2011-02-04, 2012-02-13
T2_BE_UCL lcg-ls -b -D srmv2 "srm://ingrid-se02.cism.ucl.ac.be:8444/srm/managerv2?SFN=/storage/data/cms/$LFN" 2012-02-27
T2_US_Florida lcg-ls -b -D srmv2 "srm://srm.ihepa.ufl.edu:8443/srm/v2/server?SFN=/cms/data$LFN" 2014-01-08
T1_DE_KIT lcg-ls -b -D srmv2 "srm://cmssrm-kit.gridka.de:8443/srm/managerv2?SFN=/pnfs/gridka.de/cms/disk-only/$LFN" 2014-11-17 (dataset marked as disk only for this site in DAS)

2010-08-24

  • listing files in CERN CASTOR from UAF:
 lcg-ls  -b -D srmv2 "srm://srm-cms.cern.ch:8443//srm/managerv2?SFN=/castor/cern.ch/user/a/aholz/2010-ecal-spikes-simu-4/"

  • copying from CERN castor to uaf:
 lcg-cp --verbose -b -D srmv2 "srm://srm-cms.cern.ch:8443//srm/managerv2?SFN=/castor/cern.ch/user/a/aholz/2010-ecal-spikes-simu-4/simevent_99.root" file:/tmp/simevent_99.root

see also http://www.uscms.org/uscms_at_work/physics/lpc/support/lpc_computing/LPC_FAQs.shtml for some examples

  • Chris Palmer suggested the use of srmcp.



  • how to get the PFN for an LFN at a given site ?
    • go to http://cvs.web.cern.ch/cvs/cgi-bin/viewcvs.cgi/COMP/SITECONF/ and get the storage.xml file for the site you're interested in. E.g. for CIEMAT, this is T2_ES_CIEMAT/PhEDEx/storage.xml (note that there is another directory containing CIEMAT which is empty).
    • this file contains a mapping of regexps to physical file names. Not clear to me whether the first matching or any of the matching can be taken. I have somehow the impression that one after another is applied to produce transformations...

Misc.

How can I translate a logical filename (LFN) to a physical one (PFN) ?

See the wget command example at this link in the section 'How can the data be accessed? What is the local path?'

-- AndreHolzner - 16-Apr-2010

Edit | Attach | Watch | Print version | History: r9 < r8 < r7 < r6 < r5 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r9 - 2014-11-17 - AndreHolzner
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback