Difference: POOLXMLSlice (1 vs. 2)

Revision 22008-12-02 - StuartPaterson

Line: 1 to 1
 
META TOPICPARENT name="ProductionProcedures"

Generating a POOL XML slice using DIRAC

Line: 10 to 10
 
(paterson@lxplus244)[ ~/w1/DEV-DIRAC3]$ dirac-lhcb-generate-catalog 
Changed:
<
<
Usage: dirac-lhcb-generate-catalog.py |[] --Site= --Catalog=
>
>
Usage: dirac-lhcb-generate-catalog.py |[] --site= --catalog=
 Try --help, -h for more information.
Changed:
<
<
If the Site is not specified this is taken from the local DIRAC configuration e.g. /LocalSite/Site=. On lxplus shared installations it would be sufficient to specify the LFN(s) without a site name. The following two optional arguments are also available on the command line:
>
>
If the Site is not specified this is taken from the local DIRAC configuration e.g. /LocalSite/Site=. On lxplus shared installations it would be sufficient to specify the LFN(s) without a site name. The following optional arguments are also available on the command line:
 
Changed:
<
<
2008-12-02 09:31:38 UTC Framework INFO: -n: --Site= : DIRAC Site Name 2008-12-02 09:31:38 UTC Framework INFO: -f: --Catalog= : Catalogue File Name e.g. can be /path/to/catalog/file.xml, defaults to pool_xml_catalog.xml in PWD
>
>
(paterson@lxplus244)[ ~/w1/DEV-DIRAC3]$ dirac-lhcb-generate-catalog --help 2008-12-02 16:50:57 UTC Framework INFO: Usage: 2008-12-02 16:50:57 UTC Framework INFO: /afs/cern.ch/user/p/paterson/w1/DEV-DIRAC3/DIRAC/./LHCbSystem/scripts/dirac-lhcb-generate-catalog.py (|)* 2008-12-02 16:50:57 UTC Framework INFO: Options: 2008-12-02 16:50:57 UTC Framework INFO: -o: --option= : Option=value to add 2008-12-02 16:50:57 UTC Framework INFO: -s: --section= : Set base section for relative parsed options 2008-12-02 16:50:57 UTC Framework INFO: -c: --cert= : Use server certificate to connect to Core Services 2008-12-02 16:50:57 UTC Framework INFO: -h --help : Shows this help 2008-12-02 16:50:57 UTC Framework INFO: -n: --site= : DIRAC Site Name 2008-12-02 16:50:57 UTC Framework INFO: -f: --catalog= : Catalogue File Name e.g. can be /path/to/catalog/file.xml, defaults to pool_xml_catalog.xml in PWD 2008-12-02 16:50:57 UTC Framework INFO: -d: --depth= : Optional ancestor depth to be queried from the Bookkeeping system
 

As an example:

Line: 97 to 106
 dirac-lhcb-generate-catalog LFN:/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst --Site=LCG.NIKHEF.nl --Catalog=myCat.xml
Changed:
<
<
(paterson@lxplus244)[ ~/w1/DEV-DIRAC3]$ dirac-lhcb-generate-catalog /lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst --Site=LCG.NIKHEF.nl --Catalog=myCat.xml
>
>
(paterson@lxplus244)[ ~/w1/DEV-DIRAC3]$ dirac-lhcb-generate-catalog /lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst --site=LCG.NIKHEF.nl --catalog=myCat.xml
 2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py/DiracAPI INFO: Attempting to resolve data for LCG.NIKHEF.nl 2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py/DiracAPI INFO: Replica Lookup Time: 0.19 seconds 2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py/DiracAPI INFO: Metadata Lookup Time: 0.17 seconds
Line: 145 to 154
  The Catalog option also accepts full paths.
Added:
>
>
Another example using the BK ancestor depth is as follows:

dirac-lhcb-generate-catalog /lhcb/production/DC06/phys-v2-lumi2/00001758/DST/0000/00001758_00000001_5.dst --depth=1 --site=LCG.IN2P3.fr

(paterson@lxplus244)[ ~/w1/DEV-DIRAC3]$ dirac-lhcb-generate-catalog /lhcb/production/DC06/phys-v2-lumi2/00001758/DST/0000/00001758_00000001_5.dst --depth=1 --site=LCG.IN2P3.fr
/afs/cern.ch/user/p/paterson/w1/DEV-DIRAC3/Linux_x86_64_glibc-2.3.4/lib/python2.4/xmllib.py:9: DeprecationWarning: The xmllib module is obsolete.  Use xml.sax instead.
  warnings.warn("The xmllib module is obsolete.  Use xml.sax instead.", DeprecationWarning)
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py/DiracAPI  INFO: Attempting to resolve data for LCG.IN2P3.fr
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py/DiracAPI  INFO: Replica Lookup Time: 0.18 seconds
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py/DiracAPI  INFO: Metadata Lookup Time: 0.17 seconds
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py/LHCbInputDataResolution  INFO: Found specific input data policy for site LCG.IN2P3.fr:
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py/LHCbInputDataResolution  INFO: DIRAC.WorkloadManagementSystem.Client.InputDataByProtocol
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py/LHCbInputDataResolution  INFO: Attempting to run DIRAC.WorkloadManagementSystem.Client.InputDataByProtocol
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: InputData requirement to be resolved by protocol is:
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: 1 SURLs found from catalog for LocalSE IN2P3-disk
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: IN2P3-disk srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/disk/lhcb/production/DC06/phys-v2-lumi2/00001758/DST/0000/00001758_00000001_5.dst
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py  INFO: ReplicaManager.__getPhysicalFileAccessUrl: Attempting to get access urls for 1 files.
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py  INFO: Using lcg_util from: /afs/cern.ch/user/p/paterson/w1/DEV-DIRAC3/Linux_x86_64_glibc-2.3.4/lib/python2.4/site-packages/lcg_util.pyc
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py  INFO: The version of lcg_utils is 1.6.13
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py  INFO: Using gfalthr from: /afs/cern.ch/user/p/paterson/w1/DEV-DIRAC3/Linux_x86_64_glibc-2.3.4/lib/python2.4/site-packages/gfalthr.pyc
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py  INFO: The version of gfalthr is 1.10.15
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py  INFO: StorageElement.isValid: Determining whether the StorageElement IN2P3-disk is valid for use.
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py  INFO: StorageElement.isLocalSE: Determining whether IN2P3-disk is a local SE.
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py  INFO: StorageElement.getAccessUrl: Generating protocol PFNs for SRM2.
2008-12-02 17:19:56 UTC dirac-lhcb-generate-catalog.py  INFO: StorageElement.getAccessUrl: Attempting to get access urls for 1 physical files.
2008-12-02 17:19:59 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: Resolved input data
2008-12-02 17:19:59 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>> SE: IN2P3-disk
2008-12-02 17:19:59 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>>LFN: /lhcb/production/DC06/phys-v2-lumi2/00001758/DST/0000/00001758_00000001_5.dst
2008-12-02 17:19:59 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>>PFN: srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/disk/lhcb/production/DC06/phys-v2-lumi2/00001758/DST/0000/00001758_00000001_5.dst
2008-12-02 17:19:59 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>>TURL: gsidcap://ccdcacsn008.in2p3.fr:22128//pnfs/in2p3.fr/data/lhcb/disk/lhcb/production/DC06/phys-v2-lumi2/00001758/DST/0000/00001758_00000001_5.dst
2008-12-02 17:19:59 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>>PROTOCOL SRM2
2008-12-02 17:19:59 UTC dirac-lhcb-generate-catalog.py/LHCbInputDataResolution  INFO: All replicas resolved after DIRAC.WorkloadManagementSystem.Client.InputDataByProtocol execution
2008-12-02 17:19:59 UTC dirac-lhcb-generate-catalog.py/PoolXMLSlice  INFO: POOL XML Catalogue slice written to pool_xml_catalog.xml
(paterson@lxplus244)[ ~/w1/DEV-DIRAC3]$ cat pool_xml_catalog.xml
<?xml version="1.0" encoding="UTF-8" standalone="no" ?>
<!-- Edited By PoolXMLCatalog.py -->
<!DOCTYPE POOLFILECATALOG SYSTEM "InMemory">
<POOLFILECATALOG>


  <File ID="8ECECC64-FDC3-DB11-BEDF-000D61CB99D2">
     <physical>
       <pfn filetype="ROOT_All" name="gsidcap://ccdcacsn008.in2p3.fr:22128//pnfs/in2p3.fr/data/lhcb/disk/lhcb/production/DC06/phys-v2-lumi2/00001758/DST/0000/00001758_00000001_5.dst"/>
     </physical>
     <logical>
       <lfn name="/lhcb/production/DC06/phys-v2-lumi2/00001758/DST/0000/00001758_00000001_5.dst"/>
     </logical>
   </File>

</POOLFILECATALOG>
 For completeness, the corresponding DIRAC API function to access this functionality is:

Revision 12008-12-02 - StuartPaterson

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="ProductionProcedures"

Generating a POOL XML slice using DIRAC

The following utility has been developed in order to replace the old genCatalog functionality that was available in DIRAC2. An API function and command line script are available and allow to generate a POOL XML slice for specified LFN(s).

Please note that settings in the local configuration can affect the behaviour of this tool, for example, if the site name is not correctly specified then this must be specified on the command line. Instabilities of SRM can also give rise to problems with this tool and can be more pronounced at dCache sites where TURL construction is currently not supported.

dirac-lhcb-generate-catalog

(paterson@lxplus244)[ ~/w1/DEV-DIRAC3]$ dirac-lhcb-generate-catalog 
Usage: dirac-lhcb-generate-catalog.py <LFN> |[<LFN>]  --Site=<DIRAC Site Name> --Catalog=<Catalog File Name>
Try --help, -h for more information.

If the Site is not specified this is taken from the local DIRAC configuration e.g. /LocalSite/Site=. On lxplus shared installations it would be sufficient to specify the LFN(s) without a site name. The following two optional arguments are also available on the command line:

2008-12-02 09:31:38 UTC Framework  INFO: -n:  --Site=  :  DIRAC Site Name
2008-12-02 09:31:38 UTC Framework  INFO: -f:  --Catalog=  :  Catalogue File Name e.g. can be /path/to/catalog/file.xml, defaults to pool_xml_catalog.xml in PWD

As an example:

dirac-lhcb-generate-catalog LFN:/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst

(paterson@lxplus244)[ ~/w1/DEV-DIRAC3]$ dirac-lhcb-generate-catalog LFN:/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst
2008-12-02 08:51:19 UTC dirac-lhcb-generate-catalog.py/DiracAPI  INFO: Attempting to resolve data for LCG.CERN.ch
2008-12-02 08:51:19 UTC dirac-lhcb-generate-catalog.py/DiracAPI  INFO: Replica Lookup Time: 0.26 seconds
2008-12-02 08:51:19 UTC dirac-lhcb-generate-catalog.py/DiracAPI  INFO: Metadata Lookup Time: 0.20 seconds
2008-12-02 08:51:19 UTC dirac-lhcb-generate-catalog.py/LHCbInputDataResolution  INFO: Applying default input data policy for site LCG.CERN.ch:
2008-12-02 08:51:19 UTC dirac-lhcb-generate-catalog.py/LHCbInputDataResolution  INFO: DIRAC.WorkloadManagementSystem.Client.InputDataByProtocol
2008-12-02 08:51:19 UTC dirac-lhcb-generate-catalog.py/LHCbInputDataResolution  INFO: Attempting to run DIRAC.WorkloadManagementSystem.Client.InputDataByProtocol
2008-12-02 08:51:19 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: InputData requirement to be resolved by protocol is:
2008-12-02 08:51:19 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: 1 SURLs found from catalog for LocalSE CERN-disk
2008-12-02 08:51:19 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: CERN-disk srm://srm-lhcb.cern.ch/castor/cern.ch/grid/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst
2008-12-02 08:51:19 UTC dirac-lhcb-generate-catalog.py  INFO: ReplicaManager.__getPhysicalFileAccessUrl: Attempting to get access urls for 1 files.
2008-12-02 08:51:20 UTC dirac-lhcb-generate-catalog.py  INFO: Using lcg_util from: /afs/cern.ch/user/p/paterson/w1/DEV-DIRAC3/Linux_x86_64_glibc-2.3.4/lib/python2.4/site-packages/lcg_util.pyc
2008-12-02 08:51:20 UTC dirac-lhcb-generate-catalog.py  INFO: The version of lcg_utils is 1.6.13
2008-12-02 08:51:20 UTC dirac-lhcb-generate-catalog.py  INFO: Using gfalthr from: /afs/cern.ch/user/p/paterson/w1/DEV-DIRAC3/Linux_x86_64_glibc-2.3.4/lib/python2.4/site-packages/gfalthr.pyc
2008-12-02 08:51:20 UTC dirac-lhcb-generate-catalog.py  INFO: The version of gfalthr is 1.10.15
2008-12-02 08:51:20 UTC dirac-lhcb-generate-catalog.py  INFO: StorageElement.isValid: Determining whether the StorageElement CERN-disk is valid for use.
2008-12-02 08:51:20 UTC dirac-lhcb-generate-catalog.py  INFO: StorageElement.isLocalSE: Determining whether CERN-disk is a local SE.
2008-12-02 08:51:20 UTC dirac-lhcb-generate-catalog.py  INFO: StorageElement.getAccessUrl: Generating protocol PFNs for SRM2.
2008-12-02 08:51:20 UTC dirac-lhcb-generate-catalog.py  INFO: StorageElement.getAccessUrl: Attempting to get access urls for 1 physical files.
2008-12-02 08:51:23 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: Resolved input data
2008-12-02 08:51:23 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>> SE: CERN-disk
2008-12-02 08:51:23 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>>LFN: /lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst
2008-12-02 08:51:23 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>>PFN: srm://srm-lhcb.cern.ch/castor/cern.ch/grid/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst
2008-12-02 08:51:23 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>>TURL: castor://castorlhcb.cern.ch:9002?svcClass=lhcbdata&castorVersion=2&path=/castor/cern.ch/grid/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst
2008-12-02 08:51:23 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>>PROTOCOL SRM2
2008-12-02 08:51:23 UTC dirac-lhcb-generate-catalog.py/LHCbInputDataResolution  INFO: All replicas resolved after DIRAC.WorkloadManagementSystem.Client.InputDataByProtocol execution
2008-12-02 08:51:23 UTC dirac-lhcb-generate-catalog.py/PoolXMLSlice  INFO: POOL XML Catalogue slice written to pool_xml_catalog.xml

Since the site name and catalogue names were not specified these defaulted to LCG.CERN.ch and pool_xml_catalog.xml by default. Therefore the following XML slice was generated in the current directory.

(paterson@lxplus244)[ ~/w1/DEV-DIRAC3]$ cat pool_xml_catalog.xml
<?xml version="1.0" encoding="UTF-8" standalone="no" ?>
<!-- Edited By PoolXMLCatalog.py -->
<!DOCTYPE POOLFILECATALOG SYSTEM "InMemory">
<POOLFILECATALOG>


  <File ID="3E3E097D-0AC0-DB11-9C0A-00188B770645">
     <physical>
       <pfn filetype="ROOT_All" name="castor://castorlhcb.cern.ch:9002?svcClass=lhcbdata&amp;castorVersion=2&amp;path=/castor/cern.ch/grid/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst"/>
     </physical>
     <logical>
       <lfn name="/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst"/>
     </logical>
   </File>

</POOLFILECATALOG>

It is also possible to obtain equivalent XML slices for other sites where LHCb is able to submit data processing jobs. Looking at the available replicas of the above dataset:

</POOLFILECATALOG>(paterson@lxplus244)[ ~/w1/DEV-DIRAC3]$ dirac-dms-lfn-replicas /lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst
2008-12-02 08:52:52 UTC dirac-dms-lfn-replicas.py/DiracAPI  INFO: Replica Lookup Time: 0.21 seconds
{'Failed': {},
 'Successful': {'/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst': {'CERN-disk': 'srm://srm-lhcb.cern.ch/castor/cern.ch/grid/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst',
                                                                                                  'CNAF-disk': 'srm://storm-fe-lhcb.cr.cnaf.infn.it/t0d1/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst',
                                                                                                  'GRIDKA-disk': 'srm://gridka-dCache.fzk.de/pnfs/gridka.de/lhcb/disk-only/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst',
                                                                                                  'IN2P3-disk': 'srm://ccsrm.in2p3.fr/pnfs/in2p3.fr/data/lhcb/disk/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst',
                                                                                                  'NIKHEF-disk': 'srm://srm.grid.sara.nl/pnfs/grid.sara.nl/disk/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst',
                                                                                                  'PIC-disk': 'srm://srmlhcb.pic.es/pnfs/pic.es/data/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst',
                                                                                                  'RAL-disk': 'srm://srm-lhcb.gridpp.rl.ac.uk/castor/ads.rl.ac.uk/prod/lhcb/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst'}}}

So another example, again from lxplus, could be to obtain an XML slice for NIKHEF in a file called myCat.xml.

dirac-lhcb-generate-catalog LFN:/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst --Site=LCG.NIKHEF.nl --Catalog=myCat.xml

(paterson@lxplus244)[ ~/w1/DEV-DIRAC3]$ dirac-lhcb-generate-catalog /lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst --Site=LCG.NIKHEF.nl --Catalog=myCat.xml
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py/DiracAPI  INFO: Attempting to resolve data for LCG.NIKHEF.nl
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py/DiracAPI  INFO: Replica Lookup Time: 0.19 seconds
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py/DiracAPI  INFO: Metadata Lookup Time: 0.17 seconds
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py/LHCbInputDataResolution  INFO: Applying default input data policy for site LCG.NIKHEF.nl:
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py/LHCbInputDataResolution  INFO: DIRAC.WorkloadManagementSystem.Client.InputDataByProtocol
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py/LHCbInputDataResolution  INFO: Attempting to run DIRAC.WorkloadManagementSystem.Client.InputDataByProtocol
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: InputData requirement to be resolved by protocol is:
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: 1 SURLs found from catalog for LocalSE NIKHEF-disk
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: NIKHEF-disk srm://srm.grid.sara.nl/pnfs/grid.sara.nl/disk/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py  INFO: ReplicaManager.__getPhysicalFileAccessUrl: Attempting to get access urls for 1 files.
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py  INFO: Using lcg_util from: /afs/cern.ch/user/p/paterson/w1/DEV-DIRAC3/Linux_x86_64_glibc-2.3.4/lib/python2.4/site-packages/lcg_util.pyc
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py  INFO: The version of lcg_utils is 1.6.13
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py  INFO: Using gfalthr from: /afs/cern.ch/user/p/paterson/w1/DEV-DIRAC3/Linux_x86_64_glibc-2.3.4/lib/python2.4/site-packages/gfalthr.pyc
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py  INFO: The version of gfalthr is 1.10.15
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py  INFO: StorageElement.isValid: Determining whether the StorageElement NIKHEF-disk is valid for use.
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py  INFO: StorageElement.isLocalSE: Determining whether NIKHEF-disk is a local SE.
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py  INFO: StorageElement.getAccessUrl: Generating protocol PFNs for SRM2.
2008-12-02 08:53:23 UTC dirac-lhcb-generate-catalog.py  INFO: StorageElement.getAccessUrl: Attempting to get access urls for 1 physical files.
2008-12-02 08:53:26 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: Resolved input data
2008-12-02 08:53:26 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>> SE: NIKHEF-disk
2008-12-02 08:53:26 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>>LFN: /lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst
2008-12-02 08:53:26 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>>PFN: srm://srm.grid.sara.nl/pnfs/grid.sara.nl/disk/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst
2008-12-02 08:53:26 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>>TURL: root://bee16.grid.sara.nl:1094//pnfs/grid.sara.nl/disk/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst
2008-12-02 08:53:26 UTC dirac-lhcb-generate-catalog.py/InputDataByProtocol  INFO: >>>>PROTOCOL SRM2
2008-12-02 08:53:26 UTC dirac-lhcb-generate-catalog.py/LHCbInputDataResolution  INFO: All replicas resolved after DIRAC.WorkloadManagementSystem.Client.InputDataByProtocol execution
2008-12-02 08:53:26 UTC dirac-lhcb-generate-catalog.py/PoolXMLSlice  INFO: POOL XML Catalogue slice written to myCat.xml
(paterson@lxplus244)[ ~/w1/DEV-DIRAC3]$ cat myCat.xml
<?xml version="1.0" encoding="UTF-8" standalone="no" ?>
<!-- Edited By PoolXMLCatalog.py -->
<!DOCTYPE POOLFILECATALOG SYSTEM "InMemory">
<POOLFILECATALOG>


  <File ID="3E3E097D-0AC0-DB11-9C0A-00188B770645">
     <physical>
       <pfn filetype="ROOT_All" name="root://bee16.grid.sara.nl:1094//pnfs/grid.sara.nl/disk/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst"/>
     </physical>
     <logical>
       <lfn name="/lhcb/production/DC06/phys-v2-lumi5/00001680/DST/0000/00001680_00000490_5.dst"/>
     </logical>
   </File>

</POOLFILECATALOG>

The Catalog option also accepts full paths.

For completeness, the corresponding DIRAC API function to access this functionality is:

from DIRAC.Interfaces.API.Dirac import *
dirac=Dirac()
dirac.getInputDataCatalog(lfns,siteName,catalogName)

-- StuartPaterson - 02 Dec 2008

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback