Difference: CmsIOFallback (1 vs. 2)

Revision 22010-07-13 - BrianBockelman

Line: 1 to 1
 
META TOPICPARENT name="BrianBockelman"
Deleted:
<
<
 

CMSSW Fallback

Changed:
<
<
The patch attached to this page allows a CMSSW run to fallback from the normal TFC access to an xrootd-based URL.

Whenever an error occurs when opening a CMS file, the application will switch to the Xrootd service.

>
>
The patch attached to this page allows a CMSSW run to fallback from the normal TFC access to a secondary protocol, such as the global xrootd redirector.
 
Changed:
<
<
This is only tested on CMSSW_3_7_0 or later.
>
>
This is only tested on CMSSW_3_8_0 or later.
 

CMSSW Patches

Changed:
<
<
Before you apply any patches, make sure you have your CMS environment set up correctly. From the CMSSW_3_7_x directory, do:
>
>
Before you apply any patches, make sure you have your CMS environment set up correctly. From the CMSSW_3_8_x directory, do:
 
cmsenv
export CVSROOT=:pserver:anonymous@cmscvs.cern.ch:/cvs_server/repositories/CMSSW
Line: 21 to 18
 
addpkg IOPool/Input
addpkg FWCore/Services
Changed:
<
<
/usr/bin/curl -k https://twiki.cern.ch/twiki/pub/Main/CmsIOFallback/cmssw_fallback.patch | patch -p0
>
>
addpkg FWCore/Catalog pushd src/FWCore/Catalog /usr/bin/curl -k https://twiki.cern.ch/twiki/pub/Main/CmsIOFallback/fwcore_catalog_fallback.patch | patch -p0 popd pushd src/FWCore/Services /usr/bin/curl -k https://twiki.cern.ch/twiki/pub/Main/CmsIOFallback/fwcore_services_fallback.patch | patch -p0 popd pushd src/IOPool/Input /usr/bin/curl -k https://twiki.cern.ch/twiki/pub/Main/CmsIOFallback/iopool_input_fallback.patch | patch -p0 popd
 scram b -j4 USER_CXXFLAGS="-g" It might take 3-5 minutes depending on the speed of your computer.

Add the xrootd service to the CMSSW run

Changed:
<
<
Add the following line to your CMSSW .py file:
>
>
Assuming that your site-local-config.xml event-data stanza looks like this:
    <event-data>
      <catalog url="trivialcatalog_file://opt/osg/app/cmssoft/cms/SITECONF/local/PhEDEx/storage.xml?protocol=direct"/>
    </event-data>
change it to the following:
    <event-data>
      <catalog url="trivialcatalog_file://opt/osg/app/cmssoft/cms/SITECONF/local/PhEDEx/storage.xml?protocol=direct"/>
      <catalog url="trivialcatalog_file://opt/osg/app/cmssoft/cms/SITECONF/local/PhEDEx/storage.xml?protocol=xrootd"/>
    </event-data>

where the xrootd protocol points to the xrootd redirector of your choice. If you want to use the global redirector, you would add the following line to your storage.xml file:

 
Changed:
<
<
process.source.fallbackUrl = cms.untracked.string("root://xrootd.unl.edu/")
>
>
<lfn-to-pfn protocol="xrootd" destination-match=".*" path-match="/+store/(.*)" result="root://xrootd.unl.edu//store/$1"/>
 

You can run CMSSW as normal; whenever CMSSW runs into a file it can't open, it will start using the CMS Data Access Testbed.

Changed:
<
<
META FILEATTACHMENT attachment="cmssw_fallback.patch" attr="" comment="" date="1276566499" name="cmssw_fallback.patch" path="cmssw_fallback.patch" size="7048" stream="cmssw_fallback.patch" tmpFilename="/usr/tmp/CGItemp52535" user="bbockelm" version="1"
>
>
META FILEATTACHMENT attachment="fwcore_catalog_fallback.patch" attr="" comment="" date="1278989982" name="fwcore_catalog_fallback.patch" path="fwcore_catalog_fallback.patch" size="8182" stream="fwcore_catalog_fallback.patch" tmpFilename="/usr/tmp/CGItemp19462" user="bbockelm" version="1"
META FILEATTACHMENT attachment="fwcore_services_fallback.patch" attr="" comment="" date="1278989995" name="fwcore_services_fallback.patch" path="fwcore_services_fallback.patch" size="2568" stream="fwcore_services_fallback.patch" tmpFilename="/usr/tmp/CGItemp19434" user="bbockelm" version="1"
META FILEATTACHMENT attachment="iopool_input_fallback.patch" attr="" comment="" date="1278990016" name="iopool_input_fallback.patch" path="iopool_input_fallback.patch" size="2264" stream="iopool_input_fallback.patch" tmpFilename="/usr/tmp/CGItemp19298" user="bbockelm" version="1"

Revision 12010-06-15 - BrianBockelman

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="BrianBockelman"

CMSSW Fallback

The patch attached to this page allows a CMSSW run to fallback from the normal TFC access to an xrootd-based URL.

Whenever an error occurs when opening a CMS file, the application will switch to the Xrootd service.

This is only tested on CMSSW_3_7_0 or later.

CMSSW Patches

Before you apply any patches, make sure you have your CMS environment set up correctly. From the CMSSW_3_7_x directory, do:

cmsenv
export CVSROOT=:pserver:anonymous@cmscvs.cern.ch:/cvs_server/repositories/CMSSW

Now, apply patches and build the new code:

addpkg IOPool/Input
addpkg FWCore/Services
/usr/bin/curl -k https://twiki.cern.ch/twiki/pub/Main/CmsIOFallback/cmssw_fallback.patch | patch -p0
scram b -j4 USER_CXXFLAGS="-g"
It might take 3-5 minutes depending on the speed of your computer.

Add the xrootd service to the CMSSW run

Add the following line to your CMSSW .py file:
process.source.fallbackUrl = cms.untracked.string("root://xrootd.unl.edu/")

You can run CMSSW as normal; whenever CMSSW runs into a file it can't open, it will start using the CMS Data Access Testbed.

META FILEATTACHMENT attachment="cmssw_fallback.patch" attr="" comment="" date="1276566499" name="cmssw_fallback.patch" path="cmssw_fallback.patch" size="7048" stream="cmssw_fallback.patch" tmpFilename="/usr/tmp/CGItemp52535" user="bbockelm" version="1"
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback