requirements

  • All processing, production and analysis except the T0 uses EOS and the T2_CH_CERN endpoint per default
    • this includes local submission and GRID submission
    • access permissions are handled through a script currently maintained by Stephen Gowdy
      • uses SiteDB to define access rights for individuals
      • production roles are added manually to the script by hard coding the pilot DNs
      • currently (as of 21. Nov. 2012) there are two DN's for two different production roles that need to be added:
        • production role: /DC=ch/DC=cern/OU=computers/CN=cmspilotjob/vocms157.cern.ch
        • t1production role: /DC=org/DC=doegrids/OU=Services/CN=uscmspilot/cmssrv119.fnal.gov
  • The T0 uses two special scenarios which we should be able to switch in the T0 configuration
    • default mode: access and write files from/to both EOS and Castor and register to T0_CH_CERN
      • /store/data on Castor -> tape
      • /store/t0temp and /store/temp and /store/unmerged on EOS
      • /store/t0streamer on Castor -> disk only
      • /store/streamer on Castor -> tape
      • /store/express on EOS
    • test mode: access and write files only from/to EOS and register to T2_CH_CERN
      • /store/data on EOS
      • /store/t0temp and /store/temp and /store/unmerged on EOS
      • /store/t0streamer on Castor
      • /store/streamer on Castor
      • /store/express on EOS

TFC switch for T0

  • The TFC gets read by the framework from $CMS_PATH/SITECONF/local/JobConfig/site-local-config.xml
  • At CERN, this points to the T2_CH_CERN TFC which only provides access to EOS

  • For the T0, there are two overrides in place to support the default mode (mixed Castor/EOS):
    • The T0 stageout code can be overridden with an environment variable to use $CMS_PATH/SITECONF/T0_CH_CERN/JobConfig/site-local-config.xml
    • The PoolSource gets an override TFC parameter set during configuration manipulation, the override TFC is in $CMS_PATH/SITECONF/T0_CH_CERN/JobConfig/

  • For right now we will add an entry in $CMS_PATH/SITECONF/T0_CH_CERN/Tier0/override_catalog.xml to configure reads from /store/data/WMAT0Commissioning to use EOS. That way we can quickly support WMAT0 commissioning activities on EOS.

  • Longterm and to also support overrides for other sites, we'll make both the stageout override and the PoolSource overrides configurable in the Spec. The later is already in the spec and just needs to be added to the reqmgr UI, the former needs to be implemented from scratch and will replace the environment variable override option.

  • Bottom line
    • PA T0 is fine, go ahead
    • WMA T0 will be fine once we :
      • add read rule "/store/data/WMAT0Commissioning/ --> EOS " in T0_CH_CERN/Tier0/override_catalog.xml
      • switch /store/data/ in T2_CH_CERN to read and write from EOS

Future plans

  • When the TransferSystem is able to copy files to EOS, move /store/streamer and /store/t0streamer to EOS to benefit from better replication and larger spread over disk servers to allow for higher throughput
Edit | Attach | Watch | Print version | History: r5 < r4 < r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r5 - 2012-11-23 - DirkHufnagel
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback