Processing areas

Area Description Who writes Who reads Who cleans up
/eos/cms/store/t0streamer/ Area to store the input .dat (serialized) files sent from P5, which are the input for Repack and Express jobs The Storage Manager The worker nodes Cleanup script running in the cmsprod acrontab on lxplus[1]
/eos/cms/store/express/ Area to store (part of) the output from Express jobs Worker nodes running Express jobs - Cleanup script running in the phedex acrontab on lxplus[2]
/eos/cms/store/unmerged/ Area to store the original output from processing jobs (Repack, PromptReco). Files written here are still waiting to be merged Worker nodes running Repack or PromptReco processing jobs Worker nodes running Merge jobs Cleanup script running in the phedex acrontab on lxplus[3]
/eos/cms/tier0/ Area to store the merged out from processing jobs. Data is stored in this area until it is fully transferred to all of its final destinations (where it is subscribed) PhEDEx PhEDEx

Log area

Area Description Who writes Who reads Who cleans up
/store/logs/prod/201*/0*/WMAgent/ Logs from the jobs sent by the WMAgents are stored here WMAgents -
  • For eos: Deleted after 1-2 months
  • For castor: Never deleted
-- JohnHarveyCasallasLeon - 2016-08-04
Edit | Attach | Watch | Print version | History: r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r1 - 2016-08-04 - JohnHarveyCasallasLeon
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Sandbox All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback