TWiki> CMSPublic Web>FacilitiesOps>EOS (2012-02-29, StephenJGowdy) EditAttachPDF

EOS

This is a new xrootd based storage system at CERN.

Datasets Present

The T2_CH_CERN site in PhEDEx controls the data available.

Proposed Migration Plan

Pool Current Size Proposed Size Proposed Date Prerequisites LFN Area #files Status
CMSCAF 1.7PB 2PB June 20-27 Switch to xrootd access (28th March), PhEDEx node T2_CH_CERN /store/ 992948 Done
CMSCAFUSER [*] 210TB 300TB September Data only under /store/caf/, CRAB stageout /store/caf/ 810051 Done
GRIDHOME [*] 50TB 100TB September Users need to update their CRAB config, redirect rule needed /store/user/ 13158 Done
CMSCAFT2 [*] 80TB 300TB September Redirect rule can be removed, CRAB stageout /store/user/ 22919 Done
DEFAULT 220TB 600TB September Dataset Popularity Service? /store/ 562143  
CMST3 [*] 420TB 600TB [1] September Users need to update their CRAB config, data only under /store/cmst3/, CRAB stageout /store/cmst3/ 1430045 Done
T0EXPRESS [*] 200TB 200TB November Tier-0 supports stage-out to xrootd /store/express/ 1762192 Done
T0TEMP 150TB 150TB November Tier-0 supports stage-out to xrootd /store/t0temp/ 373100 Done
T0STREAMER [2] 500TB 500TB ? P5 transfer supports stage-out to xrootd /store/t0streamer/ 9774998  

[*] These pools store only copy of data, perhaps replication factor should be 3, or a backup should be made
[1] 50TB of this is controlled by PhEDEx with group "local"
[2] Not sure we want to move this pool as it should be phased out at some point and the use folded into t0temp space

We would still keep a small (100TB) DEFAULT pool on CASTOR till end of August. After that we can remove the redirect from EOS to CASTOR. Users would need to follow specific instructions to retrieve files from tape. Open question: what about /castor/cern.ch/user files?

Current space reservations

This is dumped daily from the EOS quota system.

Failed to include URL http://cern.ch/gowdy/EOS_zh.txt Not Found

-- StephenJGowdy - 15-Dec-2010

Attachments Attachments
Topic attachments
I Attachment History Action Size Date Who Comment
Texttxt HIAZRAW.txt r1 manage 1288.6 K 2011-02-15 - 11:42 StephenJGowdy RAW ZS data on EOS
Edit | Attach | Watch | Print version | History: r28 < r27 < r26 < r25 < r24 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r28 - 2012-02-29 - StephenJGowdy
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback