Introduction

There are two main use cases related to space accounting which are being addressed by the systems developed in the experiments:
  • global view of the occupied and free space at the site, can imply details as space by space token, quota or certain level of the directory tree
  • complete storage dump, listing all files with their sizes

The first one is required for everyday processing and planning and should be updated quite often (order of half an hour or so), while the second one is required to discover so called dark data and in general to detect inconsistencies between local storage and experiment's file catalogues. Full storage dump is a heavy operation and is normally performed once a month or so.

Known formats used for storage dumps and space accounting overview

We need to align here between the experiments, storage providers and various methods which are currently used to obtain this information.

WebDAV

Some introductory information to WevDAV can be found here

Known formats used to provide storage dumps and space accounting information

DPM

Storage dump script evaluation

CMS
ATLAS
Others?

Status of providing space accounting information with WebDAV

Status of publishing space accounting info to the EGI accounting portal

dCache

Storage dump script evaluation

CMS
ATLAS
Others?

Status of providing space accounting information with WebDAV

Status of publishing space accounting info to the EGI accounting portal

EOS

Storage dump script evaluation

CMS
ATLAS
Others?

Status of providing space accounting information with WebDAV

Status of publishing space accounting info to the EGI accounting portal

StoRM

Storage dump script evaluation

CMS
ATLAS
Others?

Status of providing space accounting information with WebDAV

Status of publishing space accounting info to the EGI accounting portal

Posix-like (NFS,GPFS,Lustre,PVFS)

Storage dump script evaluation

CMS
ATLAS
Others?

Status of providing space accounting information with WebDAV

Status of publishing space accounting info to the EGI accounting portal

LStore (ACCRE)

Storage dump script evaluation

CMS
ATLAS
Others?

Status of providing space accounting information with WebDAV

Status of publishing space accounting info to the EGI accounting portal

Posix-light with FUSE (xrootd, HDFS)

Storage dump script evaluation

CMS
ATLAS
Others?

Status of providing space accounting information with WebDAV

Status of publishing space accounting info to the EGI accounting portal

-- JuliaAndreeva - 2016-04-01

Edit | Attach | Watch | Print version | History: r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r2 - 2016-04-01 - JuliaAndreeva
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback