Pledged Spacetokens

ATLAS DDM Accounting Visualisation

The accounting data are retrieved from the backend service as summary text files, eg. http://voatlas230.cern.ch/accountingcsv/2012-09-12/site_project_streamname_datatype_rarchived_hidden_rgroup_provenance_campaign/result the data are recorded in the dashboard dabase.

Usage

Set your Parameters:

  • choose a site or a set of sites - by default All Sites are selected
  • select one or more attributes such as Project(s), Datatype(s), Replica Group(s), Dataset Group(s) and etc - by defaull everything is included
  • select a time range - by default Last Week is selected
  • select the granularity of the plots - default granularity values:
    • Daily when the selected time range is up to 90 days
    • Weekly when the selected time range is longer than 90 days
  • select the grouping parameter by which you want to group the results - by default we group the results by Grouped Datatypes
Click on a button on the left to visualise the information you are interested in. The application offers either a Historical View or a Snapshot (real-time) View. The application offers Physical Definitions for your selected site or set of sites and Global ATLAS-wide Logical Definitions that are available when grouping the results by:
  • Projects
  • Datatypes
  • Base Projects
  • Grouped Datatypes
  • Streamnames
  • Grouped Streamnames
  • Generic Streamnames
  • Hidden
  • Provenance
  • Campaign
  • Base Projects & Grouped Datatypes
  • Dataset Groups
  • ProdStep
  • ProdStep & Grouped Datatypes
Please note that all times appearing in the plots are in UTC.

You can limit the maximum number of legends in a plot by adjusting the 'Select Series' entry, all the remaining legends will be grouped as 'Rest'.

Grouping of the Values

The application performs high-level grouping of most of the values. Please find the list of groupings below.

DDM Endpoints

DDM Endpoints are grouped into DDM Spacetokens. We take the last entry seperated by the underscore sign '_' out of DDM Endpoint and group it as a DDM Spacetoken. Examples:

  • mwt2_uc_localgroupdisk becomes *localgroupdisk
  • cern-prod_mctape becomes *mctape
  • cscs-lcg2_perf-egamma becomes *perf-egamma
  • *gridftp* entries become *localgroupdisk - the only exception to the above rule

Projects

Individual Projects are mapped into Base Projects. We take the first entry seperated by the underscore sign '_' out of the Project and group it as a Base Project. Examples:

  • data12_7tev becomes data12*
  • data12_8tev becomes data12*
  • cond09_data becomes cond09*
  • mc10_7tev becomes mc10*
Individual Projects are also mapped into Grouped Projects which is the highest level of grouping of the projects. For the exact grouping of the projects, please consult the following file attachment:

Datatypes

Individual Datatypes are mapped into Grouped Datatypes. We take the first entry seperated by the underscore sign '_' out of the Datatype and group it as a Grouped Datatype. Examples:

  • d2aodm_topejet becomes d2aodm*
  • daod_susyegamma becomes daod*
  • desd_hirare becomes desd*
  • ntup_fastmon becomes ntup*

Streams

There are three levels of grouping the streams.

  1. Indivudal streams are only available for *data* projects. For non-*data* projects, the individual streamname is mapped to 'no_stream'.
  2. Grouped Streamnames are only available for *data* projects. For non-*data* projects, the Grouped Streamname is mapped to 'no_stream'.
  3. Generic Streamnames is the highest level of grouping of the streams and it is valid for *data* projects. For non-*data* projects, the Generic Streamname is mapped to 'NO_STREAM'.
For the exact grouping of the streamnames, please consult the following file attachment:

Disk & Tape Pledges

We collect disk & tape pledges numbers from WLCG REBUS: http://wlcg-rebus.cern.ch/apps/pledges/resources/

We perform the following corrections to the the disk pledges (not relevant for tape pledges):

  • FR-CCIN2P3 = FR-CCIN2P3 (IN2P3-CC) + CC-IN2P3 AF (FR-IN2P3-CC-T2)
  • NDGF = NDGF (NDGF-T1) + SNIC Tier-2 (SE-SNIC-T2) + SI-SiGNET + UNINETT SIGMA Tier-2 (NO-NORGRID-T2) - 110
  • SNIC Tier-2 = 110
  • TW-ASGC = TW-ASGC (Taiwan-LCG2) + Taiwan Analysis Facility Federation (TW-FTT-T2)

Pledged Spacetokens

The Pledged Spacetokens includes all the Grouped Spacetokens except the following:

  • localgroupdisk
  • localgroupdisk-mw
  • ppslocalgroupdisk
  • tmplocalgroupdisk
  • alfa
  • cern-dpmtest
  • oldscratchdisk
  • ppsdatadisk
  • ppsscratchdisk
  • tmpdatadisk

Tape

Tape includes the following Grouped Spacetokens:

  • daq
  • tzero
  • datatape
  • mctape
  • grouptape_*

Further Assistance

For any additional help, please contact us at: dashboard-support@cernNOSPAMPLEASE.ch

For any feature request or if you want to report a bug, please open a ticket in our project tracker: https://savannah.cern.ch/bugs/?group=dashboard

-- EdwardKaravakis - 04-Oct-2012

Topic attachments
I Attachment History Action Size Date Who Comment
Texttxt grouped_projects.txt r1 manage 0.5 K 2013-02-04 - 17:39 EdwardKaravakis Detailed grouping of the Grouped Projects
Texttxt streams.txt r2 r1 manage 1.9 K 2012-10-04 - 14:03 EdwardKaravakis Detailed grouping of the Streamnames
Edit | Attach | Watch | Print version | History: r12 < r11 < r10 < r9 < r8 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r12 - 2014-12-09 - EdwardKaravakis
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    ArdaGrid All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback