Pledged Spacetokens
ATLAS DDM Accounting Visualisation
The accounting data are retrieved from the backend service as summary text files, eg.
http://voatlas230.cern.ch/accountingcsv/2012-09-12/site_project_streamname_datatype_rarchived_hidden_rgroup_provenance_campaign/result
the data are recorded in the dashboard dabase.
Usage
Set your Parameters:
- choose a site or a set of sites - by default All Sites are selected
- select one or more attributes such as Project(s), Datatype(s), Replica Group(s), Dataset Group(s) and etc - by defaull everything is included
- select a time range - by default Last Week is selected
- select the granularity of the plots - default granularity values:
- Daily when the selected time range is up to 90 days
- Weekly when the selected time range is longer than 90 days
- select the grouping parameter by which you want to group the results - by default we group the results by Grouped Datatypes
Click on a button on the left to visualise the information you are interested in. The application offers either a Historical View or a Snapshot (real-time) View. The application offers Physical Definitions for your selected site or set of sites and Global ATLAS-wide Logical Definitions that are available when grouping the results by:
- Projects
- Datatypes
- Base Projects
- Grouped Datatypes
- Streamnames
- Grouped Streamnames
- Generic Streamnames
- Hidden
- Provenance
- Campaign
- Base Projects & Grouped Datatypes
- Dataset Groups
- ProdStep
- ProdStep & Grouped Datatypes
Please note that all times appearing in the plots are in UTC.
You can limit the maximum number of legends in a plot by adjusting the 'Select Series' entry, all the remaining legends will be grouped as 'Rest'.
Grouping of the Values
The application performs high-level grouping of most of the values. Please find the list of groupings below.
DDM Endpoints
DDM Endpoints are grouped into DDM Spacetokens. We take the last entry seperated by the underscore sign '_' out of DDM Endpoint and group it as a DDM Spacetoken. Examples:
- mwt2_uc_localgroupdisk becomes *localgroupdisk
- cern-prod_mctape becomes *mctape
- cscs-lcg2_perf-egamma becomes *perf-egamma
- *gridftp* entries become *localgroupdisk - the only exception to the above rule
Projects
Individual Projects are mapped into Base Projects. We take the first entry seperated by the underscore sign '_' out of the Project and group it as a Base Project. Examples:
- data12_7tev becomes data12*
- data12_8tev becomes data12*
- cond09_data becomes cond09*
- mc10_7tev becomes mc10*
Individual Projects are also mapped into Grouped Projects which is the highest level of grouping of the projects. For the exact grouping of the projects, please consult the following file attachment:
Datatypes
Individual Datatypes are mapped into Grouped Datatypes. We take the first entry seperated by the underscore sign '_' out of the Datatype and group it as a Grouped Datatype. Examples:
- d2aodm_topejet becomes d2aodm*
- daod_susyegamma becomes daod*
- desd_hirare becomes desd*
- ntup_fastmon becomes ntup*
Streams
There are three levels of grouping the streams.
- Indivudal streams are only available for *data* projects. For non-*data* projects, the individual streamname is mapped to 'no_stream'.
- Grouped Streamnames are only available for *data* projects. For non-*data* projects, the Grouped Streamname is mapped to 'no_stream'.
- Generic Streamnames is the highest level of grouping of the streams and it is valid for *data* projects. For non-*data* projects, the Generic Streamname is mapped to 'NO_STREAM'.
For the exact grouping of the streamnames, please consult the following file attachment:
Disk & Tape Pledges
We collect disk & tape pledges numbers from WLCG REBUS:
http://wlcg-rebus.cern.ch/apps/pledges/resources/
We perform the following corrections to the the disk pledges (not relevant for tape pledges):
- FR-CCIN2P3 = FR-CCIN2P3 (IN2P3-CC) + CC-IN2P3 AF (FR-IN2P3-CC-T2)
- NDGF = NDGF (NDGF-T1) + SNIC Tier-2 (SE-SNIC-T2) + SI-SiGNET + UNINETT SIGMA Tier-2 (NO-NORGRID-T2) - 110
- SNIC Tier-2 = 110
- TW-ASGC = TW-ASGC (Taiwan-LCG2) + Taiwan Analysis Facility Federation (TW-FTT-T2)
Pledged Spacetokens
The Pledged Spacetokens includes all the Grouped Spacetokens
except the following:
- localgroupdisk
- localgroupdisk-mw
- ppslocalgroupdisk
- tmplocalgroupdisk
- alfa
- cern-dpmtest
- oldscratchdisk
- ppsdatadisk
- ppsscratchdisk
- tmpdatadisk
Tape
Tape includes the following Grouped Spacetokens:
- daq
- tzero
- datatape
- mctape
- grouptape_*
Further Assistance
For any additional help, please contact us at:
dashboard-support@cernNOSPAMPLEASE.ch
For any feature request or if you want to report a bug, please open a ticket in our project tracker:
https://savannah.cern.ch/bugs/?group=dashboard
--
EdwardKaravakis - 04-Oct-2012