WLCG Accounting Task Force

Motivation

The WLCG Accounting Task Force is set up following the outcome of the WLCG Accounting Review at the (pre-)GDB in April 2016.

The highest priority task for the Task Force is to address current issues with CPU/Wall clock accounting. Storage Space accounting should be also addressed in particular of what concerns understanding of the requirements of the experiments and sites, however with lower priority.

Mandate

CPU/Wall clock accounting

  • to agree with all stakeholders on the content of the accounting portal and accounting reports (metrics, units, aggregation in terms of time and set of attributes like site, VO, country, etc…);
  • coordinate with APEL and accounting portal development team and follow up on the progress
  • validate the new version of the portal, ideally a dedicated customized UI for WLCG, and make sure that the requirements of the stakeholders are addressed
  • validate accounting data, ensure that it is correct in the APEL repository and manual fixes could be avoided
  • follow up of on whether/ how we enable injection of the opportunistic resources to APEL and accounting portal
  • coordinate with sites which provide their resources through cloud interfaces making sure that their resources are properly published in APEL. Debug corner cases when they are not properly published

Storage space accounting

  • agree with the experiments and sites on the functionality which is required for the WLCG storage space accounting system considering the use case of the high level overview of the total and available space

Areas of work

Storage Space Accounting

CPU Accounting

Data validation

Follow up on sites which apparently do not correctly report to APEL

Automation of data validation

Data Quality Checks

New portal testing and validation

Normalization of CPU and wall clock

Accounting of non-pledged resources

Accounting data from from the primary information source to the accounting portal

How to enable accounting for jobs submitted with BOINC

HTCondor accounting instructions for OSG sites

HTCondor accounting , general instructions for sites

Accounting FAQ from sites

Task Force meetings

WLCG Accounting Task Force meetings take place be-weekly on Thursday starting at 15 o'clock Geneva time

Membership

Representatives of the
  • LHC experiments
  • WLCG sites including T0
  • WLCG operations
  • WLCG Monitoring team
  • APEL & EGI accounting portal developers

Members

  • Julia Andreeva (WLCG ops)
  • Alessandra Forti (WLCG ops & sites)
  • Maria Alandes Pradillo (WLCG ops & CMS)
  • Alessandro Di Girolamo (WLCG ops for storage accounting)
  • Giampaolo Carlino (ATLAS)
  • Costin Grigoras (ALICE)
  • Andrew McNab (LHCb)
  • Josep Flix (CMS)
  • Antonio Perez-Calero Yzquierdo (Sites & CMS)
  • Olga Kodolova (Data quality)
  • Adrian Coveney (APEL)
  • John Gordon (EGI portal & APEL)
  • Ivan Diaz Alvarez (EGI Accounting Portal)

-- JuliaAndreeva - 2016-05-25

Topic attachments
I Attachment History Action Size Date Who Comment
Unknown file formatjson CERN-PROD.json r1 manage 31.9 K 2018-10-04 - 16:06 JuliaAndreeva  
PDFpdf StorageSpaceAccounting1.pdf r1 manage 119.1 K 2017-05-17 - 16:10 JuliaAndreeva  
Unknown file formatjson praguelcg2.json r1 manage 7.4 K 2018-10-04 - 16:06 JuliaAndreeva  
Texttxt storage_service_v4.txt r1 manage 8.2 K 2017-08-14 - 17:23 JuliaAndreeva  
Edit | Attach | Watch | Print version | History: r35 < r34 < r33 < r32 < r31 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r35 - 2019-10-10 - JuliaAndreeva
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback