TWiki> LCG Web>WLCGGDBDocs>GDBMeetingNotes20160713 (revision 1)EditAttachPDF

July 2016 GDB notes



morning session to be filled in

Data matters in WLCG (Oliver Keeble)

  • Ian B: in Lisbon we decided a forum is needed for data management aspects
    • a GDB WG is a good fit
    • its terms of reference need to be agreed
  • Ian C: the upcoming WLCG workshop has a good slot for it
  • Markus: mind that storage and data access are different
    • both need to be covered
    • "Data Management" could imply that
  • Jamie: outside WLCG this would be called a Data Management Planning Group
  • Alessandra: Data Management Coordination?
  • Renaud: can site issues be discussed there? E.g. unused data?
    • A: yes

WLCG accounting task force update (Julia Andreeva)

  • John:
    • inconsistencies across views, if any, are bugs to be fixed
    • WLCG defines the WLCG views
    • it should (also) be documented what is not included
  • Julia:
    • we will only validate the WLCG view
    • non-pledged resources should also be viewable there
  • John: the TF should propose a cut-down WLCG view and invite comments

Accounting portal demonstration (Ivan Diaz)


  • John:
    • examples of issues that have been fixed:
      • the problem for DESY
      • CPU time appearing to be larger than wall-clock time
    • overall good progress!

  • Ian C: are all things on track?
  • Ian B: the main worry was that numbers could not be trusted
    • that looks under control now

  • Ian C: is the interface OK?
  • Ian B:
    • not sure if the reports should pull in the pledges?
    • should the reports be there at all?
  • John:
    • the portal reports can also be yearly, quarterly, etc.
    • REBUS does not offer such flexibility
  • Ian B: we should be careful not to mix functionalities

  • Ian B:
    • could the interface allow a selection of filters to be built up?
    • and then save them for future use?
    • in any case the interface should show which ones are applied
    • can we e.g. have an "all WLCG" selection?
  • John:
    • we will add the country view to the WLCG set
    • the "advanced options" allow fine-tuning the selections

  • John: we were asked some questions about desirable APEL enhancements
    • Q: can batch system scaling be undone?
    • A: that would be a big work, more for the Run-3 time scale
    • Q: can we have daily granularity?
    • A: that would mean a lot more data to process
      • plus changes in the client
      • we rather would see more sites publishing summaries instead
      • i.e. less work for APEL
  • Julia: you have the raw data, i.e. any desired granularity?
  • John: monthly summaries already can take ~9 days to compute!
  • Ian C: can you move to NoSQL for such computations?
  • Adrian: yes, we will already investigate that for EGI later this year

  • Ian C: we are where we wanted to be at this time!
Edit | Attach | Watch | Print version | History: r6 | r4 < r3 < r2 < r1 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r1 - 2016-07-13 - MaartenLitmaath
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback