Workflow Team Meeting - Nov 11 4PM CERN, 9 FNAL time

Vidyo Link

Attending

  • FNAL:
  • US:
  • CERN :
  • EU:

Personnel

  • Jorge - Nov 9-13
  • Julian to Colombia Dec 14, and then contract ends, will be working remotely from Colombia until the First of Jan
  • Ajit out till Nov
  • JR unavailable until Nov 23d
  • Dima traveling next week

News - Dima

3 top issues effecting production

Site support - Gaston

  • No changes in the waiting room.
  • No changes in morgue.

Currently in the waiting room: T2_ES_IFCA, T2_IT_Bari, T2_IN_TIFR, T2_TH_CUNSTDA, T2_PK_NCP, T2_EE_Estonia, T2_RU_INR, T2_BR_UERJ.

News & Issues

  • (JR) Several sites over dataops DDM quota : reasons are
    • heavy gen-sim in production or in use
    • 4 or 5 opened campaign with secondary input : 40+40+25+10+10 TB = 125TB of secondary on disk
  • (JR) Large TaskChain with large job blow-up ratio : now assigning to >4k slots sites if ratio >5

Workflows

ReDigi

*

TaskChains

  • Workflows with None AcqEra - https://cms-logbook.cern.ch/elog/Workflow+processing/22100
  • We have already discussed why this happened, and outlined the procedure to fix it
    • this is a problem of communication and documentation, Alan and Julian knew what to do, I sort of knew what to do but nothing was documented anywhere!
    • What other exceptions to regular acdc production and assigning are there?
  • (JR) what can be done about the very long running taskchains for now - long SUSY task chains training for 3-4 wks
    • keep an eye on them, if they are over 95% force complete, check to see if they are running, then check stuck workflow scripts

StepChain

Rereco

  • Need to start returning WF's that are not 100%
  • How much have we talked to the developers on why we are getting missing lumi's but they are not showing up in WmStats as errors? We need to find a better way of recovering this!

Store Results

MonteCarlo

Agent Issues

Redeployment Plan

RelVal Andrew

L3 discussion - Ajit, Jean-Roch, Matteo

Opportunistic Resources

Automatic Assignment And Unified Software

AOB

-- JenniferAdelmanMcCarthy - 2015-11-11

Edit | Attach | Watch | Print version | History: r5 < r4 < r3 < r2 < r1 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r2 - 2015-11-11 - GastonLyonsPacini
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback