Workflow Team Meeting - Oct 30 4PM CERN time

Vidyo Link

Attending

• FNAL:
• CERN :

Personel

EU

• New US Operator Ian Dyckes

News

• When setting up Ian, we realized that we need somebody to be responsible for updating and maintaining
  • https://github.com/gutsche/scripts/tree/master/Kerberos is a good master Dave suggests Alan to be our guy to maintain this as he is the one to bring up new machins
• US Operators have setup a tenitive meeting time for 1PM FNAL time on Tues
  • decide if each operator will do 10 hrs/wk or 20 hrs every other week
  • discuss issues they are having with shift work, more training
• Do we need to change the meeting time for the EU shifters?
  • We need a new EU shift schedule!
• Monitoring scripts should move to vocms049 too? We need condor to be installed in that machine.

Site support

• A few sites have 0 in CPU bound column
  • who changed them? workflow team in charge of these metrics
  • https://dashb-ssb.cern.ch/dashboard/request.py/siteview#currentView=Pledges&highlight=true

Jasper's notes

Agent Issues

• 98 had a lot of WF's that were stuck, thresholds were messed up. Anybody want to fess up what happened?
  • If you change thresholds anywhere you HAVE to e-log it so we know what is going on!
• Submit1 components down because global pool is messed up right now. Backfill on hold

Redeployment plan

• • Production Pool:

    production SL6	mc SL5
    cmssrv217 (up/new version) 218 (up/new version) 219 (up/new)	vocms216 (up/new version) 201 (up/new version) 235 (drain) cmssrv98(up - will be abandoned)
    reproc_lowprio SL5	step0 SL5
    vocms202 (up/new version) 234 (up/new version) 85 (up - will be abandoned) cmssrv112 (drain - will be abandoned)	vocms237 (up/new version- will be abandoned)

  • Global Pool

    backfill SL6
    submit1 (up/new version) submit2 (drain)

  • Redeploying submit2,
  • Draining vocms235 (to redeploy)
    • cmssrv112 (to give away)

• JobAccountant patch: 5422 it needs to be deployed in all v1.0.0patch

Workflows

ReDigi

miniaod's

Rereco

Store Results

MonteCarlo

• WFs exceeding MaxRss - https://cms-logbook.cern.ch/elog/Workflow+processing/17392

SL6 testing/backfill

RelVal Andrew

-- JenniferAdelmanMcCarthy - 24 Oct 2014