Workflow Team Meeting - Jan 22 4PM CERN time

Vidyo Link

• https://indico.cern.ch/event/368512/

Attending

Personel

• We have a new Post Doc starting next week at FNAL that will be taking over Redigi coordinating, I will start him out by teaching him operations
• First week of Feb we will have another US operator starting

News

• upgrade workflows should be available for assignment in the next 24-48 hours, once they hit they are absolute top priority, they needed them last week
• nothing else significant/critical is expected for at least a week.
• the 1B campaign is delayed due to validation and configuration is not finalized
• it's likely that we will need to redo 300 requests for RunIIFall14GS campaign. The decision is not taken. PPD is evaluating the impact of the bug that they found.

EU Operators Meeting Notes

• Julian - needs to get with Christoph about EU operators Any news yet?

Site support

Agent Issues

• JobAccountant on 219
• ErrorHandler and PhEDExInjector in 217 & 218 https://cms-logbook.cern.ch/elog/Workflow+processing/18423
• Submit errors: https://cms-logbook.cern.ch/elog/Workflow+processing/18422 - adjusting max condor jobs running
• Proxy errors on Tues

Redeployment plan

• Submit2 redeployed Wed

Workflows

• is it just me, or is work getting "stuck" behind the low priority backfill. I had a lot of jobs just sit in queued for a day even though there wasn't anything higher priority running. I bumped up the priority of the WF's and things sarted moving again. I also force completed a few old WF's that were stuck. And we've been restarting components, so a number of things could be happening but we need to make sure we keep an eye on this!

ReDigi

• pdmvserv_MUO-Phys14DR-00009_00087_v0__141218_011408_4922
  • 100% step 3 failure! https://cms-logbook.cern.ch/elog/Workflow+processing/18206

miniaod's

• 2 miniaod's with 100% error ProductNotFound: Needs to be sent back to requestor
• these are teh 2 oldest requests in the system can we PLEASE get them returned so we can reject them!
  • https://cms-logbook.cern.ch/elog/Workflow+processing/18269 -needs return to requestors so they can be rejected
  • pdmvserv_MUO-Spring14miniaod-00019_00084_v0__141030_155616_5795
  • pdmvserv_B2G-Spring14miniaod-00087_00075_v0__141030_150442_6231

Rereco

• Manually closed out the last of the ReReco's, too many lumi's per job to process any further

Store Results

MonteCarlo

SL6 testing/SL5 Decomissioning

RelVal Andrew

AOB

-- JenniferAdelmanMcCarthy - 2015-01-21