https://indico.cern.ch/conferenceDisplay.py?confId=254658

Personel

• Coming off Shift: Xavier
• Coming On Shift: Joseph
• Jacob on Vacation until June 16
• Andrew will be on vacation June 15-22
• Diego is back in Colombia but is back at work this week.
  • Diego will be taking a vacation day on Wed
• Stenick off next week
• Xavier - how is the shift scheduling doing? I notice we only have one more more week on the schedule

Site Issues:

• IN2P3 https://ggus.eu/ws/ticket_info.php?ticket=94750 Possible overload, or the change to lazy download. The cause not yet understood.
  • This is effecting the pdmvserv_HIG-Summer12_DR53X_RD workflows so we need to wait until this issue is resolved before starting ACDC's
• RAL Overload on disk servers for reading. Cause not yet understood.
• Brunel http://savannah.cern.ch/support/?138044 CVMFS black node
• RWTH cvmfs black node http://savannah.cern.ch/support/?138046
• Wisconsin Disks full/glideins not starting http://savannah.cern.ch/support/?138037
• Sites in and out of the waiting room:

Last update: June 10th

Sites IN	This week IN	# weeks IN	This week OUT
T2_IN_TIFR		5
T2_MY_UPM_BIRUNI		5
T2_PK_NCP		5
T2_PL_Cracow		5
T2_RU_RRC_KI		5
T2_TH_CUNSTDA		5
T2_TR_METU		3	X
T2_PL_Warsaw		4
T2_BR_UERJ		4
T2_RU_ITEP	X	0

Infrastructure Issues:

• cmsweb couchdb went down again on the weekend.
• MC bulk WMAgents working without ACDC creation. Otherwise we are hitting a bug in WMAgent ErrorHandler and TaskArchiver.
• issues with jobs not moving to complete - where do we stand on this?
  • https://cmslogbook.cern.ch/elog/Workflow+processing/8366

Action Items

• WMAgent 0.9.7? will be installed this week. - On which machines?
  • Procedure for activating new Agent
  • Krista has worked on doing upgrades/installs via rpm at FNAL to standardize the machines and will be working with Alison to do the same at CERN. We need to make sure that we haven't broken anything.
• Do we need to convert WMAgentScripts to git? Edgar can you do this and update our notes on updateing scripts and how to check things in and out of git?
• Procedures for re-commisioning sites after they have been in the Waiting room for a while - John
• Procedure for comissioning sites - where is it documented - John
• Recovery workflows - Jen
• updating missing Lumi scripts - Jen
• Making new shift schedule - Xavier