Week of 181001

WLCG Operations Call details

  • For remote participation we use the Vidyo system. Instructions can be found here.

General Information

  • The purpose of the meeting is:
    • to report significant operational issues (i.e. issues which can or did degrade experiment or site operations) which are ongoing or were resolved after the previous meeting;
    • to announce or schedule interventions at Tier-1 sites;
    • to inform about recent or upcoming changes in the experiment activities or systems having a visible impact on sites;
    • to provide important news about the middleware;
    • to communicate any other information considered interesting for WLCG operations.
  • The meeting should run from 15:00 Geneva time until 15:20, exceptionally to 15:30.
  • The SCOD rota for the next few weeks is at ScodRota
  • General information about the WLCG Service can be accessed from the Operations Portal
  • Whenever a particular topic needs to be discussed at the operations meeting requiring information from sites or experiments, it is highly recommended to announce it by email to wlcg-scod@cernSPAMNOTNOSPAMPLEASE.ch to allow the SCOD to make sure that the relevant parties have the time to collect the required information, or invite the right people at the meeting.

Best practices for scheduled downtimes



  • local: Kate (chair, WLCG), Julia (WLCG), Maarten (ALICE, WLCG), Paul (storage), Gavin (computing), Vincent (security), Borja (monitoring)
  • remote: John (RAL), Xavier (KIT), Di (TRIUMF), Christian (NDGF), Victor (JINR), Zoltan (LHCb), Dave M (FNAL), Marcelo (CNAF), David (IN2P3), Andrew (NL-T1)

Experiments round table:

  • CMS reports ( raw view) -
    • CPU utilization rather low: ~145k cores for Production, ~47k cores for Analysis
      • No site issue, but CMS internal distribution and assignment
    • Nothing else to report

  • ALICE -
    • NTR

  • LHCb reports ( raw view) -
    • Activity
      • Data reconstruction for 2018 data
      • User and MC jobs
    • Site Issues

Sites / Services round table:

  • ASGC: nc
  • BNL: nc
  • EGI: nc
  • IN2P3: Applying security patch for CVE-2018-14634 [EGI-SVG-CVE-2018-14634]. Deployment of security patch implies decrease in CPU capacity.
  • JINR: We have a problem on the in the Dubna-Moscow main link, our network staff is working on it.
  • KISTI: nc
  • KIT: NTR
  • NDGF: Running Atlas Tape test this week.
  • NL-T1:
    • On Thursday morning the 4th, network experts will do an LHCOPN performance test to SARA/NIKHEF. This may delay production traffic.
    • Subsequently, a dCache component will be restarted to activate a configuration change. This may interrupt some transfers.
  • NRC-KI: nc
  • OSG: nc
  • PIC: nc
  • RAL: NTR
  • TRIUMF: The core switch at new data centre had been successfully replaced last Monday. However the network tunnel, which connects the WNs in private network and the servers with public IP between the two data centres, did not work with the new core switch. We spent about two days to solve this issue, so ATLAS jobs had not run at TRIUMF about two days.

  • CERN computing services: NTR
  • CERN storage services: NTR
  • CERN databases:
    • NTR
  • Monitoring: NTR
  • MW Officer: As a follow up on the globus-gssapi-gsi issue and the BeStMan TLS limitation all OSG sites in question were contacted and they were all aware that they need to retire the service. All three are working on the subject and will have retired them in a month or two. Concerning the CERN instance, Burt Holzman (fnal) provided a patch for TLS 1.2 support that got deployed at preprod instance and that seems to work OK.
  • Networks: NTR
  • Security: Security advisory for kernel vulnerabilities has been published last week. Sites are asked to apply mitigations steps described in it.


Edit | Attach | Watch | Print version | History: r18 < r17 < r16 < r15 < r14 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r18 - 2018-10-01 - KateDziedziniewicz
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback