Network and Transfer Metrics WG

Note: This page is under construction and can change quite often, information provided is still preliminary and subject to change.



NOTICE (June 26, 2014): There was a recently announced vulnerability (See EGI SVG EGI-SVG-2014-7162 for details or refer to FAQ at http://psps.perfsonar.net/toolkit/FAQs.html#Q77) in the Cacti component of the perfSONAR Toolkit deployments in use in WLCG and OSG. A fix was provided by the perfSONAR-PS developers in the form up updated RPMS and ISO images. All sites should update their installations.

Details at https://twiki.cern.ch/twiki/bin/view/LCG/CactiperfSONAR



Mandate

  • Ensure all relevant network and transfer metrics are identified, collected and published
  • Ensure sites and experiments can better understand and fix networking issues
  • Enable use of network-aware tools to improve transfer efficiency and optimize experiment workflows

Objectives

  • Identify and continuously make available relevant transfer and network metrics
  • Document metrics and their use
  • Facilitate their integration in the middleware and/or experiment tool chain
  • Coordinate commissioning and maintenance of WLCG network monitoring
    • Finalize perfSONAR deployment
    • Ensure all links continue to be monitored and sites stay correctly configured
    • Verify coverage and optimize test parameters

Members

Shawn McKee (chairperson), Marian Babik (co-chair), ATLAS (Simone Campana), CMS (Tony Wildish), LHCb (Stefan Roiser, Joel Closier), Alice (Latchezar Betev, Costin Grigoras), FAX (Ilija Vukotic), FTS (Mikael Salichos, Oliver Keeble), CMS/PhEDEx (Tony Wildish), Panda (Kaushik De), Rucio (Vincent Garonne)

perfSONAR contacts: US-ATLAS (Shawn McKee), US-CMS (Jorge Alberto Diaz Cruz), UK-ALL (Alessandra Forti, Chris Walker, Duncan Rand), IT-ATLAS (Alessandro de Salvo), IT-CMS (Enrico Mazzoni), CA-ALL (Ian Gable ), FR-ALL (Frederique Chollet, Laurent Caillat, Frederic Schaer), TW-ALL (Hsin-Yen Chen, ), ND-ALL (Ulf Tigerstedt), DE-ALL (Guenter Duckeck, Andreas Petzold, DE-KIT: Bruno Hoeft, Aurelie Reymund), ES-ALL (Fernando Lopez, Josep Felix), CERN (Stefan Stancu), LHCOPN/LHCONE (John Shade, ESNet: Mike O’Connor), RU-ALL (Victor Kotlyar), ESnet Science Engagement group (Jason Zurawski)

Contacts

We have two mailing lists wlcg-ops-coord-wg-metrics with all WG members and wlcg-perfsonar-support with perfSONAR contacts

Coming Events

  • Mon 8th of September 2014 at 3PM CEST: Network and Transfer Metrics WG Kick-off meeting (agenda link)

Task Tracking

Task Deadline Progress Affected VOs Affected Sites Comments
Invite members June Done - - https://twiki.cern.ch/twiki/bin/view/LCG/MeshLeaders
Plan and organise kick-off meeting August Ongoing - - Will take place Mon 8th Sept 2014 following http://doodle.com/7xxfd2axcnfxc6dc
perfSONAR Deployment June Done - -  
perfSONAR Commissioning Nov Ongoing - - Detailed progress in perfSONAR service level reports below, dashboard at https://maddash.aglt2.org/WLCGperfSONAR/check_mk/ (password protected contact Marian/Shawn)
WLCG perfSONAR configuration interface Oct Ongoing - -  
WLCG perfSONAR data store Oct Ongoing - - https://twiki.opensciencegrid.org/bin/view/Production/OSGNetworkDatastorePlan

Meetings

  • 9/8/2014 Network and Transfer Metrics WG Kick-off meeting

Presentations

  • 8/5/2014 Proposal for new Working Group: Network and Transfer Metrics at WLCG Operations Coordination
  • 8/7/2014 Network Monitoring and Metrics at [[https://indico.cern.ch/event/305362/other-view?view=standard][WLCG workshop, Barcelona]

Reports

Report 21/08/2014

  • Updated WG page with list of members, ongoing tasks and reports
  • Kick-off meeting will take place on Mon 8th of Sept at 3PM
  • On July 21st perfSONAR Toolkit 3.4rc2 became available for testing, version 3.4 is major milestone for the WG as it enables access via REST API and introduces several important performance improvements, therefore deployment campaign will follow once we have a stable release
  • Work is progressing on the WLCG perfSONAR configuration interface (finalized design, work is ongoing on a prototype implementation)
  • OSG perfSONAR datastore plan has been agreed and testing of the store based on esmond is ongoing
WLCG perfSONAR service level report on 2014-08-20 16:59:32.876708=======

perfSONAR instances monitored: 214
perfSONAR-PS versions deployed: 
   3.2.2 : 6
   3.3.1 : 3
   3.3.2 : 174
   Unknown: 27
GOCDB registered total: 170
OIM registered total: 53
Unreachable instances (not monitored): 8
Incorrectly configured (failing >4 metrics): 30

-- MarianBabik - 19 May 2014

Edit | Attach | Watch | Print version | History: r202 | r10 < r9 < r8 < r7 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r8 - 2014-08-21 - MarianBabik
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback