gLExec Deployment Tracking

Conclusion !

  • a new plan for gLExec has been proposed in Ian Bird's presentation on the
    "Follow-up to the WLCG Workshop in Lisbon" during the MB meeting of Feb 16, 2016
  • page 4 says:
    "Freeze deployment of glexec - keep it supported for the existing use,
    but no point to expend further effort in deployment"
  • efforts should rather be spent to increase the use of common technologies
    • cgroups, namespaces, containers
    • 'big data' tools for managing traceability data

Introduction

In its meeting on May 14, 2013, the WLCG Management Board decided that the deployment of gLExec shall be ramped up for all WLCG sites, as summarized in the minutes. In the meeting on June 18, 2013, a deployment plan was presented and agreed after some discussion, as summarized in the minutes.

The deployment needs to happen already now, even when some of the experiments are not yet ready to let their multi-user pilot jobs make use of gLExec. Deployment issues can thus be debugged in parallel and should not interfere with current workflows. Each site will have its gLExec infrastructure regularly tested through SAM. The Management Board proposed such tests to become critical for the site availability computations in a number of months. The tentative deadline was Oct 1, 2013, while the actual deadline will likely be coupled to the timeline for the WN migration to SL6.

Further documentation is available here.

Task tracking

Task Deadline Progress Affected VOs Affected Sites Comments

Notes on the following tables

For every site the cell for each officially supported LHC experiment should have links to:

  • the SAM-3 summary of gLExec test results for the experiment
    • the previously used MyWLCG service has been retired on Jan 26, 2015
  • the latest Nagios test results for all CEs of the type used by the site
    • for now there is no shortcut directly to the CE(s) of the site
    • to access those pages one needs a certificate from an IGTF CA loaded in the browser

An unsupported experiment just has a dash in its cell.

For the Ops VO there is a link to the MyEGI summary.

The background color  cyan  is used to indicate that tests for the given VO were successful on the given date, which implies the following conditions:

  1. the site's gLExec infrastructure was working;
  2. the VO actually sent a (successful) test via its SAM-Nagios framework.

As with any service, subsequent tests may fail for a variety of reasons: the site needs to try keeping the gLExec infrastructure in good shape. To facilitate early detection of failures, EGI sites are advised to support gLExec testing by the Ops VO as well.

The following topic macros have been defined to facilitate manipulating the table:

    %alice_arc{name}%      - links for ALICE ARC   sites
    %alice_cream{name}%    - links for ALICE CREAM sites

    %atlas_arc{name}%      - links for ATLAS ARC   sites
    %atlas_cream{name}%    - links for ATLAS CREAM sites
    %atlas_osg{name}%      - links for ATLAS OSG   sites

    %cms_arc{name}%        - links for CMS   ARC   sites
    %cms_cream{name}%      - links for CMS   CREAM sites
    %cms_osg{name}%        - links for CMS   OSG   sites

    %lhcb_arc{name}%       - links for LHCb  ARC   sites
    %lhcb_cream{name}%     - links for LHCb  CREAM sites

    %ops{id}%              - links for Ops   EGI   sites

The name is the site's experiment-specific name. The id is the site's numeric ID in the MyEGI DB.

For each macro there also is a version with Done attached to the name (e.g. opsDone) which will make the cell's background color  cyan .

NOTE: when the line for a site is updated (e.g. it now passes the tests for some VO), its date should be adjusted correspondingly.

CERN and Tier-1 sites

Site Alice Atlas CMS LHCb Ops Date Comments
ASGC -
atlas  N
- - 2013-06-30  
BNL -
atlas  N
- - - 2013-07-30  
CERN
alice  N
atlas  N
cms  N
lhcb  N
2013-07-03  
FNAL - -
cms  N
- - 2013-06-30  
IN2P3-CC
alice  N
atlas  N
cms  N
lhcb  N
2013-07-10  
INFN-T1
alice  N
atlas  N
cms  N
lhcb  N
2013-06-30  
JINR-T1 - -
cms  N
- 2013-07-02  
KISTI
alice  N
- - - 2013-07-10  
KIT
alice  N
atlas  N
cms  N
lhcb  N
2013-07-30  
NDGF-T1 ? ? - - - 2013-06-30 n/a ?
NIKHEF
alice  N
atlas  N
-
lhcb  N
2013-06-30  
PIC -
atlas  N
cms  N
lhcb  N
2013-06-30  
RAL
alice  N
atlas  N
cms  N
lhcb  N
2013-06-30  
RRC-KI-T1 alice  N atlas  N - lhcb  N egi 2013-06-30 GGUS:95225
SARA
alice  N
atlas  N
-
lhcb  N
2013-07-15  
TRIUMF -
atlas  N
- - 2013-06-30  

Tier-2 sites

EGI

Site Alice Atlas CMS LHCb Ops Date Comments
Australia
Australia-ATLAS -
atlas  N
- - 2014-06-02 Ops tested manually
Austria
HEPHY-UIBK -
atlas  N
- - 2013-07-26  
Hephy-Vienna - -
cms  N
- 2013-06-30  
Belgium
BEgrid-ULB-VUB - -
cms  N
- 2013-06-30  
BelGrid-UCL - -
cms  N
- 2013-07-03  
Canada
CA-MCGILL-CLUMEQ-T2 -
atlas  N
- - 2014-05-29  
CA-SCINET-T2 -
atlas  N
- - 2014-05-19  
CA-VICTORIA-WESTGRID-T2 -
atlas  N
- - 2014-05-13 log-only mode
SFU-LCG2 -
atlas  N
- - 2013-12-17  
China
BEIJING-LCG2 -
atlas  N
cms  N
- 2013-07-26  
Czech Republic
praguelcg2
alice  N
atlas  N
- - 2013-11-21  
Estonia
T2_Estonia - -
cms  N
- - 2013-07-02  
Finland
FI_HIP_T2 - -
cms  N
- - 2013-07-09  
France
GRIF
alice  N

alice  N
atlas  N

atlas  N

atlas  N
cms  N

cms  N
lhcb  N

lhcb  N

lhcb  N
2013-07-17  
IN2P3-CC-T2
alice  N
atlas  N
cms  N
lhcb  N
2013-07-10  
IN2P3-CPPM -
atlas  N
-
lhcb  N
2013-06-30  
IN2P3-IRES
alice  N
-
cms  N
- 2013-06-30  
IN2P3-LAPP -
atlas  N
-
lhcb  N
2013-06-30  
IN2P3-LPC
alice  N
atlas  N
-
lhcb  N
2013-08-26  
IN2P3-LPSC
alice  N
atlas  N
- - 2013-07-29  
IN2P3-SUBATECH
alice  N
- - - 2013-08-13  
Germany
DESY-HH -
atlas  N
cms  N
- 2013-07-04 log-only mode
DESY-ZN -
atlas  N
-
lhcb  N
2013-09-05  
GoeGrid - atlas  N - - egi 2013-06-30 GGUS:95243
GSI-LCG2 ? - - - - 2013-06-30  
LRZ-LMU - ? - - - 2013-10-07 ARC
MPPMU -
atlas  N
- - 2013-09-24  
RWTH-Aachen - -
cms  N
- 2013-08-13  
UNI-FREIBURG - atlas  N - - egi 2013-06-30 GGUS:95248
Wuppertal - ? - - - 2013-09-30 ARC
Greece
GR-07-UOI-HEPLAB - -
cms  N
- 2013-07-03  
Hungary
BUDAPEST
alice  N
-
cms  N
- 2013-06-30  
India
IN-DAE-VECC-02 alice  N - - - egi 2013-06-30 GGUS:95251
INDIACMS-TIFR - -
cms  N
- 2013-08-27  
Israel
IL-TAU-HEP -
atlas  N
- - 2013-12-26  
TECHNION-HEP -
atlas  N
- - 2013-12-26  
WEIZMANN-LCG2 -
atlas  N
- - 2013-07-31  
Italy
INFN-BARI
alice  N
-
cms  N
- 2013-11-23 log-only mode
INFN-CATANIA
alice  N
- - - 2014-04-08  
INFN-CNAF-LHCB - - -
lhcb  N
2013-06-30  
INFN-FRASCATI -
atlas  N
- - 2014-02-19  
INFN-LNL-2
alice  N
-
cms  N
- 2013-06-30  
INFN-MILANO-ATLASC -
atlas  N
- - 2013-12-09  
INFN-NAPOLI-ATLAS -
atlas  N
- - 2013-12-18  
INFN-PISA - -
cms  N
lhcb  N
2014-02-18  
INFN-ROMA1 -
atlas  N
- - 2013-07-22  
INFN-ROMA1-CMS - -
cms  N
- 2013-06-30  
INFN-TORINO alice  N - - - egi 2013-06-30 GGUS:95263
Japan
TOKYO-LCG2 - atlas  N - - egi 2013-06-30 GGUS:95264
Norway
NO-NORGRID-T2 - ? - - - 2013-06-30 n/a ?
Pakistan
NCP-LCG2 - -
cms  N
- 2013-09-10  
Poland
CYFRONET-LCG2
alice  N
atlas  N
-
lhcb  N
egi 2015-05-26  
ICM - -
cms  N
lhcb  N
2013-10-30  
PSNC
alice  N
atlas  N
-
lhcb  N
2013-09-05  
Portugal
LIP-Coimbra -
atlas  N
- - 2013-06-30  
LIP-Lisbon - T3 - - 2013-07-03  
NCG-INGRID-PT -
atlas  N
cms  N
- 2013-07-05  
Republic of Korea
KR-KISTI-GCRT-01
alice  N
- - - 2013-07-11  
LCG_KNU - -
cms  N
- 2013-07-12  
Romania
NIHAM ? - - - - 2013-06-30  
RO-02-NIPNE -
atlas  N
- - 2014-05-20  
RO-07-NIPNE
alice  N
atlas  N
-
lhcb  N
2014-03-03  
RO-11-NIPNE - - -
lhcb  N
2014-03-05  
RO-13-ISS
alice  N
- - - 2013-11-26  
RO-14-ITIM -
atlas  N
- - 2013-11-14  
RO-16-UAIC -
atlas  N
- - 2013-11-11  
Russian Federation
ITEP
alice  N
atlas  N
cms  N
lhcb  N
2013-07-17  
JINR-LCG2
alice  N
atlas  N
cms  N
lhcb  N
2013-08-31  
RRC-KI alice  N atlas  N cms  N lhcb  N egi 2013-06-30 GGUS:95225
ru-Moscow-FIAN-LCG2 -
atlas  N
cms  N
- 2013-11-13  
ru-Moscow-SINP-LCG2 -
atlas  N
cms  N
lhcb  N
2013-12-15  
ru-PNPI
alice  N
atlas  N
cms  N
lhcb  N
2014-02-03  
RU-Protvino-IHEP
alice  N
atlas  N
cms  N
lhcb  N
2013-12-11  
RU-SPbSU
alice  N
- -
lhcb  N
2013-07-25  
Ru-Troitsk-INR-LCG2
alice  N
-
cms  N
lhcb  N
2013-12-21  
Slovak Republic
FMPhI-UNIBA
alice  N
atlas  N
- - 2013-06-30  
IEPSAS-Kosice
alice  N
atlas  N
- - 2013-07-23  
Slovenia
SiGNET - ? - - - 2013-06-30 n/a ?
Spain
CIEMAT-LCG2 - -
cms  N
- 2013-06-30  
ifae -
atlas  N
- - 2013-07-02  
IFCA-LCG2 - -
cms  N
- 2013-06-30  
IFIC-LCG2 -
atlas  N
- - 2013-10-31  
UAM-LCG2 -
atlas  N
- - 2013-07-11  
UB-LCG2 - - -
lhcb  N
2013-09-10  
USC-LCG2 - - -
lhcb  N
2013-07-01  
Sweden
SE-SNIC-T2 ? ? - - - 2013-06-30 n/a ?
Switzerland
CSCS-LCG2 -
atlas  N
cms  N
lhcb  N
2013-07-01  
UNIBE-LHEP - ? - - - 2013-06-30 n/a ?
Taipei
TW-FTT -
atlas  N
- - 2013-06-30  
Turkey
TR-03-METU - -
cms  N
- 2013-07-04  
TR-10-ULAKBIM -
atlas  N
- - 2013-07-25  
UK
EFDA-JET - - -
lhcb  N
2014-01-17  
UKI-LT2-Brunel -
atlas  N
cms  N
lhcb  N
2013-06-30  
UKI-LT2-IC-HEP -
atlas  N
cms  N
lhcb  N
2013-06-30  
UKI-LT2-QMUL -
atlas  N
cms  N
lhcb  N
2013-11-14  
UKI-LT2-RHUL -
atlas  N
cms  N
lhcb  N
2013-11-05  
UKI-LT2-UCL-HEP - atlas  N - - egi 2013-06-30 GGUS:95298
UKI-NORTHGRID-LANCS-HEP - atlas  N - lhcb  N egi 2013-06-30 GGUS:95299
UKI-NORTHGRID-LIV-HEP -
atlas  N
-
lhcb  N
2013-06-30  
UKI-NORTHGRID-MAN-HEP -
atlas  N
-
lhcb  N
2013-10-04  
UKI-NORTHGRID-SHEF-HEP -
atlas  N
-
lhcb  N
2014-01-27  
UKI-SCOTGRID-DURHAM - - -
lhcb  N
2014-01-29  
UKI-SCOTGRID-ECDF - atlas  N - lhcb  N egi 2013-06-30 GGUS:95303
UKI-SCOTGRID-GLASGOW -
atlas  N
cms  N
lhcb  N
2013-06-30  
UKI-SOUTHGRID-BHAM-HEP
alice  N
atlas  N
-
lhcb  N
2013-10-11  
UKI-SOUTHGRID-BRIS-HEP - -
cms  N
lhcb  N
2013-11-22  
UKI-SOUTHGRID-CAM-HEP -
atlas  N
-
lhcb  N
2013-11-04  
UKI-SOUTHGRID-OX-HEP
alice  N
atlas  N
cms  N
lhcb  N
2013-07-04  
UKI-SOUTHGRID-RALPP -
atlas  N
cms  N
lhcb  N
2013-07-05  
UKI-SOUTHGRID-SUSX -
atlas  N
- - 2013-08-14  
Ukraine
Kharkov-KIPT-LCG2 - -
cms  N
- 2013-06-30  
UA-BITP
alice  N
- - - 2013-08-14  
UA-ISMA
alice  N
- - - 2014-02-08  
UA-KNU
alice  N
? - - 2013-12-03  

OSG

Site Alice Atlas CMS LHCb Ops Date Comments
USALICE
LC-glcc ? - - - - 2013-06-30  
NERSC-PDSF ? - - - - 2013-06-30  
USATLAS
AGLT2 - atlas  N - - - 2013-06-30  
BU_ATLAS_Tier2 - atlas  N - - - 2013-06-30  
HU_ATLAS_Tier2 - ? - - - 2013-06-30  
MWT2 - atlas  N - - - 2013-06-30  
MWT2_UC - atlas  N - - - 2013-06-30  
OU_OCHEP_SWT2 - atlas  N - - - 2013-06-30  
SWT2_CPB - atlas  N - - - 2013-06-30  
UTA_SWT2 - atlas  N - - - 2013-06-30  
WT2 - atlas  N - - - 2013-06-30  
USCMS
Caltech - -
cms  N
- - 2013-06-30  
Florida - -
cms  N
- - 2013-06-30  
MIT - -
cms  N
- - 2013-06-30  
Nebraska - -
cms  N
- - 2013-06-30  
Purdue - -
cms  N
- - 2013-06-30  
UCSD - -
cms  N
- - 2013-06-30  
Vanderbilt - -
cms  N
- - 2013-06-30  
Wisconsin - -
cms  N
- - 2013-06-30  
Brazil
GridUNESP_CENTRAL - - ? - - 2013-06-30  
SPRACE - -
cms  N
- - 2013-06-30  
Edit | Attach | Watch | Print version | History: r128 < r127 < r126 < r125 < r124 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r128 - 2016-03-17 - MaartenLitmaath
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback