Using different versions of the gLite middleware on Worker Nodes

We provide recent versions of the tarball Worker Node on already existing Worker Nodes. By using special JDL attributes a user can enable jobs to use the desired version of gLite on WNs.

Usage

Worker Node tarballs are versioned according to the the meta rpm that was used to create the tarball (e.g. glite-WN-3.1.4-1). Tarballs intended for PPS are prefixed with "PPS-" and contain also the creation date (e.g. PPS-glite-WN-3.1.6-1_2008-01-25). Look at the tarball WN page for more information. When a site has some version of the tarball Worker Node installed it publishes this as a tag "VO-ops-WNtar-GLITE-<WN-version>", e.g. PPS-glite-WN-3.1.6-1_2008-01-25 would be published as "VO-ops-WNtar-GLITE-3.1.6-1_2008-01-25". You can find out about sites having WN_TARs installed with the command
lcg-info --list-ce --vo <your VO> --attrs Tag --query 'Tag=VO-ops-WNtar-GLITE-*'
To use a certain version of the tarball Worker Node you have to add two attributes to the JDL:
MWVersion = "<WN_TAR version>";
Requirements = Member("VO-ops-WNtar-GLITE-<WN_TAR version>",other.GlueHostApplicationSoftwareRunTimeEnvironment);
For example, to use (PPS) WN_TAR version 3.1.4-0_2008-01-11 one has to add
MWVersion = "3.1.4-0_2008-01-11";
Requirements = Member("VO-ops-WNtar-GLITE-3.1.4-0_2008-01-11",other.GlueHostApplicationSoftwareRunTimeEnvironment);
Now you can check the available CEs:

bash-3.00$ glite-wms-job-list-match -d <myDelegatedProxy> test.jdl

Connecting to the service https://wms101.cern.ch:7443/glite_wms_wmproxy_server

==========================================================================

                     COMPUTING ELEMENT IDs LIST
 The following CE(s) matching your job requirements have been found:

        *CEId*
 - a01-004-128.gridka.de:2119/jobmanager-pbspro-gLite3
 - ce-1-fzk.gridka.de:2119/jobmanager-pbspro-gLite3
 - ce-2-fzk.gridka.de:2119/jobmanager-pbspro-gLite3
 - dgc-grid-35.brunel.ac.uk:2119/jobmanager-lcgpbs-rampdown
 - dgc-grid-35.brunel.ac.uk:2119/jobmanager-lcgpbs-short
 - grid-ce3.desy.de:2119/jobmanager-lcgpbs-default
 - grid-ce3.desy.de:2119/jobmanager-lcgpbs-testing
 - hephygr.oeaw.ac.at:2119/jobmanager-lcgpbs-dteam
 - nanlcg01.in2p3.fr:2119/jobmanager-pbs-dteam
 - ce-fzk.gridka.de:2119/jobmanager-pbspro-gLite3

==========================================================================

If the job lands on the Worker Node it is ensured that its environment is pointing to the desired WN_TAR version (the version is detemined by the MWVersion JDL attribute). By using the above Requirements attribute you make sure that the job lands on a WN having the right WN_TAR version installed. If you use only MWVersion and the required WN_TAR is not installed on the site you won't get any error message; instead your job gets the default WN environment available on the site. You have to submit your job through a WMS in order to make this mechanism to work.

Availabilty

WN_TAR versions available: 3.1.6-2_2008-01-31

Sites providing WN_TAR versions: DESY-HH, FZK-LCG2, Hephy-Vienna, IN2P3-SUBATECH, UKI-LT2-BRUNEL

We are working on installing the WN_TAR on more sites. The above list will be updated on a regular bases.

Problems

On many sites newer versions of WN_TAR cannot be used. The reasons are
  • VO_OPS_SW_DIR is not available (WN_TAR is installed by ops into VO_OPS_SW_DIR).
  • VO_OPS_SW_DIR is not readable by other VOs.
  • No recent version of the script a1_grid_env.sh is installed on the WN. This script must reside in /etc/profile.d and needs to be at least version 3.0.0-1 (the rpm a1_grid_env-* is part of the glite-WN distribution and is also included in recent WN_TAR external tarballs).

If one of the above points holds for your site please fix it.

Contact

Andreas Unterkircher

-- AndreasUnterkircher - 29 Jan 2008

Edit | Attach | Watch | Print version | History: r4 < r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r4 - 2008-02-18 - AndreasUnterkircher
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback