LCG Grid Deployment - CERN ROC - CERN ROC Procedures

SFT Test Suite for ROC

The installation of the SFT instance for the CERN OC is done on the model of the one done for the Pre-Production Service.

So please refer to that page if you are looking for hints and technical details about the installation. Here we give only the correct pointers to the CERN ROC installation.

SFT client on the AFS UI

  • The installation directory is

/afs/cern.ch/project/gd/egee/sft-roc-cern-glite

  • The configuration file defaults.glite is
SFT_JOB_SUBMIT_CMD=glite-job-submit
SFT_JOB_STATUS_CMD=glite-job-status
SFT_JOB_OUTPUT_CMD=glite-job-output
SFT_JOB_LOGGING_CMD=glite-job-logging-info
SFT_JOB_LISTMATCH_CMD=glite-job-list-match
SFT_JOB_CANCEL_CMD=glite-job-cancel

SFT_PUBLISHER_PROXY=http://lcg-sft-publish.cern.ch:8083/sft/publishTuple
#SFT_GOC_MAP_SELECT="select GocSite_v0_4.siteID,hostname,sitename,region,inMaintenance from GocSite_v0_4, GocNode_v0_4 where GocSite_v0_4.siteID=GocNode_v0_4.siteID and nodetype='gliteCE'  and monitor='Y' and inMonitoring='Y' and status<>'certified' and region='CERN' order by GocSite_v0_4.siteID"
SFT_GOC_MAP_SELECT="select GocSite_v0_4.siteID,hostname,sitename,region,inMaintenance from GocSite_v0_4, GocNode_v0_4 where GocSite_v0_4.siteID=GocNode_v0_4.siteID and (nodetype='gLite-CE' or nodetype='CE') and monitor='Y' and inMonitoring='Y' and status<>'certified' and region='CERN' order by GocSite_v0_4.siteID"

#SFT_GOC_MAP_URL=http://grid-deployment.web.cern.ch/grid-deployment/gis/sft2/glite-nodes.txt
SFT_LCG_VER_FILTER="LCG-[23]_[4567890123]"

  • The default flavour of the SFT tests used on PPS is "glite". The defaults file is
SFT_VO=dteam

# default definitions for status codes
SFT_OK=10
SFT_INFO=20
SFT_NOTICE=30
SFT_WARNING=40
SFT_ERROR=50
SFT_CRITICAL=60

SFT_TYPE=glite

#SFT_LCG_CATALOG_TYPE=edg

SFT_LCG_CATALOG_TYPE=lfc
SFT_LFC_HOME=/grid/$SFT_VO/SFT

SFT_SAME_PUBLISHER_WSDL=http://gvdev.cern.ch:8080/gridview/services/WebArchiver?wsdl

  • The tests.glite file looks like:
sft-wn 
sft-softver
sft-caver --conf data/ca_data.dat --web
sft-brokerinfo 
sft-csh
sft-lcg-rm
sft-vo-tag
sft-vo-swdir
sft-rgma
sft-rgma-sc
sft-crl
sft-apel

  • The list of RB in prefRB.lst.glite is
lxb2086.cern.ch

NOTE: lxb2086.cern.ch is a gLiteWMS, which allows jobs to be sent both to LCG and gLiteCEs.


lxb2086 is also a top Level BDII , which uses the configuration file in

/afs/cern.ch/project/gd/egee/www/roc-cern/bdii/cern-roc-all-sites.conf

this file is generated by merging the production BDII configuration file

/afs/cern.ch/project/gd/www/gis/lcg2-bdii/dteam/lcg2-all-sites.conf

with a list of sites under observation by the Cern ROC (e.g. suspended, candidate, uncertified sites)

/afs/cern.ch/project/gd/egee/www/roc-cern/bdii/observed-sites.conf

The script that creates the BDII configuration file (currently run by Antonio) in his crontab is:

[aretico@lxb1908 bdii] cat /afs/cern.ch/project/gd/egee/www/roc-cern/bdii/create-roc-bdii-conf.sh
#!/bin/sh

# to be run in user's crontab
# currently run in acrontab :by Antonio
# 05 2 * * * lxplus.cern.ch /afs/cern.ch/project/gd/egee/www/roc-cern/bdii/create-roc-bdii-conf.sh 

BDII_PROD_CONF=/afs/cern.ch/project/gd/www/gis/lcg2-bdii/dteam/lcg2-all-sites.conf
BDII_OBS_CONF=/afs/cern.ch/project/gd/egee/www/roc-cern/bdii/observed-sites.conf
BDII_ROC_CONF=/afs/cern.ch/project/gd/egee/www/roc-cern/bdii/cern-roc-all-sites.conf

cat << EOF > ${BDII_ROC_CONF}
#
# ROC-CERN BDII configuration file.
# 
# This file is generated by the script
#
#    ${0}
#
# It is the result of merging the files
# ${BDII_PROD_CONF} 
# and 
# ${BDII_OBS_CONF}
# 
# Manual modifications by the CERN-ROC team should be done only in
# ${BDII_ROC_CONF}
#

# ----------------------------------
# Start of merged info
# ----------------------------------

EOF

cat ${BDII_PROD_CONF} ${BDII_OBS_CONF} >> ${BDII_ROC_CONF}

cat << EOF >> ${BDII_ROC_CONF}

# ----------------------------------
# End of merged info
# ----------------------------------

EOF


  • The list of SE in prefSE.lst is
srm.cern.ch

Details of the ROC SFT client instance

The PPS SFT client has been set-up to write on lxb1908 in /afs/cern.ch/project/gd/egee/sft-roc-cern-glite as follows:

> cat /afs/cern.ch/project/gd/egee/sft-roc-cern-glite/config-sft.cfg
SFT_WORK=/afs/cern.ch/project/gd/egee/sft-roc-cern-glite/workdir-glite
LCG_GFAL_INFOSYS=lxb2086.cern.ch:2170
To use it you need to specify the configuration file in the command line.
>  ./sftests -c config-sft.cfg submit
>  ./sftests -c config-sft.cfg status
>  ./sftests -c config-sft.cfg publish

I created a script to run it directly from lxb1908. Note that the Information system used has been redefined to lxb2086.cern.ch, which contains only sites in CERN ROC to be certified.

> cat /afs/cern.ch/project/gd/egee/sft-roc-cern-glite/submit-sft-glite-tests.sh

#!/bin/sh

# use PPS ui
source /afs/cern.ch/project/gd/egee/glite/ui_PPS_glite3.0_RC5/etc/profile.d/grid_env.sh

# use local ui
#source /etc/glite/profile.d/glite_setenv.sh

# use ROC BDII
#export LCG_GFAL_INFOSYS=lxb2086.cern.ch:2170


cat /afs/cern.ch/user/a/aretico/private/pass | voms-proxy-init -voms dteam -pwstdin
sleep 2
/afs/cern.ch/project/gd/egee/sft-roc-cern-glite/sftests -c /afs/cern.ch/project/gd/egee/sft-roc-cern-glite/config-sft.cfg publish
sleep 2

/afs/cern.ch/project/gd/egee/sft-roc-cern-glite/sftests -c /afs/cern.ch/project/gd/egee/sft-roc-cern-glite/config-sft.cfg submit

exit

Cron jobs

> cat /afs/cern.ch/project/gd/egee/gocdb-xfer/launch-gocdb-xfer.sh

#!/bin/sh

# use PPS ui
source /afs/cern.ch/project/gd/egee/glite/ui_PPS_glite3.0_RC5/etc/profile.d/grid_env.sh

cat /afs/cern.ch/user/a/aretico/private/pass | voms-proxy-init -voms dteam -pwstdin
sleep 2
/afs/cern.ch/project/gd/egee/gocdb-xfer/gocdb-xfer.py

exit
  • > acrontab -l

05 2 * * * lxplus.cern.ch /afs/cern.ch/project/gd/egee/www/roc-cern/bdii/create-roc-bdii-conf.sh 
00 * * * * lxb1908.cern.ch /afs/cern.ch/project/gd/egee/gocdb-xfer/launch-gocdb-xfer.sh> /afs/cern.ch/project/gd/egee/gocdb-xfer/gocdb-xfer.log 2>&1
45 * * * * lxb1908.cern.ch /afs/cern.ch/project/gd/egee/sft-roc-cern-glite/submit-sft-glite-tests.sh > /afs/cern.ch/project/gd/egee/sft-roc-cern-glite/sft-glite-cron.log 2>&1

NOTE: connections from lxb1908.cern.ch had to be previously authorized from the administrators of the GOC DB.

Display

https://lcg-sft.cern.ch/sft-CERN-ROC/lastreport.cgi

Maintenance

Upgrade CA

on a AFS UI (example for user=aretico)

setenv CVSROOT :ext:aretico@glite.cvs.cern.ch:/cvs/glite [aretico@lxplus ~/cvs] cvs co sft2 ... [aretico@lxplus ~/cvs] cd /afs/cern.ch/project/gd/egee/sft-roc-cern-glite [aretico@lxplus sft-roc-cern-glite cp data/ca_data.dat data/ca_data.dat.bak [aretico@lxplus sft-roc-cern-glite cp ~/cvs/sft2/data/ca_data.dat data/ca_data.dat

-- Main.aretico - 24 May 2006

Edit | Attach | Watch | Print version | History: r7 < r6 < r5 < r4 < r3 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r4 - 2006-07-21 - unknown
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback