LCG Grid Deployment -
CERN ROC -
CERN ROC Procedures
SFT Test Suite for ROC
The installation of the SFT instance for the CERN OC is done on the model of the one done for the
Pre-Production Service.
So please refer to that page if you are looking for hints and technical details about the installation. Here we give only the correct pointers to the CERN ROC installation.
SFT client on the AFS UI
The client has been installed following the instructions in
http://goc.grid.sinica.edu.tw/gocwiki/SFT_Client_installation
The installation directory is
/afs/cern.ch/project/gd/egee/sft-roc-cern-glite
The configuration file
defaults.glite is
SFT_JOB_SUBMIT_CMD=glite-job-submit
SFT_JOB_STATUS_CMD=glite-job-status
SFT_JOB_OUTPUT_CMD=glite-job-output
SFT_JOB_LOGGING_CMD=glite-job-logging-info
SFT_JOB_LISTMATCH_CMD=glite-job-list-match
SFT_JOB_CANCEL_CMD=glite-job-cancel
SFT_PUBLISHER_PROXY=http://lcg-sft-publish.cern.ch:8083/sft/publishTuple
#SFT_GOC_MAP_SELECT="select GocSite_v0_4.siteID,hostname,sitename,region,inMaintenance from GocSite_v0_4, GocNode_v0_4 where GocSite_v0_4.siteID=GocNode_v0_4.siteID and nodetype='gliteCE' and monitor='Y' and inMonitoring='Y' and status<>'certified' and region='CERN' order by GocSite_v0_4.siteID"
SFT_GOC_MAP_SELECT="select GocSite_v0_4.siteID,hostname,sitename,region,inMaintenance from GocSite_v0_4, GocNode_v0_4 where GocSite_v0_4.siteID=GocNode_v0_4.siteID and (nodetype='gLite-CE' or nodetype='CE') and monitor='Y' and inMonitoring='Y' and status<>'certified' and region='CERN' order by GocSite_v0_4.siteID"
#SFT_GOC_MAP_URL=http://grid-deployment.web.cern.ch/grid-deployment/gis/sft2/glite-nodes.txt
SFT_LCG_VER_FILTER="LCG-[23]_[4567890123]"
The default flavour of the SFT tests used on PPS is "glite". The
defaults file is
SFT_VO=dteam
# default definitions for status codes
SFT_OK=10
SFT_INFO=20
SFT_NOTICE=30
SFT_WARNING=40
SFT_ERROR=50
SFT_CRITICAL=60
SFT_TYPE=glite
#SFT_LCG_CATALOG_TYPE=edg
SFT_LCG_CATALOG_TYPE=lfc
SFT_LFC_HOME=/grid/$SFT_VO/SFT
SFT_SAME_PUBLISHER_WSDL=http://gvdev.cern.ch:8080/gridview/services/WebArchiver?wsdl
The
tests.glite file looks like:
sft-wn
sft-softver
sft-caver --conf data/ca_data.dat --web
sft-brokerinfo
sft-csh
sft-lcg-rm
sft-vo-tag
sft-vo-swdir
sft-rgma
sft-rgma-sc
sft-crl
sft-apel
The list of RB in
prefRB.lst.glite is
lxb2086.cern.ch
NOTE:
lxb2086.cern.ch
is a
gLiteWMS, which allows jobs to be sent both to LCG and gLiteCEs.
The list of SE in
prefSE.lst is
grid007g.cnaf.infn.it
NOTE: The choice of
grid007g.cnaf.infn.it
as the destination for the RM tests was carefully made. This SE has the important characteristic to be known both by the
Production and
pre-production BDIIs. So it basically belongs to two grids. This allows also PPS CEs accessing the production WNs to pass the RM tests.
Details of the ROC SFT client instance
The PPS SFT client has been set-up to write on
lxb1908
in
/afs/cern.ch/project/gd/egee/sft-roc-cern-glite
as follows:
> cat /afs/cern.ch/project/gd/egee/sft-roc-cern-glite/sft-glite-workdir.cfg
SFT_WORK=/afs/cern.ch/project/gd/egee/sft-roc-cern-glite/workdir-glite
To use it you need to specify the configuration file in the command line.
> ./sftests -c sft-glite-workdir.cfg submit
> ./sftests -c sft-glite-workdir.cfg status
> ./sftests -c sft-glite-workdir.cfg publish
I created a script to run it directly from lxb1908. Note that the Information system used has been redefined to lxb2086.cern.ch, which contains only sites in CERN ROC to be certified.
> cat /afs/cern.ch/project/gd/egee/sft-roc-cern-glite/submit-sft-glite-tests.sh
#!/bin/sh
setenv LCG_GFAL_INFOSYS lxb2086.cern.ch:2170
source /etc/glite/profile.d/glite_setenv.sh
cat /afs/cern.ch/user/a/aretico/private/pass | voms-proxy-init -voms dteam -pwstdin
sleep 2
/afs/cern.ch/project/gd/egee/sft-roc-cern-glite/sftests -c /afs/cern.ch/project/gd/egee/sft-roc-cern-glite/sft-glite-workdir.cfg publish
sleep 2
/afs/cern.ch/project/gd/egee/sft-roc-cern-glite/sftests -c /afs/cern.ch/project/gd/egee/sft-roc-cern-glite/sft-glite-workdir.cfg submit
exit
Cron jobs
> cat /afs/cern.ch/project/gd/egee/gocdb-xfer/launch-gocdb-xfer.sh
#!/bin/sh
source /etc/glite/profile.d/glite_setenv.sh
cat mysecret | voms-proxy-init -voms dteam -pwstdin
sleep 2
/afs/cern.ch/project/gd/egee/gocdb-xfer/gocdb-xfer.py
exit
00 * * * * lxb1908.cern.ch /afs/cern.ch/project/gd/egee/gocdb-xfer/launch-gocdb-xfer.sh> /afs/cern.ch/project/gd/egee/gocdb-xfer/gocdb-xfer.log 2>&1
45 * * * * lxb1908.cern.ch /afs/cern.ch/project/gd/egee/sft-roc-cern-glite/submit-sft-glite-tests.sh > /afs/cern.ch/project/gd/egee/sft-roc-cern-glite/sft-glite-cron.log 2>&1
NOTE: connections from lxb1908.cern.ch had to be previously authorized from the administrators of the GOC DB.
Display
https://lcg-sft.cern.ch/sft-CERN-ROC/lastreport.cgi
Maintenance
Upgrade CA
on a AFS UI (example for user=aretico)
setenv CVSROOT :ext:aretico@glite.cvs.cern.ch:/cvs/glite
[aretico@lxplus ~/cvs] cvs co sft2
...
[aretico@lxplus ~/cvs] cd /afs/cern.ch/project/gd/egee/sft-roc-cern-glite
[aretico@lxplus sft-roc-cern-glite cp data/ca_data.dat data/ca_data.dat.bak
[aretico@lxplus sft-roc-cern-glite cp ~/cvs/sft2/data/ca_data.dat data/ca_data.dat
-- Main.aretico - 24 May 2006