Condor batch system with lcg-CE or creamCE as Condor Submitter

Installation of the Condor software

This step is required both for the Condor Server/Condor Client and the Condor Submitter. It can be done independently from the other steps, but should be done before running YAIM.

Download the latest stable Condor package condor-7.2.X-linux-x86-rhel3-dynamic-1.i386.rpm from http://www.cs.wisc.edu/condor/downloads-v2/download.pl and installed it in the node.

$ yum localinstall condor-7.2.x-linux-x86-rhel3-dynamic-1.i386.rpm

Be aware that running Condor has security implications. You are adviced to consult the Condor manual about security, and stay up-to-date with security fixes.

A) Installation of a Condor Server (central manager)

First of all, download the repository and update the system.

$ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-CONDOR_utils.repo -O /etc/yum.repos.d/glite-CONDOR_utils.repo
$ yum update

Then, download and install latest glite-yaim-condor-server package from http://eticssoft.web.cern.ch/eticssoft/repository/org.glite/org.glite.yaim.condor-server. A Condor central manager node does not need a full gLite installation, only needs glite-yaim-core and glite-version which should be pulled as dependencies of glite-yaim-condor-server.

$ yum localinstall glite-yaim-condor-server-4.X.X-X.noarch.rpm

Edit site-info.def and adjust the following variables:

BATCH_SERVER=«hostname of this machine»
BATCH_VERSION=«Condor version (i.e 7.2.4)»
BATCH_BIN_DIR=/opt/condor-$BATCH_VERSION/bin

Finally, configure with YAIM.

$ /opt/glite/yaim/bin/yaim -c -s site-info.def -n glite-CONDOR_server

B) Installation of a Condor Client (execute node)

First of all, update the repositories and upgrade the system.

$ rm /etc/yum.repos.d/jpackage.repo
$ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/jpackage.repo -O /etc/yum.repos.d/jpackage.repo 
$ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-CONDOR_utils.repo -O /etc/yum.repos.d/glite-CONDOR_utils.repo
$ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-WN.repo -O /etc/yum.repos.d/glite-WN.repo
$ yum update

Then, download and install latest glite-yaim-condor-client package from http://eticssoft.web.cern.ch/eticssoft/repository/org.glite/org.glite.yaim.condor-client. In this case, a condor execute node needs a full gLite WN installation below, so install it too.

$ yum install glite-WN
$ yum localinstall glite-yaim-condor-client-4.X.X-X.noarch.rpm

Edit site-info.def and adjust the following variables:

BATCH_SERVER=«hostname of condor head node»
BATCH_VERSION=«Condor version (i.e 7.2.4)»
BATCH_BIN_DIR=/opt/condor-$BATCH_VERSION/bin

Add this machine to the execution node list.

grep `hostname` wn-list.conf || echo `hostname` >> wn-list.conf

Finally, configure with YAIM.

$ /opt/glite/yaim/bin/yaim -c -s site-info.def -n glite-WN -n glite-CONDOR_client

C) Installation of the Condor Submitter

We support the installation of the Condor Submitter together with the installation of a lcg-CE or a creamCE. First of all, make sure you have one of those CE installed (may be not configured).

Then, download the repository and update the system.

$ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-CONDOR_utils.repo -O /etc/yum.repos.d/glite-CONDOR_utils.repo
$ yum update

There are three ways of installing the CONDOR_utils:

1. Using the production repo (recommended):

$ yum install glite-CONDOR_utils

2. Using SA3 repository (for certification):

$ cat > /etc/yum.repos.d/condor-utils-certification.repo << EOF
[patchXXXX]
  name=gLite 3.1 patchXXXX
  baseurl=http://grid-deployment.web.cern.ch/grid-deployment/glite/cert/3.1/patches/XXXX/sl4/i386/
  enabled=1
EOF
$ yum install glite-CONDOR_utils

3. Downloading manually from ETICS certification repository (http://eticssoft.web.cern.ch/eticssoft/repository/org.glite/org.glite.yaim.condor-utils):

$ yum localinstall glite-yaim-condor-utils-4.1.2-1.noarch.rpm

Next, ensure the required configuration variables have a proper value:

- If you have LCG-CE, ensure that the variables are set in in services/glite-condor-utils:

CONDOR_ARCH=INTEL
CONDOR_OS=LINUX

- Keep also an eye on the values that are set in the site-info.def, especially:

CE_HOST=<<hostname of this machine>>
BATCH_SERVER=<<hostname of condor headnode>>
JOB_MANAGER=condor
CE_BATCH_SYS=condor
BATCH_VERSION=<<Condor version (i.e.Por ejemplo: 7.2.4)>>
BATCH_BIN_DIR=/opt/condor-$BATCH_VERSION/bin
#BATCH_LOG_DIR is the path where condor history file is located
BATCH_LOG_DIR=/opt/condor-$BATCH_VERSION/local.<<short hostname of this machine>>/spool

Finally, configure the node with YAIM. Due to a bug in yaim you need to set the path to the condor binaries (PATH=$PATH:/opt/condor-7.2.4/bin) if it is the first run of yaim.

- For LCG-CE:

$ /opt/glite/yaim/bin/yaim -c -s site-info.def -n lcg-CE -n glite-CONDOR_utils

- For creamCE:

$ /opt/glite/yaim/bin/yaim -c -s site-info.def -n creamCE -n glite-CONDOR_utils

-- PauTallada - 24-Nov-2009

Edit | Attach | Watch | Print version | History: r8 | r6 < r5 < r4 < r3 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r4 - 2009-11-24 - PauTallada
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    EGEE All webs login

This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright &© by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Ask a support question or Send feedback