Condor batch system with lcg-CE 3.1 as Condor Submitter

Installation of the Condor software

This step is required both for the Condor Server/Condor Client and the Condor Submitter. It can be done independently from the other steps, but should be done before running YAIM.

Download the latest stable Condor package condor-7.0.x-linux-x86-rhel3-dynamic-1.i386.rpm from http://www.cs.wisc.edu/condor/downloads-v2/download.pl and installed it in the node.

  [root@condor_* root]# yum localinstall condor-7.0.5-linux-x86-rhel3-dynamic-1.i386.rpm

Be aware that running Condor has security implications. You are adviced to consult the Condor manual about security, and stay up-to-date with security fixes. There are known vulnerabilities in versions prior to 7.0.5, see the Release notes.

Installation of the Condor Server/Condor Client

For the moment we will support the installation of the Condor Server/Condor Client only together with the installation of a glite-WN 3.1. We will go on investigating what is the minimum requirement of RPMs to run a Condor Server/Condor Client to enable a standalone node. Now with the combined installation of a glite-WN 3.1 and the CONDOR_server/CONDOR_client you are on the safe side.

Following recommendations from YAIM, it is NOT possible to install the CONDOR_server and CONDOR_client together on one machine following the instructions given here!!!

First install the java following the instructions https://twiki.cern.ch/twiki/bin/view/LCG/GenericInstallGuide310#jpackage_and_the_JAVA_repository

gLite repositories used:

Besides the CERN repositories for SLC4, the DAG repositories and the jpackages, you have to enable the following gLite repositories:

  [glite]
  name=gLite 3.1 (production)
  baseurl=http://linuxsoft.cern.ch/EGEE/gLite/R3.1/generic/sl4/i386
  enabled=1

  [CA]
  name=CAs
  baseurl=http://linuxsoft.cern.ch/LCG-CAs/current
  enabled=1

Do an update of the repositories:

  [root@condor_* root]# yum update

Now would be a good time to install Condor (see above).

Now install the lcg-CA and glite-WN metapackage:

  [root@condor_* root]# yum install lcg-CA
  [root@condor_* root]# yum install glite-WN

For the moment the RPMs for the CONDOR_server/CONDOR_client are available from ETICS: http://eticssoft.web.cern.ch/eticssoft/repository/org.glite/org.glite.yaim.condor-server/4.0.1/noarch/glite-yaim-condor-server-4.0.1-3.noarch.rpm (http://eticssoft.web.cern.ch/eticssoft/repository/org.glite/org.glite.yaim.condor-client/4.0.1/noarch/glite-yaim-condor-client-4.0.1-4.noarch.rpm)

Install the package CONDOR_server/CONDOR_client:

  [root@condor_server root]# rpm -Uvh glite-yaim-condor-server-4.0.1-3.noarch.rpm
  ([root@condor_client root]# rpm -Uvh glite-yaim-condor-client-4.0.1-4.noarch.rpm)

Condor specific variables you need to set in the site-info.def are:

  
  BATCH_VERSION=7.0.4
  BATCH_BIN_DIR=/opt/condor-$BATCH_VERSION/bin 
  MY_DOMAIN=set_to_the_name_of_your_domain
  BATCH_SERVER=set_to_the_hostname_of_your_condor_head_node

Last but not least configure the node:

  [root@condor_server root]# /opt/glite/yaim/bin/yaim -c -s site-info.def -n glite-WN -n glite-CONDOR_server
  ([root@condor_client root]# /opt/glite/yaim/bin/yaim -c -s site-info.def -n glite-WN -n glite-CONDOR_client)  

Installation of the Condor Submitter

We support the installation of the Condor Submitter together with the installation of a lcg-CE or a creamCE.

First install the java following the instructions https://twiki.cern.ch/twiki/bin/view/LCG/GenericInstallGuide310#jpackage_and_the_JAVA_repository.

gLite repositories used:

Besides the CERN repositories for SLC4, the DAG repositories and the jpackages, you have to enable the following gLite repositories:

  [glite]
  name=gLite 3.1 (production)
  baseurl=http://linuxsoft.cern.ch/EGEE/gLite/R3.1/generic/sl4/i386
  enabled=1

  [CA]
  name=CAs
  baseurl=http://linuxsoft.cern.ch/LCG-CAs/current
  enabled=1

Do an update of the repositories:

  [root@vce01 root]# yum update

Install Condor as described above.

Now install the lcg-CA and lcg-CE metapackages:

  [root@vce01 root]# yum install lcg-CA
  [root@vce01 root]# yum install lcg-CE (glite-CREAM)

Make sure that you have also installed the hostcert.pem and hostkey.pem:

[root@vce01 root]# ls -la /etc/grid-security/
total 164
drwxr-xr-x   5 root root     4096 Nov 12 10:54 .
drwxr-xr-x  63 root root     4096 Nov 10 04:02 ..
....
-rw-r--r--   1 root root     2310 Oct 24 16:49 hostcert.pem
-r--------   1 root root     1053 Oct 24 16:49 hostkey.pem
....

There are two ways of installing the CONDOR_utils:

1. Using the production repo (recommended)

  [root@vce01 root]# yum install glite-CONDOR_utils

2. Using the SA3 repo (if for patch certification):

  [patchXXXX]
  name=gLite 3.1 patchXXXX
  baseurl=http://grid-deployment.web.cern.ch/grid-deployment/glite/cert/3.1/patches/XXXX/sl4/i386/
  enabled=1

  [root@vce01 root]# yum install glite-CONDOR_utils

Condor specific variable you have to set in the site-info.def:

Values that are set already in defaults/glite-condor-utils.pre:

  APEL_DB=accounting
  APEL_DB_URL=jdbc:mysql://$MON_HOST:3306/accounting
  APEL_DB_USER=accounting

Values that need to be set in services/glite-condor-utils:

  CONDOR_ARCH=INTEL
  CONDOR_OS=LINUX

Keep also an eye on the values that are set in the site-info.def, especially:

  JOB_MANAGER=condor
  CE_BATCH_SYS=condor
  CONDORG_INSTALL_PATH=/opt/condor-7.0.4
  BATCH_BIN_DIR=/opt/condor-7.0.4/bin
  BATCH_VERSION=7.0.4
  MY_DOMAIN=name_of_your_domain
  BATCH_SERVER=hostname_of_your_condor_head_node
  APEL_DB_PASSWORD=discuss_that_with_your_dba
  SITE_BDII_HOST=hostname_of_your_site_bdii
  CONFIG_USERS = yes/no Do you want to create the CONDOR_USER?
 CONDOR_USER = condor

You need to set variables related to APEL to be able to terminate the configuration. However, if you are not sure about them, set some arbitrary values, you can change the parser.xml file after the YAIM configuration manually under the advice of your DBA.

Last, configure the nodes:

!!!!!!! Due to a bug in yaim you need to set the path to the condor binaries (PATH=$PATH:/opt/condor-7.0.4/bin) if it is the first run of yaim

For lcg-CE:

 [root@vce01 root]# /opt/glite/yaim/bin/yaim -c -s site-info.def -n lcg-CE -n glite-CONDOR_utils

For cream-CE:

Please note that you don't need to configure the blah parser, but in order to avoid undesired error messages please define all variables required for creamCE. I expect that there will be a clean version in near future.

 [root@vce01 root]# /opt/glite/yaim/bin/yaim -c -s site-info.def -n creamCE -n glite-CONDOR_utils

-- Main.neissner - 12 Nov 2007

Edit | Attach | Watch | Print version | History: r14 < r13 < r12 < r11 < r10 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r14 - 2008-10-28 - ChristianNeissner
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    EGEE All webs login

This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright & by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Ask a support question or Send feedback