LCG Grid Deployment - gLite Pre Production Services - PPS-CERN Admin Procedures

If a CE has to use LSF as batch system some particular extra configuration is needed.

Notably you need to run AFS clients in order to enable the log parsing.

Installation of AFS clients

Find notes for use of apt at CERN in

http://linux.web.cern.ch/linux/scientific3/docs/install.shtml

> apt-get install openafs

> apt-get install openafs-client

message printed out by apt:

The AFS cache is configured for 100 MB. Edit the /usr/vice/etc/cacheinfo file to change this before running AFS for the first time. You should also set your home cell in /usr/vice/etc/ThisCell.

Also, you may want to edit /etc/pam.d/login and possibly others there to get an AFS token on login.
Put the line:

auth sufficient /lib/security/pam_afs.so try_first_pass ignore_root

before the one for pwdb.

Done.

> vi /usr/vice/etc/ThisCell

and insert cern.ch i.e.

> more /usr/vice/etc/ThisCell cern.ch

> apt-get install lcm

> apt-get install kernel-module-openafs-2.4.21-37.EL.cernsmp

(check the most recent version of the kernel!!!!)

DO NOT DO insmod openafs
(

>  # cd /usr/vice/etc/
>  # ls
>     libafs-2.6.5-7.97-smp.mp.ko
>  # insmod libafs-2.6.5-7.97-smp.mp.ko
>  # lsmod | grep afs
>     libafs                561728  0
>
>  but when I start the startup script I get the following error :
>
>  [....openafs-1.4.0/src/afsd ] # sh afs.rc.linux start
>  Failed to load AFS client, not starting AFS services.
>
>  Can any one please guide me

The default script looks in /usr/vice/etc/modload/... for the module.
You have it in /usr/vice/etc.  At least according to the above.
Also, the default script expects to load the module itself.  That
will fail if the module is already loaded.


)

> /usr/sbin/lcm --configure afsclt

>/sbin/chkconfig --add afs

>/sbin/service afs start

LSF specific configuration

Install the lsf rpms from the afs area:
/afs/cern.ch/project/lsf/7.0/install/sep2007/i386_slc3 (CHECK the version of the rpms!!!)

CERN-CC-LSF-glibc2.3-7.0.3-1.SL3.i386.rpm  
CERN-CC-LSF-glibc2.3-config-7.0.3-1.SL3.i386.rpm           
LSF-GLIBC-2.3-lib-7.0.3-3.SL3.i386.rpm 
LSF-GLIBC-2.3-7.0.3-3.SL3.i386.rpm           

Install the ncm-lsfclient rpms from afs area:
/afs/cern.ch/project/linux/redhat/cern/addon/cc/SLC3/RPMS/noarch/ (CHECK the version of the rpms!!!)

ncm-lsfclient-1.0.24-1.noarch.rpm

Creation of the lsf admin user:

* Add to /etc/passwd

lsfadmin:x:18465:1028:Lsf ADMINISTRATOR:/afs/cern.ch/user/l/lsfadmin:/bin/ksh 

* Add to /etc/group

=c3:x:1028:lsfadmin=

=> scp fnaz@lxplus:/etc/lsf.conf /usr/local/lsf/etc/lsf.conf

=> scp fnaz@lxplus:/etc/lsf.conf /etc/lsf.conf

=> mv /etc/sysconfig/lsf /etc/sysconfig/lsf.ORIG

=> cp fnaz@lxplus:/etc/sysconfig/lsf /etc/sysconfig/lsf

=> ln -s /afs/cern.ch/project/lsf/7.0/mnt/batch /usr/local/lsf/mnt (it depends on the master!!!)

Add to /etc/lsf.conf:

LSF_STRICT_CHECKING=y

because of

# scanning LSF ports blows up the daemons if this is not enabled # this option must be enabled on all nodes in the full cluster

=> /etc/init.d/lsf start

(it takes some time for all the processes to be up and running 
as the configuration needs to be initialized)

THE HOME DIRECTORIES IN THE CE AND WN MUST BE THE SAME 
E.G. /HOME/GRID/DTEAM001 ETC ON BOTH (IF NOT YOU GET A MARADONA ERROR). 
SYMLINKS ARE ALSO DANGEROUS!!!

Install the rpms for the information provider from afs area /afs/cern.ch/user/u/uschwick/public/GRID/ (Check the version!!!) :

lcg-info-dynamic-lsf-2.0.39-1.noarch.rpm
lcg-info-dynamic-scheduler-lsf-1.0.2-1.noarch.rpm

Run the scheduler manually.

cd /opt/lcg/libexec/
./lcg-info-dynamic-scheduler -c /opt/glite/etc/lcg-info-dynamic-scheduler.conf

-- Main.fnaz - 02 Nov 2007

Edit | Attach | Watch | Print version | History: r10 < r9 < r8 < r7 < r6 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r10 - 2008-03-03 - FaridaNaz
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback