Rod Testbench Installation Guide

largrod4 SLC4 installation

networking

IP address 129.194.51.7
Mask       255.255.255.0
Gateway    129.194.48.1
DNS        129.194.4.6

partitions

hda1  /boot    100 MB  formatted
hda2  /        9.7 GB  formatted
hda6  /home    20  GB  formatted

hda5  /data    46  GB   kept
free           36  GB   kept

Linux

SLC 4.5

screen Sony - CPD G200 resolution 1024 x 768

network configuration with commands:
netconf
linuxconf
netconfig
ifconfig (eth0 aaa.bbb.ccc.ddd netmask 255.255.248.0 up)
route (add default gw aaa.bbb.ccc.ddd eth0)
netstat
netstar -r
nslookup

related configuration files:
/etc/network
/etc/sysconfig/network
/etc/sysconfig/network-scripts/ifcfg-eth0   -> check with outlet is eth0/eth1!
/etc/sysconfig/network-scripts/ifcfg-eth1
/etc/host.conf
/etc/resolv.conf
/etc/hosts

netbooted Linux

copy to /VP110:
/usr /bin /dev /etc /initrd /lib /opt /proc /sbin /selinux /usr /var
create empty 
/afs /boot /data /home /misc /mnt /root /srv /sys /tmp

compile kernel /usr/src/linux-2.4 -> .config file
create bootfile 
install: rpm -i mknbi-1.4.4-1.noarch.rpm
mkelf-linux --ip="129.194.53.189:129.194.51.7:129.194.48.1:255.255.248.0:largrod3.unige.ch" --rootdir="/VP110" <kernel> > <kernel>.nbi

ln -s /data/VP110 /VP110

check /etc/dhcpd.conf -> scpc99
-->
host largrod3 {
    hardware ethernet 00:40:9e:00:4C:41;
    fixed-address 129.194.53.189;
    server-name  "129.194.48.254";
    next-server 129.194.51.7;
    option host-name "largrod3";
#    option dhcp-message "129.194.51.7:/VP110/distrib/home/rootfs/linux-rh73/Loc
alRootFs/client/home";
    option dhcp-message "129.194.51.7:/VP110";
    filename "LinuxBootImage.nbi";
    }
<--

/etc/exports -> NFSD disk export
-->
/home/local             largrod3(rw,no_root_squash,sync)
/VP110                  largrod3(rw,no_root_squash,sync)
/home/rod4              largrod3(rw,no_root_squash,sync)
/data/soft              largrod3(rw,no_root_squash,sync)
<--

install tftp-server

edit /etc/xinet.d/xftp
-->
service tftp
{
        socket_type             = dgram
        protocol                = udp
        wait                    = yes
        user                    = root
        server                  = /usr/sbin/in.tftpd
        server_args             = -l -c -s /VP110
        disable                 = no
        per_source              = 11
        cps                     = 100 2
        flags                   = IPv4
}
<--

tools

check all services:    /sbin/service --status-all
configure rc.d:        chkconfig --list
turn off autoupdate:   chkconfig --level 0/1/2/3/4/5/6 yum-autoupdate off

check running:         netstat -pan

example cern machines

ssh atlasgw.cern.ch

sbc-lar-rcc-emba-01        2.6.9-55.EL.cern
pc-lar-pm-emba-01          2.6.9-55.EL.cernsmp

installation of TDAQ-01-08-03

export CVSROOT=:kserver:atlas-sw.cern.ch:/atlascvs
export CMTCONFIG=i686-slc4-gcc34-opt

kinit -c cern.ch -p astraess

create file .rpmmacros with 2 lines:
%_dbpath        /data/soft/DataFlow/apt/var/lib/rpm
%_rpmlock_path  /data/soft/DataFlow/apt/rpm/transaction

cd /data/soft/DataFlow

mkdir -p $PWD/apt/rpmdb
mkdir -p $PWD/apt/rpm/

rpm -i --nodeps  --relocate=/=$PWD/apt --dbpath $PWD/apt/rpmdb http://atlas-computing.web.cern.ch/atlas-computing/links/reposDirectory/apt/apt-0.5.15lorg3.90-1.slc4.atlas.i386.rpm

wget http://pcatd12.cern.ch/releases/download/config/apt.conf
sed s#INSTALL_ROOT#$PWD#g apt.conf > apt/etc/apt/apt.conf
wget http://pcatd12.cern.ch/releases/download/config/atlas.list
mv atlas.list apt/etc/apt/sources.list.d/

cd /data/soft/DataFlow/apt
wget http://pcatd12.cern.ch/releases/download/config/setup.sh
source setup.sh

apt-config dump
apt-get update

apt-get install tdaq-01-08-03_i686_slc4_gcc34_opt
apt-get install tdaq-01-08-03_src
apt-get install tdaq-01-08-03_databases

rebuilding the CERN kernel for VP110

as root on largrod4

download kernel-2.6.9-67.EL.cern.src.rpm

rpm -i -vv kernel-2.6.9-67.EL.cern.src.rpm

rpmbuild -bp --target=$(uname -m) /usr/src/redhat/SPECS/kernel-2.6.9-67.EL.cern.spec
cd /usr/src/redhat/BUILD/kernel-2.6.9/linux-2.6.9/

edit Makefile and set EXTRAVERSION = -67.EL.cern.vp110

cp /root/config-2.6.9-67.EL.cern.vp110 .config
make xconfig (to change parameters) or make oldconfig (see attachment)

make bzImage
make modules

/bin/cp -rf /usr/src/redhat/BUILD/kernel-2.6.9/linux-2.6.9 /data/VP110/usr/src/redhat/BUILD/.

chroot /data/VP110
make modules_install

cp /usr/src/redhat/BUILD/kernel-2.6.9/linux-2.6.9/arch/i386/boot/bzImage /root/MKNBI/bzImage-2.6.9-67.EL.cern.vp110
cd /root/MKNBI
./mk-vp110 bzImage-2.6.9-67.EL.cern.vp110
cp bzImage-2.6.9-67.EL.cern.vp110.nbi /data/VP110/.
ln -s bzImage-2.6.9-67.EL.cern.vp110.nbi LinuxBootImage.nbi

system configuration on largrod4

/sbin/chkconfig --level 345 afs on
/sbin/chkconfig --level 345 yum-autoupdate off
/sbin/chkconfig --level 3 drivers_tdaq on
/sbin/chkconfig --list    (for the result see attachment)

system configuration on VP110

/usr/sbin/chroot /data/VP110
/sbin/chkconfig --level 345 afs off
/sbin/chkconfig --level 345 yum-autoupdate off
/sbin/chkconfig --level 3 drivers_tdaq on
/sbin/chkconfig --list     (for the result see attachment)

configure /etc/inittab  (see attachement)

configure /etc/fstab
# This file is edited by fstab-sync - see 'man fstab-sync' for details
/dev/ram                /                       ext2    defaults        1 1
none                    /dev/pts                devpts  gid=5,mode=620  0 0
none                    /proc                   proc    defaults        0 0
none                    /dev/shm                tmpfs   defaults        0 0
largrod4:/home/rod4     /home/rod4              nfs     defaults        0 0
largrod4:/data/soft     /data/soft              nfs     defaults        0 0

configure /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=largrod3.unige.ch
GATEWAY=129.194.48.1
GATEWAYDEV=eth0

configure/etc/sysconfig/network-scripts/ifcfg-eth0
DEVICE=eth0
BOOTPROTO=static
BROADCAST=129.194.55.255
HWADDR=00:30:48:53:02:21
IPADDR=129.194.51.7
NETMASK=255.255.248.0
NETWORK=129.194.48.0
ONBOOT=yes
TYPE=Ethernet

chmod a+w /tmp

system configuration on largrod4

configure /etc/fstab
# This file is edited by fstab-sync - see 'man fstab-sync' for details
LABEL=/                 /                       ext3    defaults        1 1
LABEL=/boot             /boot                   ext3    defaults        1 2
none                    /dev/pts                devpts  gid=5,mode=620  0 0
none                    /dev/shm                tmpfs   defaults        0 0
LABEL=/home             /home                   ext3    defaults        1 2
none                    /proc                   proc    defaults        0 0
none                    /sys                    sysfs   defaults        0 0
/dev/hda5               /data                   ext3    defaults        1 2
/dev/hda3               swap                    swap    defaults        0 0
/dev/hdc                /media/cdrom            auto    pamconsole,fscontext=system_u:object_r:removable_t,exec,noauto,managed 0 0
/dev/fd0                /media/floppy           auto    pamconsole,fscontext=system_u:object_r:removable_t,exec,noauto,managed 0 0

/etc/hosts.allow
#
# hosts.allow   This file describes the names of the hosts which are
#               allowed to use the local INET services, as decided
#               by the '/usr/sbin/tcpd' server.
#
ALL: 127.0.0.1 129.194.* 137.138.*
# unige.ch and cern.ch

/etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1               largrod4.unige.ch largrod4 localhost.localdomain localhost
129.194.51.7              largrod4.unige.ch       largrod4
129.194.48.254          scpc99.unige.ch         scpc99


/etc/sysconfig/network
NETWORKING=yes
HOSTNAME=largrod4.unige.ch
GATEWAY=129.194.48.1
GATEWAYDEV=eth0

/etc/sysconfig/network-scripts/ifcfg-eth0
DEVICE=eth0
BOOTPROTO=static
BROADCAST=129.194.55.255
HWADDR=00:30:48:53:02:21
IPADDR=129.194.51.7
NETMASK=255.255.248.0
NETWORK=129.194.48.0
ONBOOT=yes
TYPE=Ethernet

system configuration of scpc30

running services (chkconfig):
netfs, autofs, afs, nfs
stopped services:
yum-autoupdate

add bigphysarea in /etc/grub.conf (like for largrod4)
kernel /vmlinuz-2.6.9-67.EL.cern ro root=LABEL=/ rhgb quiet bigphysarea=8192

/etc/fstab
# This file is edited by fstab-sync - see 'man fstab-sync' for details
LABEL=/                 /                       ext3    defaults        1 1
LABEL=/boot             /boot                   ext2    defaults        1 2
LABEL=/data             /data                   ext3    defaults        1 2
none                    /dev/pts                devpts  gid=5,mode=620  0 0
none                    /dev/shm                tmpfs   defaults        0 0
LABEL=/home             /home                   ext3    defaults        1 2
none                    /proc                   proc    defaults        0 0
none                    /sys                    sysfs   defaults        0 0
/dev/hda5               swap                    swap    defaults        0 0
129.194.51.7:/home/rod4     /home/rod4              nfs     defaults        0 0
129.194.51.7:/data/soft     /data/soft              nfs     defaults        0 0

/dev/fd0                /media/floppy           auto    pamconsole,fscontext=system_u:object_r:removable_t,exec,noauto,managed 0 0

/etc/sysconfig/network-scripts/ifcfg-eth0
DEVICE=eth0
ONBOOT=yes
BOOTPROTO=none
IPADDR=129.194.49.90
NETMASK=255.255.248.0
GATEWAY=129.194.48.1
TYPE=Ethernet
USERCTL=no
IPV6INIT=no
PEERDNS=yes

/etc/sysconfig/network
NETWORKING=yes
HOSTNAME=scpc30.unige.ch

installation of TDAQ drivers

afs source link:
/afs/cern.ch/atlas/project/tdaq/cmt/tdaq/tdaq-01-08-03

cd /data/soft/DataFlow
source tdaq/tdaq-01-08-03/installed/setup.sh
export CMTROOT=/data/soft/DataFlow/CMT/v1r20p20070720
source $CMTROOT/mgr/setup.sh

cd tdaq-common/tdaq-common-01-08-00
for dir in  */cmt; do  echo $dir; cd $dir; cmt config; cd ../..; done

cd tdaq/tdaq-01-08-03
for dir in  */cmt; do  echo $dir; cd $dir; cmt config; cd ../..; done

cd dqm/dqm-00-03-00
for dir in  */cmt; do  echo $dir; cd $dir; cmt config; cd ../..; done

export CMTPROJECTPATH=/data/soft/DataFlow

cd /data/soft/DataFlow/tdaq/tdaq-01-08-03/
source installed/setup.sh 
echo $CMTCONFIG 
export CMTPROJECTPATH=/data/soft/DataFlow

export CVSROOT=:kserver:atlas-sw.cern.ch:/atlascvs
klog -c cern.ch -pr astraess

cd /data/soft/DataFlow/tdaq/tdaq-01-08-03/ROSRCDrivers/cmt

edit the CVS tag in ../src/Makefile to
TAG := vp110

source setup.sh
make

cp ../src/drivers_tdaq /etc/init.d/.
edit drivers_tdaq to set the following paths:
export DRIVER_PATH=/data/soft/DataFlow/tdaq/tdaq-01-08-03/ROSRCDdrivers/i686-slc4-gcc34-opt
export LD_LIBRARY_PATH=/data/soft/DataFlow/tdaq/tdaq-01-08-03/installed/i686-slc4-gcc34-opt/lib
export BINARY_PATH=/data/soft/DataFlow/tdaq/tdaq-01-08-03/installed/i686-slc4-gcc34-opt/bin
export VMETAB_PATH=/lib/modules


cp /etc/init.d/drivers_tdaq /data/VP110/etc/init.d/.

change /etc/grub.conf for bigphysarea:
kernel /vmlinuz-2.6.9-67.0.1.EL.cern ro root=LABEL=/ rhgb quiet bigphysarea=8192 

configure VME

cd /lib/modules
vmeconfig -i vmetab     (see attachement)

pwd-free ssh connection

on largrod4 type:
ssh-keygen
cp id_rsa.pub authorized_keys

modify .ssh/config file     (see attachement)

installation of LargOnline 108-22-02

(export CVSROOT=:kserver:atlas-sw.cern.ch:/atlascvs)

install java:
./jdk-6u4-linux-i586-rpm.bin 

install xsd:
xsd-2.2.0-i686-linux-gnu.tar.bz2
cp xsd-2.2.0-i686-linux-gnu.tar.bz2 /data/soft/LargOnline/contrib/
tar -xjvf xsd-2.2.0-i686-linux-gnu.tar.bz2


export CVSROOT=:kserver:atdaq-sw.cern.ch:/atdaqcvs
export CMTCONFIG=i686-slc4-gcc34-opt
export CMTROOT=/data/soft/DataFlow/CMT/v1r20p20070720
source $CMTROOT/mgr/setup.sh

klog.krb -cell cern.ch -principal astraess
tokens (to check)

cd /data/soft/LargOnline/releases
cvs co -r LargOnline-108-22-02 -d LargOnline-108-22-02 detectors/LAr

cd /data/soft/LargOnline/releases/LargOnline-108-22-02
for dir in */cmt; do echo $dir; cd $dir; cmt config;  cd ../..; done

edit file /data/soft/LargOnline/releases/LargOnline-108-22-02/admin/cmt/requirements and change pathnames to local installation site GENEVA (/data/soft/DataFlow; /data/soft/LargOnline)

cd /data/soft/LargOnline/releases/LargOnline-108-22-02
mkdir cmt
create a project.cmt file (see attachment)

problem occured due to same cmt project path for
DataFlow/config and LargOnline/contrib; needed to remove the former

run twice the following:
for dir in */cmt; do echo $dir; cd $dir; source setup.sh; make; cd ../..; done
and eventually:
cd DataVerify/cmt; source setup.sh; make; cd ../..

installation of xforms

cd  /data/soft/LargOnline/contrib/xforms/v1r0/src
make

cd  /data/soft/LargOnline/contrib/xforms/v1r0/
mkdir linux-slc4-gcc34
mkdir linux-slc4-gcc34/lib
mkdir linux-slc4-gcc34/include
mkdir linux-slc4-gcc34/include/X11
mkdir linux-slc4-gcc34/bin
ln -s linux-slc4-gcc34 linux-vp110-gcc34

cp src/lib/libforms.* linux-slc4-gcc34/lib/
cp src/gl/libformsGL.* linux-slc4-gcc34/lib/
cp src/image/libflimage.* linux-slc4-gcc34/lib/
cp src/fd2ps/fd2ps linux-slc4-gcc34/bin/
cp src/fdesign/fdesign linux-slc4-gcc34/bin/
cp src/X11/X11/*.h  linux-slc4-gcc34/include/X11/

edit cmt/requirements and add line
macro xforms_linkopts "" \
    slc4     "-L$(XFORMSROOT)/$(xforms_tag) -lforms -L/usr/X11R6/lib -lXext -lX11 -lXpm -L/usr/lib -ljpeg -lm" \

install Geneva testbench

mkdir /home/rod4/GENEVA

export CVSROOT=:kserver:atdaq-sw.cern.ch:/atdaqcvs
export CMTCONFIG=i686-slc4-gcc34-opt
export CMTROOT=/data/soft/DataFlow/CMT/v1r20p20070720
source $CMTROOT/mgr/setup.sh

cvs co -d GenevaDAQ detectors/LAr/GenevaDAQ
cvs co -d RodTestBench detectors/LAr/RodTestBench
cvs co -d TBenchDAQ detectors/LAr/TBenchDAQ

Useful configuration files

-- ArnoStraessner - 22 Jan 2008

Topic attachments
I Attachment History Action Size Date Who Comment
Unknown file formatext config r2 r1 manage 1.1 K 2008-01-25 - 16:21 ArnoStraessner ssh config file
Unknown file formatext config_list_largrod3 r1 manage 3.4 K 2008-01-24 - 18:49 ArnoStraessner /sbin/chkconfig --list of largrod3
Unknown file formatext config_list_largrod4 r1 manage 3.5 K 2008-01-24 - 18:49 ArnoStraessner /sbin/chkconfig --list of largrod4
Unknown file formatext inittab r1 manage 1.7 K 2008-01-24 - 18:46 ArnoStraessner VP110 /etc/inittab
Unknown file formatconfig kernel-2.6.9-i686-vp110.config r1 manage 51.1 K 2008-01-24 - 18:36 ArnoStraessner config file for VP110 and CERN kernel 2.6.9-67
Unknown file formatcmt project.cmt r1 manage 0.3 K 2008-01-24 - 19:02 ArnoStraessner cmt/project.cmt file for LargOnline-108-22-02
Unknown file formatext vmeconfig_vmetab_largrod3 r1 manage 7.3 K 2008-01-24 - 18:58 ArnoStraessner vmeconfig of the /lib/modules/vmetab file for VP110
Edit | Attach | Watch | Print version | History: r10 < r9 < r8 < r7 < r6 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r10 - 2008-04-01 - ArnoStraessner
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback