Instruction of setup and using US-ATLAS Grid

How to setup the grid ( Getting on the Grid)

1.Go to the DOEGRIDs website to obtain the certificate.
2.Exporting your key pair for use by Globus grid-proxy-init.
    • Export or 'backup' your certificate. The interface for this varies from browser to browser. Internet Explorer starts with "Tools -> Internet Options -> Content"; Netscape Communicator has a "Security" button on the top menu bar; Mozilla starts with "Edit -> Preferences -> Privacy and Security -> Certificates". The exported file will probably have the extension .p12 or .pfx.
    • Guard this file carefully. Store it off your computer, or remove it once you are finished with this process.
    • Copy the above PKCS#12 file to the computer where you will run grid-proxy-init.
    • Extract your certificate (which contains the public key) and the private key:
      • Certificate:
        openssl pkcs12 -in US-ATlAS.p12 -clcerts -nokeys -out $HOME/.globus/usercert.pem
      • To get the encrypted private key :
        openssl pkcs12 -in US-ATlAS.p12 -nocerts -out $HOME/.globus/userkey.pem
        You must set the mode on your userkey.pem file to read/write only by the owner, otherwise grid-proxy-init will not use it(chmod go-rw $HOME/.globus/userkey.pem).
3. Joining the ATLAS VO.
  • Step 1: CERN HR registration
  • Step 2: Register through the ATLAS VOMRS (Virtual Organization Management Registration Service)
    • Became a candidate
      • Go to the ATLAS VOMRS server. Note that your personal certificate DN and Certificate Authority are noted in red at the lower left of the window. If it is not, then you need to load your certificate into your browser before proceeding.
      • Click on "Phase I Registration' on the left side bar.
      • Fill out the requested information. Under Grid job submission rights, select the default value of full.
      • As a USATLAS candidate, you should select John R. Hover as your VO Representative.
      • If you receive an error message that your email address is not registered at CERN, you may need to wait a day or two after your registration has been confirmed so that your information can be completely processed.
      • You will recieve an e-mail when your identity has been confirmed.
    • Became a applicant
    • Became a member

Use the grid

How to get CSC files from Grid

1. On Lxplus.cern.ch

Copy files on LCG
# source /afs/cern.ch/project/gd/LCG-share/sl3/etc/profile.d/grid_env.sh
# voms-proxy-init -voms atlas (This will ask you for your certificate's password.)
# grid-proxy-init
# source /afs/usatlas.bnl.gov/Grid/Don-Quijote/dq2_user_client/setup.sh.CERN
# export LFC_HOST=lfc-atlas-Sandbox.test.cern.ch
# export LCG_CATALOG_TYPE=lfc

lfc-ls /grid/atlas/datafiles/csc11/
fc-ls /grid/atlas/datafiles/mc11/recon/mc11.007061.singlepart_e_E100.recon.CBNT.v11000303/

Files can be copied using the dq2_get command, using the -l option to specify files are in LCG: dq2_get -l -r mc11.007061.singlepart_e_E100.recon.CBNT.v11000303 mc11.007061.singlepart_e_E100.recon.CBNT.v11000303._02000.root

Copy files in OSG

$ source /afs/cern.ch/project/gd/LCG-share/current/etc/profile.d/grid_env.[c]sh
$ voms-proxy-init -voms atlas
$ source /afs/usatlas.bnl.gov/Grid/Don-Quijote/dq2_user_client/setup.[c,z]sh.CERN

copies data from local storage or over the grid:
$ dq2_get -v mc11.007200.singlepart_mu2.recon.CBNT.v11000303

Copy files over the grid:
$ dq2_get -rv csc11.005001.pythia_minbias.evgen.EVNT.v11000401

Install the Grid UI.

Instructions for installing a UI can be found at http://glite.web.cern.ch/glite/packages/R3.0/deployment/glite-UI/glite-UI.asp There is also a tarball installation that does not require root access at https://twiki.cern.ch/twiki/bin/view/LCG/TarUIInstall, suitable for installation on a laptop for instance.

mkdir gLite
wget http://grid-deployment.web.cern.ch/grid-deployment/download/relocatable/gliteUI_WN-2007-03-26.tar.gz
wget http://grid-deployment.web.cern.ch/grid-deployment/download/relocatable/gliteUI_WN-userdeps-2007-03-26.tar.gz

cd ~/gLite
tar -zxvf gliteUI_WN-2007-01-22.tar.gz
tar -xzvf gliteUI_WN-userdeps-2007-01-22.tar.gz

Create a site-info.def file gLite/site-info.def as below:

#################################################################################################################################################################
# This is the site-info.def file for my gLite User Interface
#
EGEE_LOCATION=/home/wyizhang/gLite
INSTALL_ROOT=/home/wyizhang/gLite
#
PX_HOST=myproxy.cern.ch
WMS_HOST=my-wms.cern.ch
BDII_HOST=exp-bdii.cern.ch
MON_HOST=my-mon.cern.ch
REG_HOST=my-reg.cern.ch
VOS="atlas"
#
USERS_CONF=$EGEE_LOCATION/glite/yaim/examples/users.conf
SITE_EMAIL=wyizhang@weiyi.phyast.pitt.edu
JAVA_LOCATION=/usr/java/j2re-1.4.2_13
QUEUES="dummy"
DUMMY_GROUP_ENABLE="dummy"
CA_REPOSITORY="rpm http://linuxsoft.cern.ch/ LCG-CAs/current production"

#
#VO_CMS_VOMS_SERVERS="'vomss://lcg-voms.cern.ch:8443/voms/cms?/cms/'"
#VO_CMS_VOMSES="'cms lcg-voms.cern.ch 15002 /C=CH/O=CERN/OU=GRID/CN=host/lcg-voms.cern.ch cms'"
#
#
VO_ATLAS_VOMS_SERVERS='vomss://voms.cern.ch:8443/voms/atlas?/atlas/'
VO_ATLAS_VOMSES="'atlas lcg-voms.cern.ch 15001 /C=CH/O=CERN/OU=GRID/CN=host/lcg-voms.cern.ch atlas' 'atlas voms.cern.ch 15001 /DC=ch/DC=cern/OU=computers/CN=voms.cern.ch atlas'"
#
########################################################################################################################################################################################

Make sure that the file ./glite/yaim/functions/install_certs_userland contains the right URL for downloading the certificates:
CA_WGET="http://linuxsoft.cern.ch/LCG-CAs/current/RPMS.production"

cd ~/gLite
./glite/yaim/scripts/configure_node ./site-info.def TAR_UI

There is a known problem with the VOMS contact addresses when using voms-proxy-init. The error messages is, e.g.: (for other VOs accordingly) VOMS Server for cms not known!

A work around is to copy those addresses locally: (for other VOS accordingly)

mkdir $HOME/gLite/etc/vomses
cp /afs/desy.de/group/grid/www/html/etc/vomses/*
$HOME/gLite/etc/vomses

mkdir $HOME/.glite/vomses
cp /afs/desy.de/group/grid/www/html/etc/vomses/* $HOME/.glite/vomses/.
voms-proxy-init -debug -voms atlas

Contents of vomses files can be find here: VOMS in LCG2 2_7_0

file: vomes.tar

change edg configure files

vim $GLITE/edg/etc/edg_wl_ui_cmd_var.conf

uncomment LoggingDestination = "gdrb01.cern.ch:9002";

vim $GLITE/edg/etc/edg_wl_ui_gui_var.conf

uncomment LoggingDestination = "gdrb01.cern.ch:9002";

vim $GLITE/edg/etc/atlas/edg_wl_ui.conf
#NSAddresses = "gdrb01.cern.ch:7772";
#LBAddresses = "gdrb01.cern.ch:9000";
NSAddresses = {"rb106.cern.ch:7772","rb121.cern.ch:7772"};
LBAddresses = {{"rb106.cern.ch:9000"},{"rb121.cern.ch:9000"}};

Update May 17 2007

UI Installation

  1. Download the latest version of UI from
    For the time being, we use: and gliteUI_WN-userdeps-2007-05-15.tar.gz
    Also you can use:
    wget http://grid-deployment.web.cern.ch/grid-deployment/download/relocatable/gliteUI_WN-2007-03-26.tar.gz
    wget http://grid-deployment.web.cern.ch/grid-deployment/download/relocatable/gliteUI_WN-userdeps-2007-03-26.tar.gz
  2. mkdir gLite
    tar zxvf gliteUI_WN-2007-05-15.tar.gz
    tar zxvf gliteUI_WN-userdeps-2007-05-15.tar.gz
  3. edit site-info.def

    #
    # This is the site-info.def file for my gLite User Interface
    #
    EGEE_LOCATION=/home/wyizhang/gLite
    INSTALL_ROOT=/home/wyizhang/gLite
    #
    PX_HOST=myproxy.cern.ch
    WMS_HOST=my-wms.cern.ch
    BDII_HOST=exp-bdii.cern.ch
    MON_HOST=my-mon.cern.ch
    REG_HOST=my-reg.cern.ch
    SE_HOST=srm.cern.ch

    VOS="atlas"

    #
    USERS_CONF=$EGEE_LOCATION/glite/yaim/examples/users.conf
    SITE_EMAIL=wyizhang@weiyi.phyast.pitt.edu
    JAVA_LOCATION=/usr/java/j2re-1.4.2_13
    QUEUES="dummy"
    DUMMY_GROUP_ENABLE="dummy"
    CA_REPOSITORY="rpm http://linuxsoft.cern.ch/ LCG-CAs/current production"

    VO_ATLAS_VOMS_SERVERS='vomss://voms.cern.ch:8443/voms/atlas?/atlas/'
    VO_ATLAS_VOMSES="'atlas lcg-voms.cern.ch 15001 /C=CH/O=CERN/OU=GRID/CN=host/lcg-voms.cern.ch atlas' 'atlas voms.cern.ch 15001 /DC=ch/DC=cern/OU=computers/CN=voms.cern.ch atlas'"
  4. ./glite/yaim/bin/yaim -c -s ./site-info.def -n TAR_UI

    General remarks for the installation The installation scripts puts glite_setenv.(c)sh into ~/.glite/ and adds a line to .bashrc or .tcshrc. So this environment is set up every time you log in. You find this file also in ${INSTALL_ROOT}/etc/profile.d/. In addition you have to source the file ${INSTALL_ROOT}/etc/profile.d/grid_env.(c)sh (this is not being done automatically).

    Installing a UI this way puts all the CA certificates under $INSTALL_ROOT/etc/grid-security and adds a user cron job to download the crls. However, please note that you'll need to keep the CA certificates up to date yourself. You can do this by running

           $INSTALL_ROOT/glite/yaim/scripts/run_function site-info.def install_certs_userland
  5. Configure NSAdress
    edit /gLite/edg/etc/atlas/edg_wl_ui.conf
    #NSAddresses = "gdrb01.cern.ch:7772";
    #LBAddresses = "gdrb01.cern.ch:9000";
    NSAddresses = {"rb106.cern.ch:7772","rb121.cern.ch:7772"};
    LBAddresses = {{"rb106.cern.ch:9000"},{"rb121.cern.ch:9000"}};

  6. get DQ2 tools
    http://atlas-sw.cern.ch/cgi-bin/viewcvs-atlas.cgi/offline/DataManagement/DQ2_0_2/endusers/

Ganga Installation

  1. Installation
    wget http://cern.ch/ganga/download/ganga-install
    python ganga-install --extern=GangaAtlas,GangaGUI,GangaPlotter 4.3.1

  2. Preparing Ganga
    export GANGA_CONFIG_PATH=GangaAtlas/Atlas.ini
    ~/Ganga/install/4.3.1/bin/ganga

  3. Configuring Ganga
    to modify some Ganga start-up parameters, create a configuration file $HOME/.gangarc with:
    ganga -g
    and edit $HOME/.gangarc as follows:

    • In the section labelled [Configuration] add the line:
      RUNTIME_PATH = GangaAtlas
    • In the section labelled [LCG] add the line:
      VirtualOrganisation = atlas
    • In the section labelled [Athena] add the lines:
      # local path to base paths of dist-kits (lxplus example)
      ATLAS_SOFTWARE = /afs/cern.ch/project/gd/apps/atlas/slc3/software
  4. Start Ganga
    • Start UI setup files
      source $HOME/cmthome_base/grid_env.sh
    • export GANGA_CONFIG_PATH=GangaAtlas/Atlas.ini
    • ~/Ganga/install/4.3.1/bin/ganga
  5. Some Ganga Command:
    gridProxy.info

Good reference and useful links



-- WeiyiZhang - 18 Mar 2007

Topic attachments
I Attachment History Action Size Date Who Comment
Unknown file formatgz vomes.tar.gz r1 manage 30.0 K 2007-04-04 - 05:57 WeiyiZhang vomses files for install local UI
Edit | Attach | Watch | Print version | History: r8 < r7 < r6 < r5 < r4 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r8 - 2007-05-18 - WeiyiZhang
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback