Client tools for Panda analysis jobs

     IDEA!   Current version of panda-client : 0.6.9 (11/06/2018)   IDEA!

Introduction

The panda-client package contains following tools to submit/manage analysis jobs on PanDA.

  • pathena
    • Athena jobs
  • prun
    • ROOT/general jobs
  • psequencer
    • Analysis chain
  • pbook
    • Bookkeeping
  • puserinfo
    • Access control


Preparation

First of all, please make sure you have a grid certificate. See Starting on the Grid. You should have usercert.pem and userkey.pem under ~/.globus.
$ ls ~/.globus/*
usercert.pem userkey.pem

Installation

The panda-client package is distributed in two kinds of format, tarball and rpm. Users can choose one format as they like. Installation procedure is described individually. You can find available release packages in the repository. If you are using CERN AFS or CVMFS you can skip this section and go directly to setup for CERN AFS users or setup for CVMFS user.

tarball

wget --no-check-certificate https://atlpan.web.cern.ch/atlpan/panda-client/panda-client-0.6.9.tar.gz
tar xvfz panda-client-*
cd panda-client-*
python setup.py install --prefix=[install dir]
e.g.,
python setup.py install --prefix=~/mypanda

pip

You need root privilege, or to use --user, or virtualenv.
pip install panda-client

Setup

If you are using CERN AFS or CVMFS see setup for CERN AFS users or setup for CVMFS user.

First, you need to set an environment variable PATHENA_GRID_SETUP_SH which configures Grid runtine environment. Ask your site admin if you don't know its location. Note that PATHENA_GRID_SETUP_SH must be .sh even if you are using csh or tcsh. e.g.,

CERN/lxplus on SLC6

export PATHENA_GRID_SETUP_SH=/dev/null
CERN/lxplus5 on SLC5
export PATHENA_GRID_SETUP_SH=/afs/cern.ch/project/gd/LCG-share/current_3.2/etc/profile.d/grid_env.sh
LYON/ccali
export PATHENA_GRID_SETUP_SH=/afs/in2p3.fr/grid/profiles/lcg_env.sh
BNL/acas
export PATHENA_GRID_SETUP_SH=/afs/usatlas.bnl.gov/osg/client/@sys/current/setup.sh

Next, source the panda setup script according to your installation. The script sets PANDA_CONFIG_ROOT (~/.pathena by default) in addition to some environment variables. PANDA_CONFIG_ROOT is a directory name where user's configuration/data files are contained.

source [install dir]/etc/panda/panda_setup.[c]sh
e.g.,
source ~/mypanda/etc/panda/panda_setup.sh
For rpm,
source /etc/panda/panda_setup.sh

Warning, important If you are going to use pathena, this step needs to be done after sourcing Athena's setup.sh since it changes the PATH environment variable. e.g.,

source setup.sh -tag=15.6.10,32,setup
source ~/mypanda/etc/panda/panda_setup.sh

Setup file on CERN AFS

The latest version of panda-client is available on CERN AFS. If you use CERN AFS you don't need to install the package by yourself. To setup
source /afs/cern.ch/atlas/offline/external/GRID/DA/panda-client/latest/etc/panda/panda_setup.[c]sh
E.g.,
source setup.sh -tag=15.6.10,32,setup
source /afs/cern.ch/atlas/offline/external/GRID/DA/panda-client/latest/etc/panda/panda_setup.sh

Setup file on CVMFS

The latest version of panda-client is also available on CVMFS. You don't need to maintain the package by yourself. To setup
export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase
source $ATLAS_LOCAL_ROOT_BASE/user/atlasLocalSetup.[c]sh  
localSetupPandaClient --noAthenaCheck
Use either atlasLocalSetup.sh or atlasLocalSetup.csh according to your shell.

Documentation on individual tool

The following pages describe how to use tools;


Release Notes

See ChangeLog.

Edit | Attach | Watch | Print version | History: r108 < r107 < r106 < r105 < r104 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r108 - 2018-11-06 - TadashiMaeno
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    PanDA All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2018 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback