Running ATLAS software at Edinburgh

This page describes the steps needed to access and run ATLAS software from all local desktops in the Edinburgh group.

Using DQ2, ROOT, Ganga, Panda and Athena Locally.

These packages can be used through ATLASLocalRootBase, this is separate to the particular releases installed below. To use these:

export ATLAS_LOCAL_ROOT_BASE=/Disk/speyside4/atlas/ddm/ATLASLocalRootBase

export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase

source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh

and follow the instructions given on screen. Or at https://twiki.atlas-canada.ca/bin/view/AtlasCanada/ATLASLocalRootBase The former location on speyside is not up to date and the recommendation is to use the CVMFS setup.

For example: For DQ2 (to download data)

localSetupDQ2Client

voms-proxy-init --voms atlas

dq2-get [DATASET]

To use standalone root (to run on d3pds for example):

localSetupROOT

root

To run atlas software:

asetup -r 15.6.12

To use a nightly (you may need to check for the correct path

asetup --releasesarea=/Disk/speyside4/atlas/SW/nightlies/16.4.X rel_3 here

Currently for releases that aren't already around ask us - but instructions for adding them automatically will follow....

D3PDs can be stored in /Disk/speyside7/Grid/grid-files (not backed up)

Accessing files from ECDF_LOCALGROUPDISK locally

TFile::Open("root://srm.glite.ecdf.ed.ac.uk//dpm... ")

e.g.

TFile::Open("root://srm.glite.ecdf.ed.ac.uk//dpm/ecdf.ed.ac.uk/home/atlas/atlaslocalgroupdisk/mc10_7TeV/NTUP_HSG5WH/e701_s933_s946_r2302_r2300_p766/mc10_7TeV.116591.WH120lnubb_pythia.merge.NTUP_HSG5WH.e701_s933_s946_r2302_r2300_p766_tid563989_00/NTUP_HSG5WH.563989._000001.root.1")

This is slow for interactive use, but should be about as fast as having the files locally if making use of TTreeCache in your code. Using TTree::Draw() seems to be extremely fast.

Alternatively, it might be faster to copy the file locally. This can be done with rfcp:

export DPM_HOST=srm.glite.ecdf.ed.ac.uk

export DPNS_HOST=srm.glite.ecdf.ed.ac.uk

rfcp rfio:////dpm/ecdf.ed.ac.uk/home/atlas/atlaslocalgroupdisk/mc12_8TeV/NTUP_HSG2/e1622_s1581_s1586_r3658_r3549_p1344/mc12_8TeV.167892.PowhegPythia8_AU2CT10_ggH125_ZZ4lep_noTau.merge.NTUP_HSG2.e1622_s1581_s1586_r3658_r3549_p1344_tid01225391_00/NTUP_HSG2.01225391._000034.root.1 .

Listing datasets on ECDF

First, to generate a list of datasets, do e.g.:

dq2-list-dataset-site UKI-SCOTGRID-ECDF_LOCALGROUPDISK -n mc12*HSG2*

where the last parameter is a search string for your datasets. Then, given a dataset name, to generate a list of the paths to the files:

dq2-ls -f -p -L UKI-SCOTGRID-ECDF_LOCALGROUPDISK mc12_8TeV.167892.PowhegPythia8_AU2CT10_ggH125_ZZ4lep_noTau.merge.NTUP_HSG2.e1622_s1581_s1586_r3658_r3549_p1344/ | grep srm | sed 's/srm:\/\/srm.glite.ecdf.ed.ac.uk/rfio:\/\/\//g'

These can be accessed locally as described above.

Suggestions/Requests

This is an ongoing task so please let me know if everything (or anything!) is working.

Current task List

  • Interactive validation of local software
  • SL5 32-bit/64-bit issues
  • Documentation on local user setup, testing interactive job
  • Check for kit validation for SL5
  • Local cron script tests to retrieve nightlies
  • Determine best mode of file transfer (rsync or pacman package diff)
  • Associate nightly cron script to central service
  • Request software area be visible from condor
  • Test run of batch system
  • Add more development nightlies (on request)
  • Autoinstall method for new official releases
  • Possible data migration
  • Permanent mount point for /Disk/speyside4

Resources

-- AndrewWashbrook - 2009-09-30

Edit | Attach | Watch | Print version | History: r19 < r18 < r17 < r16 < r15 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r16 - 2013-06-03 - WahidBhimji
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback