CRAB3-glideinWMS testing

This page describes the very, very alpha testing for CRAB3-glideinWMS

Engineering setup

The known working host environment is:

  • RHEL5.
  • HTCondor 7.9.5 RPM. We use the python bindings heavily.
  • HTCondor schedd must be running locally. We have the code written to submit directly to a remote schedd but it's relatively untested.
    • Python2.6 must be installed on the schedd. If you have a RHEL5 box, this can be done by "yum install python26".
    • If it's a RHEL5 box, you must also install the classads module for Python 2.6. Do: curl http://hcc-briantest.unl.edu/classad.so > /usr/lib64/python2.6/site-packages/classad.so
    • The schedd needs to use full-strength delegations; FTS cannot use the default limited proxy delegation. We also suggest to increase the DAGMan submission rates for large jobs. Add the following config variables to the schedd configuration:
      DAGMAN_MAX_SUBMITS_PER_INTERVAL = 50
      DELEGATE_FULL_JOB_GSI_CREDENTIALS = True
      
  • Download the latest tarball. Unpack into a separate pre-made CRAB3 directory, then source setup.sh.
    • Example:
      mkdir ~/CRAB3; pushd ~/CRAB3
      curl http://hcc-briantest.unl.edu/CRAB3-gWMS.tar.gz | tar zx
      source setup.sh
      popd
      
  • A grid proxy that works with cmsweb. cmsweb has several bugs, so I found this precise combination works:
    voms-proxy-init --voms cms:/cms --rfc --valid 168:00

User Environment

First, setup a CMS user area:

. /cvmfs/cms.cern.ch/cmsset_default.sh
mkdir ~/tmp
cd ~/tmp
cmsrel CMSSW_5_3_7
cd CMSSW_5_3_7
cmsenv

Next, download the attached crabConfig.py. This is equivalent to the old crab.cfg.

Edit this config as desired; make sure to point it at the appropriate pset.py to run your job.

Now, source the setup.sh found inside the CRAB3-gWMS.tar.gz. crab should be in your path.

Things to Try

crab submit

crab status -t <task name>

crab getoutput -t <task name>

crab kill -t <task name>
Topic attachments
I Attachment History Action Size Date Who Comment
Texttxt crabConfig.py.txt r1 manage 0.8 K 2013-04-25 - 17:12 BrianBockelman  
Texttxt pset.py.txt r1 manage 1.0 K 2013-04-25 - 17:12 BrianBockelman  
Edit | Attach | Watch | Print version | History: r5 < r4 < r3 < r2 < r1 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r2 - 2013-04-25 - BrianBockelman
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback