RunPilot

Pilot is started by APF wrapper(https://www.racf.bnl.gov/experiments/usatlas/griddev/AutoPyFactory). You can get a copy of the wrapper. Here is an example to run pilot.

Run pilot example
Here is an example to start pilot on NERSC Edision.
            #cat /project/projectdirs/atlas/pilot/RunPilotEdison.sh
           # if cvmfs
           # export OSG_GRID=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/emi/current/
           # export VO_ATLAS_SW_DIR=/cvmfs/atlas.cern.ch/repo/sw
 
            # NERSC
            export OSG_GRID=/global/project/projectdirs/atlas/pilot/grid_env
            export VO_ATLAS_SW_DIR=/project/projectdirs/atlas

            rm -f wrapper-0.9.10.sh
            wget http://wguan-wisc.web.cern.ch/wguan-wisc/wrapper-0.9.10_hpc.sh -O wrapper-0.9.10.sh

            chmod +x wrapper-0.9.10.sh

            export COPYTOOL=gfal-copy
            export COPYTOOLIN=gfal-copy

            export PATH=$PATH:/opt/torque/4.2.7/bin:/opt/torque/4.2.7/sbin
            export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/torque/4.2.7/lib


            #./wrapper-0.9.10.sh  --wrapperloglevel=debug --wrappergrid=OSG --wrapperwmsqueue=BNL_PROD_MCORE --wrapperbatchqueue=BNL_PROD_MCORE-condor --wrappervo=ATLAS  --wrappertarballurl=http://dev.racf.bnl.gov/dist/wrapper/wrapperplugins-0.9.10.tar.gz --wrapperpilotcodeurl=http://wguan-wisc.web.cern.ch/wguan-wisc/ --wrapperpilotcode=wguan-pilot-dev-HPC -s BNL_PROD_MCORE -q BNL_PROD_MCORE-condor -u ptest -w https://aipanda007.cern.ch -p 25443 -d /global/homes/w/wguan/testpilot/test/tmp
            ./wrapper-0.9.10.sh  --wrapperloglevel=debug --wrappergrid=OSG --wrapperwmsqueue=NERSC_Edison --wrapperbatchqueue=NERSC_Edison --wrappervo=ATLAS  --wrappertarballurl=http://dev.racf.bnl.gov/dist/wrapper/wrapperplugins-0.9.10.tar.gz --wrapperpilotcodeurl=http://wguan-wisc.web.cern.ch/wguan-wisc/ --wrapperpilotcode=wguan-pilot-dev-HPC -s NERSC_Edison -q NERSC_Edison -u ptest -w https://aipanda007.cern.ch -p 25443 -d /scratch2/scratchdirs/wguan/Edison
        

In this example, settting up COPYTOOLIN and COPYTOOLIN environment is for staging input files from SE and staging out output log files to SE. I only tested gfal site mover on HPC cray system. " -d /scratch2/scratchdirs/wguan/Edison" is the pilot working directory. You need to change it to your writable directory. -- WenGuan - 2015-02-24

Edit | Attach | Watch | Print version | History: r7 | r4 < r3 < r2 < r1 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r1 - 2015-02-24 - WenGuan
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    PanDA All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback