Debugging CEs and Sites

Cream Sites

voms-proxy-init --voms ilc
glite-ce-job-submit -d -a -r  <ComputingElement/queue> TestSite.jdl

Get CE/Qeues from lcg-infosites --vo ilc ce and TestSite.jdl

[
JobName       = "CheckSite";
Executable    = "TestScript.sh";
StdOutput     = "StdOut";
StdError      = "StdErr";
InputSandbox  = "TestScript.sh";
]
Make something up for TestScript.sh (e.g., echo Hello World)

ARC Sites

arcproxy -S ilc
arcsub -c grid-arcce1.desy.de arcJob.jsdl
with arcJob.jsdl
<JobDefinition
 xmlns="http://schemas.ggf.org/jsdl/2005/11/jsdl"
 xmlns:posix="http://schemas.ggf.org/jsdl/2005/11/jsdl-posix"
 >
 <JobDescription>
   <JobIdentification>
     <JobName>test_1 job </JobName>
   </JobIdentification>
   <Application>
     <posix:POSIXApplication>
       <posix:Executable>myscript.sh</posix:Executable>
       <posix:Output>out.txt</posix:Output>
       <posix:Error>err.txt</posix:Error>
     </posix:POSIXApplication>
   </Application>
   <DataStaging>
     <FileName>myscript.sh</FileName>
     <DeleteOnTermination>false</DeleteOnTermination>
     <Source><URI>/afs/cern.ch/user/s/sailer/TestSites/myscript.sh</URI></Source>
   </DataStaging>
   <DataStaging>
     <FileName>out.txt</FileName>
     <DeleteOnTermination>false</DeleteOnTermination>
   </DataStaging>
   <DataStaging>
     <FileName>err.txt</FileName>
     <DeleteOnTermination>false</DeleteOnTermination>
   </DataStaging>
 </JobDescription>
</JobDefinition>
And something for myscript.sh (e.g., echo Hellow World)

Globus CEs

You need to have the globus commands available and the machine needs to have some ports open for outgoing connections. On LXPlus these things don't work, on voilcdiractest04 this should work:

export GLOBUS_TCP_PORT_RANGE="9130,9200"
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/lib64/condor
voms-proxy-init --voms ilc

And then to submit a job:

globus-job-submit ceServer[:port]/queue -s run.sh
Which returns a jobID that can be used for
globus-job-status <jobID>
globus-get-job-output [-out|-err] <jobID>

List the queues

globus-job-run  <ce> /bin/ls /etc/grid-services

HTCondorCEs

Manual: http://research.cs.wisc.edu/htcondor/manual/v8.2/

Accessing the Underlying SE or LCG-FileCatalog

source /cvmfs/grid.cern.ch/emi-ui-3.7.3-1_sl6v2/etc/profile.d/setup-emi3-ui-example.sh
voms-proxy-init --voms ilc
export LFC_HOST=`lcg-infosites --vo ilc lfc`

#List files/folders
gfal-ls srm://dcache-se-desy.desy.de/pnfs/desy.de/ilc/fcal
srmls -l srm://dcache-se-desy.desy.de/pnfs/desy.de/ilc/fcal/
lfc-ls -l /grid/ilc/prod/clic/3tev/aa_e3e3_o/gen/00003121/000/aa_e3e3_o_gen_3121_67.stdhep

#list replicas
lcg-lr lfn:/grid/ilc/prod/clic/3tev/aa_e3e3_o/gen/00003121/000/aa_e3e3_o_gen_3121_67.stdhep

#give GUID
lcg-lg lfn:/grid/ilc/prod/clic/3tev/aa_e3e3_o/gen/00003121/000/aa_e3e3_o_gen_3121_67.stdhep

#unregister LFN
lcg-uf `lcg-lg $LFN` `lcg-lr $LFN`

# lcg-cp
lcg-cp -n1 -v -b gsiftp://kek2-storm04.cc.kek.jp:2811//ghi/fs02/ilc/grid/storm/user/a/amiyamot/testdata/E500.Pqqh.I106525.atKEK.stdhep file:/home/sailer/software/DIRAC/DiracDevV6r13/ILCDIRAC/E500.Pqqh.I106525.atKEK.stdhep


Edit | Attach | Watch | Print version | History: r7 < r6 < r5 < r4 < r3 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r7 - 2016-08-19 - AndreSailer
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CLIC All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback