Recovering job results... simple case. Naive User.
1. What will I need to recover my job results?
2. How do I recover these results?
3. What are the options in the recovery process?
1.
* You will need a valid proxy. This proxy should be the same as you
used to submit the job. Not the EXACT same one, but should be generated
from the same cert/key pair as before:
grid-proxy-init
or more appropriately:
voms-proxy-init
The recovery command will use the generated proxy automatically.
* You will need the job identifier as returned by the job submission command:
From the job submission command eg. glite-job-submit (for the gLite WMS)
If the submission is successful, the output should contain some text such as:
Use glite-job-status command to check job current status.
Your job identifier is: -
https://egee-rb-01.mi.infn.it:9000/LPHg_qAnRlPjXtWvQlc7QQ
This job identifier "https://egee-rb-01.mi.infn.it:9000/LPHg_qAnRlPjXtWvQlc7QQ"
is the important part that you will need later... it tells you that your job
is held on a resource broker at "egee-rb-01.mi.infn.it" in Italy with a "serial
number" of "LPHg_qAnRlPjXtWvQlc7QQ".
2.
The results are recovered by using one of several gLite commands.
There are several gLite commands to recover the job results as the software
has evolved through several projects. The most relevant command here is "glite-job-output"
which is the most up-to-date.
The basic command to retrieve job output is:
glite-job-output
In this case the command will be:
glite-job-output https://egee-rb-01.mi.infn.it:9000/LPHg_qAnRlPjXtWvQlc7QQ
After the command is issued you should see:
Retrieving files from host: cert-rb-01.cnaf.infn.it ( for https:... )
*******************************************************************************
JOB GET OUTPUT OUTCOME
Output sandbox files for the job:
- https://cert-rb-01.cnaf.infn.it:9000/55YfzeDigWeoHbpHxx1BQA
have been successfully retrieved and stored in the directory:
/tmp/jwhite_55YfzeDigWeoHbpHxx1BQA
*******************************************************************************
3.
The options for the glite-job-output command are quite limited.
As a default the output of the job is recovered to your home machine under the /tmp
directory in a directory named by _.
eg. /tmp/jwhite_LPHg_qAnRlPjXtWvQlc7QQ
The option "--dir" allows the user to specify another directory to store the
recovered results
eg.
glite-job-output --dir $HOME/job_results/1 https://egee-rb-01.mi.infn.it:9000/LPHg_qAnRlPjXtWvQlc7QQ
Retrieving files from host: cert-rb-01.cnaf.infn.it ( for https:... )
*******************************************************************************
JOB GET OUTPUT OUTCOME
Output sandbox files for the job:
- https://cert-rb-01.cnaf.infn.it:9000/55YfzeDigWeoHbpHxx1BQA
have been successfully retrieved and stored in the directory:
/afs/cern.ch/user/j/jwhite/job_results/1
*******************************************************************************
will place the job results in the directory "$HOME/job_results/1".
-- OwenAppleton - 31 Aug 2006