(r5) PandaFindLogFiles < PanDA

PanDA Web>AtlasDistributedComputing>PanDA>PandaFindLogFiles (revision 5) (raw view)~~EditAttachPDF~~

<!-- This is the default ATLAS template. 
Please modify it in the sections indicated to create your topic!
If you have any comments/complaints about this template, then please email me:
edward.moyse at cern.ch
--> 


<!-- By default the title is the WikiWord used to create this topic !-->
<!-- if you want to modify it to something more meaningful, just replace %TOPIC% below with i.e "My Topic"!-->
---+!!<nop>How to Find Panda Job's Log Files
%TOC%
%STARTINCLUDE%

---+Introduction
This page describes how to find Panda job's log files.

---+Which log file to look for?
In the job definition, there should be a "log" type filename specified, which will be the logical file name of the log file to be created for 
the job. The "log" file here actually is a tarball of the work directory of the job. 

---+Log files at BU
Look at the Panda monitoring page (jobsArchieved table) for the job you want to find its log files, and get the name of the log file (the name of the tarball of job's workdir) from the type=log row. 

Example: For the job with !PandaID=4087, the name of the tarball is 

mc11.004201.ZeeJimmy.digit.log.v11000201._00060.job.log.tgz.1

Run the following command to get the location of the tarball:
<verbatim>
$ curl http://doe-dhcp195.bu.edu:8000/dq2/lrc/PoolFileCatalog\?lfns=mc11.004201.ZeeJimmy.digit.log.v11000201._00060.job.log.tgz.1
</verbatim>

You will see the following lines printed on the screen:
<verbatim>
<pfn filetype="" name="gsiftp://atlas.bu.edu/data2/dq2-cache//mc11.004201.ZeeJimmy.digit.log.v11000201_3/mc11.004201.ZeeJimmy.digit.log.v11000201._00060.job.log.tgz.1"/>
</verbatim>
Then copy the file into your machine (under /tmp directory for instance):
<verbatim>
$ globus-url-copy -vb -p 3 gsiftp://atlas.bu.edu/data2/dq2-cache//mc11.004201.ZeeJimmy.digit.log.v11000201_3/mc11.004201.ZeeJimmy.digit.log.v11000201._00060.job.log.tgz.1 file:///tmp/mc11.004201.ZeeJimmy.digit.log.v11000201._00060.job.log.tgz.1
</verbatim>

And then untar the file:
<verbatim>
$ tar -zxvf mc11.004201.ZeeJimmy.digit.log.v11000201._00060.job.log.tgz.1
</verbatim>
You will be looking at the files like pilot_child.stdout, pilot.stdout, simlog, digilog etc. for a possible reason of the job's failure.

---+Log files at BNL

For the BNL jobs, use:

<verbatim>
$ curl http://dms02.usatlas.bnl.gov:8000/dq2/lrc/PoolFileCatalog\?lfns=name_of_tarball
</verbatim>

And replace the srm host string "srm://dcsrm.usatlas.bnl.gov" by "gsiftp://dcgftp.usatlas.bnl.gov" before running "globus-url-copy" as above.

---+Log files at UC

For the UC jobs, use:

<verbatim>
$ curl http://tier2-01.uchicago.edu:8000/dq2/lrc/PoolFileCatalog\?lfns=name_of_tarball
</verbatim>

---+Log files at UTA

For the UTA jobs, use:

<verbatim>
$ curl http://osg-itb2.dpcc.uta.edu:8000/dq2/lrc/PoolFileCatalog\?lfns=name_of_tarball
</verbatim>

---+Log files at OU

For the OUHEP_OSG jobs, use:

<verbatim>
$ curl http://ouhep00.nhn.ou.edu:8000/dq2/lrc/PoolFileCatalog\?lfns=name_of_tarball
</verbatim>
<!-- MAJOR UPDATES
For significant updates to the topic, consider adding your 'signature' (beneath this editing box) !-->
-----
*Major updates*:%BR%
<!--Future editors should add their signatures beneath yours!-->
-- Main.NurcanOzturk - 06 Dec 2005
-- Main.NurcanOzturk - 28 Dec 2005

%STOPINCLUDE%

Topic revision: r5 - 2005-12-28 - NurcanOzturk

PanDA

Public webs

- Cern Search
- TWiki Search
- Google Search
PanDA All webs

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback