How to Find Panda Job's Log Files

Introduction

This page describes how to find Panda job's log files.

Note: this is all much simpler now. You can browse to the log files in the Panda monitor. On job pages you'll see a link 'Find and view log file'. Follow this, and then (if it is found) 'View this logfile'. The log tarball will be copied from BNL dCache or from the remote site and presented in the monitor.

Which log file to look for?

In the job definition, there should be a "log" type filename specified, which will be the logical file name of the log file to be created for the job. The "log" file here actually is a tarball of the work directory of the job.

Log files at BU

Look at the Panda monitoring page (jobsArchieved table) for the job you want to find its log files, and get the name of the log file (the name of the tarball of job's workdir) from the type=log row.

Example: For the job with PandaID=4087, the name of the tarball is

mc11.004201.ZeeJimmy.digit.log.v11000201._00060.job.log.tgz.1

Run the following command to get the location of the tarball:

$ curl http://doe-dhcp195.bu.edu:8000/dq2/lrc/PoolFileCatalog\?lfns=mc11.004201.ZeeJimmy.digit.log.v11000201._00060.job.log.tgz.1

You will see the following lines printed on the screen:

<pfn filetype="" name="gsiftp://atlas.bu.edu/data2/dq2-cache//mc11.004201.ZeeJimmy.digit.log.v11000201_3/mc11.004201.ZeeJimmy.digit.log.v11000201._00060.job.log.tgz.1"/>
Then copy the file into your machine (under /tmp directory for instance):
$ globus-url-copy -vb -p 3 gsiftp://atlas.bu.edu/data2/dq2-cache//mc11.004201.ZeeJimmy.digit.log.v11000201_3/mc11.004201.ZeeJimmy.digit.log.v11000201._00060.job.log.tgz.1 file:///tmp/mc11.004201.ZeeJimmy.digit.log.v11000201._00060.job.log.tgz.1

And then untar the file:

$ tar -zxvf mc11.004201.ZeeJimmy.digit.log.v11000201._00060.job.log.tgz.1
You will be looking at the files like pilot_child.stdout, pilot.stdout, simlog, digilog etc. for a possible reason of the job's failure.

Log files at BNL

For the BNL jobs, use:

$ curl http://dms02.usatlas.bnl.gov:8000/dq2/lrc/PoolFileCatalog\?lfns=name_of_tarball

And replace the srm host string "srm://dcsrm.usatlas.bnl.gov" by "gsiftp://dcgftp.usatlas.bnl.gov" before running "globus-url-copy" as above. If there is port number 8443 in the srm registration, replace it with 2811 as well.

Log files at UC

For the UC jobs, use:

$ curl http://tier2-01.uchicago.edu:8000/dq2/lrc/PoolFileCatalog\?lfns=name_of_tarball

Log files at UTA

For the UTA jobs, use:

$ curl http://osg-itb2.dpcc.uta.edu:8000/dq2/lrc/PoolFileCatalog\?lfns=name_of_tarball

Log files at OU

For the OUHEP_OSG jobs, use:

$ curl http://ouhep00.nhn.ou.edu:8000/dq2/lrc/PoolFileCatalog\?lfns=name_of_tarball

Major updates:
-- NurcanOzturk - 06 Dec 2005 -- NurcanOzturk - 28 Dec 2005



Responsible: NurcanOzturk

Edit | Attach | Watch | Print version | History: r7 < r6 < r5 < r4 < r3 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r7 - 2006-09-07 - TorreWenaus
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    PanDA All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback