Checking the transfers from Pit to Castor

The link bandwidth is 10Gbit. A normal rate (at beginning of 2012) was 280-300 MB/s.

Monitoring

Useful plots available in Dirac web portal, under Accounting / Data Operations plots / select: throughput, grouped by any metric, and in the condition box: source = DIRAC.ONLINE.ch

Debugging

What to do if the transfer drops (for the GEOC):

check the status of TransferAgent and restart it, setting a stop_agent file .

To check the assigned requests on the online system, check the directory:

[lhcbprod@store06:/sw/dirac/data-taking/requestDB/transfer] $ ls -l Assigned
total 112
-rw-r--r-- 1 lhcbprod z5 1664 Apr 14 05:09 request_8596019
-rw-r--r-- 1 lhcbprod z5 1664 Apr 14 17:05 request_8609808
-rw-r--r-- 1 lhcbprod z5 1668 Apr 14 18:36 request_8612442
-rw-r--r-- 1 lhcbprod z5 1664 Apr 14 18:35 request_8612449
-rw-r--r-- 1 lhcbprod z5 1664 Apr 14 18:35 request_8612453
-rw-r--r-- 1 lhcbprod z5 1668 Apr 14 18:36 request_8612454
-rw-r--r-- 1 lhcbprod z5 1668 Apr 14 18:36 request_8612465

Check if some task is hanging and thus blocking the agent, or if the agent itself is stuck (maybe for some open connection left pending): get all process and sub-processes:

$ ps faxu | grep TransferAgent | grep -v -e grep -e runsv
dirac    26539 14.5  0.3 316064 52944 ?        SNl  Apr12 582:41      \_ python /opt/dirac/pro/DIRAC/Core/scripts/dirac-agent.py DataManagement/TransferAgent /opt/dirac/pro/etc/DataManagement_TransferAgent.cfg -o LogLevel=INFO

check their status and possible open connections:

$ ls -l /proc/[pid]/fd
$ ls -l /proc/[pid]/task
$ netstat -puta | grep [pid]

-- ElisaLanciotti - 15-Apr-2012

Edit | Attach | Watch | Print version | History: r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r1 - 2012-04-15 - unknown
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LHCb All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback