EOS Transfer Logs

The logs for EOS transactions. Every entry corresponds to one file interaction, from open to close.

Contact

For AWG: christian.nieke@cernNOSPAMPLEASE.ch

Developer: andreas.joachim.peters@cernNOSPAMPLEASE.ch

Processed Parameters

Name Type Link Description Purpose Remarks
td String - client trace identifier (<username>.<pid>@<client-host>) This identifier can be used to aggregate sessions
(of the same user, with the same job on the same machine) 		 
path String - Full namespace path to the file The folder structure in the path could be usefull to match the file to a project/user/programm etc.  
ruid Int - mapped unix user id Allows aggregation by user ruid==1 means root process, which is usually an
internal process like rebalancing, draining etc.
guid Int - mapped unix group id Allows aggregation by group  
host String LanDB : name Name of the disk server serving the file Allows aggregation by user host and links to LanDB  
fid Int - EOS file id Allows aggregation by file unique per EOS instance (e.g. eosatlas, eoscms,... )
fsid   - EOS file system id, e.g. disk Allows aggregation of files by file system (disk)  
ots Date - File open time as unix timestamp (in seconds since January 1st, 1970 at UTC) Aggregation by time  
otms Int - Miliseconds part of "ots" Additional precision for ots  
cts Date - File close time as unix timestamp (in seconds since January 1st, 1970 at UTC) Aggregation by time  
ctms Int - Miliseconds part of "cts" Additional precision for cts  
rb Int - Bytes read during file open (in Bytes) Get amount of data read  
wb Int - Bytes written during file open (in Bytes) Get amount of data written  
sfwdb Int - Bytes seeked forward Can be used to analyse access pattern of files  
sbwdb Int - Bytes seeked backward Can be used to analyse access pattern of files  
sxlfwdb Int - Bytes seeked in large seeks (>128k) forward Can be used to analyse access pattern of files  
sxlbwdb Int - Bytes seeked in large seeks (>128k) backward Can be used to analyse access pattern of files  
nrc Int - Number of read calls Can be used to analyse access pattern of files  
nwc Int - Number of write calls Can be used to analyse access pattern of files  
nfwds Int - Number of forward seeks Can be used to analyse access pattern of files  
nbwds Int - Number of backward seeks Can be used to analyse access pattern of files  
nxlfwds Int - Number of large forward seeks (>128k) Can be used to analyse access pattern of files  
nxlbwds Int - Number of large backward seeks (>128k) Can be used to analyse access pattern of files  
rt Int - Time in ms spent for actual reading disk IO Can be used to calculate disk read speed (rb/rt), and to compare file open time with actual reading/writing time
(which allows to calculate the time where the file was opened, but not used actively) 		Reading speed (rb/rt) should be around 100MB/sec, better performance might be due to caching
wt Int - Time in ms spent for actual writing disk IO Can be used to calculate disk write speed (wb/wt), and to compare file open time with actual reading/writing time
(which allows to calculate the time where the file was opened, but not used actively) 		Writing speed (wb/wt) should be around 100MB/sec, better performance might be due to caching
osize Int - File Size when file was opened (in Bytes) Analyse file sizes can be used with csize to see if filesize was changed by the process
csize Int - File Size when file was closed (in Bytes) Analyse file sizes can be used with osize to see if filesize was changed by the process
sec.name String - mapped user name or principal Group by user, analyse "type" of user (atlas01 vs. JonDoe), report to specific user Based on security token
sec.host String LanDB : name Name of client host Group by client host, link to host configuration Based on security token
sec.vorg String - client VO Aggregation by VO Based on security token
sec.grps String - client group Aggregation by group Based on security token
sec.role String - client role Aggregation by role Based on security token
sec.app String - application identifier Aggregation by application Based on security token
(normally ""), "tpc" for third party copy transfers,
"eos.xxx" for EOS file movements e.g. eos.balancing, eos.draining, eos.gridftp ...

Raw Parameters

Name Type Link Description Remarks
log Int - internal EOS log id  
lid Int - EOS file layout id  
rb_min        
rb_max        
rb_sigma        
wb_min        
wb_max        
wb_sigma        
sec.info String - for GSI authentication DN  

-- ChristianNieke - 23 Sep 2014

Edit | Attach | Watch | Print version | History: r4 < r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r4 - 2014-09-26 - ChristianNieke
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Sandbox All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2023 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback