dCache

CIEMAT:

crab_getJobStatistics.py PAT1 'CIEMAT.*(CMSSW_3_3_2-).*' CIEMAT-PAT1.root

caveat: AUTO-AUTO from 2009-12-03

Comments:

  • tstoragefile-total-read-msecs = (tech)-total-read-msecs + (tech)-total-read-msecs (?). Eg (app-only):

#egrep 'read(v|)-total-msecs' crab_fjr_12.xml
         <Metric Name="file-read-total-msecs" Value="0"/>
         <Metric Name="file-readv-total-msecs" Value="0"/>
         <Metric Name="dcap-readv-total-msecs" Value="115200"/>
         <Metric Name="tstoragefile-read-total-msecs" Value="130049"/>
         <Metric Name="dcap-read-total-msecs" Value="17704.5"/>

(tech)-total-read-msecs + (tech)-total-read-msecs = 132904.5, almost equal to 130049

  • app-only and lazy-download use less dcap operations

  • app-only seems to read less data then any other through dcap, but actually reads it through vectorial
reading, which is then read through real cache, eg:

egrep 'read(v|).*-total-mega' crab_fjr_12.xml 

         <Metric Name="tfile-read-total-megabytes" Value="0"/>
         <Metric Name="file-readv-total-megabytes" Value="0"/>
         <Metric Name="dcap-read-total-megabytes" Value="66.409"/>
         <Metric Name="tstoragefile-read-total-megabytes" Value="893.89"/>
         <Metric Name="tstoragefile-read-async-total-megabytes" Value="0"/>
         <Metric Name="tstoragefile-read-actual-total-megabytes" Value="66.409"/>
         <Metric Name="dcap-readv-total-megabytes" Value="5840.58"/>
         <Metric Name="file-read-total-megabytes" Value="0"/>
         <Metric Name="tstoragefile-readv-actual-total-megabytes" Value="5840.58"/>
         <Metric Name="tstoragefile-read-via-cache-total-megabytes" Value="827.481"/>

Here, 5.8 Gb have been read through vect-reading, and from them 827 Mb (tstoragefile-read-via-cache-total-megabytes)+66.4 Mb (dcap-read-total-megabytes) are read in total. so, the amount of data toally read is the same for every method

* similar discussion for lazy-download, but now the cache is local. eg:

egrep 'read(v|).*-total-mega' crab_fjr_12.xml 
         <Metric Name="tfile-read-total-megabytes" Value="0"/>
         <Metric Name="file-readv-total-megabytes" Value="0"/>
         <Metric Name="local-cache-readv-total-megabytes" Value="0"/>
         <Metric Name="tstoragefile-read-total-megabytes" Value="893.89"/>
         <Metric Name="tstoragefile-read-actual-total-megabytes" Value="893.89"/>
         <Metric Name="file-read-total-megabytes" Value="0"/>
         <Metric Name="dcap-read-total-megabytes" Value="5375.19"/>
         <Metric Name="tstoragefile-read-async-total-megabytes" Value="5053.99"/>
         <Metric Name="tstoragefile-read-prefetch-to-cache-total-megabytes" Value="827.481"/>
         <Metric Name="dcap-readv-total-megabytes" Value="0"/>
         <Metric Name="local-cache-read-total-megabytes" Value="893.89"/>

Preliminary comment: both app-only and lazy-download perform very well, but the first one does not rely on a local disk (requirement for WN local disks are quite low, thanks to T.Boccali for having pointed that)

CIEMAT-PAT1-CrabCpuPercentage.jpg CIEMAT-PAT1-read-total-megabytes.jpg CIEMAT-PAT1-dcap-readv-total-megabytes.jpg CIEMAT-PAT1-tstoragefile-read-total-msecs.jpg CIEMAT-PAT1-read-total-msecs.jpg

  CIEMAT-PAT1 20091203 CIEMAT-PAT1 20091207 CIEMAT-PAT1_RHAUTO_CHAPP_CACHE20 20091207 CIEMAT-PAT1_RHAUTO_CHAUTO_CACHE20 20091203
Success 100.0% (20 / 20) 100.0% (20 / 20) 100.0% (20 / 20) 100.0% (20 / 20)
CrabCpuPercentage 63.70 +- 5.93 66.70 +- 16.61 88.65 +- 2.20 90.85 +- 9.36
CrabSysCpuTime 31.01 +- 6.48 27.36 +- 6.20 23.68 +- 4.93 20.78 +- 4.51
CrabUserCpuTime 1545.65 +- 318.39 1472.21 +- 321.84 1292.18 +- 268.40 1243.73 +- 253.42
CrabWrapperTime 2463.75 +- 535.27 2426.15 +- 915.37 1481.30 +- 300.83 1377.70 +- 267.46
OPEN
dcap-open-num-successful-operations 5.30 +- 1.10 5.30 +- 1.10 5.30 +- 1.10 5.30 +- 1.10
file-open-num-successful-operations 1.00 +- 0.00 1.00 +- 0.00 1.00 +- 0.00 1.00 +- 0.00
dcap-open-num-operations 5.30 +- 1.10 5.30 +- 1.10 5.30 +- 1.10 5.30 +- 1.10
file-open-num-operations 1.00 +- 0.00 1.00 +- 0.00 1.00 +- 0.00 1.00 +- 0.00
dcap-open-total-msecs 786.94 +- 1576.70 2422.51 +- 3243.90 417.24 +- 292.33 2508.69 +- 3351.33
file-open-total-msecs 0.13 +- 0.02 0.12 +- 0.01 0.15 +- 0.02 0.11 +- 0.01
READ
dcap-read-num-successful-operations 127473.15 +- 26728.12 127473.15 +- 26728.12 9854.30 +- 2063.79 43.55 +- 8.56
file-read-num-successful-operations 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00
tstoragefile-read-actual-num-successful-operations 127473.15 +- 26728.12 127473.15 +- 26728.12 9854.30 +- 2063.79 127473.15 +- 26728.12
tstoragefile-read-async-num-successful-operations // // 0.00 +- 0.00 12729.20 +- 2684.38
tstoragefile-read-num-successful-operations 127473.15 +- 26728.12 127473.15 +- 26728.12 127473.15 +- 26728.12 127473.15 +- 26728.12
tstoragefile-read-prefetch-to-cache-num-successful-operations // // // 117618.85 +- 24664.45
tstoragefile-read-via-cache-num-successful-operations // // 117618.85 +- 24664.45 //
dcap-read-num-operations 127473.15 +- 26728.12 127473.15 +- 26728.12 9854.30 +- 2063.79 43.55 +- 8.56
file-read-num-operations 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00
tstoragefile-read-actual-num-operations 127473.15 +- 26728.12 127473.15 +- 26728.12 9854.30 +- 2063.79 127473.15 +- 26728.12
tstoragefile-read-async-num-operations // // 5.30 +- 1.10 12729.20 +- 2684.38
tstoragefile-read-num-operations 127473.15 +- 26728.12 127473.15 +- 26728.12 127473.15 +- 26728.12 127473.15 +- 26728.12
tstoragefile-read-prefetch-to-cache-num-operations // // // 117721.75 +- 24685.83
tstoragefile-read-via-cache-num-operations // // 117721.75 +- 24685.83 //
dcap-read-total-msecs 867794.10 +- 278831.99 924985.97 +- 774411.57 22861.94 +- 6590.37 105018.49 +- 76208.73
file-read-total-msecs 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00
tstoragefile-read-actual-total-msecs 867983.40 +- 278854.47 925174.44 +- 774420.75 22879.29 +- 6592.83 75499.41 +- 57974.18
tstoragefile-read-async-total-msecs // // 0.00 +- 0.00 30519.44 +- 21753.88
tstoragefile-read-prefetch-to-cache-total-msecs // // // 20924.70 +- 18966.11
tstoragefile-read-total-msecs 849900.00 +- 199905.58 722500.00 +- 326567.45 148500.00 +- 30520.48 96500.00 +- 72656.73
tstoragefile-read-via-cache-total-msecs // // 76824.36 +- 15520.95 //
dcap-read-total-megabytes 848.64 +- 177.67 848.64 +- 177.67 62.16 +- 12.79 5013.24 +- 987.28
file-read-total-megabytes 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00
tfile-read-total-megabytes 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00
tstoragefile-read-actual-total-megabytes 848.64 +- 177.67 848.64 +- 177.67 62.16 +- 12.79 848.64 +- 177.67
tstoragefile-read-async-total-megabytes // // 0.00 +- 0.00 4788.07 +- 999.53
tstoragefile-read-prefetch-to-cache-total-megabytes // // // 786.48 +- 164.93
tstoragefile-read-total-megabytes 848.64 +- 177.67 848.64 +- 177.67 848.64 +- 177.67 848.64 +- 177.67
tstoragefile-read-via-cache-total-megabytes // // 786.48 +- 164.93 //
READV
dcap-readv-num-successful-operations 0.00 +- 0.00 0.00 +- 0.00 265.70 +- 55.37 0.00 +- 0.00
file-readv-num-successful-operations 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00
tstoragefile-readv-actual-num-successful-operations // // 265.70 +- 55.37 //
dcap-readv-num-operations 0.00 +- 0.00 0.00 +- 0.00 265.70 +- 55.37 0.00 +- 0.00
file-readv-num-operations 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00
tstoragefile-readv-actual-num-operations // // 265.70 +- 55.37 //
dcap-readv-total-msecs 0.00 +- 0.00 0.00 +- 0.00 128314.83 +- 26137.54 0.00 +- 0.00
file-readv-total-msecs 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00
tstoragefile-readv-actual-total-msecs // // 128315.79 +- 26137.71 //
dcap-readv-total-megabytes 0.00 +- 0.00 0.00 +- 0.00 5539.61 +- 1156.86 0.00 +- 0.00
file-readv-total-megabytes 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00
tstoragefile-readv-actual-total-megabytes // // 5539.61 +- 1156.86 //
SEEK
tstoragefile-seek-num-successful-operations 127736.30 +- 26776.44 127736.30 +- 26776.44 363076.90 +- 76126.71 363076.90 +- 76126.71
tstoragefile-seek-num-operations 127736.30 +- 26776.44 127736.30 +- 26776.44 363076.90 +- 76126.71 363076.90 +- 76126.71
tstoragefile-seek-total-msecs 571.23 +- 121.25 456.59 +- 99.95 739.60 +- 158.73 698.53 +- 146.00
tstoragefile-seek-total-megabytes 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00 0.00 +- 0.00

-- LeonardoSala - 08-Dec-2009

Topic attachments
I Attachment History Action Size Date Who Comment
JPEGjpg CIEMAT-PAT1-CrabCpuPercentage.jpg r1 manage 23.0 K 2009-12-08 - 16:25 UnknownUser  
JPEGjpg CIEMAT-PAT1-dcap-readv-total-megabytes.jpg r1 manage 17.8 K 2009-12-08 - 16:26 UnknownUser  
JPEGjpg CIEMAT-PAT1-read-total-megabytes.jpg r1 manage 21.3 K 2009-12-08 - 16:25 UnknownUser  
JPEGjpg CIEMAT-PAT1-read-total-msecs.jpg r1 manage 21.2 K 2009-12-08 - 16:27 UnknownUser  
JPEGjpg CIEMAT-PAT1-tstoragefile-read-total-msecs.jpg r1 manage 22.4 K 2009-12-08 - 16:27 UnknownUser  
Edit | Attach | Watch | Print version | History: r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r1 - 2009-12-08 - unknown
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback