2009 Q1

Job Statistics

  • Summary:
    • Over 1000 K jobs run
    • About 25% failed
    • Routinely running over 10 K jobs per day
    • Daily peak of over 80 K jobs
    • 440 K Production jobs run to end
    • 180 K User jobs run to the end
    • 135 K Production Jobs Failed
    • 114 K User Jobs Failed

  • Total number of Jobs by Final Major Status
Total_Number_of_Jobs_by_FinalMajorStatus.png

  • Daily number of Jobs by Final Mayor Status
Daily_Number_of_Jobs_by_FinalMajorStatus.png

  • Done|Completed Jobs by User Group
Done+Complete_Jobs_by_UserGroup.png

  • Done|Completed Production Jobs by Job Type
Done+Complete_Production_Jobs_by_JobType.png

  • Failed Jobs by User Group
Failed_Jobs_by_UserGroup.png

  • Failed Production Jobs by Minor Status
Failed_Production_Jobs_by_MinorStatus.png

  • Failed User Jobs by Minor Status
Failed_User_Jobs_by_MinorStatus.png

Running at Tier1's

  • Summary:
    • 4 K Production Jobs at Tier1s
      • Monte Carlo Production was done outside Tier1's
    • 130 K User Jobs at Tier1s
      • 50 % CERN Share
      • very low contributions from CNAF, NIHKEF, IN2P3

  • Done|Completed Production Jobs by Site
Done+Complete_Production_Jobs_at_Tier1_by_Site.png

  • Done|Completed User Jobs by Site
Done+Complete_User_Jobs_at_Tier1_by_Site.png

Job Failure Analysis

  • Summary:
    • Production Jobs Failed mostly due to:
      • Application Error everywhere (86 K)
      • Input Sandbox Download mostly at Shefield, RAL-HEP, IN2P3-T2 (45 K)
    • User Jobs Failed mosty due to:
      • Input Sandbox Download mostly at CERN, Durham, Dortmund, RAL (75 K)
      • Application Error mostly at IN2P3-T2, CERN (20 K)
      • Input Data Resolution, notice large fraction of errors at NIHKEF with respect to successful jobs (11 K)
    • Comment about any site is appropriated
      • Large number of problems with Input Data Resolution outside Tier1's.

  • Failed Production Jobs (Application Finished With Error) by Site
Failed_Production_Jobs_Application_Finished_With_Errors_by_Site.png

  • Failed Production Jobs (Input Sandbox Download) by Site
Failed_Production_Jobs_Input_Sandbox_Download_by_Site.png

  • Failed User Jobs (Input Sandbox Download) by Site
Failed_User_Jobs_Input_Sandbox_Download_by_Site.png

  • Failed User Jobs (Application Finished With Error) by Site
Failed_User_Jobs_Application_Finished_With_Errors_by_Site.png

  • Failed User Jobs (Input Data Resolution) by Site
Failed_Users_Jobs_Input_Data_Resolution_by_Site.png

Job Failure at Tier1 Analysis

  • Summary:
    • Most activity at Tier1 related to user Jobs.
    • Production Jobs Failed mostly due to:
      • Application Error everywhere (86 K)
      • Input Sandbox Download mostly at Shefield, RAL-HEP, IN2P3-T2 (45 K)
    • User Jobs Failed mosty due to:
      • Input Sandbox Download mostly at CERN, Durham, Dortmund, RAL (75 K)
      • Application Error mostly at IN2P3-T2, CERN (20 K)
      • Input Data Resolution, notice large fraction of errors at NIHKEF with respect to successful jobs (11 K)
    • Comment about any site is appropriated
      • Large number of problems with Input Data Resolution outside Tier1's.

  • Failed Jobs at CERN by Minor Status
Failed_Jobs_at_CERN_by_MinorStatus.png
  • Failed Jobs at CNAF by Minor Status
Failed_Jobs_at_CNAF_by_MinorStatus.png
  • Failed Jobs at GRIDKA by Minor Status
Failed_Jobs_at_GRIDKA_by_MinorStatus.png
  • Failed Jobs at IN2P3 by Minor Status
Failed_Jobs_at_IN2P3_by_MinorStatus.png
  • Failed Jobs at NIKHEF by Minor Status
Failed_Jobs_at_NIKHEF_by_MinorStatus.png
  • Failed Jobs at PIC by Minor Status
Failed_Jobs_at_PIC_by_MinorStatus.png
  • Failed Jobs at RAL by Minor Status
Failed_Jobs_at_RAL_by_MinorStatus.png
  • Failed Jobs at GRIDKA by Minor Status
Failed_Jobs_at_GRIDKA_by_MinorStatus.png

-- RicardoGraciani - 10 Jun 2009

Attachments Attachments
Topic attachments
I Attachment History Action Size Date Who Comment
PNGpng Daily_Number_of_Jobs_by_FinalMajorStatus.png r1 manage 48.8 K 2009-06-10 - 15:38 RicardoGraciani  
PNGpng Done+Complete_Jobs_by_UserGroup.png r1 manage 41.8 K 2009-06-10 - 15:38 RicardoGraciani  
PNGpng Done+Complete_Production_Jobs_at_Tier1_by_Site.png r1 manage 61.0 K 2009-06-10 - 15:53 RicardoGraciani  
PNGpng Done+Complete_Production_Jobs_by_JobType.png r1 manage 29.6 K 2009-06-10 - 15:39 RicardoGraciani  
PNGpng Done+Complete_User_Jobs_at_Tier1_by_Site.png r1 manage 56.3 K 2009-06-10 - 15:54 RicardoGraciani  
PNGpng Failed_Jobs_at_CERN_by_MinorStatus.png r1 manage 53.4 K 2009-06-10 - 17:17 RicardoGraciani  
PNGpng Failed_Jobs_at_CNAF_by_MinorStatus.png r1 manage 52.6 K 2009-06-10 - 17:17 RicardoGraciani  
PNGpng Failed_Jobs_at_GRIDKA_by_MinorStatus.png r1 manage 48.5 K 2009-06-10 - 17:18 RicardoGraciani  
PNGpng Failed_Jobs_at_IN2P3_by_MinorStatus.png r1 manage 53.6 K 2009-06-10 - 17:18 RicardoGraciani  
PNGpng Failed_Jobs_at_NIKHEF_by_MinorStatus.png r1 manage 58.9 K 2009-06-10 - 17:18 RicardoGraciani  
PNGpng Failed_Jobs_at_PIC_by_MinorStatus.png r1 manage 50.4 K 2009-06-10 - 17:18 RicardoGraciani  
PNGpng Failed_Jobs_at_RAL_by_MinorStatus.png r1 manage 50.9 K 2009-06-10 - 17:18 RicardoGraciani  
PNGpng Failed_Jobs_by_UserGroup.png r1 manage 33.4 K 2009-06-10 - 15:39 RicardoGraciani  
PNGpng Failed_Production_Jobs_Application_Finished_With_Errors_by_Site.png r1 manage 120.7 K 2009-06-10 - 16:01 RicardoGraciani  
PNGpng Failed_Production_Jobs_Input_Sandbox_Download_by_Site.png r1 manage 110.2 K 2009-06-10 - 16:09 RicardoGraciani  
PNGpng Failed_Production_Jobs_by_MinorStatus.png r1 manage 49.3 K 2009-06-10 - 15:40 RicardoGraciani  
PNGpng Failed_User_Jobs_Application_Finished_With_Errors_by_Site.png r1 manage 94.2 K 2009-06-10 - 16:12 RicardoGraciani  
PNGpng Failed_User_Jobs_Input_Sandbox_Download_by_Site.png r1 manage 97.6 K 2009-06-10 - 16:12 RicardoGraciani  
PNGpng Failed_User_Jobs_by_MinorStatus.png r1 manage 55.2 K 2009-06-10 - 15:40 RicardoGraciani  
PNGpng Failed_Users_Jobs_Input_Data_Resolution_by_Site.png r1 manage 61.6 K 2009-06-10 - 16:02 RicardoGraciani  
PNGpng Total_Number_of_Jobs_by_FinalMajorStatus.png r1 manage 39.9 K 2009-06-10 - 15:40 RicardoGraciani  
This topic: LHCb > WebHome > LHCbComputing > DIRACWeeklyReport > DIRACQuarterlyReport2009Q1
Topic revision: r2 - 2009-06-10 - RicardoGraciani
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback