DIRACQuarterlyReport2009Q1 < LHCb

LHCb Web>LHCbComputing>DIRACWeeklyReport>DIRACQuarterlyReport2009Q1 (2009-06-10, RicardoGraciani) (raw view)

---+++ 2009 Q1 <br />

---++++ Job Statistics<br />

   * Summary:
      * Over 1000 K jobs run
      * About 25% failed
      * Routinely running over 10 K jobs per day  
      * Daily peak of over 80 K jobs
      * 440 K Production jobs run to end
      * 180 K User jobs run to the end
      * 135 K Production Jobs Failed
      * 114 K User Jobs Failed


   * *Total* number of Jobs by Final Major Status
<img alt="Total_Number_of_Jobs_by_FinalMajorStatus.png" src="%ATTACHURL%/Total_Number_of_Jobs_by_FinalMajorStatus.png" /><br />


   * *Daily* number of Jobs by Final Mayor Status
<img alt="Daily_Number_of_Jobs_by_FinalMajorStatus.png" src="%ATTACHURL%/Daily_Number_of_Jobs_by_FinalMajorStatus.png" /><br />


   * *Done|Completed* Jobs by User Group
<img alt="Done+Complete_Jobs_by_UserGroup.png" src="%ATTACHURL%/Done+Complete_Jobs_by_UserGroup.png" /><br />


   * *Done|Completed* *Production* Jobs by Job Type
<img alt="Done+Complete_Production_Jobs_by_JobType.png" src="%ATTACHURL%/Done+Complete_Production_Jobs_by_JobType.png" /><br />


   * *Failed* Jobs by User Group
<img alt="Failed_Jobs_by_UserGroup.png" src="%ATTACHURL%/Failed_Jobs_by_UserGroup.png" ><br />


   * *Failed* *Production* Jobs by Minor Status 
<img alt="Failed_Production_Jobs_by_MinorStatus.png" src="%ATTACHURL%/Failed_Production_Jobs_by_MinorStatus.png" /><br />


   * *Failed* *User* Jobs by Minor Status
<img alt="Failed_User_Jobs_by_MinorStatus.png" src="%ATTACHURL%/Failed_User_Jobs_by_MinorStatus.png" /><br />



---++++ Running at Tier1's<br />


   * Summary:
      * 4 K Production Jobs at Tier1s
         * Monte Carlo Production was done outside Tier1's
      * 130 K User Jobs at Tier1s
         * 50 % CERN Share
         * very low contributions from CNAF, NIHKEF, IN2P3


   * *Done|Completed* *Production* Jobs by Site
<img alt="Done+Complete_Production_Jobs_at_Tier1_by_Site.png" src="%ATTACHURL%/Done+Complete_Production_Jobs_at_Tier1_by_Site.png" /><br />


   * *Done|Completed* *User* Jobs by Site
<img alt="Done+Complete_User_Jobs_at_Tier1_by_Site.png" src="%ATTACHURL%/Done+Complete_User_Jobs_at_Tier1_by_Site.png" /><br />


---++++ Job Failure Analysis<br />

   * Summary:
      * Production Jobs Failed mostly due to:
         * Application Error everywhere (86 K)
         * Input Sandbox Download mostly at Shefield, RAL-HEP, IN2P3-T2 (45 K)
      * User Jobs Failed mosty due to:
         * Input Sandbox Download mostly at CERN, Durham, Dortmund, RAL (75 K)
         * Application Error mostly at IN2P3-T2, CERN (20 K)
         * Input Data Resolution, notice large fraction of errors at NIHKEF with respect to successful jobs (11 K)
      * Comment about any site is appropriated
         * Large number of problems with Input Data Resolution outside Tier1's.


   * *Failed* *Production* Jobs (*Application Finished With Error*) by Site
<img alt="Failed_Production_Jobs_Application_Finished_With_Errors_by_Site.png" src="%ATTACHURL%/Failed_Production_Jobs_Application_Finished_With_Errors_by_Site.png" /><br />

   * *Failed* *Production* Jobs (*Input Sandbox Download*) by Site
<img alt="Failed_Production_Jobs_Input_Sandbox_Download_by_Site.png" src="%ATTACHURL%/Failed_Production_Jobs_Input_Sandbox_Download_by_Site.png" /><br />


   * *Failed* *User* Jobs (*Input Sandbox Download*) by Site
<img alt="Failed_User_Jobs_Input_Sandbox_Download_by_Site.png" src="%ATTACHURL%/Failed_User_Jobs_Input_Sandbox_Download_by_Site.png" /><br />

   * *Failed* *User* Jobs (*Application Finished With Error*) by Site
<img alt="Failed_User_Jobs_Application_Finished_With_Errors_by_Site.png" src="%ATTACHURL%/Failed_User_Jobs_Application_Finished_With_Errors_by_Site.png" /><br />

   * *Failed* *User* Jobs (*Input Data Resolution*) by Site
<img alt="Failed_Users_Jobs_Input_Data_Resolution_by_Site.png" src="%ATTACHURL%/Failed_Users_Jobs_Input_Data_Resolution_by_Site.png" /><br />

---++++ Job Failure at Tier1 Analysis<br />

   * Summary:
      * Most activity at Tier1 related to user Jobs.
      * Production Jobs Failed mostly due to:
         * Application Error everywhere (86 K)
         * Input Sandbox Download mostly at Shefield, RAL-HEP, IN2P3-T2 (45 K)
      * User Jobs Failed mosty due to:
         * Input Sandbox Download mostly at CERN, Durham, Dortmund, RAL (75 K)
         * Application Error mostly at IN2P3-T2, CERN (20 K)
         * Input Data Resolution, notice large fraction of errors at NIHKEF with respect to successful jobs (11 K)
      * Comment about any site is appropriated
         * Large number of problems with Input Data Resolution outside Tier1's.

   * *Failed* Jobs at *CERN* by Minor Status
<img alt="Failed_Jobs_at_CERN_by_MinorStatus.png" src="%ATTACHURL%/Failed_Jobs_at_CERN_by_MinorStatus.png" /><br />
   * *Failed* Jobs at *CNAF* by Minor Status
<img alt="Failed_Jobs_at_CNAF_by_MinorStatus.png" src="%ATTACHURL%/Failed_Jobs_at_CNAF_by_MinorStatus.png" /><br />
   * *Failed* Jobs at *GRIDKA* by Minor Status
<img alt="Failed_Jobs_at_GRIDKA_by_MinorStatus.png" src="%ATTACHURL%/Failed_Jobs_at_GRIDKA_by_MinorStatus.png" /><br />
   * *Failed* Jobs at *IN2P3* by Minor Status
<img alt="Failed_Jobs_at_IN2P3_by_MinorStatus.png" src="%ATTACHURL%/Failed_Jobs_at_IN2P3_by_MinorStatus.png" /><br />
   * *Failed* Jobs at *NIKHEF* by Minor Status
<img alt="Failed_Jobs_at_NIKHEF_by_MinorStatus.png" src="%ATTACHURL%/Failed_Jobs_at_NIKHEF_by_MinorStatus.png" /><br />
   * *Failed* Jobs at *PIC* by Minor Status
<img alt="Failed_Jobs_at_PIC_by_MinorStatus.png" src="%ATTACHURL%/Failed_Jobs_at_PIC_by_MinorStatus.png" /><br />
   * *Failed* Jobs at *RAL* by Minor Status
<img alt="Failed_Jobs_at_RAL_by_MinorStatus.png" src="%ATTACHURL%/Failed_Jobs_at_RAL_by_MinorStatus.png" /><br />
   * *Failed* Jobs at *GRIDKA* by Minor Status
<img alt="Failed_Jobs_at_GRIDKA_by_MinorStatus.png" src="%ATTACHURL%/Failed_Jobs_at_GRIDKA_by_MinorStatus.png" /><br />





-- Main.RicardoGraciani - 10 Jun 2009

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who
png	Daily_Number_of_Jobs_by_FinalMajorStatus.png	r1	manage	48.8 K	2009-06-10 - 15:38	RicardoGraciani
png	Done+Complete_Jobs_by_UserGroup.png	r1	manage	41.8 K	2009-06-10 - 15:38	RicardoGraciani
png	Done+Complete_Production_Jobs_at_Tier1_by_Site.png	r1	manage	61.0 K	2009-06-10 - 15:53	RicardoGraciani
png	Done+Complete_Production_Jobs_by_JobType.png	r1	manage	29.6 K	2009-06-10 - 15:39	RicardoGraciani
png	Done+Complete_User_Jobs_at_Tier1_by_Site.png	r1	manage	56.3 K	2009-06-10 - 15:54	RicardoGraciani
png	Failed_Jobs_at_CERN_by_MinorStatus.png	r1	manage	53.4 K	2009-06-10 - 17:17	RicardoGraciani
png	Failed_Jobs_at_CNAF_by_MinorStatus.png	r1	manage	52.6 K	2009-06-10 - 17:17	RicardoGraciani
png	Failed_Jobs_at_GRIDKA_by_MinorStatus.png	r1	manage	48.5 K	2009-06-10 - 17:18	RicardoGraciani
png	Failed_Jobs_at_IN2P3_by_MinorStatus.png	r1	manage	53.6 K	2009-06-10 - 17:18	RicardoGraciani
png	Failed_Jobs_at_NIKHEF_by_MinorStatus.png	r1	manage	58.9 K	2009-06-10 - 17:18	RicardoGraciani
png	Failed_Jobs_at_PIC_by_MinorStatus.png	r1	manage	50.4 K	2009-06-10 - 17:18	RicardoGraciani
png	Failed_Jobs_at_RAL_by_MinorStatus.png	r1	manage	50.9 K	2009-06-10 - 17:18	RicardoGraciani
png	Failed_Jobs_by_UserGroup.png	r1	manage	33.4 K	2009-06-10 - 15:39	RicardoGraciani
png	Failed_Production_Jobs_Application_Finished_With_Errors_by_Site.png	r1	manage	120.7 K	2009-06-10 - 16:01	RicardoGraciani
png	Failed_Production_Jobs_Input_Sandbox_Download_by_Site.png	r1	manage	110.2 K	2009-06-10 - 16:09	RicardoGraciani
png	Failed_Production_Jobs_by_MinorStatus.png	r1	manage	49.3 K	2009-06-10 - 15:40	RicardoGraciani
png	Failed_User_Jobs_Application_Finished_With_Errors_by_Site.png	r1	manage	94.2 K	2009-06-10 - 16:12	RicardoGraciani
png	Failed_User_Jobs_Input_Sandbox_Download_by_Site.png	r1	manage	97.6 K	2009-06-10 - 16:12	RicardoGraciani
png	Failed_User_Jobs_by_MinorStatus.png	r1	manage	55.2 K	2009-06-10 - 15:40	RicardoGraciani
png	Failed_Users_Jobs_Input_Data_Resolution_by_Site.png	r1	manage	61.6 K	2009-06-10 - 16:02	RicardoGraciani
png	Total_Number_of_Jobs_by_FinalMajorStatus.png	r1	manage	39.9 K	2009-06-10 - 15:40	RicardoGraciani

Topic revision: r2 - 2009-06-10 - RicardoGraciani

LHCb

Public webs

Welcome Guest

- Cern Search
- TWiki Search
- Google Search
LHCb All webs

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback