Quarterly Metrics Report Layout

Metrics list

Metric Type Metric ID What to Visualise? Scope How to Visualise? Required ETICS properties Notes Availability?
Process related PriorityBugs Immediate Priority Per Defect Tracker 'Category' Box and whisker plot: Category Vs Average time to close a bugs. Also includes average time across the whole project (red dotted line horizontal across the plot) None Do not visualise high and immediate together. Do not visualise per middleware results. Since the bugs are closed, the box and whisker plots should be green. Yes
High Priority Yes
OpenPriorityBug Open Priorities Box and whisker plot: Category Vs Average time spent so far on open priority bugs. Also includes average time across the whole project (red dotted horizontal line across the plot) Bug with priority immediate or open that are still open at the time of report generation. Plot similarly to PriorityBugs, except that the box and whiskers should be red (not green) because the bugs are still open. Yes
OpenUntouchedBug Open Untouched Bugs Box and whisker plot: Category Vs Average time spent so far on open untouched bugs. Also includes average time across the whole project (red dotted horizontal line across the plot) Bug reports that are more than two weeks old, but have never been touched (accepted or rejected). Not needed for Quarterly Reports, but will be needed for EMT. Bugs open more than 2 weeks must be acted upon immediately (see DSA 1.1). Yes List of bugs
Scatter plot Yes
Scatter plot (log scale) Yes
Bar chart, number of bugs per category Yes
Bar chart, cumulative number of days bugs have been untouched, per category Yes
FixedBugs Number of fixed bugs Vertical Bar Chart with one bar per Category This is usually only generated at each release, but its good to have it in place now using some timeframe such as a quarter or the development cycle such as March 2010-March 2011 Yes
Backlog Number of Closed Bug, Number of Open Bugs Vertical Bar Chart with two bars (open & closed bugs) per Category This is usually only generated at each release, but its good to have it in place now using some timeframe such as a quarter or the development cycle such as March 2010-March 2011 Sample Yes, last year Yes, last 30 days
Product related SLOCCount SLOC per language One graph for EMI, one bar for each subsystem. Stacked bar chart: ETICS subsystems Vs. SLOC SA2.4 to specify   Yes
FindBugsErrors High severity errors per KLOC One graph per subsystem, 3 bars for each ETICS component in the subsystem Histogram plot: ETICS component Vs. errors/KLOC ETICS FindBugs plugin Needs uniformity across all Product teams. We can't allow endless optional properties, otherwise metrics will not be interpretable Yes
Medium/low severity errors per KLOC Yes
High/medium/low severity errors per KLOC Yes
PMDErrors Errors per KLOC One graph per subsystem, n bars for each ETICS component in the subsystem Histogram plot: ETICS component Vs. errors/KLOC SA2.4 to specify   Yes, subsystem (APEL)
CheckstyleErrors Errors per KLOC One graph per subsystem, n bars for each ETICS component in the subsystem Histogram plot: ETICS component Vs. errors/KLOC SA2.4 to specify   Yes, subsystem (APEL)

Extra requirements for understanding reports

  • Legend to explain quartile ranges in box and whisker plots.

Quarterly Report Time Ranges

  • Q1 time range limits - [May 2010, Jul 2010]
  • Q2 time range limits - [Aug 2010, Oct 2010]
  • Q3 time range limits - [Nov 2010, Jan 2011]
  • Q4 time range limits - [Feb 2011, Apr 2011]

PMD & Checkstyle issues

Product Team Component Name / Subsystem PMD Reasons for Failures Checkstyle Reasons for Failures
DM (gLite) emi.fts.transfer-interface Not using src or property ${java.src.location} or ${pmd.src.location} Not using src or property ${java.src.location} or ${checkstyle.src.location}
dCache emi.dcache.server
emi.dcache.srmclient
StoRM emi.storm.gridhttps-server
UCC (UNICORE Client and APIs) emi.unicore.ucc
XUUDB (UNICORE Security) emi.unicore.xuudb
UNICORE/X (UNICORE Service Hosting) emi.unicore.unicorex
Registry (UNICORE Web Service Interfaces) emi.unicore.registry
Hydra (gLite Security) emi.hydra.catalog-interface
HILA (UNICORE Client and APIs) emi.unicore.hila-shell Runs successfully, but no files found to check Runs successfully, but no result found
emi.unicore.hila-unicore6

Backlog Management Index (BMI): undefined mappings between categories and product teams

Middleware gLite Description Possible Relationship to a Product Team Which Product Team?
gLite Cluster gLite-Cluster for multiple clusters and multiple CEs gLite Job Management gLite Job Management
Condor utils Condor related Not applicable in EMI (no bug since start of EMI) No
Data Management Portability related issues Not applicable yet in EMI (EGEE-III SA3 bugs) No
dCache dCache dCache, but should be part of Review Tracker (RT) No
gLite Middleware - General FHS compliance and globus related issues Not applicable to EMI (not part of product team) No
Information providers Glue related (not product teams) No
Information schema No bugs currently open No bugs currently open No
Installation No Longer in Savannah No bugs No
lcg-CE lcg-CE related fixes Not maintained as part of EMI No
LSF utils 1 Bug open relating glite-CE (already fixed) No
Medical Data Management No bugs currently open No bugs currently open No
R-GMA Last open bug almost 1 year old Not appliable in EMI (older bugs) No
Release documentation 2 minor items relating to documentation Could relate to VOMS and general user guide Perhaps
Security Related to gLite security Related to product team gLite security gLite Security
Service Discovery No bugs open No bugs open No
SGE utils Sun Grid Engine related tickets Not applicable to EMI No
Third-party Software No bugs open No bugs open No
TORQUE torque/pbs related issues, 1 ticket Not related to an EMI No
UI glite-UI, specific node type glite-UI ongoing support No
UNSET Extremely important since these bugs must be assigned to product teams, only 1 in gLite applied to PX Applicable currently to gLite and UNICORE Define PX in SQAPDefinitions.xsd
User tools Mainly relates to lcg-infosites and lcg-info Note related to any particular PT No
VDT VDT is replaced now with IGE globus in EPEL Not applicable to EMI No
VOBOX glite-VOBOX, specific node type glite-VOBOX ongoing support No
WN glite-WN, specific node type glite-WN ongoing support No
YAIM core Yaim core related issues installation method, ongoing support for gLite No

Related questions:

  • where is glite-cluster supported? by which product team?
  • FHS compliance and VDT globus related features: which product team?
  • is the lcg-CE still maintained?
  • what is gLite category PX? Needed to avoid gLite UNSET component.
  • UNICORE defects with categories currently set to unset: XUUDB Security Clients Registry TSI XNJS

-- EamonnKenny - 04-Dec-2010

-- LarsBarlindhaug - 24-Jan-2011

-- EamonnKenny - 04-Mar-2011

-- LarsBarlindhaug - 09-Mar-2011

-- LarsBarlindhaug - 04-Apr-2011

Topic attachments
I Attachment History Action Size Date Who Comment
PNGpng BoxWhiskerHigh2010.png r3 r2 r1 manage 46.4 K 2011-01-21 - 09:26 UnknownUser Box and whisker chart for high bugs in EMI
PNGpng BoxWhiskerImmediate2010.png r3 r2 r1 manage 37.7 K 2011-01-21 - 09:27 UnknownUser Box and whisker chart for immediate bugs in EMI
PNGpng BoxWhiskerOpen.png r3 r2 r1 manage 75.9 K 2011-01-11 - 14:37 UnknownUser  
PNGpng Checkstyle.png r2 r1 manage 36.4 K 2011-01-21 - 09:31 UnknownUser  
PNGpng CheckstyleApel.png r1 manage 39.5 K 2010-12-17 - 15:56 UnknownUser  
PDFpdf Metrics_Report_sorted_alphabetically.pdf r4 r3 r2 r1 manage 327.5 K 2011-04-18 - 12:25 UnknownUser  
PDFpdf NightlyReport.pdf r2 r1 manage 3333.1 K 2011-03-16 - 14:53 UnknownUser  
Texttxt OpenBugs14DaysOld-11Jan2010.txt r3 r2 r1 manage 13.7 K 2011-01-24 - 12:31 UnknownUser  
PNGpng PMD.png r2 r1 manage 34.1 K 2011-01-21 - 09:31 UnknownUser  
PNGpng PMDApel.png r1 manage 41.0 K 2010-12-17 - 12:41 UnknownUser  
PNGpng StackedBarChartSLOC.png r3 r2 r1 manage 40.0 K 2011-01-21 - 09:27 UnknownUser  
PNGpng backlogChart_backlogIndex.png r1 manage 54.5 K 2011-03-08 - 17:52 UnknownUser  
PNGpng backlogChart_last_30_days.png r1 manage 57.5 K 2011-03-08 - 17:31 UnknownUser  
PNGpng backlogChart_march2010-march2011.png r1 manage 56.7 K 2011-03-08 - 17:31 UnknownUser  
PNGpng backlog_sample.png r1 manage 14.0 K 2011-03-04 - 17:36 UnknownUser  
PNGpng findBugsOverallBarchartHigh.png r1 manage 23.1 K 2011-01-21 - 09:28 UnknownUser  
PNGpng findBugsOverallBarchartHighMediumLow.png r1 manage 26.5 K 2011-01-21 - 09:30 UnknownUser  
PNGpng fixedBugsBarChart.png r1 manage 39.3 K 2011-03-09 - 15:01 UnknownUser  
PNGpng fixedBugsBarChart_fixed_verified_closed.png r1 manage 56.4 K 2011-03-09 - 15:14 UnknownUser  
PNGpng openBar.png r2 r1 manage 38.6 K 2011-01-24 - 13:50 UnknownUser  
PNGpng openBarTotal.png r2 r1 manage 39.6 K 2011-01-24 - 13:50 UnknownUser  
PNGpng openBugs_generated_17_01_2011.png r1 manage 45.5 K 2011-01-17 - 11:05 UnknownUser  
Texttxt openBugs_generated_17_01_2011.txt r1 manage 13.9 K 2011-01-17 - 11:05 UnknownUser  
PNGpng openScatter.png r3 r2 r1 manage 51.1 K 2011-01-24 - 13:50 UnknownUser  
PNGpng openScatterLog.png r2 r1 manage 43.4 K 2011-01-24 - 13:51 UnknownUser  
PDFpdf open_bugs.pdf r2 r1 manage 371.3 K 2011-04-04 - 11:57 UnknownUser  
PNGpng untouched_bugs.png r1 manage 60.9 K 2011-01-24 - 12:34 UnknownUser  
Texttxt untouched_bugs_-_24Jan2011.txt r1 manage 13.7 K 2011-01-24 - 12:32 UnknownUser  
Edit | Attach | Watch | Print version | History: r33 < r32 < r31 < r30 < r29 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r33 - 2011-05-18 - unknown
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    EMI All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback