EMI Quality Model

Introduction

The EMI Quality Model helps to evaluate the EMI software product and process quality. It helps to set quality goals for software products and processes. The EMI Quality Model uses ISO/IEC 9126 Software Engineering Product Quality to identify a set of characteristics that need to be present in EMI software products and processes to be able to meet EMI quality requirements. EMI quality requirements are based on DCIs quality requirements, like the UMD Quality Criteria, and internal project objectives that influence qualitative aspects of the EMI software, as specified in the EMI DoW.

For each software characteristic, a set of associated metrics and KPIs are identified. Metrics and KPIs are defined in detail in the EMI Metrics Specification. The EMI Quality Model also defines a measurement plan. The measurement plan identifies which set of metrics and KPIs should be evaluated for each stage of the software lifecycle and how often. The results of the evaluation are reported in the corresponding metrics report. Templates for the different types of the metrics reports are also provided.

SA2.2 is responsible for maintaining the EMI Quality Model.

EMI Metrics Specification

The EMI Metrics Specification is a list of the metrics and KPIs currently calculated within EMI to evaluate the quality of the EMI software product and processes.

SA2.4 is responsible for maintaining the EMI Metrics Specification.

EMI Metrics Report Specification

For the third year of the project, metrics reports will be calculated every quarter and will be included in the activity quarterly reports. The metrics to be calculated are specified in the Quarterly report - Metrics template. The list of metrics to be calculated is:

  • General metrics showing the status at the end of the quarter (summary table + detailed reports):
    • Release:
      • Products per supported platform (SL5 x86_64 and x86, SL6 x86_64, Debian6 x86_64)
      • SW licenses (already 100%)
      • Test plans (already 100%)
    • Compliance:
      • Debian compliance
      • EPEL compliance
        • RPMlint errors * Products released in EPEL
        • EMT metrics issues tracking EPEL compliance
      • IPV6 compliance
    • Documentation:
      • Missing mandatory documents * Documentation issues
    • Security:
      • Security Assessments
  • EMI 1 and EMI 2 updates released during the quarter (A summary table per update + detailed reports aggregating all updates)
    • Testing:
      • Test reports (always 100%)
      • Mandatory tests
      • Regression tests for fixed defects
      • Functional tests for new functionality
    • Certification:
      • Passed certification checks

SA2.7 is responsible for generating the metrics reports.

EMI Metrics Report Archive

Logbook

  • 22.06.2012: Page updated to describe the metrics report specification for the 3rd year of the project.

Topic attachments
I Attachment History Action Size Date Who Comment
Microsoft Word filedoc EMI_1_Update_10_CodeTest_MetricsReport_v1.doc r1 manage 484.0 K 2012-04-03 - 16:53 UnknownUser EMI update 10 Metric Report
Unknown file formatdocx EMI_1_Update_11_CodeTest_MetricsReport_v1.docx r1 manage 390.5 K 2012-04-03 - 16:56 UnknownUser EMI update 11 Metric Report
Unknown file formatdocx EMI_1_Update_12_CodeTest_MetricsReport_v1.docx r1 manage 345.7 K 2012-04-03 - 16:56 UnknownUser EMI_1 update 12 Metric Report
Unknown file formatdocx EMI_1_Update_13_CodeTest_MetricsReport_v1.docx r1 manage 359.6 K 2012-04-03 - 16:57 UnknownUser EMI_1 update 13 Metric Report
Unknown file formatdocx EMI_1_Update_14_CodeTest_MetricsReport_v1.docx r1 manage 344.9 K 2012-04-03 - 16:57 UnknownUser EMI_1 update 14 Metric Report
Microsoft Word filedoc EMI_1_Update_9_CodeTest_MetricsReport.doc r1 manage 447.0 K 2012-04-03 - 16:52 UnknownUser EMI update 9 Metric Report
Microsoft Word filedoc EMI_2_Planning_MetricsReport.doc r1 manage 853.5 K 2011-10-26 - 11:11 MariaALANDESPRADILLO  
Microsoft Word filedoc EMI_SA2_MetricsSpecification_v1.4.doc r1 manage 676.0 K 2011-10-24 - 15:28 MariaALANDESPRADILLO  
Microsoft Word filedoc EMI_SA2_QR_metricsTemplate.doc r1 manage 288.5 K 2012-06-22 - 15:26 MariaALANDESPRADILLO  
Microsoft Word filedoc EMI_SA2_QR_metricsTemplate_v2.0.doc r2 r1 manage 269.0 K 2012-07-09 - 16:03 MariaALANDESPRADILLO  
Microsoft Word filedoc EMI_SA2_QualityModel_v1.5.doc r2 r1 manage 451.5 K 2011-10-24 - 15:15 MariaALANDESPRADILLO  
Microsoft Word filedoc EMI_X_General_MetricsReport_template.doc r1 manage 441.0 K 2011-11-16 - 11:42 MariaALANDESPRADILLO  
Microsoft Word filedoc EMI_X_Planning_MetricsReport_template.doc r1 manage 145.5 K 2011-09-29 - 11:02 MariaALANDESPRADILLO  
Microsoft Word filedoc EMI_X_Update_Y_CodeTest_MetricsReport_template.doc r4 r3 r2 r1 manage 626.0 K 2011-10-24 - 17:07 MariaALANDESPRADILLO  
Microsoft Word filedoc EMT_MetricsReport_template.doc r1 manage 645.0 K 2011-11-01 - 11:21 MariaALANDESPRADILLO  
Edit | Attach | Watch | Print version | History: r25 < r24 < r23 < r22 < r21 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r25 - 2012-07-09 - MariaALANDESPRADILLO
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    EMI All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback