Task SA2.5: QA Implementation Review and Support

Task Description

  • This task includes review activities of the QA, test and certification implementations done by the Product Teams, such as sample review of test plans and tests, compliance with packaging and porting guidelines, validation of documentation, etc.
  • The task also includes supporting the Product Teams in effective design and implementation of tests to be used with testing tools such as ETICS.
  • The success criterion for this task is the correct usage of tools and procedures by all project members to be measured by regular surveys and verifications.

Team:

Eamonn Kenny eamonn.kenny at cs.tcd.ie TCD

Fabio Capannini fabio.capannini at cnaf.infn.it INFN

Eva Cernakova cernakova.projekt@gmailSPAMNOTNOSPAMPLEASE.com UPJS

Meetings

Links to Indico entries...

Progress

Links to Savannah tasks...

Contacts

Email address of leader and contact persons...

Links

Any other material of interest for the task, documentation etc..

Reviews of EMI documents:

Document title Link Actions Remarks
DSA1.3.2 Software Maintenance Quality Control Report https://twiki.cern.ch/twiki/bin/view/EMI/DeliverableDSA132 1.February The acceptance to be reviewer was sent by e-mail to A. Aimar. A proposal to specify Input and Output titles was sent to author
DJRA1.6.1 Integration Work Plan and Status Report https://twiki.cern.ch/twiki/bin/view/EMI/DeliverableDJRA161 11. February The second review was finished. Status-proposed to accept

Quality Control validation activity for EMI1:

https://twiki.cern.ch/twiki/pub/EMI/SA1CVEMI1/Quality_Control_Verification_EMI-1_Task_Assignment.ods

Template to submit report:

https://spreadsheets.google.com/viewform?formkey=dFFZckNHUE9sbnpwTEM0OE95TGFJTVE6MQ

Page to coordinate activity:

https://twiki.cern.ch/twiki/bin/view/EMI/SA1CVEMI1

Support of product teams:

Performance testing

Date 18. March 2011

As I reported during SA2 meeting I think that not all teams are ready to perform reliable performance tests. Despite this fact I started with preparation such so called performance tests for ARC CE and Client chain. I tried to find requirements which we have to approach or verify. I found that Technical developmemt plan does not contain such information. https://twiki.cern.ch/twiki/bin/view/EMI/DeliverableDNA131 It seems that in project we have not defined technical specification of some components (for example reliability of CE job submission process of successfully finished jobs) by right way which is easy understandable for potential users. Public availability of these parameters may provide very clear message about EMI middleware quality.

I tried to find this information on other places (home pages of joined sub-projects). I focused only on CE element this means ARC and gLite teams.

I was not able to find detailed technical specification of these performance parameters for ARC see for example:

http://www.knowarc.eu/documents/Knowarc_D1.1-1_07.pdf

http://www.knowarc.eu/documents/Knowarc_D5.4-1_09.pdf

I found very good specification for CREAM CE which is attached.

My proposal is to ask Technical director about official specification expected performance parameters of CE and clients and change Technical development plan to clarify expected performance parameters in beginning of second year of the project. Clear specification has side effect that we will be able to prepare useful performance tests.

P2 activities

activity date real date
Checking availability of Development plan and associated Area Work Plans, Test plans July 2011  
Availability of ETICS configurations for all platforms July 2011  
Verification and Validation December 2011-April 2012  
Documentation review December 2011-April 2012  
Support of PTs in proposal and realization of performance testing of ARC CE and clients June August 2011  

Reviews of updating documentations:

Update 7 15. September-22. September 2011

task in Savanah date, update of documentation y/m/n/a
https://savannah.cern.ch/task/?22523  
https://savannah.cern.ch/task/?22464 12 September 2011, OK
https://savannah.cern.ch/task/?22331 12 September 2011, OK
https://savannah.cern.ch/task/?22249  
https://savannah.cern.ch/task/?22248  
https://savannah.cern.ch/task/?22135 n/a- cancelled
https://savannah.cern.ch/task/?21935 19. September 2011, 21. September OK
https://savannah.cern.ch/task/?21934 19. September 2011, OK
https://savannah.cern.ch/task/?21933 12 September 2011, OK
https://savannah.cern.ch/task/?21931 12 September 2011, OK
https://savannah.cern.ch/task/?21843  
https://savannah.cern.ch/task/?21060  
https://savannah.cern.ch/task/?21059  
https://savannah.cern.ch/task/?20652 n/a- cancelled
https://savannah.cern.ch/task/?18710  

Update 8

done

Update 9 25 October -3 November 2011

task in Savanah date, update of documentation y/m/n/a
https://savannah.cern.ch/task/?23047 1 November 2011, OK
https://savannah.cern.ch/task/?22523 1 November 2011, OK

Update 10 16 November -18 November 2011

task in Savanah date, update of documentation y/m/n/a
https://savannah.cern.ch/task/?23903 17 November 2011, OK

Update 11 5 December -15 December 2011

task in Savanah date, update of documentation y/m/n/a
https://savannah.cern.ch/task/?24178 new task created https://savannah.cern.ch/task/?24797, DONE update of release notes is needed
https://savannah.cern.ch/task/?24173 new task created https://savannah.cern.ch/task/?24799
https://savannah.cern.ch/task/?24381  
https://savannah.cern.ch/task/?22847 14.12.2011: new task created https://savannah.cern.ch/task/index.php?24933
https://savannah.cern.ch/task/?24435  

-- GianniPucciani - 02-Jun-2010

Topic attachments
I Attachment History Action Size Date Who Comment
Unknown file formatodt ARC_vv_testing_v0.2.odt r1 manage 15.9 K 2011-02-22 - 22:02 UnknownUser ARC_Validation_Vefification_v0.2
Microsoft Word filedoc _CE-proposal.doc r2 r1 manage 158.0 K 2011-03-18 - 08:33 UnknownUser EGEE CE from 2007
Edit | Attach | Watch | Print version | History: r17 < r16 < r15 < r14 < r13 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r17 - 2011-12-15 - unknown
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    EMI All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback