MJRA1.17 -Test suites of compliance checks in place

This milestone indicates the existence of testsuites for standard compliance checks that can be actually used by the quality control task.

Standard compliance test suites tracked here.

Milestone Tracking

  • 28/10/11 JKN: The plan is the following:
    • Define the available test suits (jra1 survey will be finished today)
    • Define development tasks for the missing standards test suites (at PTB level)
    • The milestone will be updated and will contain the 6-7 available test suites and links to the tracked, to-be-developed test suites
      So in the end, we expect this milestone to be finished by 11 November.
  • 11/11/11 JKN: Sent report to PEB for review
  • 11/11/11 ADM: The milestone is called “Standards Testsuite in Place”. Currently the situation is that there are couple of available but hardly used testsuites, some documentation about work in progress in some standardization body and a list of testsuites to be developed before EMI 3, which very likely will not be developed 5we cannot even develop the functionality, go figure whether the testsuites will be developed). In addition I cannot judge whether the planned testsuites cover all needs or not, for example I see EMI-ES JSDL mentioned, is that the JSDL part only? What about the EMI-ES itself? I know the situation is not easy to handle, but I don’t think we can say the milestone has been reached. I would suggest to state that after having assessed the situation, we consider the milestone unreachable until probably (hopefully) PM 30 or so rather than trying to stretch the definition of the deliverable to close it now at all costs.
  • 12/10/12 JKN: Unfortunately no new test suits have yet been finalized and there have been no efforts available so far. It would be nice to have test suites at least for CAR, StAR, delegation, EMI-ES and Glue2 but we need to find someone to write them. There will be a dedicated session on standard compliance test suites in the Budapest AHM and hopefully we can find someone to write the needed tests there. If so, the tests will be in place earliest by end of November with milestone delivery by December.
  • 23/01/13 JKN: New testsuites available for CAR, StAR and EMI ES. Only waiting for link to the implementation of EMI ES delegation port type before milestone can be considered reached.
  • 29/01/13 JKN: All planned test suite implementations finished. Attached version 1.1 of report.


version 1.1

Review tracking

  • 29/01/13 Jon sent v1.1 to PO
  • 31/01/13 v1.1 sent to PEB for review; deadline 04/02
  • 31/01/13 Alberto sent clarification on SA2 involvement
  • 11/02/13 Pending Jon input
  • 15/02/13 Jon uploaded v1.2.
  • 18/02/13 Final pdf uploaded to CDS

PEB Review comments

  • 31/01/13 @Jon: You are using an old template. I will recreate using the new template. For completeness can I ask to include the plans for running these tests [currently only a small number of tests is run] @AlbertoA: From the abstract, I take it SA2 quality control is/will be using these testsuites and provide corresponding reports. If this is the case, can I request a line or two on the current status of SA2 testing and/or reporting using these standards testsuites
  • 15/02/13 JKN: I uploaded v1.2, adding a sentence to more clearly specify that the plan is to run the tests as a testing campaign during the EMI 3 release preparations. (The new version is still using the old template, sorry about that.)

-- AleksandrKonstantinov - 13-Jul-2011

Edit | Attach | Watch | Print version | History: r18 < r17 < r16 < r15 < r14 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r18 - 2013-02-18 - unknown
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    EMI All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback