Testing the nightly builds performance and regressions

In the LHCb Computing Framework, Unit tests defined as QMtests can be run on the software, as explained in:

https://twiki.cern.ch/twiki/bin/view/Gaudi/GaudiTestingInfrastructure

Those tests, run after every build to ensure its integrity, are crucial to the quality of the Software but cannot cover all use cases: we do not have enough computing resources to run long tests for every project/every slot every day (and that does not makes sense either).

For this reason, and infrastructure was developed to run tests on a regular (but not daily) basis, the see the description in:

https://indico.cern.ch/event/333591/

The purpose of this page is to explain the procedure to add tests to the framework

1. Defining the tests

The jobs have to be committed to svn either:

  • in the project itself
  • in the PRConfig package, in the relevant directory

The PRConfig package has the advantage that its lifecycle is decouple from the release cycle of the projects, and that tests defined there can run on multiple versions of an application. For this reason using PRConfig is recommended.

In all cases, the data files used in the tests have to be defined in PRConfig, in theTestFIleDB, as per:

https://twiki.cern.ch/twiki/bin/view/LHCb/TestFileDB

This makes the management of the files easier, and ensures we can update the URLs in case of migration of the infrastructure.

The option filenames should be descriptive enough to easily understand what test is performed, and should be sefl-sufficient, with no manual interventions ti run the tests.

2. Scheduling and Running the tests

The infrastructure is work in progress for the moment, so contact Ben Couturier to discuss the steps. The documentation for the periodic tests is at:

https://twiki.cern.ch/twiki/bin/view/LHCb/AddingPeriodicTests

-- BenjaminCouturier - 03 Sep 2014

Edit | Attach | Watch | Print version | History: r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r1 - 2014-09-03 - BenjaminCouturier
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LHCb All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback