Update of test references in case of policy-breaking changes

Assuming authorization was granted to commit changes breaking the policy, you will have to update the reference files of the CI tests sensitive to those changes. The log files of the failed CI (or local) tests will help identifying the needed updates. The test references are either:

  • text files with list of containers present in AOD / ESD, or object counts of various types (xAODDigest), such as those in PROCTools/data;
  • reference AODs or ESDs used for the diff-root comparisons enabled in some of the tests.

The former are part of the athena repository, therefore simply edit the corresponding reference and commit the changes as part of your merge request. For the latter, the pool files are stored in CVMFS; you should increment (and commit) the reference version in WorkflowTestRunner/python/References.py, and also provide the new reference AOD and/or ESD file(s) to PROC who will deploy them to CVMFS. You can obtain the needed pool files by running the test locally as explained above, or in the future (ATLINFR-4564) directly by retrieving the CI output. It will generally be verified that after those changes a new CI pipeline completes successfully.

Make sure to communicate adequately with PROC or release coordinators beforehand: in case several open merge requests require reference updates, these must be updated sequentially and take into account all new changes, therefore coordination is necessary.

Topic attachments
I Attachment History Action Size Date Who Comment
PNGpng DNN_roc.png r1 manage 116.6 K 2021-10-11 - 09:20 JulienMaurer  
Edit | Attach | Watch | Print version | History: r21 < r20 < r19 < r18 < r17 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r21 - 2022-06-16 - JulienMaurer
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Sandbox All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2023 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback