Update of test references in case of policy-breaking changes
Assuming authorization was granted to commit changes breaking the policy, you will have to update the reference files of the CI tests sensitive to those changes. The log files of the failed CI (or local) tests will help identifying the needed updates. The test references are either:
- text files with list of containers present in AOD / ESD, or object counts of various types (xAODDigest), such as those in PROCTools/data
;
- reference AODs or ESDs used for the diff-root comparisons enabled in some of the tests.
The former are part of the athena repository, therefore simply edit the corresponding reference and commit the changes as part of your merge request.
For the latter, the pool files are stored in CVMFS; you should increment (and commit) the reference version in
WorkflowTestRunner/python/References.py
, and also provide the new reference AOD and/or ESD file(s) to PROC who will deploy them to CVMFS. You can obtain the needed pool files by running the test locally as explained above, or in the future (
ATLINFR-4564
) directly by retrieving the CI output. It will generally be verified that after those changes a new CI pipeline completes successfully.
Make sure to communicate adequately with PROC or release coordinators beforehand: in case several open merge requests require reference updates, these must be updated sequentially and take into account all new changes, therefore coordination is necessary.