Bug non verification criteria

( see also BugClassificationForRegressionTests for some criteria that can be used to select 'low hanging fruit' for regression tests)

One of goals of patch certification process is to verify the bug fixes introduced by the patch. However not every bug can be easily reproduced and verified for bug fixes. Especially when considering the limited manpower, we can not verify all bugs. This wiki page is trying to give a criteria on what kind of bugs can be bypassed without verification:

1. Bugs are not related to service and software quality, for example, bugs in ETICS building system.

2. The information provided on Savannah bug page is not enough and it's difficult for you to find more information.

3. Bugs only appear against services not in gLite release or EGEE production system.

4. Bugs only appear with some special or rare services, for example, BQS batch system. In this case, you can try to reproduce and verify it through production system at first. If it is still difficult to do, the bugs can be bypassed.

5. It needs too much of time, for example, more than one day, to reproduce the bug and verify the fix.

6. The bug fix is not verifiable.

Please notice that although some bugs are not verified, you still need to run certain tests defined by the service certification checklist to assure that the patch does not introduce new bugs and break services.

-- DiQing - 31 Oct 2008

Edit | Attach | Watch | Print version | History: r4 < r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r4 - 2010-02-22 - unknown
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    EGEE All webs login

This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright &© by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Ask a support question or Send feedback