Validation Table for CMSSW software release

  • No : Validation done, result is "Not Validated". Report the reasons below
  • Yes / Done : Validation done, result is "Ok, Validated"
  • Work in progress, under construction : Validation still in progress or results need to be followed up before final green/red light
  • Minus : Validation not (yet) done

Overview

Release \ Subsystem Gen Sim FastSim HLT L1 Reco DQM AlCa DB
CMSSW 440pre1 Minus Minus Minus Minus Minus data:Yes / Done, mc:Yes / Done Minus Minus Minus
CMSSW 440pre2 Minus Minus Minus Minus Minus data:Yes / Done, mc:Yes / Done Minus Minus Minus
CMSSW 440pre3 Minus Minus Minus Minus Minus data:Yes / Done, mc:Yes / Done Minus Minus Minus
CMSSW 440pre4 Minus Minus Minus Minus Minus data:Yes / Done, mc:Yes / Done Minus Minus Minus
CMSSW 440pre5 Minus Minus Minus Minus Minus data:Yes / Done, mc:Yes / Done Minus Minus Minus
CMSSW 440pre6/7 Minus Minus Minus Minus Minus data:No, mc:No Minus Minus Minus
CMSSW 440pre8 Minus Minus Minus Minus Minus data:Yes / Done, mc:No Minus Minus Minus
CMSSW 440pre9 Minus Minus Minus Minus Minus data:No, mc:No Minus Minus Minus
CMSSW 440pre10 Minus Minus Minus Minus Minus data:Minus, mc:No Minus Minus Minus
CMSSW 440 Minus Minus Minus Minus Minus data:Minus, mc:No Minus Minus Minus

Release 43X
Release \ Subsystem Gen Sim FastSim HLT L1 Reco DQM AlCa DB
CMSSW 430pre1 Minus Work in progress, under construction Minus Work in progress, under construction Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 430pre2 Minus Yes / Done Minus Work in progress, under construction Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 430pre3 Minus Work in progress, under construction Minus Work in progress, under construction Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 430pre4 Minus Yes / Done Minus Work in progress, under construction Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 430pre5 Minus Work in progress, under construction Minus Work in progress, under construction Minus data:Minus, mc:Minus Minus Minus Minus

Release 42X
Release \ Subsystem Gen Sim FastSim HLT L1 Reco DQM AlCa DB
CMSSW 420pre1 Minus Work in progress, under construction Minus Work in progress, under construction Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 420pre2 Minus Work in progress, under construction Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 420pre4 Minus Work in progress, under construction Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 420pre5 Minus Work in progress, under construction Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 420pre6 Minus Work in progress, under construction Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 420pre7 Minus No Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 420pre8 Minus Yes / Done Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 420 Minus Yes / Done Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 421 Minus Yes / Done Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 422 Minus Yes / Done Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 423 Minus Work in progress, under construction Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus

Release 41X
Release \ Subsystem Gen Sim FastSim HLT L1 Reco DQM AlCa DB
CMSSW 411 Minus Minus Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 412 Minus Minus Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus

Release 311X
Release \ Subsystem Gen Sim FastSim HLT L1 Reco DQM AlCa DB
CMSSW 3110pre1 Minus Minus Minus Work in progress, under construction Minus Minus Yes / Done Minus Minus
CMSSW 3110pre2 Minus Yes / Done Minus Work in progress, under construction Minus Minus Yes / Done Minus Minus
CMSSW 3110pre3 Minus Yes / Done Minus Work in progress, under construction Minus data:Minus, mc:Minus Yes / Done Minus Minus
CMSSW 3110pre5 Yes / Done Yes / Done Work in progress, under construction Work in progress, under construction Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 3111 Minus Work in progress, under construction Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 3111patch1 Minus Work in progress, under construction Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 3111patch2 Minus Work in progress, under construction Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 3111patch3 Minus Minus Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 3112 Minus Minus Minus Minus Minus data:Minus, mc:Minus Minus Minus Minus
CMSSW 3111hltpatch1 Minus Minus Minus Work in progress, under construction Minus data:Minus, mc:Minus Minus Minus Minus

Release 310X
Release \ Subsystem Gen Sim FastSim HLT L1 Reco DQM AlCa DB
CMSSW 3100pre1 Minus Yes / Done Minus Work in progress, under construction Minus Work in progress, under construction Yes / Done Work in progress, under construction Minus
CMSSW 3100pre2 Minus Yes / Done Minus Work in progress, under construction Minus Work in progress, under construction Yes / Done Work in progress, under construction Minus
CMSSW 3100pre3 Minus No Minus Minus Minus data:Yes / Done, mc:No Yes / Done Work in progress, under construction Minus
CMSSW 3100pre4 Minus No Minus Minus Minus data:Yes / Done, mc:No Yes / Done Minus Minus
CMSSW 3100pre5 Minus No Minus Minus Minus Minus Yes / Done Yes / Done Minus
CMSSW 3100pre6 Minus No Minus Minus Minus Minus Yes / Done Minus Minus
CMSSW 3100pre7 Minus No No Minus Minus Minus Yes / Done Minus Minus
CMSSW 3100pre8 Minus Yes / Done Minus Minus Minus Minus Yes / Done Minus Minus
CMSSW 3100pre9 Minus Yes / Done Minus Minus Minus Minus Yes / Done Minus Minus
CMSSW 3100 Minus Yes / Done Work in progress, under construction Minus Minus Minus Yes / Done Minus Minus

Release 39X
Release \ Subsystem Gen Sim FastSim HLT L1 Reco DQM AlCa DB
CMSSW 390pre1 Minus Yes / Done Minus Minus Minus Minus Yes / Done Minus Minus
CMSSW 390pre2 Minus Yes / Done Minus Minus Minus Minus Yes / Done Minus Minus
CMSSW 390 Minus Yes / Done No Minus Minus Minus Yes / Done Minus Minus
CMSSW 392 Minus Yes / Done Yes / Done Minus Minus data:Yes / Done, mc:Yes / Done Yes / Done Minus Minus
CMSSW 393 Minus Yes / Done Yes / Done Minus Minus Minus Yes / Done Minus Minus
CMSSW 394 Minus Work in progress, under construction Yes / Done Minus Minus Minus Yes / Done Minus Minus
CMSSW 395 Minus Minus Yes / Done Minus Minus Minus Yes / Done Minus Minus
CMSSW 396 Minus Minus Yes / Done Minus Minus Minus Yes / Done Minus Minus
CMSSW 397 Minus Minus Yes / Done Minus Minus Minus Yes / Done Minus Minus

Release 38X
Release \ Subsystem Gen Sim FastSim HLT L1 Reco DQM AlCa DB
CMSSW 380pre1 Minus Minus Minus No Minus Yes / Done Yes / Done Minus Minus
CMSSW 380pre2 Minus Minus Minus No Minus Minus Yes / Done Minus Minus
CMSSW 380pre3 Minus Yes / Done Minus No Minus Minus Yes / Done Minus Minus
CMSSW 380 Minus Yes / Done No Minus Minus Minus Yes / Done Minus Minus
CMSSW 385 Minus Minus No Minus Minus Minus Yes / Done Minus Minus
CMSSW 386 Minus Minus Minus Minus Minus Minus Yes / Done Minus Minus
CMSSW 387patch2 Minus Minus Yes / Done Minus Minus Minus Minus Minus Minus

Release 37X
Release \ Subsystem Gen Sim FastSim HLT L1 Reco DQM AlCa DB
CMSSW 370pre1 Minus Minus Minus n.s. Minus Minus Yes / Done Minus Minus
CMSSW 370pre2 Minus Work in progress, under construction Minus Work in progress, under construction Minus Minus Yes / Done Minus Minus
CMSSW 370pre5 Minus Yes / Done Minus No Minus Work in progress, under construction Yes / Done Minus Minus
CMSSW 370 Minus Yes / Done Yes / Done Yes / Done Minus Yes / Done Yes / Done Minus Minus

(n.s.) note: harvesting failed, no automated results were produced

Validation of Trigger code

To be considered "at full readiness," the validation code needs to either

  • Reliably produce filled histograms that accurately reflect the trigger behavior in the DQM GUI OR
  • Reliably produce results that can be quickly analyzed using a standalone package
To be considered "not at full readiness," the validation code is present, but either
  • The histograms are not reliably filled in the DQM GUI, and/or they do not accurately reflect the trigger behavior OR
  • The results are produced by standalone packages, but these packages take a non-negligible amount of time to run
There is a further category for packages that currently lacking active development work

Legend for Readiness Table

  • No : Package not at full readiness AND no development work underway
  • Yes / Done : Package is at full readiness
  • Work in progress, under construction : Package not at full readiness
  • Yes / Done/Work in progress, under construction : Package generally at full readiness and can be used for results, but some technical issues being worked on

  Group
Electron Photon Muon Jet MET Tau Top Higgs HeavyFlavor Susy Exotica
Work in progress, under construction Work in progress, under construction Yes / Done Yes / Done/Work in progress, under construction Yes / Done/Work in progress, under construction Yes / Done/Work in progress, under construction No No Yes / Done Yes / Done Work in progress, under construction

Details of Readiness Table

  • Electron/!Photon: Validation currently relies on standalone analysis to produce results, results take some time to obtain.
  • Muon: Upcoming work on L1 propagator, protection of module labels in configuration for automatic path recognition. Results can be used in the meantime
  • Jet: Some empty histograms, active development to address this
  • MET: Same issue as jet. Stadalone code exists as backup to provide validation results
  • Tau: Generally ready; most recent RelVals only in DQM tier, RECO needed (Looks like it might be an event content issue)
  • Top, Higgs: Validation contact still needed to develop these packages
  • SUSY: Basic path efficiency counts for MC selection for each RA analysis
  • Exotica: Done by standalone analysis; validation package not yet integrated in HLTriggerOffline

Validation of Fast Simulation code

  Release Group
    Tracking Electron Photon Muon Jet MET BTag Tau PartFlow HLT
  4_2_0_pre8 Yes / Done Work in progress, under construction Work in progress, under construction Yes / Done Work in progress, under construction Work in progress, under construction Yes / Done Minus No Minus
  4_2_0 Yes / Done Yes / Done Minus Yes / Done Yes / Done Minus Yes / Done Minus No Minus
  4_2_1 Minus Minus Minus Yes / Done Yes / Done Minus Yes / Done Minus No Minus
  4_2_2 Minus Minus Minus Yes / Done Minus Minus Minus Minus No Minus

Notice: embedding of latest tables from other subsystems, if maintained, should be appended.
Responsible: NunoLeonardo
Edit | Attach | Watch | Print version | History: r4 < r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r4 - 2010-03-13 - NunoLeonardo
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback