Validation of Electron and Photon Objects in CMSSW

In view of the 2009 data taking Egamma group decided to create two task forces to take care of the Electron and Photon commissioning. Their primary goal is to provide a set of tools to quickly react to unexpected problems in Electron and Photon Reconstruction and to validate the Physics objects.

These two groups have their own pages:

Data samples

All samples available and requested are documented here. Since CMSSW_1_6_0, the number of RelVal samples has been increased, with several special samples with higher statistics being produced to validate major production releases.

Validation Results

Validation plots are collected in the following page: validation results for CMSSW >17 (you have to click on release number and then click on validation.html).

A summary of all validation results for electrons since CMSSW 331 is presented here

Validation results for electrons with the preproduction sample have been summarized in this twiki page: ElectronSummero09Validation.

Older validation results can be found at the following links:

Comparison of histograms between two releases

A shell script to generate a root macro and an html file to compare histograms from two releases is available in cvs:

RecoEgamma/Examples/test/validation.csh

Instructions to use it are described below, as well as in the script itself. An example of output can be found here.

Suggested Validation Procedure

Existing tools can be used as follows to perform validation:

1) In the top src directory for a given release area, do:

cvs co RecoEgamma/Examples
cd RecoEgamma/Examples
scramv1 b

2) Edit the filenames list in one of the following cfgs (or corresponding py version from CMSSW210 on) to read in the desired RelVal or other input data:

Object to be validated cfg
GsfElectron GsfElectronMCAnalyzer.cfg
GsfElectron (fake rate) GsfElectronFakeAnalyzer.cfg
Photon CMS.SimplePhotonAnalyzer.cfg
ConvertedPhoton SimpleConvertedPhotonAnalyzer.cfg

3) Run the cfg, e.g.:

cd test
cmsRun GsfElectronsMCAnalyzer.cfg (or cmsRun GsfElectronsMCAnalyzer_cfg.py from CMSSW210 on)

4) Either performing the above, or running your own EDAnalyzer, in two different CMSSW release areas will give two output root files. The histograms within these root files can be compared using the shell script RecoEgamma/Examples/test/validation.csh. Edit the environment variables in the setup part of validation.csh:

NEWFILE Full path of root file for new release
OLDFILE Full path of root file for old release
TYPE Must be one of: GsfElectron, GsfElectronFake, Photon, ConvertedPhoton
NEWRELEASE New release version (affects output directory name and html description only)
OLDRELEASE Old release version (affects output directory name and html description only)
SAMPLE Name of sample (affects output directory name and html description only)

Output will appear in http://cmsdoc.cern.ch/Physics/egamma/www/validation/ In the case that you are using your own EDAnalyzer rather than one from RecoEgamma/Examples, the list of histograms to be compared can also be configured.

5) Execute the script: ./validation.csh. A new directory called NEWRELEASE/SAMPLE_NEWRELEASE_OLDRELEASE will be created in OUTPATH containing two files: validation.C and validation.html. The script will instruct you to run .x validation.C in root in the new directory. A comparison of the histograms can then be viewed by opening the html file in a web browser. An example output is here.

A more detailed description of the validation plot produced by the Analyzer can be found here.

Instructions for validation of CMSSSW_1_6_0

For CMSSW_1_6_0, validation should compare 160 RelVal samples of type A with corresponding CMSSW_1_5_3 or CMSSW_1_5_4 RelVal samples (if available) and preferably also with CMSSW_1_3_X RelVal or Spring07 data.

Instructions for validation w.r.t. CMSSSW_1_3_X

To use the latest version of the RecoEgamma/Examples package with CMSSW_1_3_X, the following must be performed in step 1) above, in the top src directory for a 13X release area:

cvs co -r V00-00-00 AnalysisDataFormats/Egamma
cvs co -r CMSSW_1_3_1 RecoEgamma/EgammaElectronProducers
cd RecoEgamma/EgammaElectronProducers
cvs update -r egammaTutorial_131 src/SealModule.cc
cd ..
cp /afs/cern.ch/user/f/futyand/public/RecoEgammaExamples13X.tar.gz .
tar xvfz RecoEgammaExamples13X.tar.gz
rm RecoEgammaExamples13X.tar.gz
cd Examples
scramv1 b

Validation w.r.t. Physics TDR/ORCA

Validation page w.r.t. ORCA/PTDR

-- Main.vanlaer - 27 Aug 2007

Edit | Attach | Watch | Print version | History: r15 < r14 < r13 < r12 < r11 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r15 - 2010-03-28 - ClaudeCharlot
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback