DDD vs CMS.DataBase Validation

Complete: 5

Responsible: IannaOsborne

Goal of this page

Instructions on how to use the runDDDvsDBGeometryValidation.sh.

Global Validation

With the runDDDvsDBGeometryValidation.sh script we would like to test the robustness of the geometry and ensure that the geometry description stored in the CondDB or Local DB is identical with respect to the geometry description based on XML files and DDD algorithm. In particular with this script we are checking these aspects:
  • We control that the content of a Local DB created on the fly is identical to the information stored in CondDB
  • We control that the Tracker/Calo/CSC/RPC/DT reconstruction geometries are identical if we built them from XML or if we read them from Local DB or CondDB
  • We control that the simulation geometry is identical if we built it from XML or if we read it from Local DB

Setup and script usage

Here is a recipe on how to start the validation procedure.
cmsrel CMSSW_7_1_0_pre6
cd CMSSW_7_1_0_pre6/src
cmsenv
git cms-addpkg Validation/Geometry
./Validation/Geometry/test/dddvsdb/runDDDvsDBGeometryValidation.sh  PRE_LS171_V3::All GeometryExtended

Note, Extended label in PRE_MC_71_V2 GT differs from Extended label in PRE_MC_71_V3 GT. The first is pre-Long Shutdown (in 2014) and refers to GeometryExtended transient scenario, the latter is after LS1 and refers to GeometryExtended2015 scenario.

If you have to run this multiple times, then remove the entire working area and start from scratch.

The test took roughly 31 minutes.

There is an option to supply a third option which is a local database containing a global tag which you have created yourself, not one of the official CMS tags. This can be useful when testing tags that are not in an official global tag yet.

Validation/Geometry/test/dddvsdb/runDDDvsDBGeometryValidation_local_test.sh  MC_39Y_V2::All GeometryExtended sqlite_fip:./dbtoconf.db

There are official instructions on how to make a global tag database here: CMS.GlobalTagInstructions. At the moment those instructions are out of date, but there are instructions that work and some additional useful comments here: Database Geometry.

Once the script has run you will find a workArea directory below the directory from which you ran the script and inside workArea there is a file GeometryValidation.log that contain the results of the validation.

You have to parse the file looking for WARNING or ERROR.

If you find an ERROR it means that some of the test have been failed and the validation is aborted then you have to fix the problem clean your work area and restart the validation.

If you find a WARNING it means that you have some discrepancies between the geometries, then you have to look carefully at the specific output, in the following you will find the detail of each test with the list of test run and the files produced.

Local DB and CondDB

The comparison among the Local DB and CondDB is made using these file:

$CMSSW_RELEASE_BASE/src/CondTools/Geometry/test/geometrytest_local.py  #analysis of Local DB 
$CMSSW_RELEASE_BASE/src/CondTools/Geometry/test/geometrytest_db.py  #analysis of CondDB 

If you find this message in the report of the validation "WARNING THE CONTENT OF GLOBAL TAG IS DIFFERENT WHIT RESPECT TO THE LOCAL DB FILE" to look in detail at the difference you need to open the file in workArea/ogDiffLocalvsGT.log

Simulation Geometry

Please for documentation on this test refer this page

Tracker Geometry

The comparison among the Local DB, CondDB and XML is made using these file:
$CMSSW_RELEASE_BASE/src/Geometry/TrackerGeometryBuilder/test/trackerModuleInfoDB_cfg.py  #analysis of CondDB 
$CMSSW_RELEASE_BASE/src/Geometry/TrackerGeometryBuilder/test/trackerModuleInfoLocalDB_cfg.py  #analysis of Local DB 
$CMSSW_RELEASE_BASE/src/Geometry/TrackerGeometryBuilder/test/trackerModuleInfoDDD_cfg.py  #analysis of XML 

If you find this message in the report of the validation like:

  • "WARNING THE TRACKER RECO GEOMETRY IS DIFFERENT BETWEEN DDD AND GT DB" to look in detail at the difference you need to open the file in workArea/logTkDiffGTvsDDD.log
  • "WARNING THE TRACKER RECO GEOMETRY IS DIFFERENT BETWEEN DDD AND LOCAL DB" to look in detail at the difference you need to open the file in workArea/logTkDiffLocalvsDDD.log
  • "WARNING THE TRACKER RECO GEOMETRY IS DIFFERENT BETWEEN GT DB AND LOCAL DB" to look in detail at the difference you need to open the file in workArea/logTkDiffGTvsLocal.log

Calo Geometry

To run the comparison:

cd Geometry/CaloEventSetup/data

Copy in the reference files:

wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/calogeom.root.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/eb.ovr.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/ee.ovr.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/eb.cor.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/eb.ctr.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/ee.cor.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/ee.ctr.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/es.cor.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/es.ctr.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/hb.cor.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/hb.ctr.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/he.cor.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/he.ctr.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/ho.cor.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/ho.ctr.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/hf.cor.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/hf.ctr.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/ca.cor.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/ca.ctr.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/ct.cor.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/ct.ctr.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/zd.cor.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/zd.ctr.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/my.log.gz
wget http://cmsdoc.cern.ch/cms/data/CMSSW/Geometry/CaloEventSetup/data/mydb.log.gz

then go into the test directory and execute:

setup.scr

then do the cmsRun.

The comparison among the Local DB, CondDB and XML is made using these file:

$CMSSW_RELEASE_BASE/src/Geometry/CaloEventSetup/test/runTestCaloGeometryDB_cfg.py  #analysis of CondDB 
$CMSSW_RELEASE_BASE/src/Geometry/CaloEventSetup/test/runTestCaloGeometryLocalDB_cfg.py  #analysis of Local DB 
$CMSSW_RELEASE_BASE/src/Geometry/CaloEventSetup/test/runTestCaloGeometryDDD_cfg.py  #analysis of XML 

If you find this message in the report of the validation like:

  • "WARNING THE CALO GEOMETRY IS DIFFERENT BETWEEN DDD AND REF" to look in detail at the difference you need to open the file in workArea/CALODDDError.log
  • "WARNING THE CALO GEOMETRY IS DIFFERENT BETWEEN GT DB AND REF" to look in detail at the difference you need to open the file in workArea/CALODBError.log
  • "WARNING THE CALO GEOMETRY IS DIFFERENT BETWEEN LOCAL DB AND REF" to look in detail at the difference you need to open the file in workArea/CALOLocalError.log

CSC Geometry

The comparison among the Local DB, CondDB and XML is made using these file:
$CMSSW_RELEASE_BASE/src/Geometry/CSCGeometry/test/testCSCGeometryFromDB_cfg.py  #analysis of CondDB 
$CMSSW_RELEASE_BASE/src/Geometry/CSCGeometry/test/testCSCGeometryFromLocalDB_cfg.py  #analysis of Local DB 
$CMSSW_RELEASE_BASE/src/Geometry/CSCGeometry/test/testCSCGeometry_cfg.py  #analysis of XML 

If you find this message in the report of the validation like:

  • "WARNING THE CSC RECO GEOMETRY IS DIFFERENT BETWEEN DDD AND GT DB" to look in detail at the difference you need to open the file in workArea/logCSCDiffGTvsDDD.log
  • "WARNING THE CSC RECO GEOMETRY IS DIFFERENT BETWEEN DDD AND LOCAL DB" to look in detail at the difference you need to open the file in workArea/logCSCDiffLocalvsDDD.log
  • "WARNING THE CSC RECO GEOMETRY IS DIFFERENT BETWEEN GT DB AND  LOCAL DB" to look in detail at the difference you need to open the file in workArea/logCSCDiffLocalvsGT.log

RPC Geometry

The comparison among the Local DB, CondDB and XML is made using these file:
$CMSSW_RELEASE_BASE/src/Geometry/RPCGeometry/test/testRPCGeometryFromDB_cfg.py  #analysis of CondDB 
$CMSSW_RELEASE_BASE/src/Geometry/RPCGeometry/test/testRPCGeometryFromLocalDB_cfg.py  #analysis of Local DB 
$CMSSW_RELEASE_BASE/src/Geometry/RPCGeometry/test/testRPCGeometry_cfg.py  #analysis of XML 

If you find this message in the report of the validation like:

  • "WARNING THE RPC RECO GEOMETRY IS DIFFERENT BETWEEN DDD AND GT DB" to look in detail at the difference you need to open the file in workArea/logRPCDiffGTvsDDD.log
  • "WARNING THE RPC RECO GEOMETRY IS DIFFERENT BETWEEN DDD AND LOCAL DB" to look in detail at the difference you need to open the file in workArea/logRPCDiffLocalvsDDD.log
  • "WARNING THE RPC RECO GEOMETRY IS DIFFERENT BETWEEN GT DB AND  LOCAL DB" to look in detail at the difference you need to open the file in workArea/logRPCDiffLocalvsGT.log

DT Geometry

The comparison among the Local DB, CondDB and XML is made using these file:
$CMSSW_RELEASE_BASE/src/Geometry/DTGeometry/test/testDTGeometryFromDB_cfg.py  #analysis of CondDB 
$CMSSW_RELEASE_BASE/src/Geometry/DTGeometry/test/testDTGeometryFromLocalDB_cfg.py  #analysis of Local DB 
$CMSSW_RELEASE_BASE/src/Geometry/DTGeometry/test/testDTGeometry_cfg.py  #analysis of XML 

If you find this message in the report of the validation like:

  • "WARNING THE DT RECO GEOMETRY IS DIFFERENT BETWEEN DDD AND GT DB" to look in detail at the difference you need to open the file in workArea/logDTDiffGTvsDDD.log
  • "WARNING THE DT RECO GEOMETRY IS DIFFERENT BETWEEN DDD AND LOCAL DB" to look in detail at the difference you need to open the file in workArea/logDTDiffLocalvsDDD.log
  • "WARNING THE DT RECO GEOMETRY IS DIFFERENT BETWEEN GT DB AND  LOCAL DB" to look in detail at the difference you need to open the file in workArea/logDTDiffGTvsLocal.log

Geometry File (i.e. Simulation Geometries)

The comparison among the Local DB, CondDB, single (Big) XML file and multiple (Standard) XML files uses:

$CMSSW_RELEASE_BASE/src/GeometryReaders/XMLIdealGeometryESSource/test/readIdealAndDump.py
$CMSSW_RELEASE_BASE/src/GeometryReaders/XMLIdealGeometryESSource/test/testReadXMLFromGTDB.py
$CMSSW_RELEASE_BASE/src/GeometryReaders/XMLIdealGeometryESSource/test/testReadXMLFromDB.py
$CMSSW_RELEASE_BASE/src/GeometryReaders/XMLIdealGeometryESSource/test/readBigXMLAndDump.py
$CMSSW_RELEASE_BASE/src/GeometryReaders/XMLIdealGeometryESSource/test/testCompareDumpFiles.py

The last one is used six(6) times to compare the output of the first four.

If you find this message in the report of the validation like:

  • "ERROR THE MULTI-XML FILE GEOMETRY WAS NOT DUMPED PROPERLY." to look in detail at the difference you need to open the file in workArea/diffreadXMLSTD.log
  • "ERROR THE GLOBAL TAG DATABASE GEOMETRY WAS NOT DUMPED PROPERLY." to look in detail at the difference you need to open the file in workArea/diffreadXMLGTDB.log
  • "ERROR THE LOCAL DATABASE GEOMETRY WAS NOT DUMPED PROPERLY." to look in detail at the difference you need to open the file in workArea/diffreadXMLLocDB.log
  • "ERROR THE BIG SINGLE XML FILE WAS NOT DUMPED PROPERLY." to look in detail at the difference you need to open the file in workArea/diffreadXMLBDB.log
  • "WARNING THE GEOMETRYFILE IS DIFFERENT BETWEEN STD XML AND BIG SINGLE XML." to look in detail at the difference you need to open the file in workArea/diffcompSTDvsBDB.log
  • "WARNING THE GEOMETRYFILE IS DIFFERENT BETWEEN STD XML AND LOCAL DATABASE BLOB." to look in detail at the difference you need to open the file in workArea/diffcompSTDvsLocDB.log
  • "WARNING THE GEOMETRYFILE IS DIFFERENT BETWEEN STD XML AND GLOBALTAG DATABASE BLOB." to look in detail at the difference you need to open the file in workArea/diffcompSTDvsGTDB.log
  • "WARNING THE GEOMETRYFILE IS DIFFERENT BETWEEN SINGLE BIG XML FILE AND LOCAL DATABASE BLOB." to look in detail at the difference you need to open the file in workArea/diffcompBDBvsLocDB.log
  • "WARNING THE GEOMETRYFILE IS DIFFERENT BETWEEN SINGLE BIG XML FILE AND GLOBALTAG DATABASE BLOB." to look in detail at the difference you need to open the file in workArea/ diffcompBDBvsGTDB.log
  • "WARNING THE GEOMETRYFILE IS DIFFERENT BETWEEN LOCAL AND GLOBALTAG DATABASE BLOBS." to look in detail at the difference you need to open the file in workArea/diffcompLocDBvsGTDB.log
Edit | Attach | Watch | Print version | History: r16 < r15 < r14 < r13 < r12 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r16 - 2014-08-12 - IannaOsborne
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback