TWiki> TOTEM Web>CompDBSoftware (revision 13)EditAttachPDF

TOTEM database

For interaction with Database there are the following tools:

  1. Projects in progress
  2. Finished projects

Totem DataBase POPulation System - UNDER DEVELOPMENT


Totem DBPop is an application used to fill the Totem Offline Database with data coming from different sources. Currently it provides the mechanisms to store data from LHC Logging Databases using its Java API, but it is being extended to store data from Data Acquisition System. Filling the database involves transfering large amounts of data, therefore an asynchronous, queue-based system was developed to meet the performance issues. Here you can find the list of measurements, which are currently populated by DBPop: CompDBPopStoredMeasurements


The Installation Guide and User's Guide for current version are available in the repository under: svn+ssh://

The release of Developer's Guide is postponed due to constant development works which change the implementation solutions.


Application code can be accessed via SVN under:

  • svn+ssh://
-- PrzemyslawWyszkowski - 04-Nov-2010

Totem DataBase Extraction Library - UNDER DEVELOPMENT


This project involves extracting data from the database. Expected artefact is a library which:

  • retrieves data from Totem Database (conditions and parameters of detectors, eg. luminosity)
  • makes the object-relational mapping using Hibernate framework
  • allows to write data into XML files, which would be used by concrete algorithms
  • provides access to these data through objects (optional)
  • does not depend on client's application (works as separate module)


Our vision, proposed solution and progress of work: Documentation


Application code is located in the SVN repository:

  • svn+ssh://
-- JakubSzymanek & MateuszPolnik - 01-Jul-2011

Totem Database Service (legacy)


A module of the CMS Offline Software that allows to write and read certain kinds of data from database. It is generally a set of classes(programming interface) that can be used for implementing access to database for specified type of data.


Code is (mostly) documented with doxygen. Code documentation can be also downloaded here:

Totem Database Service documentation is available in TotemDatabaseService/Doc in the source code. Pdf version can be downloaded here.


Implementation Examples are provided in TotemDatabaseService/ExampleESSource and TotemDatabaseService/Examples in the source code.

  • /trunk/offline/cmssw/src/TotemDatabaseService/ (removed in revision 6303)

Totem Offline Database Monitor


TOTODAM application is a Java application for the Totem Offline Software Database. Its goal is to provide graphical interface to inspect the content of the offline database. Its structure reflects the way it is used by the Totem Offline Software, which bases on the validity intervals of the data. The same approach is presented in the TOTODAM application. Therefore it allows to preview any kind of non-event data stored in the offline database the same way as this data is used by the reconstruction process. It also allows to decide on the input that the reconstruction process will receive from the database.


Application code is documented using javadoc. Javadoc generated for the code is located in SVN /trunk/offline/cmssw/tools/totodam/documentaton/javadoc Users and Programmers Guide is located in SVN in /trunk/offline/cmssw/tools/totodam/documentation/ And can be downloaded from:


Executables for Totem Offline Database Monitor can be found in SVN in directory:

  • /trunk/offline/cmssw/tools/totodam/executable
-- PrzemyslawDadel - 2009-09-25


Made in 2010

In order to meet new requirements connected with storing data from LHC Logging Database, the following changes in schema have bee made:

  • Added startTime and endTime fields in table T3_ValidityInterval to give the possibility of defining IOV not only by event number but also by timestamp
  • Added align_column_description field in table T5_Alignments together with new data type Alignment_Vector_Labels in order to store labels of alignment values from table T1_DetectorAlignment
  • Added measurementSingleUnit field in table T15_MeasurementType in order to give the possibility of storing single unit instead of whole Oracle arrays
  • Added measurementSingleValue fields int tables T16_SensorPartMeasurements, T17_StructElementMeasurement and T18_GeneralMeasurement in order to give the possibility of storing single value instead of whole Oracle arrays

Totem Unified Database Access Service


TUDAS should help in efficient managing and accesing TOTEM experiment data and be easy to use at the same time. In order to achieve this goal, we need to create complex and fully transparent for user solution assuring reliable communication with TOTEM Offline Database.

A concept of the system is built on three layer architecture. We define three areas that can be developped independently:

  • Database Access - concerning direct database management
  • TUDAS Interface - a remote server dispatching clients' requests and forming replies
  • Bindings - communication engine with client-side application programming interface
We would like to allow end-user to cooperate with TOTEM Offline Database without need of writing SQL commands, even without full knowledge of database structure. One of our main purposes is to keep client-side as simple as possible. Then, we would like to offer our users fully functional, high-level programming interface. API will be unified and based on object-oriented programming principles. User can write applications in his preferable programming language - we will assure support for C++, Java and Python.
The idea of transparency model is rather simple : user calls one of TUDAS API methods (for example, to get some specific data), then it is formed as a request and sent to TUDAS server and waits in queue to be served. When request is eventually dispatched, it is translated to low-level, database requests and sent to TOTEM Offline Database.If needed, database can return a reply which again is packed in TUDAS objects. At the end, the reply is provided to client and in that moment, remote method invocation is terminated. From user point of view, it doesn't differ from any "normal" method invocations.

Apart from efficient database access, TUDAS will also provide security mechanism. Data access should be protected against unauthorized requests. We would like to integrate system with CERN Single Sign On solution which guarantees all authentication aspects will be fulfilled. Additionally, every database operation will be logged so that system administrators could supervise database usage.

With all these presumptions, we hope TUDAS will significantly improve workflows of TOTEM members and contribute to better organisation of experiment data.


Current documentation is located here: Documentation


Application code can be found in the SVN repository:

  • svn+ssh://
Topic attachments
I Attachment History Action Size Date Who Comment
PDFpdf 2009-09-23_TOTODAM_User_Guide_v_1.0.pdf r1 manage 586.4 K 2011-09-06 - 14:52 UnknownUser TOTODAM User Guide
PDFpdf 2009-09-24_TOTODAM_Programmer_Guide_v_1.1.pdf r1 manage 554.6 K 2011-09-06 - 14:52 UnknownUser TOTODAM Programmer Guide
PDFpdf LuminosityInterfaces.pdf r1 manage 93.1 K 2012-08-24 - 12:43 UnknownUser  
PDFpdf RomanPotManagementInterfaces.pdf r1 manage 88.3 K 2012-08-24 - 12:42 UnknownUser  
PDFpdf TUDAS_Prototype_User_Guide.pdf r7 r6 r5 r4 r3 manage 170.2 K 2012-08-27 - 10:03 UnknownUser  
PDFpdf TudasDBPopInterfaces.pdf r1 manage 80.0 K 2012-08-24 - 12:43 UnknownUser  
Compressed Zip archivezip r1 manage 162.4 K 2011-09-06 - 14:54 UnknownUser Doxygen code documentation
PDFpdf users_guide.pdf r1 manage 519.3 K 2011-09-06 - 14:53 UnknownUser Developer and User Guide for Totem Database Service
Edit | Attach | Watch | Print version | History: r17 | r15 < r14 < r13 < r12 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r13 - 2012-09-04 - unknown
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    TOTEM All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback