Difference: McMonitor (1 vs. 4)

Revision 42009-09-16 - SilviaMiglioranzi

Line: 1 to 1
 
META TOPICPARENT name="LHCbSimulation"

MC Monitoring Tools

Online HistDB

The Online HistDB is an SQL based database storing the display settings and configurations for all histograms and pages. It can be used also for Offline histogram Monitoring (devdb10).

Changed:
<
<
All histograms published by an Algorithm need to be registered into the database. Histograms are identified by the combination of Task name, Algorithm Name and histogram Name (ex: Gauss/MCTruthMonitor/103).
>
>
All histograms published by an Algorithm need to be registered into the database. Histograms are identified by the combination of Task name, Algorithm Name and histogram Name (ex: Gauss/MCTruthMonitor/105).
 The database can be accessed through a web interface as well through the Presenter.

Online Presenter

Changed:
<
<
The Presenter is a graphical user interface to display the ROOT-based histograms published by the monitoring Algorithms. To display histograms, a "page" has to be defined. A page contains one or more histograms in a given layout and with given display settings. When the page is selected in the presenter, the page and histogram configuration are loaded from the database. Then the histogram data published by the monitoring algorithm is read and the pages are displayed. As all display properties are stored in the database, the presenter loads only the bins and their content from the histograms published by the algorithms. The display properties specified by the algorithm will be ignored.
>
>
The Presenter is a graphical user interface to display the ROOT-based histograms published by the monitoring Algorithms. To display histograms, a "page" has to be defined. A page contains one or more histograms in a given layout and with given display settings. When the page is selected in the presenter, the page and histogram configuration are loaded from the database. Then the histogram data published by the monitoring algorithm is read and the pages are displayed. As all display properties are stored in the database, the presenter loads only the bins and their content from the histograms published by the algorithms. The display properties specified by the algorithm will be ignored.
 

How to configure the Presenter to check the MC histograms

Line: 50 to 50
 
  • executing the command:
    $OMALIBROOT/$CMTCONFIG/DumpOMAlarms.exe -t DBDrivenAnalysisTask_Gauss -d devdb10 -u lhcb_mon_giacomo -p password
    only the list of all Warnings and Alarms will be printed in the stdoutput like:
Added:
>
>
  ----------------------------------------------------------------------
****** Tue Sep 1 16:13:37 2009
WARNING from analysis Task DBDrivenAnalysisTask_Gauss in analysis Compare To Reference on Gauss/MCTruthMonitor/105
Line: 57 to 58
  from saveset /afs/cern.ch/user/s/silviam/cmtuser/Online_v4r27/Online/Presenter/test/Gauss_00004607_00000001_1_Hist.root
algorithm Compare To Reference : Comparison Test p-value= 0.315322
----------------------------------------------------------------------
Changed:
<
<
>
>
 
  • you can visualize the resulting messages associated to every histogram using the Presenter (bottom-left menu in the display). Since the Alarms will be deleted from the Presenter after a certain amount of time, the full list of Warning/Alarms is also summarized in a set of html pages for each PRODID.
Line: 72 to 73
 
  • when you are in the Histogram Record page, you can set the " Display Options" and "Custom Bin Labels"
  • you can choose which analysis perform on the histogram setting up the "Automatic Analysis" (click on "Add Automatic Analysis")
Added:
>
>

References :

(1) OnlineHistDB Manual

(2) "Tools for Automatic Analysis of Online Monitoring Histograms", G. Graziani, SoftWeek 18062009

(3) Online Monitoring for the Silicon Tracker of the lhcb Experiment
  -- SilviaMiglioranzi - 2009-09-15

Revision 32009-09-16 - SilviaMiglioranzi

Line: 1 to 1
 
META TOPICPARENT name="LHCbSimulation"

MC Monitoring Tools

Changed:
<
<

Online HistDB

>
>

Online HistDB

 
Changed:
<
<
The Online HistDB is an SQL based database storing the display settings and configurations for all histograms and pages (see details in next sections). All histograms published by an Algorithm need to be registered into the HistDB. Histograms are identified by the combination of Task name, Algorithm Name and histogram Name.
>
>
The Online HistDB is an SQL based database storing the display settings and configurations for all histograms and pages. It can be used also for Offline histogram Monitoring (devdb10).
All histograms published by an Algorithm need to be registered into the database. Histograms are identified by the combination of Task name, Algorithm Name and histogram Name (ex: Gauss/MCTruthMonitor/103).
 The database can be accessed through a web interface as well through the Presenter.

Online Presenter

Changed:
<
<
The Presenter is a graphical user interface to display the ROOT-based histograms published by the monitoring Algorithms. To display histograms, a "page" has to be defined. A page contains one or more histograms in a given layout and with given display settings. When the page is selected in the presenter, the page and histogram configuration are loaded from the HistDB. Then the histogram data published by the monitoring algorithm is read and the pages are displayed. As all display properties are stored in the HistDB, the presenter loads only the bins and their content from the histograms published by the algorithms. The display properties specified by the algorithm will be ignored.
>
>
The Presenter is a graphical user interface to display the ROOT-based histograms published by the monitoring Algorithms. To display histograms, a "page" has to be defined. A page contains one or more histograms in a given layout and with given display settings. When the page is selected in the presenter, the page and histogram configuration are loaded from the database. Then the histogram data published by the monitoring algorithm is read and the pages are displayed. As all display properties are stored in the database, the presenter loads only the bins and their content from the histograms published by the algorithms. The display properties specified by the algorithm will be ignored.
 

How to configure the Presenter to check the MC histograms

  • get from CVS the Online/Presenter
  • edit the doc/presenter.cfg to set the editor-offline mode, change the database-credentials etc. (an example can be found here). Ask for the passwords.
Changed:
<
<
  • choose a reference rootopla (to be compared with the root file you want to analyze) and place it in a directory with the same name as the Task (ex: create a "Gauss" directory in your working dir and put a Gauss reference rootopla in it). Report the "reference-path" in the doc/presenter.cfg.
>
>
  • choose a reference rootopla (to be compared with the root file you want to analyze) and place it in a directory with the same name as the Task (ex: create a "Gauss" directory and put a Gauss reference rootopla in it). Report the "reference-path" in the doc/presenter.cfg.
 
  • in cmt/ do a SetupProject Online and source setup.csh before launching the Presenter
  • run the Presenter with the command: ../slc4_amd64_gcc34/presenter.exe -C ../doc/presenter.cfg
Changed:
<
<
  • once the presenter is opened, from the second drop-down box, select the (Gauss) rootpla you want to check. A dialog box will pop up, where you can choose your root file. The contents should show up in the top right tree. Tick the checkbox, and use the right mouse button to declare them to the database (this step is necessary to declare the Task the first time into the DB, it is already done for Gauss and Boole so you can skip it and go to the next step).
>
>
  • once the presenter is opened, from the second drop-down box, select the rootpla you want to check. A dialog box will pop up, where you can choose your root file. The contents should show up in the top right tree. Tick the checkbox, and use the right mouse button to declare them to the database (this step is necessary to declare the Task the first time into the DB, it is already done for Gauss and Boole so you can skip it and go to the next step).
 

How to create histogram Pages using the Presenter

Changed:
<
<
The histograms need to be organised in pages inside the HistDB. When you open the Presenter, a New Page (empty) appears in the central part of the display. You can fill at this point the Page with you histogram selection. Use case: Gauss/MCTruthMonitor/ histograms are grouped together and named 100,101,... . Suppose we want to create a more meaningful classification of the histos we could create a ParticleMomentum (Vertex,...) Page where we can group together the Momentum (Vertex, ...) related histos.
>
>
The histograms need to be organised in pages inside the database. When you open the Presenter, a New Page (empty) appears in the central part of the display. You can fill at this point the Page with you histogram selection. Use case: Gauss/MCTruthMonitor/ histograms are grouped together and named 100,101,... . Suppose we need to create a more meaningful classification of the histos we could create a momentum (vertex,...) Page where the momentum (vertex,...) related histograms are grouped together.
 
  • from the database listing menu on the bottom right, you can select the histos you want to book into the DB (tick their boxes). Add them to the page with the right mouse button.
  • you can save the page to the database (click on the top left icon "Save Page to Database"); when you enter a folder name or page name that doesn't exist in the dialog box, it will automatically create a new entry (please don't forget to press enter after you have typed the name in the input line).
Line: 37 to 38
 

OMAlib

Changed:
<
<
OMAlib is an histogram analyser package. It can be used online as well as offline. The checks can be defined/edited/masked through the Online HistDB web interface. Custom analysis tasks can be implemented as well. The analysis output consists of Warning and Alarms. You can see the messages associated to every histogram using the Presenter. They list of Warning/Alarms is also summarized in here for each PRODID.
>
>
OMAlib is an histogram analyser package. It can be used online as well as offline. It implements simple check algorithms to be run on the histograms. The checks can be defined/edited/masked through the database web interface (see next section). The list of already available algorthms which can be run over the histograms includes "Compare to Reference", "Check Mean and Sigma", "Gauss Fit" etc.. If required, a custom analysis tasks can be implemented as well. The analysis output consists of Warning and Alarms. Here the steps to run the OMAlib algorithms on a specific root file:

  • get from CVS the Online/OMAlib
  • edit the options/AutoAnalysis.opts to set the Input Tasks, Input Files, Hist Reference Root (see example for Gauss in here).Ask for password.
  • run the program:
    $GAUDIROOT/$CMTCONFIG/Gaudi.exe $OMALIBROOT/options/AutoAnalysis.opts.
    In the stdoutput the results of the Analysis algorithms will be reported.
  • executing the command:
    $OMALIBROOT/$CMTCONFIG/DumpOMAlarms.exe -t DBDrivenAnalysisTask_Gauss -d devdb10 -u lhcb_mon_giacomo -p password
    only the list of all Warnings and Alarms will be printed in the stdoutput like:
    ----------------------------------------------------------------------
    ****** Tue Sep 1 16:13:37 2009
    WARNING from analysis Task DBDrivenAnalysisTask_Gauss in analysis Compare To Reference on Gauss/MCTruthMonitor/105
    on histogram Gauss/MCTruthMonitor/105
    from saveset /afs/cern.ch/user/s/silviam/cmtuser/Online_v4r27/Online/Presenter/test/Gauss_00004607_00000001_1_Hist.root
    algorithm Compare To Reference : Comparison Test p-value= 0.315322
    ----------------------------------------------------------------------

  • you can visualize the resulting messages associated to every histogram using the Presenter (bottom-left menu in the display). Since the Alarms will be deleted from the Presenter after a certain amount of time, the full list of Warning/Alarms is also summarized in a set of html pages for each PRODID.

Online HistDB web interface

The web interface allows to set the histogram diplay options and to choose the OMAlib analysis algorithms in an easy way.

  • browse the http://lbhistogramdb.cern.ch/
  • login as LHCB_MON_GIACOMO (ask for password) into the devdb10
  • browse the histogram you want to setup (display the histos by Page, by Task..., see the left menu)
  • when you are in the Histogram Record page, you can set the " Display Options" and "Custom Bin Labels"
  • you can choose which analysis perform on the histogram setting up the "Automatic Analysis" (click on "Add Automatic Analysis")
 

-- SilviaMiglioranzi - 2009-09-15

Revision 22009-09-16 - SilviaMiglioranzi

Line: 1 to 1
 
META TOPICPARENT name="LHCbSimulation"

MC Monitoring Tools

Changed:
<
<

OnlineHistDB

>
>

Online HistDB

 
Changed:
<
<
The Online HistDB can be used to store the display settings and configurations for all histograms and pages (see later). The database can be accessed through a web interface as well through the presenter.
>
>
The Online HistDB is an SQL based database storing the display settings and configurations for all histograms and pages (see details in next sections). All histograms published by an Algorithm need to be registered into the HistDB. Histograms are identified by the combination of Task name, Algorithm Name and histogram Name. The database can be accessed through a web interface as well through the Presenter.
 
Changed:
<
<

Online Presenter

>
>

Online Presenter

  The Presenter is a graphical user interface to display the ROOT-based histograms published by the monitoring Algorithms. To display histograms, a "page" has to be defined. A page contains one or more histograms in a given layout and with given display settings. When the page is selected in the presenter, the page and histogram configuration are loaded from the HistDB. Then the histogram data published by the monitoring algorithm is read and the pages are displayed. As all display properties are stored in the HistDB, the presenter loads only the bins and their content from the histograms published by the algorithms. The display properties specified by the algorithm will be ignored.
Line: 19 to 20
 
  • run the Presenter with the command: ../slc4_amd64_gcc34/presenter.exe -C ../doc/presenter.cfg
  • once the presenter is opened, from the second drop-down box, select the (Gauss) rootpla you want to check. A dialog box will pop up, where you can choose your root file. The contents should show up in the top right tree. Tick the checkbox, and use the right mouse button to declare them to the database (this step is necessary to declare the Task the first time into the DB, it is already done for Gauss and Boole so you can skip it and go to the next step).
Changed:
<
<

How to create histogram Pages using the presenter

>
>

How to create histogram Pages using the Presenter

  The histograms need to be organised in pages inside the HistDB. When you open the Presenter, a New Page (empty) appears in the central part of the display. You can fill at this point the Page with you histogram selection. Use case: Gauss/MCTruthMonitor/ histograms are grouped together and named 100,101,... . Suppose we want to create a more meaningful classification of the histos we could create a ParticleMomentum (Vertex,...) Page where we can group together the Momentum (Vertex, ...) related histos.

  • from the database listing menu on the bottom right, you can select the histos you want to book into the DB (tick their boxes). Add them to the page with the right mouse button.
Changed:
<
<
  • you can save the page to the database (cllikking on the top left icon "Save Page to Database"; when you enter a folder name or page name that doesn't exist in the dialog box, it will automatically create a new entry (please don't forget to press enter after you have typed the name in the input line).
>
>
  • you can save the page to the database (click on the top left icon "Save Page to Database"); when you enter a folder name or page name that doesn't exist in the dialog box, it will automatically create a new entry (please don't forget to press enter after you have typed the name in the input line).
 
Changed:
<
<

How to check existing histogram Pages using the presenter

>
>

How to check existing histogram Pages using the Presenter

  You can open the presenter to check your rootopla using the already configured Pages in the DB (see previous Section).
Line: 36 to 37
 

OMAlib

Changed:
<
<
-- SilviaMiglioranzi - 2009-09-15
>
>
OMAlib is an histogram analyser package. It can be used online as well as offline. The checks can be defined/edited/masked through the Online HistDB web interface. Custom analysis tasks can be implemented as well. The analysis output consists of Warning and Alarms. You can see the messages associated to every histogram using the Presenter. They list of Warning/Alarms is also summarized in here for each PRODID.
 

-- SilviaMiglioranzi - 2009-09-15 \ No newline at end of file

Revision 12009-09-15 - SilviaMiglioranzi

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="LHCbSimulation"

MC Monitoring Tools

OnlineHistDB

The Online HistDB can be used to store the display settings and configurations for all histograms and pages (see later). The database can be accessed through a web interface as well through the presenter.

Online Presenter

The Presenter is a graphical user interface to display the ROOT-based histograms published by the monitoring Algorithms. To display histograms, a "page" has to be defined. A page contains one or more histograms in a given layout and with given display settings. When the page is selected in the presenter, the page and histogram configuration are loaded from the HistDB. Then the histogram data published by the monitoring algorithm is read and the pages are displayed. As all display properties are stored in the HistDB, the presenter loads only the bins and their content from the histograms published by the algorithms. The display properties specified by the algorithm will be ignored.

How to configure the Presenter to check the MC histograms

  • get from CVS the Online/Presenter
  • edit the doc/presenter.cfg to set the editor-offline mode, change the database-credentials etc. (an example can be found here). Ask for the passwords.
  • choose a reference rootopla (to be compared with the root file you want to analyze) and place it in a directory with the same name as the Task (ex: create a "Gauss" directory in your working dir and put a Gauss reference rootopla in it). Report the "reference-path" in the doc/presenter.cfg.
  • in cmt/ do a SetupProject Online and source setup.csh before launching the Presenter
  • run the Presenter with the command: ../slc4_amd64_gcc34/presenter.exe -C ../doc/presenter.cfg
  • once the presenter is opened, from the second drop-down box, select the (Gauss) rootpla you want to check. A dialog box will pop up, where you can choose your root file. The contents should show up in the top right tree. Tick the checkbox, and use the right mouse button to declare them to the database (this step is necessary to declare the Task the first time into the DB, it is already done for Gauss and Boole so you can skip it and go to the next step).

How to create histogram Pages using the presenter

The histograms need to be organised in pages inside the HistDB. When you open the Presenter, a New Page (empty) appears in the central part of the display. You can fill at this point the Page with you histogram selection. Use case: Gauss/MCTruthMonitor/ histograms are grouped together and named 100,101,... . Suppose we want to create a more meaningful classification of the histos we could create a ParticleMomentum (Vertex,...) Page where we can group together the Momentum (Vertex, ...) related histos.

  • from the database listing menu on the bottom right, you can select the histos you want to book into the DB (tick their boxes). Add them to the page with the right mouse button.
  • you can save the page to the database (cllikking on the top left icon "Save Page to Database"; when you enter a folder name or page name that doesn't exist in the dialog box, it will automatically create a new entry (please don't forget to press enter after you have typed the name in the input line).

How to check existing histogram Pages using the presenter

You can open the presenter to check your rootopla using the already configured Pages in the DB (see previous Section).

  • choose the Page you want to visualize from the top-left menu
  • to overlap you current histogram with the reference one you need to click on the top-right icon "Overlay with reference"
  • if the plot shows a red contour box, at least one of the analysis tests (see OMAlib section) did fail. The box at the bottom of the page gives you the details of the failure.

OMAlib

-- SilviaMiglioranzi - 2009-09-15

-- SilviaMiglioranzi - 2009-09-15

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback