Welcome to the NP04/protoDUNE-SP Online Monitoring TWiki Home page

List of Desired Metrics

  • Event Display
  • Mean and RMS
  • FFT
  • Check for Stuck Bits

Online Monitoring on LArSoft

Disclaimer: The source codes were inspired by the work stored in dune35t found in various modules in LArSoft.

  • The source code is stored under /srcs/dunetpc/dune/Protodune/OnlineMonitor and it contains multiple modules:
    • DONE OnlineMonitor_module.cc:
      • ALERT! the ranges are hardwired --> needs improvements
    • DONE OnlineMonitorWithPedestal_module.cc:
      • ALERT! --> same as above

RMS example.png
RMS metrics for non-noisy vs noisy conditions

    • DONE RawEventDisplay_module.cc
    • DONE FFT_module.cc
    • DONE StuckBits_module.cc

  • Channel Mapping:
    • loop through channels in the first APA to find the channel boundaries for each view
  • Filling:
    • loop over all raw digits (entire channels) , look in each view (per chan) for each APA
    • Histos stored for each APA, each View

Simulated Scenarios

The OnlineMonitor metrics are tested and validated under various simulated scenarios. These simulated data are based on following chain: gen (particle ID, input geometry)-> g4 (full MC truth, energy deposits) -> detsim (scintillation light and ionization electrons from energy deposits, recombination of ionization electrons, attenuation of electrons number, due to LAr impurities at given drift distance, longitudinal and transverse diffusion of electrons at given drift distance, added readout info: electronics response, noise, ADC waveforms on readout channels)

Various conditions of the noise were produced (by Dorota and Robert) and they are stored here: http://dune-data.fnal.gov/mc/mcc8/protodune_request1/index.html.

  • standard detsim makes low, white noise, equivalent to 1.6 parameter for white noise in exp.noise version
  • desim_noise has exponential noise on top of white, with still reasonable amplitudes
  • detsim_noise_high is ~worst case.

    • low noise (using protoDUNE_detsim.fcl)
    • medium noise (using protoDUNE_detsim_noise.fcl)
      Medium noise.png
      Medium Noise Scenario
    • high noise - a la dune35t (using protoDUNE_detsim_noise_high.fcl)
      nois example lar.png
      Simulated Noise Scenarios

These noise definitions are based on the parameters used for the WhiteNoise (incoherent - flat noise) and for the NoiseNorm parameters (exponential noise). These parameters are defined in .fcl files in srcs/dunetpc/fcl/protodune/detsim/ .

Moreover, since the Online Monitoring aims to address the sanity of the data quality, raw data is simulated with various assumptions of electronics: These flags exist in the default .fcl files: srcs/dunetpc/fcl/protodune/detsim/protoDUNE_detsim.fcl

  • physics.producers.daq.NoiseOn:
  • physics.producers.daq.PedestalOn:
  • physics.producers.daq.DistortOn:
  • physics.producers.daq.SuppressOn:

Which correspond to:

  • with or without distortion applied
  • with or without Suppression applied

Following parameters were used for these conditions if applied:

SimWire.png
Sample with Distortion and Noise as viewed by lar event display

noDistortion noSuppression.png
No Distortion, no Suppression

yesDistortion noSuppression.png
Sample with Distortion, no Suppression as viewed by lar event display

Performance monitoring via profiling tool

A first attempt to monitor the profiling was performed used igprof tool. It has the advantage that it does not require re-configuration and it should work with the default LArSoft optimisation. This is now installed centrally on the neut platform cluster. To use it just run a setup:

    • source /mnt/nas01/software/products/setups
    • setup igprof v5_9_16 -q e10

However, the demangle does not really work and then itís hard to digest the performance

  • - for performance:

    • igprof -d -pp -t lar -o igprof_lar.pp.gz lar -c ..
    • igprof-analyse -d -v -g igprof_lar.pp.gz > igreport_perf.res

  • - for memory:

    • igprof -d -mp -t lar -o igprof_lar.gz lar -c ...
    • igprof-analyse -d -v -g -r MEM_TOTAL igprof_lar.gz > igreport_total.res

igprof problem.png
Igprof summary table in SQL web tool format

Output Root Files

ALERT! The test outputs are store for now in the public lxplus area till Marco settles his accounts on neutrino cluster:

  • ~radescu/public/forMarco/

Web Tool Monitor (Marco)


Arrow blue up Back to protoDUNE-SP Data Quality Twiki Main Page

Arrow blue up Back to protoDUNE-SP Data Preparation Twiki Main Page


Major updates:

-- NectarB - 2017-03-02 - created web site

-- VoicaAnaMariaRadescu - 2017-03-16 - created structure and content

Edit | Attach | Watch | Print version | History: r9 < r8 < r7 < r6 < r5 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r7 - 2017-03-28 - VoicaAnaMariaRadescu
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CENF All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback