Welcome to the NP04/protoDUNE-SP Online Monitoring TWiki Home page

List of Metrics

Priority:

  • Event Display
  • Mean and RMS
  • FFT
  • Check for Stuck Bits
  • display of beam region vs non-beam region
  • Trigger ?
  • Photon Detector ?

Desirable:

  • Purity check
  • Muon monitors

Online Monitoring on LArSoft

Disclaimer: The source codes were inspired by the work stored in dune35t found in various modules in LArSoft.

  • The source code is stored under _/srcs/dunetpc/dune/Protodune/OnlineMonitor and it contains multiple modules:
    • DONE OnlineMonitor_module.cc:
      • ALERT! the ranges are hardwired --> needs improvements
    • DONE OnlineMonitorWithPedestal_module.cc:
      • ALERT! --> same as above

RMS example.png
RMS metrics for non-noisy vs noisy conditions

    • DONE RawEventDisplay_module.cc
    • DONE FFT_module.cc
    • DONE StuckBits_module.cc
    • ALERT! PurityAna_module.cc

  • Channel Mapping:
    • loop through channels in the first APA to find the channel boundaries for each view
  • Filling:
    • loop over all raw digits (entire channels) , look in each view (per chan) for each APA
    • Histos stored for each APA, each View

Simulated Scenarios

The OnlineMonitor metrics are tested and validated under various simulated scenarios. These simulated data are based on following chain: gen (particle ID, input geometry)-> g4 (full MC truth, energy deposits) -> detsim (scintillation light and ionization electrons from energy deposits, recombination of ionization electrons, attenuation of electrons number, due to LAr impurities at given drift distance, longitudinal and transverse diffusion of electrons at given drift distance, added readout info: electronics response, noise, ADC waveforms on readout channels)

Various conditions of the noise were produced (by Dorota and Robert) and they are stored here: http://dune-data.fnal.gov/mc/mcc8/protodune_request1/index.html.

Access and copy of the simulated data

For new people: follow up the instructions at: https://web.fnal.gov/collaboration/DUNE/SitePages/How%20to%20Map%20Your%20CERN%20Grid%20Cert%20to%20GUMS%20at%20FNAL.aspx

For those who have already certificate installed and want to copy from fermilab to neutplatform - example to use copy from http://dune-data.fnal.gov/mc/mcc8/protodune_request1/xml/protoDune/ProtoDUNE_beam_2GeVc_cosmics_3ms_noise_high_detsim.list

  • voms-proxy-init --voms dune:/dune/Role=Analysis -vomses ~/dunevomses
  • xrdcp xroot://fndca1.fnal.gov/pnfs/fnal.gov/usr/dune/persistent/dunepro/v06_18_01_01/detsim/ProtoDUNE_beam_2GeVc_cosmics_3ms_noise_high/12938753_0/ProtoDUNE_beam_2GeVc_cosmics_3ms_noise_high_0_20161231T120953_detsim2_e28b54c3-cfa2-4b67-81bc-907e32d22d49.root /mnt/nas01/users/radescu/Feb2017_v22/inputs/.

Scenario Description

  • standard detsim makes low, white noise, equivalent to 1.6 parameter for white noise in exp.noise version
  • desim_noise has exponential noise on top of white, with still reasonable amplitudes
  • detsim_noise_high is ~worst case.

    • low noise (using protoDUNE_detsim.fcl)
    • medium noise (using protoDUNE_detsim_noise.fcl)
      Medium noise.png
      Medium Noise Scenario
    • high noise - a la dune35t (using protoDUNE_detsim_noise_high.fcl)
      nois example lar.png
      Simulated Noise Scenarios

These noise definitions are based on the parameters used for the WhiteNoise (incoherent - flat noise) and for the NoiseNorm parameters (exponential noise). These parameters are defined in .fcl files in srcs/dunetpc/fcl/protodune/detsim/ .

Moreover, since the Online Monitoring aims to address the sanity of the data quality, raw data is simulated with various assumptions of electronics: These flags exist in the default .fcl files: srcs/dunetpc/fcl/protodune/detsim/protoDUNE_detsim.fcl

  • physics.producers.daq.NoiseOn:
  • physics.producers.daq.PedestalOn:
  • physics.producers.daq.DistortOn:
  • physics.producers.daq.SuppressOn:

Which correspond to:

  • with or without distortion applied
  • with or without Suppression applied

Following parameters were used for these conditions if applied:

SimWire.png
Sample with Distortion and Noise as viewed by lar event display

noDistortion noSuppression.png
No Distortion, no Suppression

yesDistortion noSuppression.png
Sample with Distortion, no Suppression as viewed by lar event display

Performance monitoring via profiling tool

A first attempt to monitor the profiling was performed used igprof tool. It has the advantage that it does not require re-configuration and it should work with the default LArSoft optimisation. This is now installed centrally on the neut platform cluster. To use it just run a setup:

    • source /mnt/nas01/software/products/setups
    • setup igprof v5_9_16 -q e10

However, the demangle does not really work and then itís hard to digest the performance

  • - for performance:

    • igprof -d -pp -t lar -o igprof_lar.pp.gz lar -c ..
    • igprof-analyse -d -v -g igprof_lar.pp.gz > igreport_perf.res

  • - for memory:

    • igprof -d -mp -t lar -o igprof_lar.gz lar -c ...
    • igprof-analyse -d -v -g -r MEM_TOTAL igprof_lar.gz > igreport_total.res

igprof problem.png
Igprof summary table in SQL web tool format

Output Root Files

The working platform for the online monitor is now on the daq machine: pddaq-gen05.

Location

The files will be stored there: /daq/onlinemonitor/data_histos/simulation .

Convention

The name convention of files is run_#_ev_#_time_#.root The time # is ...

ALERT! The test outputs are stored for now in the public lxplus area till Marco settles his accounts on neutrino cluster:

  • ~radescu/public/forMarco/

Web Tool Monitor (Marco)


Arrow blue up Back to protoDUNE-SP Data Quality Twiki Main Page

Arrow blue up Back to protoDUNE-SP Data Preparation Twiki Main Page


Major updates:

-- NectarB - 2017-03-02 - created web site

-- VoicaAnaMariaRadescu - 2017-03-16 - created structure and content

Edit | Attach | Watch | Print version | History: r9 < r8 < r7 < r6 < r5 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r9 - 2017-05-10 - VoicaAnaMariaRadescu
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CENF All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback