ContentSigmaQualityTest < Sandbox

---+ 

-- Main.ChadFreer - 2017-12-19
---+ Content Sigma Quality Test

This twiki is meant only to describe the Content Sigma quality test.

For documentation on all quality tests see [[CMS.DQMQualityTests][Quality tests]]
---++ What is the content sigma quality test

The content sigma quality test is designed to test histogram bins/blocks of bins against their neighboring bins to compare the statistics of a run (visualization below).

The workflow for the test:

   1 Get the content of bin or block to be tested
   1 Get the average of neighbors with the associated deviation
   1 compare content to neighbor average using poisson statistics and thresholds set in the xml file
      1 Noisy/Dead Probability = poissonCDF[Content,Neighbor+unc]
   1 calculate tolerance
      1 Tolerance =normalCDF(tolerance) {set in xml file}
   1 Calculate if block fails
      1 Noisy/Dead probability &lt; Noisy/Dead Threshold
Test uses poisson statistics to test thresholds and standard deviation to calculate uncertainty.

<span style="background-color: #f6f6f6; color: #630000; font-size: 18.85px;"><img alt="" height="576" src="%ATTACHURL%/QT_visual.png" width="462" /></span>

---++ Test Parameter and Flags

toleranceNoisy: The poisson threshold for noisy bins/blocks

toleranceDead: The poisson threshold for dead bins/blocks

Xblocks: the number of blocks for x axis that will be used. For example XBlocks=5 means that the x bins will be split into 5 blocks.
   * FLAG: XBlocks=999 sets it to binwise
Yblocks: the number of blocks for y axis that will be used. For example YBlocks=5 means that the y bins will be split into 5 blocks.
   * FLAG: YBlocks=999 sets it to binwise
neighboursX: the number of neighbor blocks in x that you wich to compare against. Neighbors do not wrap around histogram edges, they merely stop as shown above
   * FLAG: neighboursX=999 means that neighbors in that dimension will be suppressed
neighboursY: the number of neighbor blocks in y that you wich to compare against. Neighbors do not wrap around histogram edges, they merely stop as shown above
   * FLAG: neighboursY=999 means that neighbors in that dimension will be suppressed
noisy: 1 means this will use noisy test. 0 supresses noisy test

dead: 1 means this will use dead test. 0 supresses dead test

error: the percentage of failed bins/blocks required for the test to throw an error flag (between 0-1)

warning: the percentage of failed bins/blocks required for the test to throw a warning flag (between 0-1)

xMin: specify a specific lower x value for histogram. Anything lower will be ignored
   * FLAG: xMin=0 uses lowest natural bin for test
xMax: specify a specific upper x value for histogram. Anything higher will be ignored
   * FLAG: xMax=0 uses highest natural bin for test
yMin: specify a specific lower y value for histogram. Anything lower will be ignored
   * FLAG: yMin=0 uses lowest natural bin for test
yMax: specify a specific upper y value for histogram. Anything higher will be ignored
   * FLAG: yMax=0 uses highest natural bin for test
---++ XML declaration and Implentation
---++++ The following is the creation of a content sigma test
<verbatim><QTEST name="ContentSigma_Noisy">      
     <TYPE>ContentSigma</TYPE>
      <PARAM name="toleranceNoisy">3</PARAM>
      <PARAM name="toleranceDead">1</PARAM>
      <PARAM name="Xblocks">999</PARAM>
      <PARAM name="Yblocks">999</PARAM>
      <PARAM name="neighboursX">10</PARAM>
      <PARAM name="neighboursY">10</PARAM>
      <PARAM name="noisy">1</PARAM>
      <PARAM name="dead">0</PARAM>
      <PARAM name="error">0.94</PARAM>
      <PARAM name="warning">0.97</PARAM>
      <PARAM name="xMin">0</PARAM> <!-- specify area of histogram to be analyzed -->
      <PARAM name="xMax">0</PARAM>
      <PARAM name="yMin">0</PARAM>
      <PARAM name="yMax">0</PARAM>
 </QTEST></verbatim>
---++++ The following is the application of the test on specific histograms
<verbatim>
<LINK name="*emtfTrackPhi">
      <TestName activate="true">ContentSigma_Noisy</TestName>
      <TestName activate="true">ContentSigma_Dead</TestName>
 </LINK></verbatim>

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
png	QT_visual.png	r1	manage	322.2 K	2017-12-19 - 15:49	ChadFreer

Topic revision: r1 - 2017-12-19 - ChadFreer

Account
- Log In

- Cern Search
- TWiki Search
- Google Search
Sandbox All webs

Edit
Attach

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback