Validation Plots

Some validation plots for the CARL way of determining variation weights associated with Shower/Hadronization systematic uncertainties.

Link to the HZZ presentation: https://indico.cern.ch/event/1050099/

The NN will output a score s(x) for each event x, which can then be used to form the ratio variation as such:

var_ratio = (sigma_var/sigma_nominal) * (s(x)/(1-s(x))

The value of sigma_var/sigma_nominal for each of the variations is recorded below.

qqZZ samples

PATH to NN models giving the following diagnostics: /afs/cern.ch/user/j/jsandesa/public/forSam/arch_qqZZ (it contains the architecture, weight and variables.json file)

Note: The variables.json file in the path above contains the information on which variables were used for training as well as the scale/offsets for data preprocessing. Here is the nomenclature for some of the observables that required non-linear transformations to be used as inputs:

log_higgs_pt_fidBorn_truth_p2 : log(higgs_pt_fidBorn_truth+2.0)

log_higgs_m_fidBorn_truth : log(higgs_m_fidBorn_truth)

CKKW15 varaiton

sigma_CKKW15/sigma_nominal = 1.02 (inclusive)

sigma_CKKW15/sigma_nominal = 1.04 (selection m4l>180)

qqZZ_CKKW15_5.png

qqZZ_CKKW15.jpg

qqZZ_CKKW15_2.png

qqZZ_CKKW15_3.png

qqZZ_CKKW15_4.png

CKKW30 variation

sigma_CKKW30/sigma_nominal = 0.97 (inclusive)

sigma_CKKW30/sigma_nominal = 1.00 (selection m4l>180)

qqZZ_CKKW30_5.png

qqZZ_CKKW30_new.png

qqZZ_CKKW30_new2.png

qqZZ_CKKW30_new3.jpg

qqZZ_CKKW30_new4.png

QSF4 variation

sigma_QSF4/sigma_nominal = 0.99 (inclusive)

sigma_QSF4/sigma_nominal = 1.01 (selection m4l>180)

qqZZ_QSF4_5.png

qqZZ_QSF4.jpg

qqZZ_QSF4_2.png

qqZZ_QSF4_3.png

qqZZ_QSF4_4.png

QSF025 variation

sigma_QSF025/sigma_nominal = 1.01 (inclusive)

sigma_QSF025/sigma_nominal = 1.05 (selection m4l>180)

qqZZ_QSF025_5.png

qqZZ_QSF025.jpg

qqZZ_QSF025_2.png

qqZZ_CKKW30_new3.jpg

qqZZ_QSF025_4.png

CSSKIN variation

No variation sample available

ggZZ SBI samples

PATH to NN models giving the following diagnostics: /afs/cern.ch/user/j/jsandesa/public/forSam/arch_ggZZSBI (it contains the architecture, weight and variables.json file) (In progress)

Note: The variables.json file in the path above contains the information on which variables were used for training as well as the scale/offsets for data preprocessing. Here is the nomenclature for some of the observables that required non-linear transformations to be used as inputs:

log_higgs_pt_fidBorn_truth_p2 : log(higgs_pt_fidBorn_truth+2.0)

log_higgs_m_fidBorn_truth : log(higgs_m_fidBorn_truth)

CKKW15 varaiton

sigma_CKKW15/sigma_nominal = 0.99 (inclusive)

sigma_CKKW15/sigma_nominal = 0.99 (selection m4l>180)

SBI_CKKW15_5.png

SBI_CKKW15_1.png

SBI_CKKW15_new_2.png

SBI_CKKW15_new_2.png

SBI_CKKW15_3.png

SBI_CKKW15_4.png

CKKW30 variation

sigma_CKKW30/sigma_nominal = 1.08 (inclusive)

sigma_CKKW30/sigma_nominal = 1.08 (selection m4l>180)

SBI_CKKW30_5.png

SBI_CKKW30_1.png

SBI_CKKW30_2.png

SBI_CKKW30_3.png

SBI_CKKW30_4.png

QSF4 variation

sigma_QSF4/sigma_nominal = 0.81 (inclusive)

sigma_QSF4/sigma_nominal = 0.81 (selection m4l>180)

SBI_QSF4_5.png

SBI_QSF4_1.png

SBI_QSF4_2.png

SBI_QSF4_3.png

SBI_QSF4_4.png

QSF025 variation

sigma_QSF025/sigma_nominal = 1.38 (inclusive)

sigma_QSF025/sigma_nominal = 1.37 (selection m4l>180)

SBI_QSF025_5.png

SBI_QSF025_1.png

SBI_QSF025_2.png

SBI_QSF025_3.png

SBI_QSF025_4.png

CSSKIN variation

sigma_CSSKIN/sigma_nominal = 1.02 (inclusive)

sigma_CSSKIN/sigma_nominal = 1.02 (selection m4l>180)

SBI_CSSKIN_5.png

SBI_CSSKIN_1.png

SBI_CSSKIN_2.png

SBI_CSSKIN_4.png

SBI_CSSKIN_3.png

ggZZ Sig samples

PATH to NN models giving the following diagnostics: /afs/cern.ch/user/j/jsandesa/public/forSam/arch_ggZZSig (it contains the architecture, weight and variables.json file) (In progress)

Note: The variables.json file in the path above contains the information on which variables were used for training as well as the scale/offsets for data preprocessing. Here is the nomenclature for some of the observables that required non-linear transformations to be used as inputs:

log_higgs_pt_fidBorn_truth_p2 : log(higgs_pt_fidBorn_truth+2.0)

log_higgs_m_fidBorn_truth : log(higgs_m_fidBorn_truth)

CKKW15 varaiton

sigma_CKKW15/sigma_nominal = 1.012 (inclusive)

sigma_CKKW15/sigma_nominal = 1.004(selection m4l>180)

Sig_CKKW15_5.png

Sig_CKKW15_1.png

Sig_CKKW15_2.png

Sig_CKKW15_3.png

SBI_QSF4_4.png

CKKW30 variation

sigma_CKKW30/sigma_nominal = 1.019 (inclusive)

sigma_CKKW30/sigma_nominal = 1.01 (selection m4l>180)

Sig_CKKW30_1.png

Sig_CKKW30_2.png

Sig_CKKW30_3.png

Sig_CKKW30_4.png

Sig_CKKW30_5.png

QSF025 variation

sigma_QSF4/sigma_nominal = 1.289 (inclusive)

sigma_QSF4/sigma_nominal = 1.278 (selection m4l>180)

Sig_QSF025_1.png

Sig_QSF025_2.png

Sig_QSF025_3.png

Sig_QSF025_4.png

Sig_QSF025_5.png

CSSKIN variation

sigma_QSF4/sigma_nominal = 1.022 (inclusive)

sigma_QSF4/sigma_nominal = 1.013 (selection m4l>180)

Sig_CSSKIN_1.png

Sig_CSSKIN_2.png

Sig_CSSKIN_3.png

Sig_CSSKIN_4.png

Sig_CSSKIN_5.png


VBF Samples

-- JayAjitbhaiSandesara - 2021-12-06

Topic attachments
I Attachment History Action Size Date Who Comment
PNGpng SBI_CKKW15_1.png r1 manage 2991.1 K 2021-12-10 - 11:02 JayAjitbhaiSandesara  
PNGpng SBI_CKKW15_2.png r1 manage 2394.5 K 2021-12-10 - 11:03 JayAjitbhaiSandesara  
PNGpng SBI_CKKW15_2_new.png r1 manage 2394.5 K 2021-12-10 - 12:13 JayAjitbhaiSandesara  
PNGpng SBI_CKKW15_3.png r1 manage 2737.7 K 2021-12-10 - 11:03 JayAjitbhaiSandesara  
PNGpng SBI_CKKW15_4.png r1 manage 2660.9 K 2021-12-10 - 11:03 JayAjitbhaiSandesara  
PNGpng SBI_CKKW15_5.png r1 manage 2000.5 K 2021-12-10 - 11:58 JayAjitbhaiSandesara  
PNGpng SBI_CKKW15_new_2.png r1 manage 2397.5 K 2021-12-10 - 12:14 JayAjitbhaiSandesara  
PNGpng SBI_CKKW30_1.png r1 manage 2659.7 K 2021-12-10 - 13:55 JayAjitbhaiSandesara  
PNGpng SBI_CKKW30_2.png r1 manage 2926.8 K 2021-12-10 - 13:55 JayAjitbhaiSandesara  
PNGpng SBI_CKKW30_3.png r1 manage 2775.5 K 2021-12-10 - 13:55 JayAjitbhaiSandesara  
PNGpng SBI_CKKW30_4.png r1 manage 2215.1 K 2021-12-10 - 13:55 JayAjitbhaiSandesara  
PNGpng SBI_CKKW30_5.png r1 manage 3027.9 K 2021-12-10 - 13:55 JayAjitbhaiSandesara  
PNGpng SBI_CSSKIN_1.png r1 manage 2909.2 K 2021-12-17 - 11:08 JayAjitbhaiSandesara  
PNGpng SBI_CSSKIN_3.png r1 manage 2105.9 K 2021-12-17 - 12:47 JayAjitbhaiSandesara  
PNGpng SBI_CSSKIN_4.png r1 manage 2146.6 K 2021-12-17 - 12:47 JayAjitbhaiSandesara  
PNGpng SBI_QSF025_1.png r1 manage 2677.2 K 2021-12-10 - 14:16 JayAjitbhaiSandesara  
PNGpng SBI_QSF025_2.png r1 manage 2291.3 K 2021-12-10 - 14:16 JayAjitbhaiSandesara  
PNGpng SBI_QSF025_3.png r1 manage 2638.1 K 2021-12-10 - 14:16 JayAjitbhaiSandesara  
PNGpng SBI_QSF025_4.png r1 manage 2886.7 K 2021-12-10 - 14:16 JayAjitbhaiSandesara  
PNGpng SBI_QSF025_5.png r1 manage 2945.5 K 2021-12-10 - 14:16 JayAjitbhaiSandesara  
PNGpng SBI_QSF4_1.png r1 manage 2892.5 K 2021-12-10 - 15:47 JayAjitbhaiSandesara  
PNGpng SBI_QSF4_2.png r1 manage 2848.4 K 2021-12-10 - 15:47 JayAjitbhaiSandesara  
PNGpng SBI_QSF4_3.png r1 manage 2888.1 K 2021-12-10 - 15:47 JayAjitbhaiSandesara  
PNGpng SBI_QSF4_4.png r1 manage 2765.5 K 2021-12-10 - 15:48 JayAjitbhaiSandesara  
PNGpng SBI_QSF4_5.png r1 manage 3005.3 K 2021-12-10 - 15:47 JayAjitbhaiSandesara  
PNGpng Sig_CKKW15_1.png r1 manage 2979.9 K 2021-12-17 - 12:47 JayAjitbhaiSandesara  
PNGpng Sig_CKKW15_2.png r1 manage 2871.6 K 2021-12-17 - 12:47 JayAjitbhaiSandesara  
PNGpng Sig_CKKW15_3.png r1 manage 2107.7 K 2021-12-17 - 12:49 JayAjitbhaiSandesara  
PNGpng Sig_CKKW15_4.png r1 manage 2708.1 K 2021-12-17 - 12:49 JayAjitbhaiSandesara  
PNGpng Sig_CKKW15_5.png r1 manage 2482.6 K 2021-12-17 - 12:48 JayAjitbhaiSandesara  
PNGpng Sig_CKKW30_1.png r1 manage 2168.5 K 2022-01-26 - 22:52 JayAjitbhaiSandesara  
PNGpng Sig_CKKW30_2.png r1 manage 2703.4 K 2022-01-26 - 22:52 JayAjitbhaiSandesara  
PNGpng Sig_CKKW30_3.png r1 manage 2228.1 K 2022-01-26 - 22:53 JayAjitbhaiSandesara  
PNGpng Sig_CKKW30_4.png r1 manage 3115.7 K 2022-01-26 - 22:53 JayAjitbhaiSandesara  
PNGpng Sig_CKKW30_5.png r1 manage 2482.6 K 2022-01-26 - 22:53 JayAjitbhaiSandesara  
PNGpng Sig_CSSKIN_1.png r1 manage 2956.1 K 2022-01-26 - 22:53 JayAjitbhaiSandesara  
PNGpng Sig_CSSKIN_2.png r1 manage 2709.0 K 2022-01-26 - 22:53 JayAjitbhaiSandesara  
PNGpng Sig_CSSKIN_3.png r1 manage 2605.5 K 2022-01-26 - 22:54 JayAjitbhaiSandesara  
PNGpng Sig_CSSKIN_4.png r1 manage 3018.4 K 2022-01-26 - 22:54 JayAjitbhaiSandesara  
PNGpng Sig_CSSKIN_5.png r1 manage 2384.7 K 2022-01-26 - 22:56 JayAjitbhaiSandesara  
PNGpng Sig_QSF025_1.png r1 manage 3010.7 K 2022-01-26 - 22:56 JayAjitbhaiSandesara  
PNGpng Sig_QSF025_2.png r1 manage 1438.0 K 2022-01-26 - 22:56 JayAjitbhaiSandesara  
PNGpng Sig_QSF025_3.png r1 manage 2711.0 K 2022-01-26 - 22:56 JayAjitbhaiSandesara  
PNGpng Sig_QSF025_4.png r1 manage 2833.4 K 2022-01-26 - 22:56 JayAjitbhaiSandesara  
PNGpng Sig_QSF025_5.png r1 manage 3102.2 K 2022-01-26 - 22:56 JayAjitbhaiSandesara  
JPEGjpg qqZZ_CKKW15.jpg r1 manage 279.9 K 2021-12-06 - 05:38 JayAjitbhaiSandesara  
PNGpng qqZZ_CKKW15_2.png r1 manage 1225.6 K 2021-12-09 - 19:59 JayAjitbhaiSandesara  
PNGpng qqZZ_CKKW15_3.png r1 manage 2968.5 K 2021-12-09 - 20:00 JayAjitbhaiSandesara  
PNGpng qqZZ_CKKW15_4.png r1 manage 2682.8 K 2021-12-09 - 20:00 JayAjitbhaiSandesara  
PNGpng qqZZ_CKKW15_5.png r1 manage 2044.0 K 2021-12-10 - 12:24 JayAjitbhaiSandesara  
PNGpng qqZZ_CKKW30.png r2 r1 manage 3003.8 K 2021-12-06 - 06:53 JayAjitbhaiSandesara  
PNGpng qqZZ_CKKW30_5.png r1 manage 2989.8 K 2021-12-10 - 12:34 JayAjitbhaiSandesara  
PNGpng qqZZ_CKKW30_new.png r1 manage 3003.8 K 2021-12-06 - 06:54 JayAjitbhaiSandesara  
PNGpng qqZZ_CKKW30_new2.png r1 manage 2060.9 K 2021-12-06 - 08:43 JayAjitbhaiSandesara  
JPEGjpg qqZZ_CKKW30_new3.jpg r1 manage 351.3 K 2021-12-06 - 08:43 JayAjitbhaiSandesara  
PNGpng qqZZ_CKKW30_new4.png r1 manage 2799.2 K 2021-12-06 - 08:43 JayAjitbhaiSandesara  
JPEGjpg qqZZ_QSF025.jpg r1 manage 337.5 K 2021-12-06 - 05:48 JayAjitbhaiSandesara  
PNGpng qqZZ_QSF025_2.png r1 manage 2755.9 K 2021-12-08 - 09:04 JayAjitbhaiSandesara  
PNGpng qqZZ_QSF025_3.png r1 manage 2917.3 K 2021-12-08 - 09:05 JayAjitbhaiSandesara  
PNGpng qqZZ_QSF025_4.png r1 manage 2023.8 K 2021-12-08 - 09:05 JayAjitbhaiSandesara  
PNGpng qqZZ_QSF025_5.png r1 manage 2135.7 K 2021-12-10 - 13:39 JayAjitbhaiSandesara  
JPEGjpg qqZZ_QSF4.jpg r1 manage 329.9 K 2021-12-06 - 05:39 JayAjitbhaiSandesara  
PNGpng qqZZ_QSF4_2.png r1 manage 2781.1 K 2021-12-08 - 13:15 JayAjitbhaiSandesara  
PNGpng qqZZ_QSF4_3.png r1 manage 2178.0 K 2021-12-08 - 13:15 JayAjitbhaiSandesara  
PNGpng qqZZ_QSF4_4.png r1 manage 2885.0 K 2021-12-08 - 13:15 JayAjitbhaiSandesara  
PNGpng qqZZ_QSF4_5.png r1 manage 2293.3 K 2021-12-10 - 13:13 JayAjitbhaiSandesara  
Edit | Attach | Watch | Print version | History: r13 < r12 < r11 < r10 < r9 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r13 - 2022-01-26 - JayAjitbhaiSandesara
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Sandbox All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback