VPT HV Scans

WARNING - CONFIGURING FOR HVSCANS
Contact ECAL DCS on 72606, or Serguei on 70827 before doing anything !!!!
In GECO2020, remember to set HVmax for the dynodes from 600 V to 705 V for dynode voltage scans.
Take care not to set a zero voltage target by clumsy editing in GECO.
NEVER try to go in as admin in GECO with a small laptop from home.
After the cernts window, the cerntscms window and the GECO window you cannot see what you are doing !!!
Dynode scan ALERT - near 700 V, run into dynode IOmon limits ! Have to temporarily raise these !!!!!

Steps to access raw data for the minidaq runs, the .dat data:

(1) ssh into cmsusr:
ssh cmsusr
(2) (From cmsusr prompt): login to the DQM development FU:
ssh fu-c2f11-21-02
(3) The raw data should be visible on a folder mounted on this machine, ie :
ls /dqmminidaq/run303213/
(4) To set up a CMSSW environment: (from the cmsusr prompt)
source ~ecalpro/DQM/proxy.sh
export SCRAM_ARCH=slc7_amd64_gcc530
source /opt/offline/cmsset_default.sh || (echo "CMSSW setup script not found on this machine"; return 1)
(5) To copy files over from the FU machine to a target machine:
#see what files are there:
ls -al /dqmminidaq/run303537/*.dat

# first copy files over to /nfshome0/davec :
cp /dqmminidaq/run303537/run303537_ls0002_streamDQM_mrg-c2f12-31-01.dat .

or 
cp /dqmminidaq/run303537/run303537_ls*_streamDQM_mrg-c2f12-31-01.dat .
to copy ALL 303537 files into cmsusr:/nfshome0/davec/

From a prompt on the target machine:
scp cmsusr:/nfshome0/davec/run303537_ls0001_streamDQM_mrg-c2f12-31-01.dat .

To use scp with a wildcard, either put filename in quotes or put a backslash in front of the asterix, ie: 
scp cmsusr:/nfshome0/davec/run303537_ls00\*_streamDQM_mrg-c2f12-31-01.dat .

Processing the raw .dat files into .root files:

When in a CMSSW release, use :
/convertDat2Pool.sh -d FileName.dat
where FileName.dat is in the directory /tmp/fay It will create /tmp/fay/FileName.dat.root

ie, over multiple input files, output net output to 303532-all.dat:

./convertDat2Pool.sh -d 303532-all.dat

HV scan datasets

21 Sep 2017
Scans by DaveC, all EE, dynode HV scan, B = 3.8 T, 303577 - 303591
Analysis in /afs/cern.ch/user/d/davec/CMSSW_9_2_10/src/Reco/HVAnalyzer
EE Dynode HV scan at 3.8 T, started at 18.45, completed at 21.23, on 21 Sep 2017.

anode/dynode
setting        run        start time
800/600        303577     18.45
800/625        303583     19.46   (303581 stopped due to an SEU/LHC beam dump)
800/650        303584     20.04
800/675        303587     20.37   (303585 crashed)
800/700        303591     21.03

NOTE: had to raise dynode IOmon limits at 800/700 to avoid dynode current trips.

21.35 System returned to standard 800/600.

21 Sep 2017
Scans by DaveC, all EE, anode HV scan, B = 3.8 T, 303517 - 303537
Analysis in /afs/cern.ch/user/d/davec/CMSSW_9_2_10/src/Reco/HVAnalyzer

EE Anode HV scan at 3.8 T, started at 14.17, completed at 15.50, on 21 Sep 2017.

anode/dynode
setting        run        start time
800/600        303517     14.17
775/600        303522     14.41
750/600        303527     15.12
725/600        303532     15.17
700/600        303537     15.39

16.00 System returned to standard 800/600.

20 Sep 2017
Scans by DaveC, all EE, partial anode HV scan, B = 0 T, 303213 - 303233

 Blue laser, blue LEDs, test pulse

 run 303213      800/600            15:09 - 15:16
 run 303229      780/600            16:20 - 16:34
 run 303233      760/600            16:38 - 16:49

 17.00 returned all EE to standard 800/600.

19 Feb 2013
Scans by Ken Bell, all EE, at 0.0 T, 212234 - 212249

0.0T Ken Bell, ELOG TUE 19.FEB.13 01:37:39
 ==========================================
 Anode  Dynode    #Run
  HV(V)   HV(V) 
  800     600    212234

 1000     800    212235
  900     700    212237
  800     600    212238
  700     500    212239
  600     400    212241
  500     300    212242
  400     200    212243

  800     600    212244

  800     620    212245
  800     640    212246
  800     670    212247
  800     700    212248

  800     600    212249

Analysed with
/afs/cern.ch/work/d/davec/hvscans/CMSSW_5_3_3_patch2/src/HV/HVAnalyzer HVAnalyzer.cc
with files in my work area (no longer there):

17 Dec 2012
Scans by Ken Bell, all EE, at 3.8 T, 209192 - 209210

3.8T Ken Bell, ELOG MON 17.DEC.12 14:11:42
 ==========================================
 Anode  Dynode   #Run
  HV(V)   HV(V) 
  800     600    209192
 1000     800    209197
  900     700    209199
  800     600    209200
  700     500    209201
  600     400    209202
  500     300    209203
  400     200    209204

  800     600    209205

  800     620    209206
  800     640    209207
  800     670    209208
  800     700    209209

  800     600    209210
Processing History: LHC '' '"CMSSW_5_1_2_ONLINE"'
Root files at 'file:/afs/cern.ch/work/d/davec/HVscans2012/209197 to 209210.root'
Full dynode scan from set above, anode at 800 V:
800     600    209192
800     600    209200
800     600    209205

800     620    209206
800     640    209207
800     670    209208
800     700    209209

25 Feb 2011
Scans by Ken Bell, at 3.8 T, EE+ 158928 - 158933, EE- 158945 - 158952

HV scan 25 Feb 2011 at 3.8T


EE- HV scan with LEDs, 12:01:53 3.8T Local runs LED_TTCcci in EE- with different HV settings
LEDs are in a state that has been left as default. It should be BLUE 


EE+ HV scan with LEDs, 11:14:28
 158928  EE+   800/600      ecal_local.00158928.0001.A.storageManager.00.0000.dat
 158930  EE+   600/400
 158931  EE+   400/200
 158932  EE+   600/400
 158933  EE+   800/600
 

 158945  EE-   800/600
 158948  EE-   600/400
 158949  EE-   400/200
 158951  EE-   600/400
 158952  EE-   800/600
Processing History: FU '' '"CMSSW_3_3_0"'
Analysed with
/afs/cern.ch/work/d/davec/hvscans/CMSSW_3_9_5/src/HV/HVAnalyzer HVAnalyzer.cc
with files in my scratch0 area, ie:
'file:/afs/cern.ch/user/d/davec/scratch0/ecal_local.00152836.0001.A.storageManager.00.0000.dat.root' #EE+ 800/600
and with python run number insertion:
run = ['158931','EE+','400/200']
'file:/afs/cern.ch/user/d/davec/scratch0/ecal_local.00' + run[0] + '.0001.A.storageManager.00.0000.dat.root'
fileName = cms.string('histo-run' + run[0] + '.root')

31 Jan 2011
Scans Ken Bell, 31 Jan 2011 at 0.0 T, EE+ 156132 - 156149, EE- 156150 - 156167

Mon 31 Jan 2011

The following local LED_TTCci runs were taken for EE HV scan, B = 0T

  Run      EE       HV  (Anode/Dynode)
-----------------------------------------------------
156132  EE+    800/600              ecal_local.00156132.0001.A.storageManager.00.0000.dat
156134  EE+    600/400
156136  EE+    400/200
156137  EE+    600/400
156138  EE+    800/600 No EE digis in last 350 events
156139  EE+    800/650
156142  EE+    800/700
156143  EE+    800/750
156144  EE+    750/600
156145  EE+    700/600
156146  EE+    650/600
156149  EE+    800/600



156150  EE-     800/600
156151  EE-     800/600
156153  EE-     600/400
156154  EE-     400/200
156156  EE-     600/400
156157  EE-     800/600
156158  EE-     800/650
156159  EE-     800/700
156161  EE-     800/750
156162  EE-     750/600
156164  EE-     700/600
156165  EE-     650/600
156167  EE-     800/600

Dec 2010
Scans for data taken by Sasha Ledovskoy, in Dec 2010 at 0.0 T, 152836 - 152853

Runs on dfs: 152836 - 152853, ie ecal_local.00152836.0001.A.storageManager.00.0000.dat
Processing History: FU '' '"CMSSW_3_3_0"'
152836  EE+   800/600
152843  EE+   600/400
152844  EE+   400/200
152845  EE+   600/400
152846  EE+   800/600

152847  EE-    800/600
152849  EE-    600/400
152850  EE-    400/200
152851  EE-    600/400
152853  EE-    800/600
Txt output file for all EE, in:
\\cern.ch\dfs\Workspaces\d\DaveC\Analysis\HV-scans\HV scan data\HV-scans-2Dec2010\

12 Aug 2009
Scan by Nick Ryder/Sasha Ledovskoy, EE+ HV scan at 3.8T with EE+1+2+3+4, 25 runs 110764 - 110803

see Elog-Ryder-runs-12Aug2009.txt
Processing History: FU '' '"CMSSW_2_1_9"'
hv_scan_b38-2010.dat and hv_scan_b00-2010.dat, in Sasha email, 5Apr2010
Full dynode scan, anode at 800 V with
110765  at  800/700 
110767  at  800/670 
110768  at  800/640 
110769  at  800/600
Have 3.8 T data for a dynode, and a partial anode, scan on one channel, 39, 68, +1.
Dynode-scan-2009.pdf, Anode-scan-2009-3p8T.pdf

Results

Nick Ryder HV scans, summer 2009:

Fri 25 Feb 2011

Results for HVscan at 3.8T, HVScansFeb2011

Wed 16 Feb 2011

Now try to analyze rechits instead of digis. Need

Handle<EEUncalibratedRecHitCollection> rechits;
iEvent.getByLabel("ecalWeightUncalibRecHit", "EcalUncalibRecHitsEE", rechits);
Found example in EcalRecHitProducer.cc.

Related files:

Methods in class EcalUncalibratedRecHit, declared in EcalUncalibratedRecHit.h

00027   double amplitude() const { return amplitude_; }
00028   double pedestal() const { return pedestal_; }
00029   double jitter() const { return jitter_; }
00030   double chi2() const { return chi2_; }
00031   uint32_t recoFlag() const { return 0xF & flags_; }
00032   float  outOfTimeEnergy() const;
00033   float  outOfTimeChi2() const;
00034   float jitterError() const;
00035   uint8_t jitterErrorBits() const;
00036   DetId  id() const { return id_; }

Mon 7 Feb 2011

Looking at EE- HV scan on 31 Jan 2011. Study run 156151 at Va/Vd = 800/600.

EE- data, 2Dec 2011, 700 events, 800/600
Begin processing the 700th record. Run 156151, Event 350, LumiSection 1 at 07-Feb-2011 11:56:41.234 CET
 Into Handle section !
 Run number = 156151
Number of digis, digi size = 7274
Numbins = 131 minBin = 0 maxBin = 100
07-Feb-2011 11:56:41 CET  Closed file file:/afs/cern.ch/user/d/davec/scratch0/ecal_local.00156151.0001.A.storageManager.00.0000.dat.root
In HVAnalyzer::endJob() !!!!!!! number of events = 700
 xmin, xmax, ymin, ymax = 1 100 1 100
 High statistical error on the mean, >= 1%
 ix   iy  digimean  sigma  digient  mean error (all in adc counts)
 33   58   2.50      2.31     700   0.087   << present on 2Dec2011
 35   87   4.61      2.23     700   0.084   << NEW, not seen on 2Dec 2011
 41   60   0.64      3.16     700   0.119    << present on 2Dec2011
 46   67   0.62      2.30     700   0.087              "
 54   94   5.88      2.27     700   0.086              "
 55   36   0.55      2.43     700   0.092              "
 64   41   0.40      2.24     700   0.085              "
 71   67   0.55      2.32     700   0.088              "
 76   61   0.42      2.25     700   0.085              "
 82   36   0.76      2.10     700   0.080              "
 Number of high stat errors (>= 1%) = 10


 Highish statistical error on the mean, > 0.3% and < 1%
 ix   iy  digimean  sigma  digient  mean error (all in adc counts)
 10   30  12.34      2.35     700   0.089    << present on 2Dec2011
 31   56  25.52      2.29     700   0.087              "
 31   57  16.02      2.45     700   0.093              "
 32   57  23.08      2.41     700   0.091              "
 33   57  16.32      2.38     700   0.090              "
 33   60  15.67      2.30     700   0.087              "
 52   11  22.43      2.29     700   0.087              "
 68   49  28.33      2.36     700   0.089              "
 75   37  12.15      2.26     700   0.085              "
 86   70  24.85      2.37     700   0.090              "
 Number of high(ish) stat errors (0.3 < merror < 1%) = 10

EEM-digihits-31Jan2011.png: EEM-digiph-31Jan2011.png, run 156151, Va/Vd = 800/600 :
EEM-digihits-31Jan2011.png EEM-digiph-31Jan2011.png

EEM-digimeaerror-31Jan2011.png: EEM-digisigma-31Jan2011.png, run 156151, Va/Vd = 800/600:
EEM-digimeaerror-31Jan2011.png EEM-digisigma-31Jan2011.png

EE- HV scan results from 31 Jan 2011 * EEM-hvscan-31Jan2011.png:
EEM-hvscan-31Jan2011.png

  • EEM-ratio-Va400Va800-31Jan2011.png: * EEM-ratio-Va600Va800-31Jan2011.png:
    EEM-ratio-Va400Va800-31Jan2011.png EEM-ratio-Va600Va800-31Jan2011.png

EE- HV scan 31Jan 2011, bad channel list, data Va400/Va800 > 0.8 or Va400/Va800 < 0.4

HV scan, bad channel list, EE- 31Jan 2011
 End,i,j   Ents   800    600     400      400/800     600/800    800/800
 -1 27 33   700   75.02   73.81  61.59    0.82        0.98     1.00    near the cut, probably OK
 -1 42 61   700    0.64    0.72   0.68    1.06        1.13     1.00   << as for 2Dec2011
 -1 47 68   700    0.62    0.88   0.72    1.16        1.41     1.00   << as for 2Dec2011     
 -1 55 95   700    5.88    5.74   4.71    0.80        0.98     1.00      near the cut, probably OK
 -1 62 15   700   79.00   74.36  66.85    0.85        0.94     1.00     << as for 2Dec2011
 -1 65 42   700    0.40    0.22   0.49    1.23        0.57     1.00   << as for 2Dec2011
 -1 77 62   700    0.42    0.34   0.43    1.02        0.81     1.00     << as for 2Dec2011

Fri 4 Feb 2011

Need to enter a specific type of string (TString) into histo title, (ie via SetTitle ) to indicate date of hvscan data. Do this with TString in root. See TString examples.

EE- HV scan results, LED local runs, from 31Jan2011, 156151 EE- 800/600, 156153 EE- 600/400, 156154 EE- 400/200. NB: EE- was equipped with NEW input and control cards on Wed 26 Jan 2011.

EE+ HV scan results, LED local runs, from 31Jan2011, 156132 EE+ 800/600, 156134 EE+ 600/400, 156136 EE+ 400/200. Results show a functioning 'as usual' EE+ endcap following intervention on Wed Jan 19 2011 to replace top HV distribution crate to try and isolate LV trip problems. Unfortunately bad SC still present. NB: EE+ yet to have NEW input and control cards.

EEP digiphentries-800-600-31Jan2011.png: EEP meandigiph-800-600-31Jan2011.png:
EEP-digiphentries-800-600-31Jan2011.png EEP-meandigiph-800-600-31Jan2011.png

EEP hvscan-31Jan2011.png: EEP hvscan-badchanneels-31Jan2011.png:
EEP-hvscan-31Jan2011.png EEP-hvscan-badchanneels-31Jan2011.png

Bad channels from general HV scan on EE+, 31 Jan 2011. Same supercrystal problem as 2Dec2011, BUT its symptoms look very different to 2Dec 2011!:

Bad channel list
 End,i,j   Ents   800    600     400      400/800     600/800    800/800
  1 25 66   700    0.36    0.50   0.57    1.60        1.39     1.00  <<< also bad 2Dec2010
  1 39 20   700    0.29    0.31   0.27    0.95        1.08     1.00  <<< also bad 2Dec2010
  1 39 97   700    0.81    0.71   0.88    1.08        0.87     1.00  <<< also bad 2Dec2010
  1 53  3   700   237.01   173.98  41.79    0.18        0.73     1.00  <<< also bad 2Dec2010
  1 53 28   700    0.72    0.78   0.60    0.83        1.08     1.00  <<< also bad 2Dec2010
  1 67 53   700    0.62    0.46   0.63    1.02        0.75     1.00  <<< also bad 2Dec2010
  1 81 23   700    0.36    0.46   0.39    1.08        1.29     1.00  <<< also bad 2Dec2010
  1 97 58   700    1.12    0.98   0.90    0.81        0.87     1.00  <<< also bad 2Dec2010

  1 77 77   700   173.83   173.54  172.46    0.99        1.00     1.00
  1 77 78   700   166.05   163.78  160.14    0.96        0.99     1.00
  1 77 79   700   160.66   159.22  156.99    0.98        0.99     1.00
  1 77 80   700   184.60   182.49  179.58    0.97        0.99     1.00
  1 77 81   700   179.38   176.91  173.07    0.96        0.99     1.00
  1 78 77   700   193.41   194.04  192.53    1.00        1.00     1.00
  1 78 78   700   168.85   166.67  163.45    0.97        0.99     1.00
  1 78 79   700   228.66   226.30  222.87    0.97        0.99     1.00
  1 78 80   700   130.92   130.76  129.08    0.99        1.00     1.00
  1 78 81   700   208.84   206.06  201.43    0.96        0.99     1.00
  1 79 77   700   184.17   180.60  175.37    0.95        0.98     1.00
  1 79 78   700   266.45   262.52  254.57    0.96        0.99     1.00
  1 79 79   700   206.02   204.20  199.61    0.97        0.99     1.00
  1 79 80   700   156.44   153.86  149.79    0.96        0.98     1.00
  1 79 81   700   176.90   174.33  170.58    0.96        0.99     1.00
  1 80 77   700   165.88   163.00  158.49    0.96        0.98     1.00
  1 80 78   700   186.25   185.83  184.00    0.99        1.00     1.00
  1 80 79   700   170.42   167.33  162.74    0.95        0.98     1.00
  1 80 80   700   183.44   179.03  171.22    0.93        0.98     1.00
  1 80 81   700   157.85   157.33  156.42    0.99        1.00     1.00
  1 81 77   700   172.77   169.21  164.10    0.95        0.98     1.00
  1 81 78   700   191.79   187.84  182.45    0.95        0.98     1.00
  1 81 79   700   157.38   155.04  152.50    0.97        0.99     1.00
  1 81 80   700   167.08   164.61  159.85    0.96        0.99     1.00
  1 81 81   700   165.41   163.59  161.21    0.97        0.99     1.00

Look at dynode scan, EE+, 156132 EE+ 800/600, 156139 EE+ 800/650, 156142 EE+ 800/700, 156143 EE+ 800/750.

* EEP-dynode-650-600-31Jan2011.png: * EEP-dynode-700-600-31Jan2011.png:
EEP-dynode-650-600-31Jan2011.png EEP-dynode-700-600-31Jan2011.png

  • EEP-dynode-750-600-31Jan2011.png: * EEP-dynode-scan-31Jan2011.png:
    EEP-dynode-750-600-31Jan2011.png EEP-dynode-scan-31Jan2011.png

Dynode scan, 750/600, out of dist channels, > 1.1 or < 0.8 :

High ratio, dynode scan 750/600, End, i, j = 1 16 63  <<< also seen bad on anode scan
High ratio, dynode scan 750/600, End, i, j = 1 24 65  <<< also seen bad on anode scan
High ratio, dynode scan 750/600, End, i, j = 1 38 19  <<< also seen bad on anode scan
High ratio, dynode scan 750/600, End, i, j = 1 66 52  <<< also seen bad on anode scan
High ratio, dynode scan 750/600, End, i, j = 1 80 22  <<< also seen bad on anode scan

Look at anode scan, EE+, 156132 EE+ 800/600, 156144 EE+ 750/600, 156145 EE+ 700/600, 156146 EE+ 650/600.

EEP-Va750-800-31Jan2011.png: EEP-Va700-800-31Jan2011.png:
EEP-Va750-800-31Jan2011.png EEP-Va700-800-31Jan2011.png

* EEP-Va650-800-31Jan2011.png: EEP-AnodeScan-31Jan2011.png:
EEP-Va650-800-31Jan2011.png EEP-AnodeScan-31Jan2011.png

EE+ channels with a high ratio, > 1.05 for Va750/Va800

Bad 750/800 ph ratio, ratio > 1.05, End, i, j = 1 16 63
Bad 750/800 ph ratio, ratio > 1.05, End, i, j = 1 24 65
Bad 750/800 ph ratio, ratio > 1.05, End, i, j = 1 38 19
Bad 750/800 ph ratio, ratio > 1.05, End, i, j = 1 38 96
Bad 750/800 ph ratio, ratio > 1.05, End, i, j = 1 42 75
Bad 750/800 ph ratio, ratio > 1.05, End, i, j = 1 49 6
Bad 750/800 ph ratio, ratio > 1.05, End, i, j = 1 66 52
Bad 750/800 ph ratio, ratio > 1.05, End, i, j = 1 80 22

* EEP-bad750-800-ratio-ix-iy.png:
EEP-bad750-800-ratio-ix-iy.png

Thu 3 Feb 2011 Do standard digi analysis for EE+, all runs except 156149 (not available from CASTOR). Similar outputs to 2Dec 2010

Mon 31 Jan 2011

The following local LED_TTCci runs were taken for EE HV scan, B = 0T

  Run      EE       HV  (Anode/Dynode)
-----------------------------------------------------
156132  EE+    800/600
156134  EE+    600/400
156136  EE+    400/200
156137  EE+    600/400
156138  EE+    800/600 No EE digis in last 350 events
156139  EE+    800/650
156142  EE+    800/700
156143  EE+    800/750
156144  EE+    750/600
156145  EE+    700/600
156146  EE+    650/600
156149  EE+    800/600
156150  EE-     800/600
156151  EE-     800/600
156153  EE-     600/400
156154  EE-     400/200
156156  EE-     600/400
156157  EE-     800/600
156158  EE-     800/650
156159  EE-     800/700
156161  EE-     800/750
156162  EE-     750/600
156164  EE-     700/600
156165  EE-     650/600
156167  EE-     800/600

28 Jan 2010

Run hvscans.C to look at EE+ hvscan results with the digis. Reminder - only ~85 events per HV setting.

EE+ anomalous channels at 400/200 wrt 800/600. One supercrystal and 11 strange channels under HV scan.

Cut:   if (data[0] > 0.8 || (data[0] < 0.4 && data[0] > 0.001 )      where data[0] = Va(400)/Va(800)

EE+ 2Dec2010 root files loaded
 Bad channel list
 End,i,j   Ents   800    600     400      400/800     600/800    800/800
  1 17 64    86    0.94    0.55   1.20    1.27        0.59     1.00        <<<< v low ph
  1 25 66    86    0.57    0.27   0.74    1.30        0.47     1.00        <<<< v low ph
  1 39 20    86    0.44    0.31   0.45    1.01        0.69     1.00        <<<< v low ph
  1 39 97    86    0.74    0.81   0.76    1.03        1.09     1.00        <<<< v low ph
  1 43 76    86    1.29    1.65   1.28    0.99        1.28     1.00        <<<< v low ph
  1 53  3    86   11.53    1.61   1.51    0.13        0.14     1.00
  1 53 28    86    0.81    0.67   0.84    1.03        0.82     1.00        <<<< v low ph
  1 67 53    86    0.34    0.19   0.61    1.81        0.56     1.00        <<<< v low ph
  1 79 54    86   49.91   -4.54  -1.18   -0.02      -0.09     1.00
  1 81 23    86    0.09    0.24   0.31    3.29        2.53     1.00        <<<< v low ph
  1 97 58    86    0.47   -0.15   0.61    1.32       -0.33     1.00        <<<< v low ph

One supercrystal - same HV problem as in HV scans in 2009:
  1 77 77    86   262.01   -15.74  -10.75   -0.04       -0.06     1.00
  1 77 78    86   264.85   -18.61  -14.21   -0.05       -0.07     1.00
  1 77 79    86   236.97   -7.87  -4.99   -0.02       -0.03     1.00
  1 77 80    86   288.02   -21.11  -17.07   -0.06       -0.07     1.00
  1 77 81    86   279.43   -18.58  -13.05   -0.05       -0.07     1.00
  1 78 77    86   264.37   -14.41  -9.53   -0.04       -0.05     1.00
  1 78 78    86   261.43   -15.13  -11.01   -0.04       -0.06     1.00
  1 78 79    86   367.16   -14.72  -9.61   -0.03       -0.04     1.00
  1 78 80    86   208.97   -9.42  -6.18   -0.03       -0.05     1.00
  1 78 81    86   312.00   -19.66  -15.89   -0.05       -0.06     1.00
  1 79 77    86   269.93   -19.82  -15.61   -0.06       -0.07     1.00
  1 79 78    86   404.73   -18.79  -14.45   -0.04       -0.05     1.00
  1 79 79    86   320.59   -20.25  -14.93   -0.05       -0.06     1.00
  1 79 80    86   243.99   -26.01  -22.49   -0.09       -0.11     1.00
  1 79 81    86   292.03   -16.47  -13.25   -0.05       -0.06     1.00
  1 80 77    86   255.69   -13.40  -9.64   -0.04       -0.05     1.00
  1 80 78    86   287.83   -13.01  -8.14   -0.03       -0.05     1.00
  1 80 79    86   293.33   -13.28  -10.33   -0.04       -0.05     1.00
  1 80 80    86   303.67   -15.15  -12.42   -0.04       -0.05     1.00
  1 80 81    86   256.40   -15.40  -12.11   -0.05       -0.06     1.00
  1 81 77    86   269.19   -13.74  -10.22   -0.04       -0.05     1.00
  1 81 78    86   295.95   -26.41  -22.21   -0.08       -0.09     1.00
  1 81 79    86   245.40   -23.95  -19.21   -0.08       -0.10     1.00
  1 81 80    86   263.76   -20.11  -15.88   -0.06       -0.08     1.00
  1 81 81    86   265.50   -24.56  -20.20   -0.08       -0.09     1.00

And the same analysis for digis, EE-. A total of 8 strange channels under HV scan.

 
EE- 2Dec2010 root files loaded
 Bad channel list
 End,i,j   Ents   800    600     400      400/800     600/800    800/800
 -1 24 22   700   141.63   63.68  24.97    0.18        0.45     1.00
 -1 42 61   700    0.59    0.35   0.53    0.89        0.59     1.00        <<<< v low ph
 -1 47 68   700    0.31    0.32   0.34    1.10        1.05     1.00        <<<< v low ph
 -1 56 37   700    0.32    0.22   0.33    1.02        0.68     1.00        <<<< v low ph
 -1 62 15   700   86.48   83.42  80.03    0.93        0.96     1.00
 -1 65 42   700    0.55    0.45   0.74    1.34        0.80     1.00        <<<< v low ph
 -1 72 68   700    0.32    0.42   0.53    1.67        1.33     1.00        <<<< v low ph
 -1 77 62   700    0.30    0.34   0.40    1.32        1.11     1.00        <<<< v low ph

EEplus-hvscans-zoomout.png. EEplus-hvscan-zoomin.png.
EEplus-hvscans-zoomout.png EEplus-hvscan-zoomin.png

EEplus-hvscans-zoomout.png. EEminus-hvscan-zoom.png.
EEplus-hvscan-zoomin.png EEminus-hvscan-zoom.png

here

EEplus-ratios-for-600to800.png: EEminus-ratios-for-600to800-2Dec2010.png:

EEplus-ratios-for-600to800.png EEminus-ratios-for-600to800-2Dec2010.png

EEplus-ratios-for-400to800.png: EEminus-ratios-Va400Va800-2Dec2010.png:
EEplus-ratios-for-400to800.png EEminus-ratios-Va400Va800-2Dec2010.png

EEplus-ixiy-bad-ch.png: EEminus-ixiy-bad-ch.png:
EEplus-ixiy-bad-ch.png EEminus-ixiy-bad-ch.png

21 Jan - 25 Jan 2011

Coding to look at ix iy maps of digiph, sigma and error on mean digiph, run 152847 (800V/600V) etc, EE- and EE+. WARNING, C++ arrays run from 0->99, channel ix/iy runs from 1->100 ! Have to take great care over array indices!

No good doing if var > 100000000 to search for division by 0 ! This stores an exception instead. Must always check that denominator =0 !!!!! This explained 2 overflows in the plots !

List out bad digi channels in EE- and EE+. Most have no/little pulse height. Sigma usually ~2.3 adc counts. Channel EE+ ix=51, iy=25 very noisy ! Looks like one event - with a peculiar pedestal. All other events look OK, with peak in adc[5]:

Begin processing the 53rd record. Run 152836, Event 53, LumiSection 1 at 25-Jan-2011 12:19:38.903 CET
 jx jy = 51 25 pedest = 872 digiph = -545
 jx jy  adc[0]->adc[9]
 51   25   188   187  2241   200   289   327   314   285   258   231     <<<<<<<<<<<<<<<
                     ******
Begin processing the 54th record. Run 152836, Event 54, LumiSection 1 at 25-Jan-2011 12:19:38.922 CET
 jx jy = 51 25 pedest = 187 digiph = 142
 jx jy  adc[0]->adc[9]
 51   25   187   189   186   200   289   329   312   283   253   235
Begin processing the 55th record. Run 152836, Event 55, LumiSection 1 at 25-Jan-2011 12:19:38.940 CET
 jx jy = 5125  pedest = 190 digiph = 135
 jx jy  adc[0]->adc[9]
 51   25   190   189   191   196   288   325   317   285   260   236
Begin processing the 56th record. Run 152836, Event 56, LumiSection 1 at 25-Jan-2011 12:19:38.958 CET
 jx jy = 51 25 pedest = 188 digiph = 138
 jx jy  adc[0]->adc[9]
 51   25   190   190   186   200   285   326   310   284   257   237

Odd single event, Run 152836 (Vd/Va 800/600), 53rd record. LumiSection 1, jx jy = 51 25 pedest = 872 digiph = -545 !!!!! This one event, in the 85 events of the run, enough to mark this channel bad, even though all other events on this channel were fine. EEplus-odd-event.png:
EEplus-odd-event.png

List of bad digi channels in EE- and EE+.

EE- data, 2Dec 2011, 700 events, 800/600
Begin processing the 700th record. Run 152847, Event 350, LumiSection 1 at 25-Jan-2011 11:32:32.000 CET
 Into Handle section !
 Run number = 152847
Number of digis, digi size = 7274
Numbins = 131 minBin = 0 maxBin = 100
25-Jan-2011 11:32:32 CET  Closed file file:/afs/cern.ch/user/d/davec/scratch0/ecal_local.00152847.0001.A.storageManager.00.0000.dat.root
In HVAnalyzer::endJob() !!!!!!! number of events = 700
 xmin, xmax, ymin, ymax = 1 100 1 100
 High statistical error on the mean, >= 1%
 ix   iy  digimean  sigma  digient  mean error (all in adc counts)
 33   58   3.01      2.32     700   0.088
 41   60   0.59      3.17     700   0.120
 46   67   0.31      2.37     700   0.090
 54   94   5.25      2.37     700   0.090
 55   36   0.32      2.20     700   0.083
 64   41   0.55      2.24     700   0.085
 71   67   0.32      2.27     700   0.086
 76   61   0.30      2.32     700   0.088
 82   36   0.64      2.24     700   0.085
 Number of high stat errors (>= 1%) = 9

 Highish statistical error on the mean, > 0.3% and < 1%
 ix   iy  digimean  sigma  digient  mean error (all in adc counts)
 10   30  12.90      2.29     700   0.086
 31   56  28.42      2.42     700   0.092
 31   57  19.16      2.44     700   0.092
 32   57  27.03      2.44     700   0.092
 33   57  18.51      2.37     700   0.089
 33   60  17.53      2.48     700   0.094
 52   11  26.26      2.30     700   0.087    << seen as low laser and splash response, Duncan, PFG, 28Sep2010, 
 68   49  27.08      2.39     700   0.090
 75   37  13.05      2.33     700   0.088    << seen as low laser and splash response, Duncan, PFG, 28Sep2010, 
 86   70  27.72      2.40     700   0.091
 Number of high(ish) stat errors (0.3 < merror < 1%) = 10

List out bad digi channels in EE+

EE+ data, 2Dec 2011, only 86 events, 800/600
Begin processing the 86th record. Run 152836, Event 86, LumiSection 1 at 25-Jan-2011 11:37:29.248 CET
25-Jan-2011 11:37:29 CET  Closed file file:/afs/cern.ch/user/d/davec/scratch0/ecal_local.00152836.0001.A.storageManager.00.0000.dat.root
In HVAnalyzer::endJob() !!!!!!! number of events = 86
 xmin, xmax, ymin, ymax = 1 100 1 100
 High statistical error on the mean, >= 1%
 ix   iy  digimean  sigma  digient  mean error (all in adc counts)
 16   63   0.94      2.19      86   0.236
 20   63  12.83      1.85      86   0.199  << seen as low laser and splash response, Duncan, PFG, 28Sep2010 
 24   65   0.57      2.58      86   0.279
 33   69   1.08      2.03      86   0.219
 35   72   1.80      2.02      86   0.217   << seen as low laser and splash response, Duncan, PFG, 28Sep2010
 38   19   0.44      2.22      86   0.239
 38   96   0.74      2.48      86   0.268
 39   46  24.03      2.34      86   0.253    << seen as low laser and splash response, Duncan, PFG, 28Sep2010 
 42   75   1.29      2.09      86   0.226
 43   66   8.69      2.26      86   0.243
 49    6   3.43      1.86      86   0.201    << seen as low laser and splash response, Duncan, PFG, 28Sep2010 
 51   25  130.01     73.72      86   7.949  <<???!!!
 52    2  11.53      2.42      86   0.261
 52   27   0.81      2.32      86   0.251
 66   52   0.34      2.31      86   0.250
 80   22   0.09      2.10      86   0.226
 85   48  18.38      2.18      86   0.235    << seen as low laser and splash response, Duncan, PFG, 28Sep2010 
 96   57   0.47      2.65      86   0.286
100   59   0.14      2.65      86   0.286
 Number of high stat errors (> 1%) = 19

jan21-h012-mean-stat-error.png jan21-h012-logy.png

jan21-h011-digiph-sigma.png jan21-h011-logy.png

jan21-h010-ixiy-erroronmean.png jan21-h009-digiph-sigma.png

jan21-h008-jz-1jx49jy87-digiph.png jan21-h008-logy.png

jan21-h007-ixiy-entries.png jan21-h006-ixiy-digiph.png

16.30. talking to Sasha Ledovskoy. Explanations for the 3 extra needed lines in the cfg file. First:

process.source = cms.Source("PoolSource",
    # extra line needed, as found by Sasha Ledovskoy, wrt to his cfg file for ped data in 2009
    duplicateCheckMode = cms.untracked.string('noDuplicateCheck'),
    'file:/afs/cern.ch/user/d/davec/scratc.......................... etc ...................
Local data can only take bursts of 350 events and has no Luminosity tag info! Therefore the same event numbers appear for every new batch of 350 events! A standard LED run has 2x350 events. CMSSW now checks for no duplicate event numbers (ie for safety with massive crab jobs etc). To avoid crashing, have to tell CMSSW not to do the duplicate check!

Concerning the global tag lines:

process.load("Configuration.StandardSequences.FrontierConditions_GlobalTag_cff")
process.GlobalTag.globaltag = 'GR10_P_V4::All'
CMSSW loads up all the calibration constants for making reco hits etc etc, at the start, whether or not they will be used! Therefore need to tell CMSSW what to load/where to get it with these 2 lines.

Ideas for further digi analysis - check width of LED peak vesus ped width, in ADC counts, to see what contribution the LED makes to the width (if any).

jan21-h013-ped-vs-digiph.png jan21-h013-proj-onto-x-peds.png

20 Jan 2011

Now get some plots, run 152849, EE- 600/400. The single channel, ix=49, iy=87 (iz=-1), has 700 events * 10 samples = 7000 entries, as expected.

digi-gains-run152849.png digiph-ix-iy-run152849.png digis-49-87-run152849.png digis-all-ch-run152849.png

Now get ix-iy plot of summed digiph. Do root>TBrowser browser and open the plot. In 'View' click on 'Editor' . Click somewhere in the ix-iy plane. The 'Style' window now gives the histo Name h006::TH2D. Tick the 'Col' box lower down, then the 'Palette' box to get the vertical colour scale on the rhs of the plot.

19 Jan 2011 Feedback from Sasha Ledovskoy concerning cmsRun problems. 3 extra lines needed in cfg file:

1. Add noDuplicateCheck like this

process.source = cms.Source("PoolSource",
     duplicateCheckMode = cms.untracked.string('noDuplicateCheck'),
     fileNames = cms.untracked.vstring(
     'file:/afs/cern.ch/user/d/davec/public/ecal_local.00152849.0001.A.storageManager.00.0000.dat.root'
     )
)

2. Add global tag after process.source and before process.demo like this

process.load("Configuration.StandardSequences.FrontierConditions_GlobalTag_cff")
process.GlobalTag.globaltag = 'GR10_P_V4::All'

Full config file now looks like this:

import FWCore.ParameterSet.Config as cms

process = cms.Process("Demo")

process.load("FWCore.MessageService.MessageLogger_cfi")
process.load("EventFilter.EcalRawToDigiDev.EcalUnpackerMapping_cfi")
process.load("EventFilter.EcalRawToDigiDev.EcalUnpackerData_cfi")
# need to tell programme where to find database details, ie channel mapping
# we forgot these initially
process.load("Geometry.EcalMapping.EcalMapping_cfi")
process.load("Geometry.EcalMapping.EcalMappingRecord_cfi")


process.maxEvents = cms.untracked.PSet( input = cms.untracked.int32(-1) )

process.source = cms.Source("PoolSource",
    # extra line needed, as found by Sasha Ledovskoy, wrt to his cfg file for ped data in 2009
    duplicateCheckMode = cms.untracked.string('noDuplicateCheck'),
    # replace 'myfile.root' with the source file you want to use

#process.source = cms.Source("NewEventStreamFileReader",
    fileNames = cms.untracked.vstring(
#        'file:myfile.root'
# need to define FULL path, with quotes
    'file:/afs/cern.ch/user/d/davec/scratch0/ecal_local.00152849.0001.A.storageManager.00.0000.dat.root'
    )
)

# Sasha's 2nd suggestion: 2. add global tag after process.source and before process.demo like this
process.load("Configuration.StandardSequences.FrontierConditions_GlobalTag_cff")
process.GlobalTag.globaltag = 'GR10_P_V4::All'

process.demo = cms.EDAnalyzer('HVAnalyzer',
                numBins = cms.untracked.int32(131),
                minBin  = cms.untracked.double(0),
                maxBin  = cms.untracked.double(100)
)

process.TFileService = cms.Service("TFileService",
    fileName = cms.string('histo.root')
)

process.p = cms.Path(process.ecalEBunpacker*process.demo)
#process.p = cms.Path(process.demo)
#process.end = cms.Endpath(process.counter)

Can now edit .cc file and access digis etc

However, now a new error (with servers???) :

%MSG-s StdLibException:  19-Jan-2011 15:13:36 CET pre-events
Standard library exception caught in cmsRun
Can not get data (Additional Information: [frontier.c:729]: No more servers/proxies. Last error was: Request 23 on chan 1
failed at Wed Jan 19 15:13:36 2011: -8 [fn-htclient.c:392]: server error (HTTP/1.0 503 Service Unavailable) proxy=cmst0frontier.cern.ch 
server=cmsfrontier4.cern.ch) ( CORAL : "coral::FrontierAccess::Statement::execute" from "CORAL/RelationalPlugins/frontier" )
%MSG

Turns out to be a CMS database problem - system is down. Mail reply from cms.support@cernNOSPAMPLEASE.ch, Lassi Tuura:

 CMSR which hosts CMS offline condition data is currently down. 

See: https://hypernews.cern.ch/HyperNews/CMS/get/cmpAnnounce/466.html

http://it-support-servicestatus.web.cern.ch/it-support-servicestatus/ScheduledInterventionsArchive/110113-CMSofflineDB.htm

This is a consequence of analyses now needing the global tag info (as included in the config file above) which provides the good and missing channel lists.

A further announcement from Stephen Gowdy at 17.04: "There seems to be a problem with Frontier after the upgrade. It is being investigated." which would relate to the FrontierAccess error above.

18.50 Back to business - databases OK - program runs ! Take care looking at ParameterSet items. Need to ensure each variable passed from cfg file is properly specified for type, viz:

numBins = iConfig.getUntrackedParameter<int>("numBins",-1);
minBin = iConfig.getUntrackedParameter<double>("minBin",-1);
maxBin = iConfig.getUntrackedParameter<double>("maxBin",-1);
numBins is integer, minBin and maxBin are double, and omitting the 'getUntrackedParameter' lines means these variables will be filled randomly !!!

18 Jan 2011

Problems running HVscan job. Compiles OK but get error:

>   cmsRun hvanalyzer_cfg.py
> 17-Jan-2011 16:43:31 CET  Initiating request to open file file:/afs/cern.ch/user/d/davec/scratch0/ecal_local.00152849.0001.A.storageManager.00.0000.dat.root
> 17-Jan-2011 16:43:32 CET  Successfully opened file file:/afs/cern.ch/user/d/davec/scratch0/ecal_local.00152849.0001.A.storageManager.00.0000.dat.root
> 17-Jan-2011 16:43:35 CET  Closed file file:/afs/cern.ch/user/d/davec/scratch0/ecal_local.00152849.0001.A.storageManager.00.0000.dat.root
> %MSG-s CMSException:  AfterFile 17-Jan-2011 16:43:35 CET PostBeginRun
> cms::Exception caught in cmsRun
> ---- EventProcessorFailure BEGIN
> EventProcessingStopped
> ---- ScheduleExecutionFailure BEGIN
> ProcessingStopped
> ---- NoRecord BEGIN
> No "EcalChannelStatusRcd" record found in the EventSetup.
>   Please add an ESSource or ESProducer that delivers such a record.
> cms::Exception going through module EcalRawToDigi/ecalEBunpacker run: 152849
> ---- NoRecord END
> Exception going through path p
> ---- ScheduleExecutionFailure END
> an exception occurred during current event processing
> cms::Exception caught in EventProcessor and rethrown
> ---- EventProcessorFailure END
Got 3 files from Jean Fay to try on the raw data root files, a cfg, a cc and a .h file. No time to try them yet. Tried python variable transfer via PSET - no luck yet. Note, Python variables are TRACKED during the job, or UNTRACKED if no tracking needed (ie just a print level command).

Tried to reconstitute my 'public area. Not sufficient to set chmod permissions to

drwxr-xr-x   2 davec zh       2048 Jan 17 16:45 public
Must also reset the ACL afs access with
fs setacl public davec all system:anyuser read

Checked contents of Jean Fay's .dat.root files with edm

Do edm<!TAB> to see full list of possible edm commands.

edmConfDBDiff            edmCopyPickMerge         edmPluginDump
edmConfigBrowser         edmDumpEventContent      edmPluginHelp
edmConfigDump            edmEventSize             edmPluginRefresh
edmConfigEditor          edmFileUtil              edmProvDiff
edmConfigFromDB          edmInventory.sh          edmProvDump
edmConfigHash            edmMakePhDThesis         edmPythonSearch
edmConfigIncludeChecker  edmOneToOneComparison.py edmPythonTree
edmConfigToGraph         edmParameterSetDump      edmStreamerIndex
edmConfigToHTML          edmPickEvents.py         edmToFriendlyClassName
edmConfigTree            edmPluginCoverage        edmWriteConfigs

The files contain the FEDRawDataCollection from the module "source" :

[lxplus315] ~/scratch0 $ edmDumpEventContent ecal_local.00152850.0001.A.storageManager.00.0000.dat.root
Type                     Module             Label     Process
----------------------------------------------------------------
FEDRawDataCollection     "source"           ""        "FU"
edm::TriggerResults      "TriggerResults"   ""        "FU"

14 Jan 2011

Preparing CMS area for analysis. CMSSW_3_9_5 appears to be the most recent in lxr.

ssh lxplus
[ ... enter password ... ]
cd scratch0/
mkdir hvscans
cd hvscans

Create the project area

cmsrel CMSSW_3_9_5
cd CMSSW_3_9_5/src 
cmsenv

From the src directory make my own work area (HV) and create a skeleton module. MUST be done this way otherwise my code will not compile.

mkdir HV
cd HV
mkedanlzr HVAnalyzer         -> Creates the "skeleton" of an EDAnalyzer module
cd HVAnalyzer
scram b  -> compile the code

Output from the 'mkedanlzr HVAnalyzer' command:

 I: using skeleton: /afs/cern.ch/cms/slc5_ia32_gcc434/cms/cmssw/CMSSW_3_9_5/bin/slc5_ia32_gcc434/mkTemplates/EDAnalyzer/ConfFile_cfg.py
  I: authors name is: Dave Cockerill,40 1-B20,+41227671642,, determined by the gcos entry
  I: creating file:  HVAnalyzer/hvanalyzer_cfg.py
  I: using skeleton: /afs/cern.ch/cms/slc5_ia32_gcc434/cms/cmssw/CMSSW_3_9_5/bin/slc5_ia32_gcc434/mkTemplates/EDAnalyzer/BuildFile.temp
  I: authors name is: Dave Cockerill,40 1-B20,+41227671642,, determined by the gcos entry
  I: creating file: HVAnalyzer/BuildFile
  I: using skeleton: /afs/cern.ch/cms/slc5_ia32_gcc434/cms/cmssw/CMSSW_3_9_5/bin/slc5_ia32_gcc434/mkTemplates/EDAnalyzer/edanalyzer.cc
  I: authors name is: Dave Cockerill,40 1-B20,+41227671642,, determined by the gcos entry
  I: creating file: HVAnalyzer/src/HVAnalyzer.cc
  I: using skeleton: /afs/cern.ch/cms/slc5_ia32_gcc434/cms/cmssw/CMSSW_3_9_5/bin/slc5_ia32_gcc434/mkTemplates/EDAnalyzer/CfiFile_cfi.py
  I: authors name is: Dave Cockerill,40 1-B20,+41227671642,, determined by the gcos entry
  I: creating file: HVAnalyzer/python/hvanalyzer_cfi.py

'scram b' to compile the code gives, amongst other things,

@@@@ ----> OK, shared library FULLY-BOUND (no missing symbols): libHVHVAnalyzer.so

Now try to introduce code from Sasha's Pedestal.cc file

~/CMSSW_2_1_19/src/work/Pedestal/src/Pedestal.cc
First, get into trouble with
#include "PhysicsTools/UtilAlgos/interface/TFileService.h"
No longer exists. Try "CommonTools/UtilAlgos/interface/TFileService.h". Now OK. Also must remember to #include the files TH1.h, TH2.h and TF1.h otherwise these root histograms are not defined !

Also, need

#include "FWCore/ServiceRegistry/interface/Service.h"
to deal with lines like:
   edm::Service<TFileService> fs;
   // z = +1
   h001 = fs->make<TH2D>("h001"," ped entries, gain 12, z = +1", 102,-0.5,101.5, 102,-0.5, 101.5 );
otherwise get compile errors such as
error: 'Service' is not a member of 'edm'

Needed #include "Riostream.h" in order to have 'cout' and 'endl' etc defined.

Needed

#include "DataFormats/EcalDigi/interface/EcalDigiCollections.h"  in HVAnalyzer.cc
and 
<use name=DataFormats/EcalDigi>  in BuildFile

in order to get lines:
   string digiProducer_ = "ecalEBunpacker";
   string eeDigiCollection_ = "eeDigis";
   // how sasha gets digis, define pointer ee_digis
   // assume system has Handle<EEDigiCollection already
   edm::Handle<EEDigiCollection>  ee_digis;
   iEvent.getByLabel(digiProducer_,eeDigiCollection_, ee_digis);
   if ( ee_digis->size() == 0 ){
     edm::LogError("My Code: ") << "EE Digis were not found!";
to compile

Code compiles - but get errors on Event 1 - cant find the digi collections. Try adding "process.p = cms.Path(process.ecalEBunpacker*process.demo)" to the config file instead of "process.p = cms.Path(process.demo)" - no luck.

Next - try to check if events have data! Try cmsShow fn.root (Fireworks!) - nothing shows up in the displays.

Try DQM. Go to ECAL DQM page -> ECAL Summary -> enter run number in panel, 152836, EE+, wait for new page, then on rhs click on 'maps' icon for MON_LED1_DAT [HTML] and MON_PEDESTALS_ONLINE_DAT -> see the av value of ~210 on ix/iy and ped rms of ~2 for 7224 entries = number of xtals!!!. Mean ph ~200 ADC counts, mean VPT/PN ~ 0.5 - 1.

In the table below, R means Jean Fay's root file has been made from the .dat file and exists on /castor/cern.ch/user/c/ccecal/rawFromP5/.

Run number HV EE side Events VPT mean ph VPT/PN ped ped rms
R 152836 800/600 + 700 200-700 0.5-1 ~200 ~2
152841   - 700 100-500 ~0.5-1 ~200 ~2
152842   - 700 100-500 ~0.5-1 ~200 ~2
R 152843 600/400 + 700 200-800 ~0.5 ~200 ~2
R 152844 400/200 + 700 100-400 ~0.5 ~200 ~2
152845 600/400 + No DQM data    
152846 800/600 + No DQM data    
R 152847 800/600 - 700 100-400 0.5-1 ~200 ~2
R 152849 600/400 - 700 100-400 0.5-1 ~200 ~2
R 152850 400/200 - 700 50-250 0.5-1 ~200 ~2
R 152851 600/400 - 700 100-400 0.5-1 ~200 ~2

13 Jan 2011

Good news from Jean Fay - he reprocesses all the local DAQ runs and sends the root files to

 /castor/cern.ch/user/c/ccecal/rawFromP5/
with the same name ended by root

To get the full list of jean Fay's root files on CASTOR do:
rfdir /castor/cern.ch/user/c/ccecal/rawFromP5/

eg : the last local run can be found as :
/castor/cern.ch/user/c/ccecal/rawFromP5/ecal_local.00153297.0001.A.storageManager.00.0000.dat.root
These root files can be analyzed with any recent CMSSW version.

Benefits of root files - can be accessed by any CMSSW version, can use the browser to see the subdirectories and leaves etc. However, still need Handle etc for real analysis.

12 Jan 2011

08.55 rfcp run 152843 to scratch0. 09.27 completed = 32mins. 11.45 rfcp run 152844 to scratch0, 12.19 finished = 34mins.

David Petyt -> Pipes the rfdir output into a file, edits using emacs and the 'rect' facility (!!!!!!) to remove columns and the adds back tthe rfcp string to handle many many files.

Create file get-files.exe to copy over multiple files with rfcp, make it executable with chmod.

~/scratch0 $ chmod 744 get-files.exe
[lxplus313] ~/scratch0 $ ./get-files.exe         
Started ~15.30 for 4 files from EE-: 47, 49, 50, 51. At 19.34, all files on scratch0 with same time stamp = 4h. Each of these files is ~80MB, whereas the EE+ files are only ~9.5MB - short of data? Known DAQ problems during data taking.

Next problem - local DAQ takes data with CMSSW 3_3_0. No longer a listed release!

Can search for releases with

 scramv1 list | grep "CMSSW_3_3" 
where the vertical bar (|) is the pipe operator

Installing a CMSSW version on my machine, search for

 apt-cache cmssw
in Google

11 Jan 2011

Search for run 152836. Go to https://cmswbm.web.cern.ch/cmswbm/cmsdb/servlet/RunSummary and enter run number - shows run info. Locate run on CASTOR with rfdir /castor/cern.ch/cms/store/streamer/PrivEcal330/A/000/152/836 (unlike rfcp, can be done from pcralxp4) and drill down to final listing - which gives

rfdir /castor/cern.ch/cms/store/streamer/PrivEcal330/A/000/152/836
-r--r--r--   1 5410     zh                   10186052 Dec 02 17:35 ecal_local.00152836.0001.A.storageManager.00.0000.dat
Logon with an 'ssh lxplus' and copy file to scratch area, at ~16.20, with
rfcp /castor/cern.ch/cms/store/streamer/PrivEcal330/A/000/152/836/ecal_local.00152836.0001.A.storageManager.00.0000.dat /afs/cern.ch/user/d/davec/scratch0/
See comments in ~davec/led.txt about failure to do rfcp from PCRALXP4. The copy of 152836 took from 16.20-20.12 = 4h.

Message from rfcp:

~/scratch0 $ rfcp /castor/cern.ch/cms/store/streamer/PrivEcal330/A/000/152/836/ecal_local.00152836.0001.A.storageManager.00.0000.dat /afs/cern.ch/user/d/davec/scratch0/
10186052 bytes in 0 seconds through eth0 (in) and local (out)
10186052 bytes in remote file

Size of runs, for example on scratch0 already

 -r--r--r--   1 davec zh   113720805 Sep 30  2009 ecal_local.00113994.0001.A.storageManager.00.0000.dat 
which is ~114MB and is ~10x the size of run 152836 which is only ~14MB. According to Martii Pimia's email of 24/09/2009 11:58, I have 2000MB on scratch0 !!!!!!!! Get amount used on scratch0 with fs (use 'man fs' to see what things you can find with fs):
~/scratch0 > fs quota
46% of quota used.

~/scratch0 > fs listquota
Volume Name                    Quota       Used %Used   Partition
s.cms.davec.0                2000000     925097   46%         27%
Quota of 2000000 would appear to be in kB = 2Gb !

Scans taken with LEDs on 2nd Dec 2010

Thurs 02.DEC.10 18:44:31, Alexander LEDOVSKOY , Alexander.Ledovskoy@cern.ch , Tests, EE HV scan
Message ID: 466283     Entry time: Thu December 02 18:44:31 2010
A number of LED_TTCci local runs taken to do EE HV scan

152836  EE+   800/600
152843  EE+   600/400
152844  EE+   400/200
152845  EE+   600/400
152846  EE+   800/600

152847  EE-    800/600
152849  EE-    600/400
152850  EE-    400/200
152851  EE-    600/400
152853  EE-    800/600

7 July 2010

Looking at EE+ HV scans taken by Sasha and Nick Ryder in 2009 using a .dat ascii files from Sasha:

Analysis files: /afs/cern.ch/work/d/davec/HVscans/HVscans-2009/
read-hvscan-b00.C:    
fills xtal array, seemingly set up in hv-class-working.C

indata.open("hv_scan_b00.dat"); //opens file
.......or...........
read-hvscan.C:    
indata.open("hv_scan_b38.dat"); //opens file


Data files /afs/cern.ch/work/d/davec/HVscans/HVscans-2009/HV-scans-12Aug2009
-rw-r--r--. 1 davec zh 4.8M Apr  9  2010 hv_scan_b00-2010.dat
-rw-r--r--. 1 davec zh 2.8M Apr  9  2010 hv_scan_b38-2010.dat

Corresponding analysis files, with scans as a function of radius, are (Nov 2017) at
/afs/cern.ch/work/d/davec/HVscans/HVscans-2009:

/HVscans/HVscans-2009/dynode-scan.C:hpx3->SetTitle("Dynode scan, Va 900V, 3.8T, 30<r<40 ");
./HVscans/HVscans-2009/anode-scan.C:hpx3->SetTitle("Anode scan, Va-Vd = 160 volts, 30<r<40 ");
./HVscans/HVscans-2009/d-new.C:hpx3->SetTitle("Dynode scan, Va = 900 volts, 30<r<40 ");
./HVscans/HVscans-2009/anode-scan-b00.C:hpx3->SetTitle("Anode scan, Va-Vd = 160 volts, 30<r<40 ");
./HVscans/HVscans-2009/dynode-scan-b00.C:hpx3->SetTitle("Dynode scan, Va = 700V, 0.0T, 30<r<40 ");

* 2009-anode-scans-0T.png, EE+: * 2009-anode-scans-3p8.png, EE+ but only half endcap (NOT side with bad SC):
2009-anode-scans-0T.png 2009-anode-scans-3p8.png

* 2009-dynode-scans-0T.png, EE+: * 2009-dynode-scan-3p8.png, EE+ but only half endcap:
2009-dynode-scans-0T.png 2009-dynode-scan-3p8.png

* 2009-ph-map-0T.png, EE+: * 2009-ph-map-3p8.png, EE+ but only half endcap:
2009-ph-map-0T.png 2009-ph-map-3p8.png

* 2009-hit-map-0T.png, EE+: * 2009-hit-map-3p8.png, EE+ but only half endcap:
2009-hit-map-0T.png 2009-hit-map-3p8.png

  • 2009-badsc-hits-0T.png, EE+: * 2009-bad-sc-ratio-0T.png, EE+:
    2009-badsc-hits-0T.png 2009-bad-sc-ratio-0T.png

  • vptbypn-histo.png, EE+: * VPTvradius.png, EE+:
    vptbypn-histo.png VPTvradius.png

Code for HV scan analysis

Versions from 7 Feb 2011, 16.25

-- DavidCockerill - 11-Jan-2011

Topic attachments
I Attachment History Action Size Date Who Comment
PNGpng 2009-anode-scans-0T.png r1 manage 178.6 K 2011-01-23 - 08:31 DavidCockerill  
PNGpng 2009-anode-scans-3p8.png r1 manage 173.4 K 2011-01-23 - 08:34 DavidCockerill  
PNGpng 2009-bad-sc-ratio-0T.png r1 manage 39.2 K 2011-01-23 - 08:32 DavidCockerill  
PNGpng 2009-badsc-hits-0T.png r1 manage 49.1 K 2011-01-23 - 08:37 DavidCockerill  
PNGpng 2009-dynode-scan-3p8.png r1 manage 24.6 K 2011-01-23 - 08:34 DavidCockerill  
PNGpng 2009-dynode-scans-0T.png r1 manage 197.8 K 2011-01-23 - 08:38 DavidCockerill  
PNGpng 2009-dynode-scans-3p8.png r1 manage 228.7 K 2011-01-23 - 08:32 DavidCockerill  
PNGpng 2009-hit-map-0T.png r1 manage 57.8 K 2011-01-23 - 08:35 DavidCockerill  
PNGpng 2009-hit-map-3p8.png r1 manage 35.8 K 2011-01-23 - 08:39 DavidCockerill  
PNGpng 2009-ph-map-0T.png r1 manage 205.4 K 2011-01-23 - 08:33 DavidCockerill  
PNGpng 2009-ph-map-3p8.png r1 manage 161.5 K 2011-01-23 - 08:35 DavidCockerill  
Unknown file formatext BuildFile r1 manage 0.5 K 2011-02-07 - 16:22 DavidCockerill  
PNGpng EEM-digihits-31Jan2011.png r1 manage 12.9 K 2011-02-07 - 12:31 DavidCockerill  
PNGpng EEM-digimeaerror-31Jan2011.png r1 manage 13.1 K 2011-02-07 - 12:31 DavidCockerill  
PNGpng EEM-digiph-31Jan2011.png r1 manage 25.8 K 2011-02-07 - 12:32 DavidCockerill  
PNGpng EEM-digisigma-31Jan2011.png r1 manage 11.6 K 2011-02-07 - 12:31 DavidCockerill  
PNGpng EEM-hvscan-31Jan2011.png r1 manage 17.6 K 2011-02-07 - 15:09 DavidCockerill  
PNGpng EEM-ratio-Va400Va800-31Jan2011.png r2 r1 manage 10.9 K 2011-02-07 - 15:35 DavidCockerill  
PNGpng EEM-ratio-Va600Va800-31Jan2011.png r2 r1 manage 10.5 K 2011-02-07 - 15:39 DavidCockerill  
PNGpng EEP-AnodeScan-31Jan2011.png r1 manage 17.8 K 2011-02-04 - 11:30 DavidCockerill  
PNGpng EEP-Va650-800-31Jan2011.png r1 manage 12.7 K 2011-02-04 - 11:24 DavidCockerill  
PNGpng EEP-Va700-800-31Jan2011.png r1 manage 12.5 K 2011-02-04 - 11:24 DavidCockerill  
PNGpng EEP-Va750-800-31Jan2011.png r1 manage 13.0 K 2011-02-04 - 11:24 DavidCockerill  
PNGpng EEP-bad750-800-ratio-ix-iy.png r1 manage 11.6 K 2011-02-04 - 11:45 DavidCockerill  
PNGpng EEP-digiphentries-800-600-31Jan2011.png r1 manage 11.0 K 2011-02-04 - 15:44 DavidCockerill  
PNGpng EEP-dynode-650-600-31Jan2011.png r1 manage 10.6 K 2011-02-04 - 12:02 DavidCockerill  
PNGpng EEP-dynode-700-600-31Jan2011.png r1 manage 10.7 K 2011-02-04 - 12:02 DavidCockerill  
PNGpng EEP-dynode-750-600-31Jan2011.png r1 manage 10.7 K 2011-02-04 - 12:02 DavidCockerill  
PNGpng EEP-dynode-scan-31Jan2011.png r1 manage 16.8 K 2011-02-04 - 12:03 DavidCockerill  
PNGpng EEP-hvscan-31Jan2011.png r1 manage 18.3 K 2011-02-04 - 15:45 DavidCockerill  
PNGpng EEP-hvscan-badchanneels-31Jan2011.png r1 manage 10.6 K 2011-02-04 - 15:45 DavidCockerill  
PNGpng EEP-meandigiph-800-600-31Jan2011.png r1 manage 21.7 K 2011-02-04 - 15:44 DavidCockerill  
PNGpng EEminus-hvscan-zoom.png r1 manage 17.0 K 2011-01-28 - 15:27 DavidCockerill  
PNGpng EEminus-ixiy-bad-ch.png r1 manage 11.1 K 2011-01-28 - 17:21 DavidCockerill  
PNGpng EEminus-ratios-Va400Va800-2Dec2010.png r1 manage 11.2 K 2011-02-07 - 15:57 DavidCockerill  
PNGpng EEminus-ratios-Va400Va800.png r1 manage 8.1 K 2011-01-28 - 17:18 DavidCockerill  
PNGpng EEminus-ratios-for-600to800-2Dec2010.png r1 manage 11.2 K 2011-02-07 - 15:57 DavidCockerill  
PNGpng EEminus-ratios-for-600to800.png r1 manage 11.9 K 2011-01-28 - 17:26 DavidCockerill  
PNGpng EEplus-hvscan-zoomin.png r1 manage 18.8 K 2011-01-28 - 15:26 DavidCockerill  
PNGpng EEplus-hvscans-zoomout.png r1 manage 15.0 K 2011-01-28 - 15:26 DavidCockerill  
PNGpng EEplus-ixiy-bad-ch.png r1 manage 11.1 K 2011-01-28 - 17:17 DavidCockerill  
PNGpng EEplus-odd-event.png r1 manage 8.4 K 2011-01-28 - 18:19 DavidCockerill  
PNGpng EEplus-ratios-for-400to800.png r1 manage 10.6 K 2011-02-07 - 16:12 DavidCockerill  
PNGpng EEplus-ratios-for-600to800.png r2 r1 manage 11.0 K 2011-02-07 - 15:56 DavidCockerill  
Unknown file formatcc HVAnalyzer.cc r1 manage 23.7 K 2011-02-07 - 16:21 DavidCockerill  
PNGpng VPTvradius.png r1 manage 8.1 K 2011-01-23 - 08:39 DavidCockerill  
PDFpdf anode-scan-3p8.pdf r1 manage 9.4 K 2012-02-01 - 09:36 DavidCockerill an-3p8
C source code filec anode-scan.C r1 manage 6.1 K 2011-02-07 - 16:22 DavidCockerill  
PNGpng digi-gains-run152849.png r2 r1 manage 10.1 K 2011-02-09 - 17:45 DavidCockerill  
PNGpng digiph-all-channels-run152849.png r1 manage 10.2 K 2011-02-09 - 17:38 DavidCockerill  
PNGpng digiph-ix-iy-run152849.png r1 manage 25.0 K 2011-02-09 - 17:51 DavidCockerill  
PNGpng digis-49-87-run152849.png r2 r1 manage 14.1 K 2011-02-09 - 17:52 DavidCockerill  
PNGpng digis-all-ch-run152849.png r2 r1 manage 28.4 K 2011-02-09 - 17:51 DavidCockerill  
PDFpdf dynode-scan-3p8.pdf r1 manage 9.1 K 2012-02-01 - 09:36 DavidCockerill an-dy-3p8
C source code filec dynode-scan.C r1 manage 6.1 K 2011-02-07 - 16:22 DavidCockerill  
Texttxt hvanalyzer_cfg.py.txt r1 manage 3.3 K 2011-02-07 - 16:21 DavidCockerill  
C source code filec hvscans.C r1 manage 6.7 K 2011-02-07 - 16:20 DavidCockerill  
PNGpng jan21-h006-ixiy-digiph.png r1 manage 24.0 K 2011-01-21 - 10:53 DavidCockerill  
PNGpng jan21-h007-ixiy-entries.png r1 manage 10.9 K 2011-01-21 - 10:53 DavidCockerill  
PNGpng jan21-h008-jz-1jx49jy87-digiph.png r1 manage 14.1 K 2011-01-21 - 10:52 DavidCockerill  
PNGpng jan21-h008-logy.png r1 manage 10.9 K 2011-01-21 - 11:12 DavidCockerill  
PNGpng jan21-h009-digiph-sigma.png r1 manage 9.1 K 2011-01-21 - 10:52 DavidCockerill  
PNGpng jan21-h010-ixiy-erroronmean.png r1 manage 10.4 K 2011-01-21 - 10:52 DavidCockerill  
PNGpng jan21-h011-digiph-sigma.png r1 manage 12.6 K 2011-01-21 - 10:51 DavidCockerill  
PNGpng jan21-h011-logy.png r1 manage 10.3 K 2011-01-21 - 11:12 DavidCockerill  
PNGpng jan21-h012-logy.png r1 manage 11.2 K 2011-01-21 - 11:13 DavidCockerill  
PNGpng jan21-h012-mean-stat-error.png r1 manage 12.2 K 2011-01-21 - 10:51 DavidCockerill  
PNGpng jan21-h013-ped-vs-digiph.png r1 manage 18.5 K 2011-01-21 - 18:08 DavidCockerill  
PNGpng jan21-h013-proj-onto-x-peds.png r1 manage 15.6 K 2011-01-21 - 18:08 DavidCockerill  
PNGpng summed-digiph-ix-iy-run152849.png r2 r1 manage 23.8 K 2011-01-20 - 15:08 DavidCockerill  
PNGpng vptbypn-histo.png r1 manage 8.9 K 2011-01-23 - 08:36 DavidCockerill  
Edit | Attach | Watch | Print version | History: r54 < r53 < r52 < r51 < r50 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r54 - 2017-11-03 - DavidCockerill
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback