Data taking periods and GRLs

The list of runs for specific period could be retrieved by using the following command in run-query:

f r data10_7TeV.periodA / sh all

Integral luminosities (Lumi w/o prescale) mentioned below were calculated with the following command:

iLumiCalc.exe -t [TRIGGER_NAME] -x [GRL_NAME] --lumitag=OflLumi-7TeV-002

Period Runs Rec. IL (nb^-1) EM Trigger Calc. IL (nb^-1) MU Trigger Calc. IL (nb^-1) GRL
A 152166-153200 0.4 L1_EM14 0.231 L1_MU10 0.327 download
B 153565-155160 9 L1_EM14 7.978 L1_MU10 7.967 download
C 155228-156682 9.5 L1_EM14 8.441 L1_MU10 8.427 download
D 158045-159224 320 L1_EM14 274.4 L1_MU10 274.4 download
E1 160387-160479 144 L1_EM14 138.9 L1_MU10 138.9 download
E2 160530 96 L1_EM14 88.1 L1_MU10 88.1 download
E3 160613-160879 272 L1_EM14 201.1 L1_MU10 201.2 download
E4 160899-160980 133 L1_EM14 65.8 EF_mu10_MSonly 65.8 download
E5 161118-161379 138 L1_EM14 129.7 EF_mu10_MSonly 129.7 download
E6 161407-161520 160 L1_EM14 153.9 EF_mu10_MSonly 153.9 download
E7 161562-161948 175 L1_EM14 159.8 EF_mu10_MSonly 159.8 download
E 937.3 937.4 download
F1 162347-162577 580 EF_e20_loose 506.6 EF_mu10_MSonly 506.6 download
F2 162620-162882 1400 EF_e20_loose 1204.9 EF_mu10_MSonly 1204.9 download
F 1711.5 1711.5 download
G1 165591, 165632 780 EF_e20_loose 681.9 EF_mu10_MSonly 682.0 download
G2 165703, 165732 1190 EF_e20_loose 975.7 EF_mu10_MSonly 975.8 download
G3 165767-165815 1300 EF_e20_loose 1041.1 EF_mu10_MSonly 1041.2 download
G4 165817-165818 300 EF_e20_loose 217.9 EF_mu10_MSonly 218.0 download
G5 165821-166143 1900 EF_e20_loose 1587.9 EF_mu15 1588.1 download
G6 166198-166383 3600 EF_e20_loose 1154.3 EF_mu15 1154.2 download
G 5658.8 5659.3 download
H1 166466-166850 6500 EF_e20_loose 4876.2 EF_mu15 4877.2 download
H2 166856-166964 2800 EF_e20_loose 2179.3 EF_mu15 2179.6 download
H 7055.5 7056.8 download
I1 167575-167680 14500 EF_e20_loose 13279.2 EF_mu15 13281.4 download
I2 167776-167844 8500 EF_e20_loose 5717.9 EF_mu15 5718.1 download
I 18997.1 18999.5 download
               
A-I 34651.3 34655.6 download

More information on data taking periods is available here: Data Periods

GRLs could be merged by using the following command:

merge_goodrunslists GRL/ grl_merged.xml

Triggers are close to those recommended by Egamma and Muon experts:

TrigEgammaRecommendedTriggers

MuonTriggerPhysicsTriggerRecommendations

Quality requirements in GRL

ptag data10_7TeV - project tag

db DATA - type of data is real data

partition ATLAS - DAQ partition name

lhc beamenergy 3400-3600 - requirement on beam energy of 3.50 +/- 0.10 TeV

lhc stablebeams T - stable beams requirement

ready 1 - ready for physics flag

dq GLOBAL_STATUS g - ATLGL+L1CTP

dq CP_TRACKING g - IDGL + IDAL + IDVX + PIXB + PIXEA + PIXEC + SCTB + SCTEA + SCTEC + TRTB + TRTEA + TRTEC

dq CP_EG_ELECTRON_BARREL g - ATLSOL + PIX0 + PIXB + SCTB + SCTEA + SCTEC + TRTB + TRTEA + TRTEC + IDAL + EMBA + EMBC + TILBA + TILBC + TIEBA + TIEBC + EIDB

dq CP_EG_ELECTRON_ENDCAP g - ATLSOL + PIX0 + PIXB + PIXEA + PIXEC + SCTB + SCTEA + SCTEC + TRTEA + TRTEC + IDAL + EMECA + EMECC + TILBA + TILBC + TIEBA + TIEBC + HECA + HECC + EIDE

dq CP_MU_MSTACO g - MSTACO + GLOBAL_ALL_ID_GL_AL + GLOBAL_PERIODSPECIFIC_MS + GLOBAL_ALL_MAG

dq CP_MU_MMUIDCB g - MMUIDCB + GLOBAL_ALL_ID_GL_AL + GLOBAL_PERIODSPECIFIC_MS + GLOBAL_ALL_MAG

dq CP_JET_JETB g - JETB + EMBA + EMBC + TILBA + TILBC + TIEBA + TIEBC

dq CP_JET_JETEA g - JETEA + EMECA + HECA

dq CP_JET_JETEC g - JETEC + EMECC + HECC

dq CP_MET_METCALO g - METCALO + EMBA + EMBC + TILBA + TILBC + TIEBA + TIEBC + EMECA + HECA + EMECC + HECC + FCALA + FCALC

dq CP_MET_METMUON g - METMUON + GLOBAL_PERIODSPECIFIC_MS

dq IDBS g - full beam spot determination requirement

dq LUMI g - luminosity measurement is done

dq L1CAL g - L1 Calo trigger is operating normally

dq L1MUE g - L1 Muon Endcap trigger is operating normally

dq L1MUB g - L1 Muon Barrel trigger is operating normally

dq TRELE g - HLT electron trigger is operating normally

dq TRMUO g - HLT muon trigger is operating normally

mag s > 6900 - solenoid is ON and the magnetic field is close to the nominal value

mag t > 18000 - toroid is ON and the magnetic field is close to the nominal value

Use GRL in Athena

Take one of the GRL listed above and add the following lines to your jobOptions file:

from LumiBlockComps.LumiBlockCompsConf import LumiBlockMetaDataTool                                                      
ToolSvc += LumiBlockMetaDataTool( "LumiBlockMetaDataTool" )                                                              
LumiBlockMetaDataTool.calcLumi = True                                                                                    
LumiBlockMetaDataTool.storeXMLFiles = True                                                                               
LumiBlockMetaDataTool.applyDQCuts = True                                                                                 
LumiBlockMetaDataTool.OutputLevel = ERROR                                                                                
                                                                                                                             
from EventSelectorAthenaPool.EventSelectorAthenaPoolConf import MetaDataSvc                                              
svcMgr += MetaDataSvc( "MetaDataSvc" )                                                                                   
svcMgr.MetaDataSvc.MetaDataTools += [ ToolSvc.LumiBlockMetaDataTool ]                                                    
                                                                                                                             
from GoodRunsLists.GoodRunsListsConf import *                                                                            
ToolSvc += GoodRunsListSelectorTool()                                                                                    
GoodRunsListSelectorTool.OutputLevel    = ERROR                                                                          
GoodRunsListSelectorTool.GoodRunsListVec = [ 'MyLBCollection_7TeV_152166_155697.xml' ]                                   
GoodRunsListSelectorTool.PassThrough = False                                                                             
                                                                                                                             
from GoodRunsListsUser.GoodRunsListsUserConf import *                                                                    
seq += GRLTriggerSelectorAlg('GRLTriggerAlg1')                                                                           
seq.GRLTriggerAlg1.GoodRunsListArray = ['MyLBCollection_7TeV_152166_155697']                                             
                                                                                                                             
topSequence += DummyDumperAlg('DummyDumperAlg1')                                                                         
topSequence.DummyDumperAlg1.RootFileName = 'selection1.root'                                                             
topSequence.DummyDumperAlg1.GRLNameVec = [ 'LumiBlocks_GoodDQ0', 'IncompleteLumiBlocks_GoodDQ0' ]

The example above uses MyLBCollection_7TeV_152166_155697.xml as in input, please notice the second instance of xml file name without .xml.

Make sure to use the latest version of LumiBlockComps if you are going to calculate luminosity afterward by using iLumiCalc tool. At the moment of this note creation the latest version was LumiBlockComps-00-01-08.

More information on how to use GRLs in Athena is available here.

Use GRL in ROOT

Information on how to use GRLs in ROOT is available here.

Access to COOL database

List of database connection names could be found in dblookup.xml file, you can get the path to it by checking CORAL_DBLOOKUP_PATH environmental variable, should be something like this:

/afs/cern.ch/atlas/software/builds/AtlasCore/15.6.9/InstallArea/XML/AtlasAuthentication

For example, you can find COOLOFL_GLOBAL database connection defined there that we need to connect to in order to get the information about offline DQ flags. To list what DQ flags were set to for specific run you can try using detStatus_query.py CoolDetStatus utility:

detStatus_query.py --r=153565 --folder=/GLOBAL/DETSTATUS/SHIFTOFL COOLOFL_GLOBAL/COMP200 HEAD ALL

In the example above we connect to SHIFTOFL database and retrieve DQ flags for ALL detectors using the HEAD tag which means that we are looking at the most recent update of the following entry in database.

An example of how to list available tags for SHIFTOFL folder using AtlCoolConsole:

[kskovpen@lxplus301]~/work/testarea/15.6.9.8/PhysicsAnalysis/AnalysisCommon/UserAnalysis/cmt% AtlCoolConsole.py "COOLOFL_GLOBAL/COMP200"
Data source lookup using /afs/cern.ch/atlas/software/builds/AtlasCore/15.6.9/InstallArea/XML/AtlasAuthentication/dblookup.xml file
Connected to 'COOLOFL_GLOBAL/COMP200'
Welcome to AtlCoolConsole. Type 'help' for instructions.
>>> ls
  Name              Description     
  /GLOBAL                           
  Name              Description       Count     Size        
>>> cd GLOBAL
>>> ls
  Name              Description     
  /GLOBAL/BTagCalib                  
  /GLOBAL/DETSTATUS                  
  /GLOBAL/DQM                       
  /GLOBAL/FILECOUNT                  
  /GLOBAL/HeavyIon                  
  /GLOBAL/InsituPerf                  
  Name              Description       Count     Size        
>>> cd DETSTATUS
>>> ls
  Name              Description     
  Name              Description       Count     Size        
  /GLOBAL/DETSTATUS/ASBUILT  <timeStamp>run-lumi</timeStamp><addrHeader><address_header service_type="71" clid="1238547719" /></addrHeader><typeName>CondAttrListCollection</typeName><named/>  -         -           
  /GLOBAL/DETSTATUS/DCSOFL  <timeStamp>run-lumi</timeStamp><addrHeader><address_header service_type="71" clid="1238547719" /></addrHeader><typeName>CondAttrListCollection</typeName><named/>  -         -           
  /GLOBAL/DETSTATUS/DQCALCOFL  <timeStamp>run-lumi</timeStamp><addrHeader><address_header service_type="71" clid="1238547719" /></addrHeader><typeName>CondAttrListCollection</typeName><named/>  -         -           
  /GLOBAL/DETSTATUS/DQMFOFL  <timeStamp>run-lumi</timeStamp><addrHeader><address_header service_type="71" clid="1238547719" /></addrHeader><typeName>CondAttrListCollection</typeName><named/>  -         -           
  /GLOBAL/DETSTATUS/DQMFOFLH  <timeStamp>run-lumi</timeStamp><addrHeader><address_header service_type="71" clid="1238547719" /></addrHeader><typeName>CondAttrListCollection</typeName><named/>  -         -           
  /GLOBAL/DETSTATUS/LBSUMM  <timeStamp>run-lumi</timeStamp><addrHeader><address_header service_type="71" clid="1238547719" /></addrHeader><typeName>CondAttrListCollection</typeName><named/>  -         -           
  /GLOBAL/DETSTATUS/MUONCALIB  <timeStamp>time</timeStamp><addrHeader><address_header service_type="71" clid="1238547719" /></addrHeader><typeName>CondAttrListCollection</typeName><named/>  -         -           
  /GLOBAL/DETSTATUS/SHIFTOFL  <timeStamp>run-lumi</timeStamp><addrHeader><address_header service_type="71" clid="1238547719" /></addrHeader><typeName>CondAttrListCollection</typeName><named/>  -         -           
  /GLOBAL/DETSTATUS/TISUMM  <timeStamp>time</timeStamp><addrHeader><address_header service_type="71" clid="1238547719" /></addrHeader><typeName>CondAttrListCollection</typeName><named/>  -         -           
  /GLOBAL/DETSTATUS/VIRTUALFLAGS  <timeStamp>run-lumi</timeStamp><addrHeader><address_header service_type="71" clid="1238547719" /></addrHeader><typeName>CondAttrListCollection</typeName>  -         -           
>>> listtags SHIFTOFL
Listing tags for folder /GLOBAL/DETSTATUS/SHIFTOFL
DetStatusSHIFTOFL-900GeV_firstcoll-t0 (unlocked) [DQ status for first 900 GeV collisions, T0 processing]
DetStatusSHIFTOFL-April10-00 (locked) [April 2010 reprocessing (OBSOLETE)]
DetStatusSHIFTOFL-April10-01 (locked) [April 2010 reprocessing (OBSOLETE)]
DetStatusSHIFTOFL-April10-02 (locked) [April 2010 reprocessing]
DetStatusSHIFTOFL-December09-00 (locked) [December 2009 reprocessing (OBSOLETE)]
DetStatusSHIFTOFL-December09-01 (locked) [December 2009 reprocessing]
DetStatusSHIFTOFL-February10-00 (locked) [February 2010 reprocessing]
DetStatusSHIFTOFL-pass1 (partially locked) [Status of Tier-0 output files]
DetStatusSHIFTOFL-pass1-analysis-2010B (locked) [Status of Tier-0 output files, 2010 period B: tag for analysis]
DetStatusSHIFTOFL-pass1-analysis-2010B-01 (locked) []
DetStatusSHIFTOFL-pass1-analysis-2010C (unlocked) []
DetStatusSHIFTOFL-repro04-00 (locked) [Reprocessing 4 (May 2010) (OBSOLETE)]
DetStatusSHIFTOFL-repro04-01 (unlocked) [Reprocessing 4 (May 2010)]
>>> usetag DetStatusSHIFTOFL-repro04-01
Changed current tag selection to DetStatusSHIFTOFL-repro04-01
>>> more SHIFTOFL
...
[155073,0] - [155073,4294967295] (482) [Code (Int32) : 3], [deadFrac (Float) : 0], [Thrust (Float) : 0], [Comment (String255) : hans: ]
[155112,0] - [155112,4294967295] (482) [Code (Int32) : 3], [deadFrac (Float) : 0], [Thrust (Float) : 0], [Comment (String255) : hans: ]
[155116,0] - [155116,4294967295] (482) [Code (Int32) : 3], [deadFrac (Float) : 0], [Thrust (Float) : 0], [Comment (String255) : hans: ]
[155118,0] - [155118,4294967295] (482) [Code (Int32) : 3], [deadFrac (Float) : 0], [Thrust (Float) : 0], [Comment (String255) : hans: ]
[155160,0] - [155160,4294967295] (482) [Code (Int32) : 3], [deadFrac (Float) : 0], [Thrust (Float) : 0], [Comment (String255) : hans: ]
[141748,0] - [141748,4294967295] (501) [Code (Int32) : 0], [deadFrac (Float) : 0], [Thrust (Float) : 0], [Comment (String255) : gybeless: Not enough stats]
[141749,0] - [141749,4294967295] (501) [Code (Int32) : 0], [deadFrac (Float) : 0], [Thrust (Float) : 0], [Comment (String255) : O.A.: Very few stats (nobody on shift today ?)]
[141811,0] - [141811,4294967295] (501) [Code (Int32) : 0], [deadFrac (Float) : 0], [Thrust (Float) : 0], [Comment (String255) : gybeless: Not enough stats]
[141994,0] - [141994,4294967295] (501) [Code (Int32) : 0], [deadFrac (Float) : 0], [Thrust (Float) : 0], [Comment (String255) : O.A.: Very few stats]
[141999,0] - [141999,4294967295] (501) [Code (Int32) : 0], [deadFrac (Float) : 0], [Thrust (Float) : 0], [Comment (String255) : O.A.: Very few stats]
...

LBSUMM folder of COOL database contains all the DQ information for data indexed by run/LB and is recommended to use in offline analysis being the final product for the data quality status. TISUMM contains the same information indexed by absolute timestamp.

The list of DQ flags and the meaning of it for each subdetector could be found here:

https://twiki.cern.ch/twiki/bin/view/Atlas/DQFlagInterpretation

Using iLumiCalc

To calculate integrated luminosity with xml files one can use iLumiCalc tool. The example of the calculation using online values:

iLumiCalc.exe -t L1_MBTS_1 -x GRL_152166_153200_lbsumm_repro04_01_periodA.xml --online

For offline integrated luminosity calculation which is recommended for physics analysis one should specify the corresponding tag of the offline folder:

iLumiCalc.exe -t L1_MBTS_1 -x GRL_152166_153200_lbsumm_repro04_01_periodA.xml --lumitag=OflLumi-7TeV-002

An additional information about the offline tags could be found here.

-- KirillSkovpen - 07-Jun-2010

Edit | Attach | Watch | Print version | History: r23 < r22 < r21 < r20 < r19 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r23 - 2010-11-04 - KirillSkovpen
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Sandbox All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback