- ZinonasZinonos - 15-Jan-2010


Running Athena at Pisa

How can I run Athena on my pc?

Given that the local host can see the Pisa AFS system /afs/pi.infn.it/, running Athena is quite a straight-forward action.

Setup Atlas login:

cd $HOME/Athena15.6.0
mkdir cmthome 
mkdir testarea
cd cmthome 


Setup a typical requirements file in cmt area:

set CMTSITE STANDALONE
set SITEROOT /afs/cern.ch/atlas/software/releases/15.6.0
macro ATLAS_TEST_AREA ${HOME}/Athena15.6.0/testarea
macro ATLAS_DIST_AREA ${SITEROOT}
apply_tag projectArea
macro SITE_PROJECT_AREA ${SITEROOT}
macro EXTERNAL_PROJECT_AREA ${SITEROOT}
apply_tag opt
apply_tag setup
apply_tag simpleTest
use AtlasLogin AtlasLogin-* $(ATLAS_DIST_AREA)
set CMTCONFIG i686-slc4-gcc34-opt

or in case you prefer to work on lxplus

set CMTSITE STANDALONE
set SITEROOT /afs/cern.ch/atlas/software/releases/15.6.1
macro ATLAS_TEST_AREA ${HOME}/Athena15.6.1/testarea
macro ATLAS_DIST_AREA ${SITEROOT}
apply_tag projectArea
macro SITE_PROJECT_AREA ${SITEROOT}
macro EXTERNAL_PROJECT_AREA ${SITEROOT}
apply_tag opt
apply_tag setup
apply_tag simpleTest
use AtlasLogin AtlasLogin-* $(ATLAS_DIST_AREA)
set CMTCONFIG i686-slc4-gcc34-opt

in case you prefer to work on lxplus and you want to use the iLumiCalc.exe (the version 15.6.4 is recommended ):

#--------------------------------------------------------------------- 
set CMTSITE CERN 
set SITEROOT /afs/cern.ch 
macro ATLAS_DIST_AREA /afs/cern.ch/atlas/software/dist 
macro ATLAS_TEST_AREA ${HOME}/Athena15.6.4/testarea
apply_tag setup 
apply_tag simpleTest 
use AtlasLogin AtlasLogin-* $(ATLAS_DIST_AREA) 
#---------------------------------------------------------------------


Set up CMT:

source /afs/cern.ch/sw/contrib/CMT/v1r20p20090520/mgr/setup.sh 
cmt config


Set up the ATLAS software:

cd $HOME/Athena15.6.0
source cmthome/setup.sh -tag=15.6.0,setup,32
echo $TestArea 
mkdir $TestArea

Every time exercise:

source cmthome/setup.sh -tag=15.6.0,setup,32


To check if your paths have been correctly set:

echo 'Atlas version'
echo $AtlasVersion
echo 'Showing atlas area'
echo $AtlasArea
echo 'Directory for compilation results'
echo $CMTCONFIG
echo 'My path and the Atlas release'
echo $CMTPATH
echo 'My test area'
echo $TestArea

Check out a package:

cd $TestArea
cmt show versions PhysicsAnalysis/AnalysisCommon/UserAnalysis
cmt co -r UserAnalysis-00-13-14 PhysicsAnalysis/AnalysisCommon/UserAnalysis
cd PhysicsAnalysis/AnalysisCommon/UserAnalysis/cmt
source setup.sh
cmt bro gmake
cd ../share
get_files -jo AnalysisSkeleton _topOptions.py

How can I install Athena software in my test area?

Since we are working outside CERN, we need to execute the following commands

  1. access the AFS volume at CERN by doing $klog username@CERNNOSPAMPLEASE.CH and insert your AFS password. Notice that CERN.CH is all capital letters.
  2. get a valid kerberos ticket as follows $ kinit -5 -4 <cern-user>@CERN.CH. To access AFS and get a valid kerberos ticket in one command, you can do $klog.krb username@CERNNOSPAMPLEASE.CH
  3. in a freshly opened shell do: $ export SVNROOT=svn+ssh://<cern-user>@svn.cern.ch/reps/atlasoff
  4. Ready to check out Athena packages, eg. $ cmt show versions Database/CoolRunQuery

Problems with DataBase access?


When running an Athena job away from CERN, the access is not anymore the database servers at CERN but the closest one, the CNAF. In case that we recieve messages similar to the following

PluginManager Info PluginManager loaded
Persistency/Services/XMLAuthenticationService factory from XMLAuthenticationService library
Persistency/Services/XMLAuthenticationService Info Authentication using /afs/cern.ch/atlas/software/releases/15.6.0/DBRelease/7.5.1/XMLConfig/authentication.xml file
Persistency/RelationalPlugins/oracle Error ORA-12560: TNS:protocol adapter error (attaching a server)
Persistency/Services/ConnectionService Warning Failed to connect to service
CNAF (coral::ConnectionException): 'Cannot connect to the server. (
CORAL : "IConnection::connect" from "Persistency/RelationalPlugins/oracle" )'- retry unless timed out
Persistency/Services/ConnectionService Warning Retry (1) after 300 seconds

and evidently the server cannot be reached

Persistency/RelationalPlugins/oracle Error ORA-12543: TNS:destination host unreachable (attaching a server)

It means that something is preventing our local host to access Oracle database at CNAF. Trying the command

$ less /afs/cern.ch/atlas/project/database/DBREL/packaging/DBRelease/current/oracle-admin/tnsnames.ora


from our local host and searching for our host (infn) we may detect the follwing message:

CIC_CNAF =
    (DESCRIPTION=
         (ADDRESS=(PROTOCOL=TCP)(HOST=egee004.cnaf.infn.it)(PORT=1521))
      (CONNECT_DATA=
         (SID=cicfailover)
      )
    )


From that, we can learn that your job can read this file. Thus, the cause of the error

Error ORA-12560: TNS:protocol adapter error (attaching a server) 


is elswhere, eg. firewall at our site. However, we can access the Oracle database at CERN instead. This can be achieved by executing in the working shell set for Athena

export ATLAS_CONDDB='cern.ch'

or

export TNS_ADMIN=/afs/cern.ch/atlas/project/database/DBREL/packaging/DBRelease/current/oracle-admin

the first command line didn't work.

How can I change localy the DB version?

The DB version can be changed by following the instructions decribed below. To download the release X.Y.Z of the database, at /home/username for instance, we do

kinit -5 -4 username@CERN.CH
source /afs/cern.ch/atlas/software/pacman/pacman-latest/setup.sh
pacman  -get http://atlas.web.cern.ch/Atlas/GROUPS/DATABASE/pacman4/DBRelease:DBRelease-X.Y.Z

where X.Y.Z can be 8.2.1. In this way the complete Database directory is downloaded at /home/username/DBRelease. Then in .bashrc we must include

export DBRELEASE_OVERRIDE=X.Y.Z
export ATLAS_DB_AREA=/home/username

How can I use a non-default DBRelease when running realtime Athena?

In order to use another DBRelease, simply add this line to your requirements file

set DBRELEASE_OVERRIDE x.y.z

and in a fresh session retry to setup Athena environment.

How can I change the DBRelease for Ganga?

Look at Changing_the_DB_Release site.

More details can be found here:

  1. How to setup a special dataBase release
  2. Specifying a database release
  3. Atlas Database Release

NAS Disk of ATLAS Pisa

Thanks to the ARTEMIS RTN funds, our group has been recently provided a NAS external ethernet disk Raid-X of capacity up to 12 TB. More details can be found here. Its high storage capability will make our efforts to keep and proccess the first LHC real data much easier with respect to other methods like running on lxplus or on Grid with distributed analysis tools (Pathena-Panda, Ganga).

Selection of Good Luminosity Blocks

The selection of events in good luminosity blocks can be done using the GoodRunListSelectorTool as explained in details at GoodRunsListsTutorial. The selector tool requires as input an xml file containing the list of good lumi blocks for each run. This list can be created from the web interface to the database using the Atlas Trash.AtlasRunQuery tool.

A possible selection rule can be the following:

find run 140541+ and partition ATLAS and db DATA and st physics_MinBias and ptag data09_900GeV and duration 60s+ and events 100+ and mag s and dq til y+ and dq lar y+ and dq atlsol y+ and lhc beamenergy 449-451 and lhc stablebeams true/ show dq til and dq lar and dq pix

The XML files produced by this selection is in attachment (some crosschecks are needed). The obtaining xml file contains 14 runs that satisfy the above DQ criteria set by the query string: 142383, 142195, 142193, 142191, 142190, 142189, 142174, 142171, 142166, 142165, 142154, 142149, 141811, 141749.

Further details about run queries and GRL requirements can be obtained at FirstDataGoodRunsListPisa .

GoodRunsList package and Athena

Installation

The recommended release for the GoodRunsList package is 15.6.4 or greater. First of all, we need to check out the recent packages with the tags:

cmt co -r GoodRunsListsUser-00-00-11 DataQuality/GoodRunsListsUser
cmt co -r GoodRunsLists-00-00-72 DataQuality/GoodRunsLists
cmt co -r LumiBlockComps-00-00-87 LumiBlock/LumiBlockComps
cmt co -r CoolRunQuery-00-01-93 Database/CoolRunQuery


as described at GoodRunsLists page. Afterwards, these packages must be compiled in the following chronological order due to some code dependencies:

  1. Database/CoolRunQuery
  2. DataQuality/GoodRunsLists
  3. LumiBlock/LumiBlockComps
  4. DataQuality/GoodRunsListsUser

Job Options

Now we are ready to run Athena...

A Quick Look at the Job Options

The dumper topOptions file has been simplified into several blocks keeping only a few switches relevant for the users. Hopefully all the different cases can be handled with the following settings.

The job sequence

from AthenaCommon.AlgSequence import AlgSequence, AthSequencer
job = AlgSequence()

Atlas Geometry

The Atlas Geometry and Condition tags can be detected by using the commanddumpVersionTags.py <pool> after setting the Athena environment, e.g.

dumpVersionTags.py /nasatlas1/DESD_COLLCAND/data09_900GeV.00142383.physics_MinBias.merge.DESD_COLLCAND.r988_p62_tid102217_00/DESD_COLLCAND.102217._000001.root.1

Picking up these tags we eventually set up correctly the job option's geometry according to the input pools. For real data and AODs we must set

from AthenaCommon.GlobalFlags import GlobalFlags 
GlobalFlags.DetGeo.set_atlas()    
GlobalFlags.InputFormat.set_pool()
GlobalFlags.DataSource.set_data()  
GlobalFlags.DetDescrVersion = geom_AOD
GlobalFlags.ConditionsTag = cond_AOD

while for real data ESD or dESD we need to configure the geometry as follows

from AthenaCommon.GlobalFlags import globalflags
globalflags.DetGeo.set_Value_and_Lock('atlas')
globalflags.InputFormat.set_Value_and_Lock('pool')
globalflags.DataSource.set_Value_and_Lock('data')
globalflags.DetDescrVersion.set_Value_and_Lock(geom_ESD)
globalflags.ConditionsTag.set_Value_and_Lock(cond_ESD)
include("RecExCond/AllDet_detDescr.py")

For MC data we must change DataSource from 'data' to 'geant4'. Notice also the use of set_Value_and_Lock for the ESD case. This guarantees that the variable set is locked as well, avoid thus Athena to crash. Dumping any data09_900GeV.00xxxxxx.physics_MinBias.merge.DESD_COLLCAND.r988_p62 dataset's version tags we observe at the end of its outputthe following lines

AMITag 'p62'
AtlasRelease 'AtlasTier0-15.5.4.10'
GeoAtlas 'ATLAS-GEO-08-00-02'
IOVDbGlobalTag 'COMCOND-REPPS-001-00'
beam_energy '450000.0'
beam_type 'collisions'

and therefore we must set

geom_ESD = "ATLAS-GEO-08-00-02"
cond_ESD = "COMCOND-REPPS-001-00"

Jet Algorithm

Configuring a jet algorithm is failry an easy procedure in Athena ( Jet Configuration Job Options). The make_StandardJetGetter function returns a getter object. From that one can access the actual jet algorithm instance and modifies its properties.

from CaloRec.CaloRecFlags import jobproperties 
#jobproperties.CaloRecFlags.Enabled.set_Value_and_Lock(True) 
jobproperties.CaloRecFlags.doCaloTopoCluster.set_Value_and_Lock(False) #false if no LAr containers in ESD
#jobproperties.CaloRecFlags.doCaloCluster.set_Value_and_Lock(False) 
#jobproperties.CaloRecFlags.doCaloTopoTower.set_Value_and_Lock(True) 

# This is important for jets rerunning; It completely removes the standard jet configuration.
from JetRec.JetRecFlags import jetFlags
jetFlags.noStandardConfig = True
jetFlags.doBTagging = False
#jetFlags.inputFileType.set_Value("AOD") #for AOD pools

# load the definition of jet helper functions
from JetRec.JetGetters import *

# load the definition of python JetTools
from JetRec.JetRecConf import * 

algo_AntiKt4H1Topo = make_StandardJetGetter( 'AntiKt', 0.4, 'H1Topo').jetAlgorithmHandle()
#algo_AntiKt4H1Topo = make_StandardJetGetter( 'AntiKt', 0.4, 'H1Topo', doEM=True ).jetAlgorithmHandle()
algo_AntiKt4H1Topo.OutputLevel = INFO
JetContainerName = algo_AntiKt4H1Topo.getName()

Now, in order to enable the AtniKt4H1Topo JetFinding Algorithm we configure the line below in the job options file as follows

job.ModSequence1.AOD2ROOT.JetContainer = JetContainerName

This can be confirmed later by the message's output by running Athena

Py:AntiKt4H1TopoGetter::configure : INFO now adding to topSequence
Py:AntiKt4H1TopoGetter::configure : INFO scheduled to output {'JetCollection': 'AntiKt4H1TopoJets'}
Py:Configured::__init__:AntiKt4H1TopoGetter: INFO Configured/Enabled

and that AntiKt4H1TopoJets aglorithm has been succesfully added to the top sequence

AntiKt4H1TopoJe... INFO configuration: select Pt > 7 GeV ... AntiKt4H1TopoJets INFO Successfully retrieved ...
AntiKt4H1TopoJets INFO JetCollectionName...: <AntiKt4H1TopoJets>

In case that the LAr*Containers are actually missing in the ESD pools then we need to disable the jet remaking from raw cells

from CaloRec.CaloRecFlags import jobproperties 
jobproperties.CaloRecFlags.doCaloTopoCluster.set_Value_and_Lock(False)

just before the jet maker algorithms and avoiding thus error messages such as

StoreGateSvc WARNING retrieve(const): No valid proxy for object FREE of type LArDigitContainer(CLID 2711) 
LArRawChannelBu... ERROR Can't retrieve LArDigitContainer with key FREEfrom StoreGate. 
StoreGateSvc WARNING retrieve(const): No valid proxy for object FREE of type LArDigitContainer(CLID 2711) 
LArDigitThinner WARNING Input LArDigitContainer not found with keyFREE 
StoreGateSvc WARNING retrieve(const): No valid proxy for object LArRawChannels of type 
LArRawChannelContainer(CLID 2721)ToolSvc.LArCell... ERROR Can not retrieve LArRawChannelContainer: LArRawChannels
CaloCellMaker ERROR Error executing tool LArCellBuilderFromLArRawChannelTool
StoreGateSvc WARNING retrieve(const): No valid proxy for object TileRawChannelCnt of type TileRawChannelContainer(CLID 2927) 
ToolSvc.TileCel...WARNING Could not find container TileRawChannelCnt ToolSvc.TileCel...WARNING do not fill CaloCellContainer 
AntiKt4H1TopoJe...WARNING No jets in input collection

The GoodRunsList

This job options file sets up the good-run list selector tool (and the luminosity calculation) of the selected sample. The input good run list XML file(s) created by the Trash.AtlasRunQuery tool is/are specified here:

GoodRunsListSelectorTool.GoodRunsListVec = [ '<name>.xml' ]

The actual selection of DQ good lumi blocks is done in the sequence ModSequence1, by the algorithm GRLTriggerAlg1. Here the name of the actual GRL selection, as taken from the xml files, needs to specified:

job.ModSequence1.GRLTriggerAlg1.GoodRunsListArray = ['<name>']

excluding the extension .xml in the list array. Afterwards, we add out own algorithms immediately after the GRLTriggerSelectorAlg

# setup DBReplicaSvc to choose closest DB Oracle replica when running outside of cern:
if UseClosestDB == True:
    from PoolSvc.PoolSvcConf import PoolSvc
    ServiceMgr+=PoolSvc(SortReplicas=True)
    from DBReplicaSvc.DBReplicaSvcConf import DBReplicaSvc
    DBReplicaSvc = DBReplicaSvc(UseCOOLSQLite=False)
    ServiceMgr+=DBReplicaSvc

The UseClosestDB variable must be kept as False if we intend to access the Oracle database at CERN. Below once we configure the GRL selector tool, this is added to the default Athena Top Sequence:

# Configure the goodrunslist selector tool
from GoodRunsLists.GoodRunsListsConf import *
ToolSvc += GoodRunsListSelectorTool()
GoodRunsListSelectorTool.OutputLevel    = DEBUG   
GoodRunsListSelectorTool.GoodRunsListVec = GRL_XML
GoodRunsListSelectorTool.BlackRunsListVec = BRL_XML

#Athena job consists of algorithms that loop over events; here the (default) top sequence is used:
job += AthSequencer("ModSequence1")

## GRL selector
from GoodRunsListsUser.GoodRunsListsUserConf import *

# with sequence 1:
# trigger selector
job.ModSequence1 += GRLTriggerSelectorAlg('GRLTriggerAlg1')
job.ModSequence1.GRLTriggerAlg1.GoodRunsListArray = GRL_TRIG #### NOTE : NO .xml defined here!!!
job.ModSequence1.GRLTriggerAlg1.BlackRunsListArray = BRL_TRIG
if GRL_TRIGGER_use==True:
   job.ModSequence1.GRLTriggerAlg1.TriggerSelection = GRL_TRIGGER

# User analysis steering algorithm
from UserAnalysis.UserAnalysisConf import AOD2ROOT
job.ModSequence1 += AOD2ROOT('AOD2ROOT')

Luminosity Estimate

All the detail for the luminosity estimate for the different runs can be found in:

https://atlas.web.cern.ch/Atlas/GROUPS/DATAPREPARATION/runs.shtml

To summarize:

  • This is nothing more than the accepted L1_MBTS_1_1 trigger rates divided by a number wihch is a rough MC estimate of the accepted cross-section.
  • It is likely an overestimate of 20% due to background contamination from both beam halo and out-of-time bunches.
  • There are also large uncertainties due to the theoretical cross section and the acceptance for the different components of the inelastic cross-section. Do not in any way mistake this for a measurement of the luminosity!
  • A corrected luminosity estimation is in progress and will be available when it is available.
  • This page is intended to be a useful source of immediate information which can be updated automatically.
  • To find more information about a run, click on the run number, which will take you to AtlRunQuery.

The other way to estimate the luminosity of a certain Lumiblick is to use the iLumiCalc.exe (you can find a tutorial in

https://twiki.cern.ch/twiki/bin/view/Atlas/CoolLumiCalcTutorial):

iLumiCalc.exe --lumitag=OflLumi-Dec2009-001 --lumimethod=ATLAS_PREFERRED -x xmlfile.xml -t L1_MBTS_1

Using the file MyLBCollection _900GeVDESD_COLLCAND.xml (in attachment) you can obtain the following result:

--- iLumiCalc           : Trigger(s): L1_MBTS_1,
--- iLumiCalc           : Lumimethod: ATLAS_PREFERRED
--- iLumiCalc           : Lumitag: OflLumi-Dec2009-001
--- iLumiCalc           : Being in XML file mode...
--- iLumiCalc           : Processing file: <XMLfiles/MyLBCollection_900GeVDESD_COLLCAND.xml>
--- iLumiCalc           : --------------------------------------------
--- LumiCalculator      : Luminosity database: COOLOFL_TRIGGER/COMP200
--- LumiCalculator      : Trigger database: COOLONL_TRIGGER/COMP200
--- CoolQuery           : Trying to connect to database COOLOFL_TRIGGER/COMP200...
Data source lookup using /afs/cern.ch/atlas/software/builds/AtlasCore/15.6.4/InstallArea/XML/AtlasAuthentication/dblookup.xml file
--- CoolQuery           : Trying to connect to database COOLONL_TRIGGER/COMP200...
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 141749 LB [1-128]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :                18974         0         0         1         1         1   10374.5    0.00023181
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00023181
--- LumiCalculator      : L1/2/3 accept: 18974     0         0
--- LumiCalculator      : L1BeforePresc: 21654
--- LumiCalculator      : Livetime     : 10374.5
--- LumiCalculator      : Good LBs     : 99
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 141749 1 128 18974 21654 18974
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 141811 LB [110-178]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :                44227         0         0         1         1         1   15974.8    0.00064793
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00064793
--- LumiCalculator      : L1/2/3 accept: 44227     0         0
--- LumiCalculator      : L1BeforePresc: 50340
--- LumiCalculator      : Livetime     : 15974.8
--- LumiCalculator      : Good LBs     : 152
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 141811 110 178 44227 50340 44227
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142149 LB [55-95]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :                48517         0         0         1         1         1   19508.6    0.00068344
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00068344
--- LumiCalculator      : L1/2/3 accept: 48517     0         0
--- LumiCalculator      : L1BeforePresc: 55796
--- LumiCalculator      : Livetime     : 19508.6
--- LumiCalculator      : Good LBs     : 190
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142149 55 95 48517 55796 48517
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142154 LB [12-12]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :                48798         0         0         1         1         1   19593.3    0.00068832
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00068832
--- LumiCalculator      : L1/2/3 accept: 48798     0         0
--- LumiCalculator      : L1BeforePresc: 56099
--- LumiCalculator      : Livetime     : 19593.3
--- LumiCalculator      : Good LBs     : 191
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142154 12 12 48798 56099 48798
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142154 LB [18-44]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :                53528         0         0         1         1         1   21478.6    0.00075345
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00075345
--- LumiCalculator      : L1/2/3 accept: 53528     0         0
--- LumiCalculator      : L1BeforePresc: 61594
--- LumiCalculator      : Livetime     : 21478.6
--- LumiCalculator      : Good LBs     : 210
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142154 18 44 53528 61594 53528
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142165 LB [123-266]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :               150127         0         0         1         1         1   34570.3    0.00225538
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00225538
--- LumiCalculator      : L1/2/3 accept: 150127    0         0
--- LumiCalculator      : L1BeforePresc: 175440
--- LumiCalculator      : Livetime     : 34570.3
--- LumiCalculator      : Good LBs     : 342
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142165 123 266 150127 175440 150127
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142166 LB [1-12]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :               150127         0         0         1        -1        -1   34570.3    0.00225538
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00225538
--- LumiCalculator      : L1/2/3 accept: 150127    0         0
--- LumiCalculator      : L1BeforePresc: 175440
--- LumiCalculator      : Livetime     : 34570.3
--- LumiCalculator      : Good LBs     : 342
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142166 1 12 150127 175440 150127
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142166 LB [29-123]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :               214428         0         0         1         1         1   41703.2    0.00328368
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00328368
--- LumiCalculator      : L1/2/3 accept: 214428    0         0
--- LumiCalculator      : L1BeforePresc: 251261
--- LumiCalculator      : Livetime     : 41703.2
--- LumiCalculator      : Good LBs     : 412
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142166 29 123 214428 251262 214428
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142171 LB [197-229]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :               240478         0         0         1         1         1   44276.6    0.00376952
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00376952
--- LumiCalculator      : L1/2/3 accept: 240478    0         0
--- LumiCalculator      : L1BeforePresc: 279278
--- LumiCalculator      : Livetime     : 44276.6
--- LumiCalculator      : Good LBs     : 432
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142171 197 229 240478 279279 240478
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142174 LB [1-54]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :               258792         0         0         1         1         1   49052.8    0.00404479
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00404479
--- LumiCalculator      : L1/2/3 accept: 258792    0         0
--- LumiCalculator      : L1BeforePresc: 299132
--- LumiCalculator      : Livetime     : 49052.8
--- LumiCalculator      : Good LBs     : 476
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142174 1 54 258792 299133 258792
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142189 LB [131-147]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :               265031         0         0         1         1         1   50032.8    0.00415359
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00415359
--- LumiCalculator      : L1/2/3 accept: 265031    0         0
--- LumiCalculator      : L1BeforePresc: 306447
--- LumiCalculator      : Livetime     : 50032.8
--- LumiCalculator      : Good LBs     : 486
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142189 131 147 265031 306448 265031
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142190 LB [1-12]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :               265763         0         0         1         1         1   50191.5     0.0041658
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.0041658
--- LumiCalculator      : L1/2/3 accept: 265763    0         0
--- LumiCalculator      : L1BeforePresc: 308367
--- LumiCalculator      : Livetime     : 50191.5
--- LumiCalculator      : Good LBs     : 491
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142190 1 12 265763 308368 265763
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142191 LB [1-44]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :               278037         0         0         1         1         1   53856.5    0.00435813
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00435813
--- LumiCalculator      : L1/2/3 accept: 278037    0         0
--- LumiCalculator      : L1BeforePresc: 321285
--- LumiCalculator      : Livetime     : 53856.5
--- LumiCalculator      : Good LBs     : 525
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142191 1 44 278037 321286 278037
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142191 LB [132-247]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :               359142         0         0         1         1         1   66968.8    0.00578479
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00578479
--- LumiCalculator      : L1/2/3 accept: 359142    0         0
--- LumiCalculator      : L1BeforePresc: 403798
--- LumiCalculator      : Livetime     : 66968.8
--- LumiCalculator      : Good LBs     : 637
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142191 132 247 359142 403799 359142
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142193 LB [26-163]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :               488897         0         0         1         1         1   82931.2    0.00815142
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00815142
--- LumiCalculator      : L1/2/3 accept: 488897    0         0
--- LumiCalculator      : L1BeforePresc: 536191
--- LumiCalculator      : Livetime     : 82931.2
--- LumiCalculator      : Good LBs     : 774
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142193 26 163 488897 536192 488897
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142195 LB [1-73]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :               549750         0         0         1         1         1   88321.8    0.00926662
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00926662
--- LumiCalculator      : L1/2/3 accept: 549750    0         0
--- LumiCalculator      : L1BeforePresc: 599470
--- LumiCalculator      : Livetime     : 88321.8
--- LumiCalculator      : Good LBs     : 823
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142195 1 73 549750 599471 549750
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142383 LB [200-211]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :               549750         0         0         1        -1        -1   88321.8    0.00926662
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.00926662
--- LumiCalculator      : L1/2/3 accept: 549750    0         0
--- LumiCalculator      : L1BeforePresc: 599470
--- LumiCalculator      : Livetime     : 88321.8
--- LumiCalculator      : Good LBs     : 823
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142383 200 211 549750 599471 549750
--- LumiCalculator      : Beginning calculation for Trigger L1_MBTS_1, Run 142383 LB [245-294]
--- LumiCalculator      :      LumiB    L1-Acc    L2-Acc    L3-Acc    L1-pre    L2-pre    L3-pre  LiveTime     IntL/nb-1
--- LumiCalculator      :               674581         0         0         1         1         1   92383.8     0.0111477
--- LumiCalculator      : >== Trigger  : L1_MBTS_1
--- LumiCalculator      : IntL (nb^-1) : 0.0111477
--- LumiCalculator      : L1/2/3 accept: 674581    0         0
--- LumiCalculator      : L1BeforePresc: 731420
--- LumiCalculator      : Livetime     : 92383.8
--- LumiCalculator      : Good LBs     : 859
--- LumiCalculator      : Bad LBs     : 0
--- LumiCalculator      : SUMMARY 142383 245 294 674581 731422 674581
--- iLumiCalc           : --------------------------------------------
--- TGoodRunsListWriter : GoodRunsList stored as        : ilumicalc_merged_grl_141749.1-142383.294.xml
--- iLumiCalc           : Real time: 13.1167 s
--- iLumiCalc           : CPU time:   5.45 s

Real Data Analysis at 900GeV without Event Cleaning Cuts

All the details of each run can be found in InterestingRuns2009. The main purpose of our analysis is to check hat we are able to understand the data and the tools required for the analysis. * E-beam: 450 GeV

  • Project tag: data09_900GeV
  • Physics stream: MinBias
  • Pool format: DESD
  • Use DESD_COLLCAND: yes
  • Use GoodRunsList: yes
  • COLLCAND: Since recently we have a DESD for collision candidates called DESD_COLLCAND: this contains all the events that are selected as collision candidates based either on LAr EC or MBTS timing information. A selection based on LAr timing information in the end-cap is therefore used to select collision candidates for studies of collision events. At least 9 cells on each end-cap are required, with less 5 ns time difference (LArRecEvent/LArCollisionTime.h). More details can be found at LArECCTimeCollisionSelection.
  • Configuration tag: r988_p62. For full interpretation go to AMI.
  • Jet configuration: AntiKt4H1Topo
  • XML: attched below as MyLBCollection_900GeVDESD_COLLCAND

Analysis on r988_p62 samples

  • Below you can find the details of the events using the latest egamma GRL here on r988_p62 samples
  • NAS directory: /nasatlas1/AtlasData/data09_900GeV/MinBiasStudies/Ntuples/data09_900GeV.physics_MinBias.merge.DESD_COLLCAND.r988_p62/
  • Jet Algorithm: AntiKt4H1TopoJets

Below is a table with a summary of available statistics obtained after applying the LB filtering using DataQuality flags (the four columns about the Run summary are taken from https://atlas.web.cern.ch/Atlas/GROUPS/DATAPREPARATION/runs.shtml):

Run LBs Events DESD files on grid DESD files on NAS LB selected by GRL DESD events Events accepted by GRL Events from Run Summ. AllData Events from Run Summ. StableBeams Luminosity from Run Summ. AllData (mb-1) Luminosity from Run Summ. StableBeams (mb -1) Jets accepted by Jet Algo Jets accepted by GRL N ≥ 2 jets events
142383 451
(118 s)
566,226
(10.6 Hz)
38 38 200-211, 245-294 134846 80950 132694 84927 3171 2029 2534 1606 185
142195 84
(107 s)
640,590
(70.9 Hz)
23 23 1-73 48531 48531 47702 47702 1140 1140 930 930 97
142193 180
(117 s)
1,972,065
(93.3 Hz)
51 51 26-163 117844 100822 115772 100193 2766 2394 2410 2077 251
142191 247
(116 s)
1,475,463
(51.5 Hz)
32 32 1-44, 132-247 84376 69337 82962 69297 1982 1656 1649 1346 148
142190 12
(95 s)
12,173
(10.7 Hz)
1 1 1-12 540 540 535 535 12 12 11 11 1
142189 147
(119 s)
472,437
(26.9 Hz)
14 14 131-147 33596 4673 32996 5263 788 125 652 102 13
142174 54
(109 s)
423,654
(71.9 Hz)
5 5 1-54 12603 12603 12411 12411 296 296 251 251 31
142171 229
(133 s)
572,013
(18.6 Hz)
23 23 197-229 53659 20716 52733 22056 1260 527 1058 407 43
142166 123
(112 s)
764,348
(55.2 Hz)
28 28 1-12, 29-123 63147 49554 62213 50223 1486 1200 1132 884 101
142165 266
(113 s)
1,927,819
(64.0 Hz)
47 47 123-266 122889 73085 120964 73656 2891 1760 2244 1312 137
142154 44
(97 s)
325,455
(76.2 Hz)
4 4 12, 28-44 5317 3411 5225 3491 124 83 86 56 8
142149 125
(114 s)
414,954
(29.0 Hz)
10 10 55-95 6057 2118 5962 2193 142 52 109 35 5
141811 183
(114 s)
457,953
(21.9 Hz)
9 9 110-178 28763 18868 28280 19042 675 455 568 369 34
141749 133
(116 s)
527,457
(34.1 Hz)
10 10 1-128 11104 11104 10941 10941 261 261 192 192 25
Total

          496312     16994 11990   9578 1079

jets_per_run.png

By using the iLumiCalc.exe, with the trigger L1_MBTS_1_1, we get the following luminosities

RunLB selected by GRLEvents Before PrescaleEvent After Prescale Luminosity (mb-1) Events accepted by GRLEvents accepted by GRL and L1_MBTS_1_1
142383 245 - 294 83823 79667 1892.99 80950 79670
142383 200 - 211 0 0 0 0
142195 1 - 73 49636 47702 1115.15 48531 47702
142193 26 - 163 101088 99055 2367.03 100822 99061
142191 132 - 247 61117 60055 1426.49 69337 60058
142191 1 - 44 8582 8143 192.234 8142
142190 1 - 12 1377 535 12.191 540 534
142189 131 - 147 5376 4601 108.763 4673 4591
142174 1 - 54 13534 12407 275.194 12603 12411
142171 197 - 229 21901 20385 485.744 20716 20383
142166 29 -123 57216 48842 1035.07 49554 48842
142166 1-12 0 0 0 0
142165 123 - 266 84501 71946 1509.52 73085 71948
142154 18 - 44 3603 3147 66.0828 3411 3148
142154 12 -12 215 203 4.96837 203
142149 55 - 95 2735 2094 34.8674 2118 2094
141811 110 -178 20856 18570 421.296 18868 18570
141749 22-128 9736 8878 190.502 11104 8878
Total 525296 486230 11138.092 496312 486235
Total (WO 141749)
515560 477352 10947.59 485208 477357

Real Data Analysis at 900GeV with Event Cleaning Cuts

Good-runs-list: created by AtlRunQuery.py

SVN Version: CoolRunQuery-00-01-92


Query string: find run 140541+ and duration 60s+ and events 100+ and partition ATLAS and db DATA and lhc beamenergy 449-451 and lhc stablebeams true and st physics_MinBias and ptag data09_900GeV and dq ATLGL green LBSUMM#DetStatusLBSUMM-December09-00 and dq L1CTP green LBSUMM#DetStatusLBSUMM-December09-00 and dq atlsol green LBSUMM#DetStatusLBSUMM-December09-00 and dq lar green LBSUMM#DetStatusLBSUMM-December09-00 and dq tile green LBSUMM#DetStatusLBSUMM-December09-00


Run list: 142383,142195,142193,142191,142190,142189,142174,142171,142166,142165,142154,142149,141811,141749

NAS directory: /nasatlas1/AtlasData/data09_900GeV/MinBiasStudies/Ntuples/data09_900GeV.physics_MinBias.merge.DESD_COLLCAND.r988_p62_JetCaloQual/

Jet Algorithm: AntiKt4H1TopoJets

Run summary: with accepted Lumi ranges

Run 142383:
LB range: [ 200- 211]
LB range: [ 245- 294]

Run 142195:
LB range: [ 1- 73]

Run 142193:
LB range: [ 26- 163]

Run 142191:
LB range: [ 1- 44]
LB range: [ 132- 247]
Run 142190:
LB range: [ 1- 12]

Run 142189:
LB range: [ 131- 147]

Run 142174:

LB range: [ 1- 54]

Run 142171:
LB range: [ 197- 229]

Run 142166:
LB range: [ 1- 12]
LB range: [ 29- 123]
Run 142165:
LB range: [ 123- 266]

Run 142154:
LB range: [ 12- 12]
LB range: [ 18- 44]

Run 142149:

LB range: [ 55- 95]

Run 141811:
LB range: [ 110- 178]

Run 141749:
LB range: [ 22- 128]

Stream summary for all selected runs:

Stream name #Events total #Events selected Sel. fraction (%)
physics_MinBias 1,017,131 682,045 67.06
physics_L1Calo 4,561 2,359 51.72
physics_L1CaloEM 930 641 68.92
physics_RNDM 548,625 319,516 58.24
physics_BPTX 8,812,555 6,937,152 78.72

Jet calo quality

JetCaloQuality

MBTS Trigger

The Minimum Bias Trigger Scintillators is divided in three different configurations at Level 1 (L1):

  • MBTS_1: requiring one hit in total
  • MBTS_2: requiring two hits in total
  • MBTS_1_1: requiring a coincidence of at least one hit per side

During commissioning there will be MBTS_1, MBTS_2,.., MBTS_32, MBTS_A, MBTS_C. The MBTS_A and MBTS_C are the multiplicities of A and C sides of the MBTS. For the MBTS_N, N is a number from 1 to 32 are the 32 logic inputs to the CTP. The trigger items defined in logic terms of number of hits in MBTS_A and MBTS_C are:

Trigger - Logic
L1_MBTS_1 MBTS_A(1) OR MBTS_C(1)
L1_MBTS_2 MBTS_A(2) OR MBTS_C(2)
L1_MBTS_1_1 MBTS_A(1) AND MBTS_C(1)

Further details csn be found at MbtsTrigger.

Ntuple Production

Data MinBias: /nasatlas1/AtlasData/data09_900GeV/MinBiasStudies/Ntuples/data09_900GeV.physics_MinBias.merge.DESD_COLLCAND.r988_p62_JetCaloQual/

Pythia MinBias+ddiff+sdiff: /nasatlas1/AtlasSim/mc09/MinBias/Pythia/Ntuples/

  1. mc09_900GeV.105001.pythia_minbias.recon.ESD.e500_s655_s657_d257_r1023_JetCaloQual/
  2. mc09_900GeV.105004.pythia_ddiff.recon.ESD.e466_s655_s657_d257_r1023_JetCaloQual/
  3. mc09_900GeV.105003.pythia_sdiff.recon.ESD.e466_s655_s657_d257_r1023_JetCaloQual/

Real Data Analysis at 900GeV with R=0.6 Jets

GRL: data_minbias_solon_windet_900GeV.xml file obtained by Good Run List Generator found online here. The run query and result are found to be similar to the jetetmiss_windet_900GeV.xml case. Both make use of DetStatusLBSUMM-December09-01.

Jet Algorithm: AntiKt6H1TopoJets

Runs: 142383,142195,142193,142191,142189,142174,142171,142166,142165,142154,142149,141811,141749

Topic attachments
I Attachment History Action Size Date Who Comment
Compressed Zip archivetgz MyLBCollection_900GeV.tgz r1 manage 1.6 K 2010-01-28 - 15:16 UnknownUser MyLBCollection_900GeVDESD_COLLCAND
PNGpng jets_per_run.png r1 manage 11.1 K 2010-02-12 - 12:26 UnknownUser  
Edit | Attach | Watch | Print version | History: r49 < r48 < r47 < r46 < r45 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r49 - 2011-07-27 - unknown
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback