Guidelines, Suggestions, and Links for M7 Friends of the Data May 16 2008 The M7 Friends of the Data is an exercise in looking at the M7 cosmics data offline in an organized way, shortly after it's taken. We hope to provide offline monitoring and quick feedback to control room operations. At the same time, we hope to introduce more LAr collaborators to the monitoring plots and other methods of accessing the commissioning data. Some useful links are at the bottom of this document. ###################### *)Background Material: An informal tour of Calo Week web-based monitoring plots can be found at http://pcatdwww.cern.ch/twiki/pub/Main/LArOperationManualShifter/monitoringTour.txt it discusses many of the same plots available for M7. The LAr Operations manual (http://pcatdwww.cern.ch/atlas-point1/lar/doc/AtLarOper.html/index.html) includes sections on the Monitoring and Data Quality (http://pcatdwww.cern.ch/atlas-point1/lar/doc/AtLarOper.html/node43.html) with a focus on what's available in the control room (usually a subset of what we can see offline). Some additional documentation of offline plots is at http://pcatdwww.cern.ch/atlas-point1/lar/doc/AtLarOper.html/node79.html . You may also find interesting the training slides for LAr M7 control room shifters, available at http://pcatdwww.cern.ch/twiki/pub/Main/LArOperationManualShifter/M7_training_14May.pdf ######################## *)Suggestions for a day in the life of a Friend of the Data: The day can cover whatever hours you'd like, wherever in the world you happen to be with e.g. a net connection to lxplus. It can be split up to allow you to attend a meeting or other activity, but I'd appreciate it if you put in something like a day's work. 1)Catch up with recent data taking and analysis news, and make a plan. Check the hypernews and indico for the last Friends of the Data report(s). Check also the elog for recent LAr control room shift reports and other news. With these resources and e.g. run lists decide on interesting runs to look at (last night's overnight run? other recent runs that haven't been looked at, or not sufficiently looked explored? some interesting run that you'd like to explore in a new way?). 2)What to focus on? There are some basic checks we'd like to make for every run. These can usually be accomplished with the web-based DQM plots, perhaps with some reference to the monitoring ROOT files. If there are several Friends on duty together they might each start with a different run, or a different trigger stream in the same run. Or, they can work closely together. If you have additional time or manpower it may also be interesting to look at ntuples or ESD's from the Tier 0 reconstruction, or to reconstruct the raw data yourself. 3)If you haven't already, get in touch with any other Friends of the Data working at the same time as you are. Compare plans so that you can all work effectively. Decide how to stay in touch so you can send questions back and forth, share plots, etc. (Email? Phone? IM?) You may also want to be in touch with the LAr control room shift crew to see if they have plans to look at the data offline, or any important news. 4)Look at the Data! When questions come up, you might first try any other Friends of the Data working at the same time as you are. Next, you might contact the LAr shift crew in the control room - their focus isn't on looking at the data offline, but there's a lot of overlap and they know how to get in touch with experts. If there are still questions, the LAr commissioning hypernews is probably your best chance at a quick and accurate answer. (https://hypernews.cern.ch/HyperNews/Atlas/get/larCommissioning.html) 5)Make some sort of report when you're done When you're done for the day, make some sort of report to share what you've done. I suggest the hypernews, with plots to the indico page. What runs have you looked at? What tools did you use? What did you find? What mysteries remain? What runs or checks did you not get to, that future Friends might look at? Any news to pass along? This could be an individual report, or combined with other Friends working at the same time. 6)Send any suggestions or comments to the operations crew Adam Gibson (adam.gibson@cern.ch) Kathy Copic (kcopic@nevis.columbia.edu) Jessica Leveque (jessica.leveque@cern.ch) ############ *)Basic Checks for Every Run: Some basic checks are important for each trigger type in each run. Some quantities should not depend on trigger type, others may (e.g. the timing of cosmics signals). See http://pcatdwww.cern.ch/twiki/pub/Main/LArOperationManualShifter/monitoringTour.txt for some additional description. 1)Have all expected FEB's been read out for every event? Are there any errors reported by FEBMon? 2)Is there any unexpected behavior in OddCellMon? 3)Detector Monitoring Are the expected LAr cells seen for every event? Are calibrations (conditions) available for all cells? Are there any (unmasked) noisy or otherwise problematic regions or cells? The LAr "Detector Monitoring" plots are useful here, or there are other options. 4)Cosmics Monitoring Are there cosmics visible? The plots of signal shapes provide some convincing evidence - do you see the distinctive LAr pusle shape? For all partitions? At what sample are the cosmics peaking? Is it different for different partitions (Barrel A, C, EMEC A, C, HEC A, C, FCAL A,C)? 5)Cell and Cluster Monitoring can also be interesting ############ *)How to Look at the Data: 1)Data Quality Monitoring Web Page When it's operating correctly, the Tier0 reconstructions raw data shortly after they're recorded. The files are processed one at a time, often separated into streams according to trigger type. At the end of the run, the histograms are merged. png versions of selected histograms are published to the DQM Web Page at https://atlasdqm.web.cern.ch/atlasdqm/ Check http://pcatdwww.cern.ch/twiki/pub/Main/LArOperationManualShifter/monitoringTour.txt for some information on how to navigate these web pages. Another similar page for LAr only is at http://larp3c.web.cern.ch/larp3c/RunList/ this page is updated manually. It contains complimentary information, sometimes with additional useful plots. Both of these web pages include the results of Data Quality (DQ) checks, which are under development. 2)Monitoring ROOT files from the T0 reconstruction It's often helpful to have access to the original ROOT versions of the monitoring files. Then one can zoom in, change the display options, etc. All of the plots from the web are available, along with others. The location of the ROOT files, ntuples, ESD's, and raw data is given at https://twiki.cern.ch/twiki/bin/view/Atlas/LArCosmicMuonAnalysis#M7_14_May_Jun_2008 There is also a set of ROOT macros which may make it easier to browse the ROOT files. See "Offline Monitoring and DQ" in the LAr Ops Manual e.g. http://pcatdwww.cern.ch/atlas-point1/lar/doc/AtLarOper.html/node45.html 3)Ntuples from the T0 reconstruction The Tier0 reconstruction also produces ntuples and ESD's. The ntuples contain LAr cells, clusters, digits for high amplitude cells, information about the trigger, and much more. Some description of variables found in the CBNT ntuples is available at https://twiki.cern.ch/twiki/bin/view/Atlas/CBNTVariableList and https://twiki.cern.ch/twiki/bin/view/Atlas/LevelOneCaloCBNT ESD's are also available. 4)Raw data The raw data is also available if you'd like to reconstruct it yourself. The P1 relase 14.0.10.5 was used at the beginning of M7 along with RecExCommission-00-02-59. RecExCommission_Tier0.py as a top option works fairly well. 14.0.10.6 is expected on May 17 and has some important fixes for the LAr. See https://twiki.cern.ch/twiki/bin/view/Atlas/CosmicCommissioningReconstructionStatus#14_0_10_Y_AtlasPoint1_nightlies for information about P1 releases. ######### Useful Links: Elog https://pcatdwww.cern.ch/elog/ATLAS/ATLAS/ atlas/insider LAr commssioning hypernews https://hypernews.cern.ch/HyperNews/Atlas/get/larCommissioning.html Indico Page for M7 Friends of Data http://indico.cern.ch/conferenceDisplay.py?confId=34066 Run lists Automatically updated with convenient compact format http://isolov.web.cern.ch/isolov/cgi-bin/rn.pl Automatically updated with info about included detectors http://atlas.web.cern.ch/Atlas/GROUPS/DATABASE/runsum/ DQM Web Page with monitoring plots, automatically updated https://atlasdqm.web.cern.ch/atlasdqm/ Alternate LAr version http://larp3c.web.cern.ch/larp3c/RunList/ Where to Find the Data https://twiki.cern.ch/twiki/bin/view/Atlas/LArCosmicMuonAnalysis#M7_14_May_Jun_2008 Trigger info From M6, but may still be substantially correct http://pcatdwww.cern.ch/twiki/bin/view/Main/M6RunSchedule#Trigger_setup LAr Operations Manual Set of links: http://pcatdwww.cern.ch/twiki/bin/view/Main/LArOperationManualShifter HTML manual: http://pcatdwww.cern.ch/atlas-point1/lar/doc/AtLarOper.html/index.html Monitoring and Data Quality http://pcatdwww.cern.ch/atlas-point1/lar/doc/AtLarOper.html/node43.html (link may change) Some additional monitoring description http://pcatdwww.cern.ch/atlas-point1/lar/doc/AtLarOper.html/node82.html Other Monitoring Documentation FEBMon documentation https://twiki.cern.ch/twiki/bin/view/Atlas/DataIntegrityMonitoring OddCells https://twiki.cern.ch/twiki/bin/view/Atlas/NoiseAndPedestalMonitoring#LAr_Odd_Cells_monitoring Cosmics https://twiki.cern.ch/twiki/bin/view/Atlas/NoiseAndPedestalMonitoring#LAr_Cosmics_monitoring Cell and Cluster Monitoring https://twiki.cern.ch/twiki/bin/view/Atlas/CaloMonitoring#Physics_Run_Monitoring_CaloMonit Converting FT/slot/channel to eta/phi http://www.usatlas.bnl.gov/hmscript/LArMap/larMap.cgi works fairly well for the barrel, the endcap's a little more complicated because of various garaged geometries M7 Friends of the Data schedule https://twiki.cern.ch/twiki/pub/Main/AdamGibsonLArM7FriendsOfData/M7__Friends_of_Data.pdf M7 LAr Control Room Shift List http://kcopic.web.cern.ch/kcopic/operations/M7_shifts.pdf Control Room Contact Info LAr Desk x71346 LAr Run Coordinator x16 2582