TWiki> DREAM Web>DreamDataAnalysis (revision 3)EditAttachPDF

Dream Data Analysis

Run informations

Logbooks

Run numbers

  • 2009 : from 0067 to 1543
  • 2010 Jun: from 1554 to 2875
  • 2010 Oct: from 3048 to 4303
  • 2011 Jun: from 4335 to 4693
  • 2011 Jul: from 4685 to .... run list file RunList.pdf

Ntuple Structure:

Data Storage

Setup

  • The temporary storage h/w is pcdream:/mnt/working
    • A small HD (460 GB) hosted on pcdream
    • The disk is NFS mounted by both pcdreamdaq and pcdream
    • It is supposed to temporarily host data before backup to pcdream:/mnt/wd/working_bak
    • At the end of each run the ~/bin/backupDataFile (called by daq) takes care of copy data and pedestal files to pcdream:/mnt/wd/working_bak
  • The actual storage h/w is pcdream:/mnt/wd/working_bak
    • It is a 2 TB extenal disk connected to pcdream
    • The script ~/bin/mirrorRuns can be used to verify the status of the backup procedure and to backup files which failed the automatic copy procedures (e.g: due to a crash of the daq script)
    • The data is manually mirrored (~daily) via globus to a storage element at TTU
    • As the disk is getting full, the ntuple files (~600GB already copied at TTU) are manually moved to pcdream:/mnt/bak2/working_bak/ntuple
  • The storage element at TTU
    • Used to mirror, via globus, the pcdream:/mnt/wd/working_bak disk
    • ~Daily TTU mirror procedure:
      • Login to cli.globusonline.org
      • Execute: scp -r -s 0 -v PCDREAM:/mnt/wd/working_bak/ TTU-Sigmorgh-DREAM:/lustre/hep/osg/dream/
    • The script ~/bin/ttuls lists files hosted in the storage element at TTU. E.g.: ~/bin/ttuls data
    • How to retrieve data from the storage element at TTU: ... coming soon ...
  • Second USB disk: pcdream:/mnt/bak2/working_bak
    • It stores ntuples as the pcdream:/mnt/wd/working_bak disk becomes full

Where are the data files?

  1. In pcdream:/mnt/wd/working_bak/data
  2. In a disk at TTU. Use the ~/bin/ttuls data script to lists them (How to copy ntuple on your PC)
  3. In case of recent runs, in pcdream:/mnt/working/data

Where are the pedestal files?

  1. In pcdream:/mnt/wd/working_bak/pedestal
  2. In a disk at TTU. Use the ~/bin/ttuls pedestal script to lists them (How to copy ntuple on your PC)
  3. In case of recent runs, in pcdream:/mnt/working/pedestal

Where are the ntuple files?

  1. In pcdream:/mnt/wd/working_bak/ntuple or pcdream:/mnt/bak2/working_bak/ntuple
  2. In a disk at TTU. Use the ~/bin/ttuls ntuple script to lists them (How to copy ntuple on your PC)
  3. You can find some preliminary ntuples in pcdream:
[pcdream] /home/dreamtest/working/ntuple >              DRS 32 channels
[pcdream] /home/dreamtest/working/ntuple/silvia >     DRS read with 16 channels

Example macros

A few example macro to analyze the DREAM ntuples.

Useful information to do analysis:

Topic attachments
I Attachment History Action Size Date Who Comment
PDFpdf LOG_JULY_2011_1part.pdf r1 manage 14266.0 K 2011-11-04 - 01:05 GabriellaGaudio  
PDFpdf RunList.pdf r1 manage 68.0 K 2011-11-04 - 01:09 GabriellaGaudio  
PDFpdf logbook_July_2011_part2.pdf r1 manage 8656.3 K 2011-11-04 - 01:07 GabriellaGaudio  
Edit | Attach | Watch | Print version | History: r7 | r5 < r4 < r3 < r2 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r3 - 2012-12-12 - MicheleCascella
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    DREAM All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback