Dream Data Analysis
Run informations
Logbooks
Run numbers
- 2009 : from 0067 to 1543
- 2010 Jun: from 1554 to 2875
- 2010 Oct: from 3048 to 4303
- 2011 Jun: from 4335 to 4693
- 2011 Jul: from 4685 to .... run list file RunList.pdf
Ntuple Structure:
Data Storage
Setup
- The temporary storage h/w is
pcdream:/mnt/working
- A small HD (460 GB) hosted on
pcdream
- The disk is NFS mounted by both
pcdreamdaq
and pcdream
- It is supposed to temporarily host data before backup to
pcdream:/mnt/wd/working_bak
- At the end of each run the
~/bin/backupDataFile
(called by daq
) takes care of copy data and pedestal files to pcdream:/mnt/wd/working_bak
- The actual storage h/w is
pcdream:/mnt/wd/working_bak
- It is a 2 TB extenal disk connected to
pcdream
- The script
~/bin/mirrorRuns
can be used to verify the status of the backup procedure and to backup files which failed the automatic copy procedures (e.g: due to a crash of the daq script)
- The data is manually mirrored (~daily) via globus to a storage element at TTU
- As the disk is getting full, the ntuple files (~600GB already copied at TTU) are manually moved to
pcdream:/mnt/bak2/working_bak/ntuple
- The storage element at TTU
- Used to mirror, via globus, the
pcdream:/mnt/wd/working_bak
disk
- ~Daily TTU mirror procedure:
- Login to
cli.globusonline.org
- Execute:
scp -r -s 0 -v PCDREAM:/mnt/wd/working_bak/ TTU-Sigmorgh-DREAM:/lustre/hep/osg/dream/
- The script
~/bin/ttuls
lists files hosted in the storage element at TTU. E.g.: ~/bin/ttuls data
- How to retrieve data from the storage element at TTU: ... coming soon ...
- Second USB disk:
pcdream:/mnt/bak2/working_bak
- It stores ntuples as the
pcdream:/mnt/wd/working_bak
disk becomes full
Where are the data files?
- In
pcdream:/mnt/wd/working_bak/data
- In a disk at TTU. Use the
~/bin/ttuls data
script to lists them (How to copy ntuple on your PC)
- In case of recent runs, in
pcdream:/mnt/working/data
Where are the pedestal files?
- In
pcdream:/mnt/wd/working_bak/pedestal
- In a disk at TTU. Use the
~/bin/ttuls pedestal
script to lists them (How to copy ntuple on your PC)
- In case of recent runs, in
pcdream:/mnt/working/pedestal
Where are the ntuple files?
- In
pcdream:/mnt/wd/working_bak/ntuple
or pcdream:/mnt/bak2/working_bak/ntuple
- In a disk at TTU. Use the
~/bin/ttuls ntuple
script to lists them (How to copy ntuple on your PC)
- You can find some preliminary ntuples in pcdream:
[pcdream] /home/dreamtest/working/ntuple > DRS 32 channels
[pcdream] /home/dreamtest/working/ntuple/silvia > DRS read with 16 channels
Example macros
A few example macro to analyze the DREAM ntuples.
Useful information to do analysis: