Difference: DaTa (1 vs. 4)

Revision 42014-01-10 - SilviaAmerio

Line: 1 to 1
 
META TOPICPARENT name="LHCbDataPreservation"

WP1: Data preservation

Line: 32 to 32
 
    • for archived data there is no recovery mechanism in plase, but DST/mDST can be regenerated
To do: which data integrity checks are in place in the Tier1s where LHCb data are stored?

Changed:
<
<

Official Productions of LHCb data

>
>

Official Productions of LHCb data

  The list of the official productions of LHCb data can be found here.

Revision 32014-01-10 - SilviaAmerio

Line: 1 to 1
 
META TOPICPARENT name="LHCbDataPreservation"
Changed:
<
<

Data storage

>
>

WP1: Data preservation

 
Changed:
<
<
LHCb data are stored on tape and disk at Tier0 and Tier1 sites.
>
>
The goal of this work package is the definition of a policy for the long term future preservation of LHCb data (bit preservation).

Tasks

  • WP1.T1: Definition of Run 1 legacy dataset; locations of all datasets and available copies.
  • WP1.T2: For each archival location, check migration and data integrity procedures in place at that site. Definition of recovery procedures in case of file loss/damage.
  • WP1.T3: Definition of tests to regularly check data access (this task is in common with WP2 – software preservation - and WP3 – validation framework)
 
Changed:
<
<
Todo: list of locations, amount of disk/tape
>
>

Deliverables

  • WP1.D1: Webpage collecting all information about Run 1 legacy datasets (locations, recovery procedures,...)
  • WP1.D2: Tests for periodic validation of data access and analysis. Reference results in LHCbPR. (in common with WP2 and WP3)
 
Changed:
<
<

Backup policy

>
>

Info

Locations

LHCb data are stored on tape and disk at Tier0 and Tier1 sites.

Backup policy

 
  • Raw data: 2 copies on tape, one at T0 and one in a Tier1

  • Full.DST: 1 copy on tape, for the most recent reprocessing
  • DST/mDST
    • 4 copies on disk for the latest reprocessing N (3 on T0D1 storage at selected T1s + 1 at T0)
    • 2 copies on disk for the N-1 reprocessing
    • One copy on T1D0 either at T0 or at one T1
Changed:
<
<

Recovery Mechanisms

>
>

Recovery Mechanisms

 
  • Raw data: as there are two copies of raw data in distinct locations, known losses can be recovered; currently there are no systematic checks on tape integrity
  • Full.DST: known losses can be recovered re-running the reconstruction
  • DST/mDST

Revision 22013-10-23 - SilviaAmerio

Line: 1 to 1
 
META TOPICPARENT name="LHCbDataPreservation"
Changed:
<
<

Current backup policy

>
>

Data storage

LHCb data are stored on tape and disk at Tier0 and Tier1 sites.

Todo: list of locations, amount of disk/tape

Backup policy

  • Raw data: 2 copies on tape, one at T0 and one in a Tier1

  • Full.DST: 1 copy on tape, for the most recent reprocessing
  • DST/mDST
    • 4 copies on disk for the latest reprocessing N (3 on T0D1 storage at selected T1s + 1 at T0)
    • 2 copies on disk for the N-1 reprocessing
    • One copy on T1D0 either at T0 or at one T1

Recovery Mechanisms

  • Raw data: as there are two copies of raw data in distinct locations, known losses can be recovered; currently there are no systematic checks on tape integrity
  • Full.DST: known losses can be recovered re-running the reconstruction
  • DST/mDST
    • for live data there is a mechanism to recover a lost disk copy from other disk copies
    • for archived data there is no recovery mechanism in plase, but DST/mDST can be regenerated
To do: which data integrity checks are in place in the Tier1s where LHCb data are stored?
 

Official Productions of LHCb data

Revision 12013-10-23 - SilviaAmerio

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="LHCbDataPreservation"

Current backup policy

Official Productions of LHCb data

The list of the official productions of LHCb data can be found here.

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback