WLCG Archival Storage Group

Description

The group has been formed to tackle two main themes

• establish a knowledge-sharing community for those operating archival storage for WLCG
• understand how to monitor usage of archival systems and optimise their exploitation by experiments

Main point of contact for all involved parties is wlcg-data-archival-storage@cernNOSPAMPLEASE.ch mailing list.

For low level tape technology related discussion there is also hep-tape-experts@cernNOSPAMPLEASE.ch mailing list.

Documents

• Tape Metrics
• Archival Site Survey

Meetings

When	Where	Description	Participants	Agenda
18th Jan 2019	CERN	6th Meeting		https://indico.cern.ch/event/790246/
27th Sep 2018	CERN	5th Meeting		https://indico.cern.ch/event/756338/
5th July 2018	CERN	4th Meeting		https://indico.cern.ch/event/739586/
7th May 2018	CERN	3rd Meeting		https://indico.cern.ch/event/724729/
16th April 2018	CERN	2nd Meeting		https://indico.cern.ch/event/722405/
21st Nov 2017	CERN	WLCG Archival Storage Group 1st Meeting		https://indico.cern.ch/event/681096/
28-29 June 2010	SARA, Amsterdam	T1T2Tape First Workshop	ASGC, CC IN2P3, CERN, DESY, FNAL (evo), KIT, NDGF, RAL, SARA	Indico key: t012

Sites configuration overview

Please include only equipment used for HEP data.

Site	Libraries	Total HEP Slots	Drives	Total HEP media capacity	Software	Contact	Valid as of
CH - CERN	3 x IBM TS4500	55000	20 x LTO-8, 10 x TS1160, 46 x TS1155	350+ PB	CASTOR	tape-operations@cernNOSPAMPLEASE.ch	Feb 2020
CA - Triumf	1xTS3500, 1xTS4500	7000	6xLTO5, 18xLTO6, 8xLTO7	18 PB	Tapeguy	simonliuxl@triumfNOSPAMPLEASE.ca	Nov 2017
DE - KIT-GridKa	1xSL8500	10000	27xT10000D	78 PB	IBM Spectrum Protect	dataprotection@listsNOSPAMPLEASE.kit.edu	Nov 2017
ES - PIC	1xSL8500 1xIBM TS4500	6300	4xLTO5, 8xT10000C, 5xT10000D, 6xLTO8	29 PB	Enstore	storage@picNOSPAMPLEASE.es	Feb 2020
FR - CCIN2P3	4xSL8500 , 1xTFinity	40000 , 3200	56xT10000D , 12xTS1160	79 PB	HPSS	hpssmaster@ccNOSPAMPLEASE.in2p3.fr	Feb 2020
GB - STFC-RAL	2xSL8500, 1xTFinity	10000, 6500	21xT10000D, 20xTS1160	60 PB	CASTOR	tim.folkes@stfcNOSPAMPLEASE.ac.uk	Feb 2020
IT - INFN-CNAF	1xSL8500, 1xTS4500	14700	16xT10000D, 19xTS1160	74 PB	IBM Spectrum Protect	storage@listsNOSPAMPLEASE.cnaf.infn.it	Feb 2020
KR - GSDC-KISTI	1xTS3500	800	8xTS1140	3.5 PB	IBM Spectrum Protect + IBM Spectrum Scale	sahn@kistiNOSPAMPLEASE.re.kr	Nov 2017
NL - NIKHEF-SARA	2xSL8500	20000	10xT10000D, 18xLTO-8	18PB	DMF	fes-tg@surfsaraNOSPAMPLEASE.nl ds-tg@surfsaraNOSPAMPLEASE.nl	Mar 2020
RU - NRC-KI	1xTS3500	2642	9xTS1140	7 PB	Enstore	gridops@gridNOSPAMPLEASE.kiae.ru	Nov 2017
RU - JINR	1xTS3500	3240	11xLTO6	8 PB	Enstore	Владимир Трофимов (tvv@jinrNOSPAMPLEASE.ru)	Nov 2017
Scandinavia - NDGF	?xTS3500	?	LTO, TS11XX	9 PB	IBM Spectrum Protect + ENDIT	support@ndgfNOSPAMPLEASE.org	Nov 2017
TW - ASGC (no tape)	TS3500	?	LTO4	?	CASTOR	?	Jul 2010
US - BNL	4xSL8500	36000	LTO3, LTO4, LTO6, LTO7	44 PB	HPSS	Shigeki Misawa misawa@bnlNOSPAMPLEASE.gov	Oct 2017
US - FNAL	5xSL8500, 2xTS4500	67000	92xLTO8, 61xT10000C, 23xT10000D, 18xLTO4	150+ PB	Enstore	oleynik@fnalNOSPAMPLEASE.gov	Nov 2018

Useful information

• Tape Metrics - obsolete (as defined in 2011)
• GPFS and TSM experience
• T10000 drive tests

Join the group

Anyone with an interest in the topic is encouraged to join the group:

https://e-groups.cern.ch/e-groups/EgroupsSubscription.do?egroupName=wlcg-data-archival-storage

To Do

• Definition of a HEP Tape Archive
• Define data loss policy
• Define common error handling policy
• Enviromental conditions for rooms with tape equipment
• Define Tape Metrics
• Small file handling

HEPTape Web Utilities