Prototype of National Federated Storage

Introduction

R&D project to develop, prototype and implement a federated data storage system between Russian WLCG sites and University clusters and to demonstrate how data reconstruction and analysis payloads (for at least two LHC experiments ATLAS and ALICE) and for bioinformatics applications (genome sequencer group of NRC-KI) running on WLCG facilities, on super-computers and Academic cloud can access federated data. This project intends to implement a federated distributed storage for all kind of operations such as read/write/transfer(3rd party)-RWT, and access via WAN from heterogeneous computing resources, such as Grid centers, University clusters, academic and commercial clouds and supercomputers.

Participating Labs and Universities

• National Research Center "Kurchatov Institute" (NRC-KI)
• Saint-Petersburg State University (SPbSU)
• Petersburg Nuclear Physics Institute (PNPI)
• Skobeltsyn Institute of Nuclear Physics (SINP MSU)
• Joint Institute of Nuclear Research (JINR)
• Institute for Theoreticla and Experimental Physics (ITEP)
• Moscow Engineering Physics Institute (MEPHI)
• CERN

Table of readiness

Table of readiness_old

Technologies to be evaluated

• EOS
  • EOS Installation and configuration documentation
    • UI
    • MGM
    • FST
• dCache
  • dCahe Installation and configuration documentation

Computing Facilities

• Grid centers
• University clusters
• Academic cloud(s)
• Supercomputers

Technical requirements

Technical_requirements_en

• PerfSonar should be insttaled on each participating site

Tests

List of Tests

• Synthetic
  • Bonnie++

• Experiments tests
  • ALICE
    • add short desc or ref to doc
  • ATLAS
    • ditto
  • Bioinformatics (genome sequencer)

Tests schemes

• SPb:
  • FST: SPbSU, PNPI
  • MGM: CERN (SPbSU, PNPI)
  • UI: SPbSU, PNPI, CERN, SINP
• KI minimal
  • FST: KI
  • MGM: KI
  • UI: ALL
• KI full
  • FST: KI,JINR,SINP,MEPHI
  • MGM: KI,JINR
  • UI: ALL

Test results

Results are stored at https://stor4.grid.kiae.ru/fedstor/. You'll need RDIG CA root certificate (in your browser or at the machine, depending on the access method) and your personal certificate (browser/machine too).

People with r/w access:

• Eygene Ryabinkin
• Andrey Zarochentsev
• Andrey Kiryanov

People with r/o access:

• Alexey Klimentov
• Dmitry Krasnopevtsev

More people can be added, drop a letter to rea@gridNOSPAMPLEASE.kiae.ru, tell why do you need access and attach your X.509 certificate (BEWARE: not the private key).

Access to results

Use plain browser for read-only operations.

Use Davix for X.509-powered read-write access:

• common part of davix invocation (referenced below as $davix-XXX): davix-XXX --capath /etc/grid-security/certificates --cert ~/.globus/usercert.pem --key ~/.globus/userkey.pem
• upload: $davix-put <local-file> https://stor4.grid.kiae.ru/fedstor/REMOTE-FILE
• grab: $davix-get https://stor4.grid.kiae.ru/fedstor/REMOTE-FILE <local-file>
• remove: $davix-rm https://stor4.grid.kiae.ru/fedstor/REMOTE-FILE
• make directory: $davix-mkdir https://stor4.grid.kiae.ru/fedstor/SOME-REMOTE-PATH
• list directory/file: $davix-ls https://stor4.grid.kiae.ru/fedstor/SOME-REMOTE-PATH

Currently we don't allow for anonymous access at all.

Bonnie

• SPb: http://alice28.spbu.ru/bonnie-eos/
• KI mimal http://alice28.spbu.ru/bonnie-ki/

Tests (xrd and alice)

http://alice22.spbu.ru/distr/tema/

Perfsonar

http://alice22.spbu.ru/maddash-webui/

EOS resources

• SPbCloud:
  • MGM: rueosfed.cern.ch, eoshead.pnpi.nw.ru, alice01.spbu.ru
  • FST: eos.pnpi.nw.ru, alice20.spbu.ru

• KICloud:
  • MGM: muon.grid.kiae.ru
  • FST: xr12.grid.kiae.ru, xr15.grid.kiae.ru

Project meetings

• Sep 13,2016F2F meeting at NRC KI agenda and materials
• Jun 24,2016 F2F meeting at NRC KI agenda and materials
• Jun 3, 2016 F2F meeting at NRC KI agenda and materials
• May 13, 2016 F2F meeting at NRC KI agenda and materials
• Apr 15, 2016 F2F meeting at NRC KI agenda and materials
• Feb 18th, 2016. F2F meeting at NRC KI agenda and materials
• Jan 15, 2016 Federated Storage phonecon
• Dec 24th, 2015 F2F meeting at NRC KI agenda and materials

Conference talks and publications

• WLCG workshop. Feb 2015, Lisbon, Portugal
• ACAT2016 Federated storage talk. Jan 2016, Valparaiso, Chile
• ALICE Tier-1/Tier-2 Workshop 19 April 2016, Bergen, Norway,

-- AndreyZarochentsev - 2016-02-21