Prototype of National Federated Storage

Introduction

R&D project to develop, prototype and implement a federated data storage system between Russian WLCG sites and University clusters and to demonstrate how data reconstruction and analysis payloads (for at least two LHC experiments ATLAS and ALICE) and for bioinformatics applications (genome sequencer group of NRC-KI) running on WLCG facilities, on super-computers and Academic cloud can access federated data. This project intends to implement a federated distributed storage for all kind of operations such as read/write/transfer(3rd party)-RWT, and access via WAN from heterogeneous computing resources, such as Grid centers, University clusters, academic and commercial clouds and supercomputers.

Participating Labs and Universities

Table of readiness

Table of readiness

Table of readiness_old

Technologies to be evaluated

Computing Facilities

  • Grid centers
  • University clusters
  • Academic cloud(s)
  • Supercomputers

Technical requirements

Technical_requirements_ru

Technical_requirements_en

  • PerfSonar should be insttaled on each participating site

Tests

List of Tests

  • Experiments tests
    • ALICE
      • add short desc or ref to doc
    • ATLAS
      • ditto
    • Bioinformatics (genome sequencer)

Tests schemes

  • SPb:
    • FST: SPbSU, PNPI
    • MGM: CERN (SPbSU, PNPI)
    • UI: SPbSU, PNPI, CERN, SINP
  • KI minimal
    • FST: KI
    • MGM: KI
    • UI: ALL
  • KI full
    • FST: KI,JINR,SINP,MEPHI
    • MGM: KI,JINR
    • UI: ALL

Test results

Results are stored at https://stor4.grid.kiae.ru/fedstor/. You'll need RDIG CA root certificate (in your browser or at the machine, depending on the access method) and your personal certificate (browser/machine too).

People with r/w access:

  • Eygene Ryabinkin
  • Andrey Zarochentsev
  • Andrey Kiryanov

People with r/o access:

  • Alexey Klimentov
  • Dmitry Krasnopevtsev

More people can be added, drop a letter to rea@gridNOSPAMPLEASE.kiae.ru, tell why do you need access and attach your X.509 certificate (BEWARE: not the private key).

Access to results

Use plain browser for read-only operations.

Use Davix for X.509-powered read-write access:

Currently we don't allow for anonymous access at all.

Bonnie
Tests (xrd and alice)
http://alice22.spbu.ru/distr/tema/
Perfsonar
http://alice22.spbu.ru/maddash-webui/

EOS resources

  • SPbCloud:
    • MGM: rueosfed.cern.ch, eoshead.pnpi.nw.ru, alice01.spbu.ru
    • FST: eos.pnpi.nw.ru, alice20.spbu.ru

  • KICloud:
    • MGM: muon.grid.kiae.ru
    • FST: xr12.grid.kiae.ru, xr15.grid.kiae.ru

Project meetings

Conference talks and publications

-- AndreyZarochentsev - 2016-02-21

Topic attachments
I Attachment History Action Size Date Who Comment
PDFpdf Federated_Storage_Demonstrator.pdf r1 manage 61.0 K 2016-04-17 - 12:22 UnknownUser WLCG demo project draft
Edit | Attach | Watch | Print version | History: r31 < r30 < r29 < r28 < r27 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r31 - 2020-08-13 - unknown
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Sandbox All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback