CERN Data Management - LFC Requirements

Description

Catalogue consistency EMI project and the LFC/DPM.

One-way reliable data transfer between N producers and M consumers.

Client types

Producers

1 producer per Storage Element or Catalogue. Mostly WAN distributed.

Consumers
1 consumer per Storage Element or Catalogue. Mostly WAN distributed.

Destination types

2 by now.

For a give destination type:

  • instances number: 100-200 hundreds
  • messages content: file metadata
  • messages size: few KB up to roughly 1MB
  • format of the messages body: JMS MapMessages, eventually translated
  • messages lifetime: days
  • maximum latency: < 2 seconds
  • permanent vs occasional connections: permanent connections
  • security requirements: SSL connections

For a given destination instance:

  • order of 100 producers
  • 1 consumer per virtual destination
  • tens of messages per second up to 1K/s

For a given destination type:
  • order of 100 producers
  • order of 100 consumers
  • 1000 messages per second in total, peaks up to 10K/s

Programming Languages

C++

Edit | Attach | Watch | Print version | History: r5 < r4 < r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r5 - 2011-04-01 - MassimoPaladin
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Main/MassimoPaladin All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2023 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback