Accounting data from from the primary information source to the accounting portal

For EGI sites

APEL clients can run an APEL parser to extract data from a batch system and place it in their client database, or they can use third-party tools to extract batch or cloud data. This data is then unloaded into a message format suitable for transmission. APEL clients run a sending Secure Stomp Messenger (SSM) to send these messages containing records via the EGI Message Brokers the central APEL server. The messages can contain either Job Records or Summary records. This is configurable in the APEL client. The central APEL server runs an instance of the SSM, which receives these messages and a “loader” processes the records in the messages and loads them into a MySQL database. A “summariser” process runs to create summaries of any Job Records received and load them in a “SuperSummaries” table along with any Summary records. This summariser runs as a cron job approximately once a day. A database “unloader” process unloads the summary records into the message format to be sent on by the sending SSM via the EGI Message Brokers to the EGI Accounting Portal. https://github.com/apel/ssm

-- JuliaAndreeva - 2016-11-04

Topic attachments
I Attachment History Action SizeSorted ascending Date Who Comment
PNGpng DataFlow.png r1 manage 320.6 K 2016-11-04 - 17:47 JuliaAndreeva  
Edit | Attach | Watch | Print version | History: r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r1 - 2016-11-04 - JuliaAndreeva
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback