ATLAS Analytics

Overview

The ATLAS Analytics effort is focused on creating systems which provide ATLAS Distributed Computing (ADC) with new capabilities for understanding distributed systems and overall operational performance. These capabilities include:

  • Correlate information from multiple systems (PanDA, Rucio, FTS, Dashboards, Tier0, PilotFactory, ...)
  • Predictive Analytics: Execute arbitrary data mining or machine learning algorithms over raw and aggregated data
  • Ability to host new third party analytics services on a scalable compute platform
  • Satisfy variety of use cases for different user roles for ad-hoc analytics
  • Provide an open platform with documented collections and tools to broaden participation in ADC Analytics.

Organisation

Clusters and Resources

  • analytix cluster at CERN, access to hadoop: In order to get the access you have to be in ai-hadoop-users e-group which is managed by CERN-IT. To get access you need to open a Snow ticket to Hadoop Service, providing your lxplus user name.
  • es-atlas: The default Kibana is read-only. Use https://es-atlas.cern.ch/kibana_rw to save dashboard and visualisations.
  • UChicago Kibana: default istance is read-only. For write access use: http://atlas-kibana-dev.mwt2.org.

Data collection

Data visualization

Data analysis

Completed notebooks

  • For a given RSE, show the size vs. age distribution Link

Dedicated projects

Tutorials and How-To's

Related efforts

  • WLCG Machine Learning Demonstrator Indico
  • IT Analytics Working Group Indico, TWiki
  • WLCG Analytics Platform TWiki

Attic

Historical information goes into the ATLASAnalyticsAttic.



Major updates:
-- IlijaVukotic - 2014-11-11
-- MarioLassnig - 2016-06-08

Responsible: IlijaVukotic, MarioLassnig
Last reviewed by: Never reviewed

Edit | Attach | Watch | Print version | History: r59 < r58 < r57 < r56 < r55 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r59 - 2018-06-11 - unknown
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Atlas All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2018 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback