Title

Key developments of the Ganga task-management framework.

Abstract

Ganga is an easy-to-use frontend for the definition and management of analysis jobs, providing a uniform interface across multiple distributed computing systems. It is the main end-user distributed analysis tool for the ATLAS and LHCb experiments and provides the foundation layer for the HammerCloud sytem, used by the LHC experiments for validation and stress testing of their numerous distributed computing facilities.

This poster will illustrate recent developments aimed at improving both the efficiency with which computing resources are utilised, and the end-user experience. Notable highlights include a new web-based monitoring interface (WebGUI) that allows users to conveniently view the status of their submitted Ganga jobs and browse the local job repository. Improvements to the core Ganga package will also be outlined. Specifically we will highlight the development of procedures for automatic handling and resubmission of failed jobs, alongside a mechanism that stores an analysis application such that it can be repeated (optionally using different input data) at any point in the future.

We will demonstrate how tools that were initially developed for a specific user community have been migrated into the Ganga core, and so can be exploited by a wider user-base. Similarly, examples will be given where Ganga components have been adapted for use by communities in their custom analysis packages.

Summary

An overview of recent Ganga developments, stressing improvements to the user-experience and demonstrating how originally community-specific tools have been adapted for use by a wider user-base.

Author

Mike Kenyon (CERN)

Co-Authors

Jakub Moscicki (CERN), Ivan Dzhunov (CERN), Ulrik Egede (Imperial College London), Alex Richards (Imperial College London), Johannes Ebke (Ludwig Maximilians Universitaet Muenchen), Mark Slater (Birmingham University), Mike Williams (Imperial College London), Hurng-Chun Lee(), Frederic Brochu ().

Presentation Type

Poster

Comments

None

-- MikeKenyon - 30-Sep-2011

Edit | Attach | Watch | Print version | History: r8 < r7 < r6 < r5 < r4 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r8 - 2011-10-13 - MichaelJohnKenyonExCern
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback