Title

Towards HammerCloud 5: Progress and Experience in Grid Site Testing

Abstract

High performance and reliability in a grid infrastructure can be achieved through frequent validation and stress testing of the network, storage and CPU resources. HammerCloud was previously introduced as a service with the goals of enabling VO and site admins to run such tests in an automated or on-demand manner. The ATLAS, CMS and LHCb experiments have all developed VO plugins for the service and have successfully integrated it into their grid operations infrastructures.

This talk will present the experience in running HammerCloud at full scale for more than 3 years and present solutions to the scalability issues faced by the service. First, a study of the automatic site exclusion component will be presented along with results for tuning the blacklisting policies. Next, we will discuss the particular challenges faced when integrating with CMS and LHCb, namely in the development of custom functional test dashboards and a HammerCloud API for tighter integration with the LHCbDIRAC Resource Status System. Finally, we will look to future challenges, including the requirements to increase the rates of concurrent tests, to allow a scale up in number of metrics recorded per job (up to hundreds), and to store many millions of jobs per VO, which will allow users to obtain better global results through extensive data mining.

Author

Dan van der Ster (CERN)

Co-authors

Ramon Medrano Llamas (CERN) Johannes Elmsheuser (Munich) Federica Legger (Munich) Andrea Sciaba (CERN) Mario Ubeda Garcia (CERN)

Presentation type (parallel or poster)

parallel

-- DanielVanDerSter - 20-Sep-2011

Edit | Attach | Watch | Print version | History: r3 < r2 < r1 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r1 - 2011-09-20 - unknown
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback