From toolkit to framework - the past and future evolution of PhEDEx

PhEDEx is the data-movement solution for CMS at the LHC. Created in 2004, it is now one of the longest-lived components of the CMS dataflow/workflow world.

As such, it has undergone significant evolution over time, and continues to evolve today, despite being a fully mature system. Originally a toolkit of agents and utilities dedicated to specific tasks, it is becoming a more open framework that can be used in several ways, both within and beyond its original problem domain.

In this talk we describe how a combination of refactoring and adoption of new technologies that have become available over the years have made PhEDEx more flexible, maintainable, and scalable. Finally, we describe how we will guide the evolution of PhEDEx into the future.

Main Author:

* Tony Wildish

Other Authors:

* Nicolo Magini (IT-ES), Chih-Hao Huang, Natalia Ratnikova, Alberto Sanchez (CMS PhEDEx development team)

* Track: Distributed Processing and Analysis on Grids and Clouds

* https://indico.cern.ch/abstractDisplay.py?abstractId=188&confId=149557

-- NicoloMagini - 03-Oct-2011