Please refer to the updated version at: https://twiki.cern.ch/twiki/bin/view/EGEE/EGEEgLiteWorkPlans

Data Management WP

Context of the CERN Data Management cluster

Members:

Paolo Badino, Gavin McCance, Jean-Philippe Baud, David Smith, Sophie Lemaitre, Krzysztof Nienartowicz, Akos Frohner, Antonio Sobreira, Daniel Rodrigues

Antonio will be with the group until September and Daniel until October.

In addition Jiri Kosina is currently working with the group at CERN. He will leave CERN 20 May, but will be able to make further contribution during July.

Members are connected with EGEE JRA1, SA3 or CERN IT.

Broadly speaking the following people work on the components:

FTS: Paolo, Gavin, Daniel, Antonio, Akos

LFC/DPM/lcg_utils/GFAL: Jean-Philippe, Jir, Sophie, Krzysztof, Akos

EDS (Encrypted Data Storage): Akos

POOL LFC interface: David

Items not in this plan: Time for migration to SLC4, migration to VDT-1.3. Possibly changing versions of Axis, gSOAP, Java, Tomcat.

Workplan by timeframe / person:

Ongoing activity; End not known or not clearly defined

• Jean-Philippe Baud

(*) Activity within SRM group: e.g. deciding on SRM v2 specification. Currently attending grid storage interface workshops, will be away from CERN until 25 May.

(*) Reviewing srm v2 compatibility tests results. Ongoing activity.

• Gavin McCance & Paolo Badino

(*) Support of FTS production (for service challenge); Involving investigation and diagnosis of overall system behavior and preparation of appropriate response.

• Akos Frohner

(*) Contact with BIOMED VO.

• Sophie Lemaitre

(*) Builds of LFC/DPM (work is ongoing to have automatic builds by glite build system). Support of production LFC - this responsibility is in the process of being moved to another group(s).

Tasks starting/ending/ongoing for May

• Jean-Philippe Baud

(*) Working with Jiri Kosina to have a common RFIO library for Castor & DPM. The common part and DPM specific plugin should be finished by the end of May. Plan to also have testing completed by end of May.

(*) Allowing for the automatic build of LFC/DPM by the glite build system, working with Akos. Plan to finish by the end of May.

• Gavin McCance

(*) Preparing the documentation of procedures relating to FTS production servers. Plan to complete by the end of May.

• Paolo Badino

(*) Revision of FTS agents to remove need for database locking and to facilitate future developments such as prestaging and the proxy renewal. Plan to complete by the end of May.

• Sophie Lemaitre

(*) Testing of database replication to allow for a replicated LFC service. Plan to complete the tests by the end of May.

• Krzysztof Nienartowicz

(*) Enable GFAL to use SRM v2. Check that the root build with GFAL is able to use all required POSIX methods that were previously not fully functional due to limitations of SRM v1. Plan to complete by the end of May.

• Akos Frohner

(*) Enable LFC/DPM to be built with glite build system, with Jean-Philippe. Estimate end of May.

• Antonio Sobreira

(*) Testing of FTS retry logic for SRM Copy. Estimate working into June.

• Daniel Rodrigues

(*) Evaluating SRM v2 tests. (Aim to eventually have a definitive test to test SRM v2 spec compliance). Estimate working into June.

• David Smith

(*) Provide POOL file catalog plugin to LFC that supports the new style pool file catalog interface. Required for 15 June.

Tasks scheduled to be started during June

• Akos Frohner

(*) Adding delegation to the FTS client tools. Estimate a week.

(*) Removal of build dependency on FireMan from FTS & Hydra. Estimate a week.

(*) Integration of EDS to GFAL. Estimate 2 weeks.

• Krzysztof Nienartowicz

(*) Add lookup in the information system to determine srm v1/v2 for a given SE. Start as soon as possible (in June) estimate a few days.

(*) lcg_utils retires with different replica(s) in case of failure. Estimate end of June.

(*) xrootd aware DPM. Requires xrootd plugin plus changes to DPM. Estimate a month of work. May work in parallel with lcg_utils retries. Estimate middle of July.

• Sophie Lemaitre

(*) Testing of LFC/DPM build from old LCG build and glite build system.

(*) Testing of fixes for lcg_utils and GFAL already prepared by Jiri.

(*) Packaging & testing of DPM-FTP based on gridftp2. Estimate finishing in July.

• Gavin McCance

(*) Refactoring of FTS component: transfer-url-copy, including addition of SRM v2. Estimate completion in September.

• Paolo Badino

(*) Writing the new FTS proxy renewal agent. Estimate 2 weeks.

• Jean-Philippe

(*) Provide SRM Copy for DPM.

Tasks scheduled to be started during July

• Akos Frohner

(*) Add M/N key splitting of Hydra keys. Estimate 3 weeks.

• Gavin McCance

(*) Testing of FTS delegation and proxy renewal. Estimate all of July.

• Jean-Philippe

(*) Database backup for LFC/DPM nameserver.

• Krzysztof Nienartowicz

(*) Thread safety fixes for lcg_utils, GFAL.

(*) Revision of GFAL information system access to provide cache.

After July

(*) Support for multiple LFC replicas.

-- Main.grandic - 27 Jun 2006