Difference: Meeting071206 (3 vs. 4)

Revision 42007-12-12 - PhilippeCharpentier

Line: 1 to 1
 
META TOPICPARENT name="BKDev"

Bookkeeping meeting, December 6th 2007

Line: 8 to 8
 

Current bookkeeping system (Marianne)

Changed:
<
<
Marianne presented the current status of the [[http://indico.cern.ch/getFile.py/access?contribId=0&resId=1&materialId=slides&confId=24813][system], which is also in slides from Carmine Cioffi.
>
>
Marianne presented the current status of the system, which is also in slides from Carmine Cioffi.
 
Changed:
<
<
There were discussions on the understanding of the actual content of the views (roottree and JobFileInfo tables). The understanding was that roottree contains for each file an entry with all parameters that queries can be made on. JobFileInfo is a table for each file containing the most usual metadata for that file.
>
>
There were discussions on the understanding of the actual content of the views (roottree and JobFileInfo tables). The understanding was that roottree contains for each file an summary of all parameters that can be used to make queries. Each entry then points to a JobFileInfo table that contains the most usual metadata for that file.
  AMGA is used as an access layer to the actual Oracle database. It implements authentication as well as an insulation from the actual backend. The actual BK schema is based on the generic AMGA schema.
Line: 41 to 41
 

Current new developments (Elisa)

Changed:
<
<
Elisa presented the status of hte work she had been doing (slides) in the past month.
>
>
Elisa presented the status of the work she had been doing (slides) in the past month.
  She has developed a python class that allows querying the BKDB directly through the AMGA interface after having prompted the user for his search criteria (in any order). The interface discovers the allowed values for the next criterion, from the previous ones. Checking this method against the web interface+servlets is giving identical results. When asking for files replicated at a given sites, there is one more replica found which pointed to a bug in the web implementation (one file missing)...
Changed:
<
<
There was a long discussion on how to evolve this prototype. One possibility would be to implement the interface as in the prototype directly in the client, while the alternative is to turn it into a DIRAC service that would be interrogated by a DIRAC API client within the framework.
>
>
There was a long discussion on how to evolve this prototype. One possibility would be to implement the interface as in the prototype directly in the client, while the alternative is to turn it into a DIRAC service that would be interrogated by a DIRAC API client within the framework. The direct implementation is faster for testing while the service implementation is much neater and allows a clear definition of the interface, that could be stable under various implementations.

It was finally decided to first define this interface, then prototype it in a client which then should be made a DIRAC service together with a light client API. It was suggested by Andrew (outside the meeting) that in case the functionality of the interface is similar to that of the generic DIRAC File Catalog interface, the same method and signature be used. This would simplify the implementation (for example for removing a file).

Short term plans

Elisa will be away (conference) until Christmas break. Zoltan would possibly move to CERN in January.

They would work on defining the interface and providing a prototype (Elisa for the query methods, Zoltan for a GUI starting from what he had developed for feicim but in python this time). In parallel they would familiarise with the DIRAC framework.

Marianne will re-implement the manager and related tools in python.

A machine will be dedicated for installing test services (volhcb07). Marianne will enquire whether we still have a test instance of the DB and a connected AMGA service that we can use for non-destructive tests. Philippe (with Roberto) will ask for a PPS AMGA service for this purpose. After a suitable PPS stage, this service could be declared "in production" and be used by the production BK while the AMGA service on arda01 would be used for tests.

Tahar declared he was very much interested in following the topic as well as participating in further architectural discussions. Philippe said that this collaboration should not necessarily be restricted to BK (most urgent need) but hopefully will enlarge to other domains of distributed computing.

Thanks to everybody who participated! Season's Greetings!

 -- PhilippeCharpentier - 10 Dec 2007 \ No newline at end of file
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback