PersistencyRepository < Persistency

Persistency Web>PersistencyCommon>PersistencyRepository (2020-11-27, CharlesDelort) (raw view)
*THIS PAGE IS DEPRECATED*

The Persistency Framework code is currently maintained in SVN. User and admin documentation for the SVN repositories is provided below.

%TOC{depth="2"}%

---+ Persistency Framework SVN repository: User documentation

---++ CVS to SVN migration

The CORAL and COOL repositories were moved in August 2013 from the AFS-based [[http://cvs.web.cern.ch/cvs/][CERN Central CVS service]] (cool.cvs.cern.ch and coral.cvs.cern.ch) to the AFS-based [[http://svn.web.cern.ch/svn][CERN SVN Service]]. Incomplete documentation about the CVS to SVN migration is provided in the OLDPersistencyCvs2Svn page of this twiki.

The POOL software is now being maintained (as one of its many internal packages) by ATLAS, the only experiment that still uses POOL. A read-write SVN repository for POOL has been set up in ATLAS for that purpose. The historical CVS repository for POOL (pf.cvs.cern.ch) has in any case also been migrated to SVN, solely for data preservation purposes, i.e. with the goal of maintaining long term access to this software even when the CVS servers are switched off.

---++ SVN Web interfaces

Web interfaces to the new SVN repositories are provided using both !WebSVN and TRAC.
   * For COOL, see http://svnweb.cern.ch/world/wsvn/lcgcool and https://svnweb.cern.ch/trac/lcgcool/browser
   * For CORAL, see http://svnweb.cern.ch/world/wsvn/lcgcoral and https://svnweb.cern.ch/trac/lcgcoral/browser
   * For POOL, see http://svnweb.cern.ch/world/wsvn/lcgpool and https://svnweb.cern.ch/trac/lcgpool/browser (read-only repository!)
Note that the CMS experiment maintains its tools to build CORAL under [[https://github.com/cms-sw/cmsdist][github]].

---++ SVN client access

The recommended method for accessing the SVN repositories is svn+ssh. Guest access via http is also possible.
   * For COOL, use svn+ssh://svn.cern.ch/reps/lcgcool or http://svn.cern.ch/guest/lcgcool
   * For CORAL, use svn+ssh://svn.cern.ch/reps/lcgcoral or http://svn.cern.ch/guest/lcgcoral
<!--   * For POOL, use svn+ssh://svn.cern.ch/reps/lcgpool  (read-only repository!) -->

Note that the CORAL repository is named 'lcgcoral' (and COOL is now named 'lcgcool' for consistency) to avoid name clashes with the Compass experiment CORAL software framework.

---+ Persistency Framework SVN repository: Admin documentation

---++ SVN administration

The [[http://information-technology.web.cern.ch/book/how-start-working-svn/administering-svn-repository][SVN administration]] section of the CERN SVN Service user guide describes in detal how to perform operations such as configuring access control or automatic emails on commits.

The SVN repositories are hosted on AFS. Their configuration is controlled by the =conf= and =usr-hooks= subdirectories of the =/afs/cern.ch/project/svn/reps/&lt;project&gt;= directories on AFS. These are only accessible to the librarian accounts for these SVN repositories(libcoral, libcool and libcoral for CORAL, COOL and POOL, respectively).

As described in the [[http://information-technology.web.cern.ch/book/how-start-working-svn/administering-svn-repository#adm-admin-rep][admin repository]] section of the CERN SVN Service user guide, as an alternative to changing configuration files on AFS, it is also possible to change these files in a special admin repository that is itself hosted in SVN. Any changes to the contents of this admin repository are automatically propagated to AFS. This is the recommended mechanism for CORAL and COOL, as it also allows version control for configuration changes. The admin repository can also be browsed (using the appropriate account) on [[https://svnweb.cern.ch/cern/wsvn/admin][WebSVN]] (but not on TRAC). In addition to the librarian accounts, the admin/lcgcoral, admin/lcgcool and admin/lcgpool directories can be read and modified by all members of the special egroups [[https://e-groups.cern.ch/e-groups/Egroup.do?egroupId=10099400][VC-librarians-lcgcoral]], [[https://e-groups.cern.ch/e-groups/Egroup.do?egroupId=10098032][VC-librarians-lcgcool]] and [[https://e-groups.cern.ch/e-groups/Egroup.do?egroupId=10101832][VC-librarians-lcgpool]], respectively (see [[https://cern.service-now.com/service-portal/view-request.do?n=RQF0574447][RQF0574447]]); users valassi, avalassi  and cdelort are now members of all these three egroups.

In particular, allowed writers (including valassi, avalassi and cdelort) and recipients of automatic emails on commits (including Andrea Valassi and Charles Delort) are defined in the following files:
   * For CORAL, in [[https://svnweb.cern.ch/cern/wsvn/admin/lcgcoral/conf/authz][admin/lcgcoral/conf/authz]] and [[https://svnweb.cern.ch/cern/wsvn/admin/lcgcoral/conf/svn-mailer.conf][admin/lcgcoral/conf/svn-mailer.conf]]
   * For COOL, in [[https://svnweb.cern.ch/cern/wsvn/admin/lcgcool/conf/authz][admin/lcgcool/conf/authz]] and [[https://svnweb.cern.ch/cern/wsvn/admin/lcgcool/conf/svn-mailer.conf][admin/lcgcool/conf/svn-mailer.conf]]
   * For POOL, in [[https://svnweb.cern.ch/cern/wsvn/admin/lcgpool/conf/authz][admin/lcgpool/conf/authz]] and [[https://svnweb.cern.ch/cern/wsvn/admin/lcgpool/conf/svn-mailer.conf][admin/lcgpool/conf/svn-mailer.conf]]

---++ TRAC administration

After the migration from CVS to SVN, TRAC interfaces were requested for lcgcoral and lcgcool ( [[https://cern.service-now.com/service-portal/view-request.do?n=RQF0234770][RQF0234770]]) and also for lcgpool ( [[https://cern.service-now.com/service-portal/view-request.do?n=RQF0249689][RQF0249689]]).

TRAC can be configured using the Web interfaces on https://svnweb.cern.ch/trac/lcgcoral/admin, https://svnweb.cern.ch/trac/lcgcool/admin and https://svnweb.cern.ch/trac/lcgpool/admin. Initially these three TRAC repositories could only be administered by their respective librarian accounts (lcgcoral, lcgcool and lcgcoral), but users valassi, avalassi and cdelort have now been granted TRAC_ADMIN privileges on all three. BROWSER_VIEW privileges have been granted to anonymous

---++ Computing group administration

The following e-groups are relevant to the management and communication flow for CORAL/COOL activities. The list is non-exhaustive: in particular, it does not include the many "LCG PEB" e-groups that were used initially for the management of POOL/CORAL and COOL (e.g. [[https://e-groups.cern.ch/e-groups/Egroup.do?egroupId=145234][project-lcg-peb-persistency]] and [[https://e-groups.cern.ch/e-groups/Egroup.do?egroupId=156061][project-lcg-peb-conditionsdb]]) and that are no longer used, but have not been deleted.
| *E-group* | *Owner* | *Admin e-group* | *Description* |
| [[https://e-groups.cern.ch/e-groups/Egroup.do?egroupId=209707][persistency-service]] | C. Delort | persistency-service | Top-level management e-group. CORAL/COOL FE team in SNOW. Admins of DBOD instances. |
| [[https://e-groups.cern.ch/e-groups/Egroup.do?egroupId=10099400][VC-librarians-lcgcoral]] | C. Delort | persistency-service | SVN admins for lcgcoral. |
| [[https://e-groups.cern.ch/e-groups/Egroup.do?egroupId=10098032][VC-librarians-lcgcool]] | C. Delort | persistency-service | SVN admins for lcgcool. |
| [[https://e-groups.cern.ch/e-groups/Egroup.do?egroupId=10101832][VC-librarians-lcgpool]] | C. Delort | persistency-service | SVN admins for lcgpool. |
| [[https://e-groups.cern.ch/e-groups/Egroup.do?egroupId=10125402][coral-ai-admin]] | A. Valassi | - | Puppet admins for coral and heposlibs AI nodes. Includes persistency-service e-group. |
| [[https://e-groups.cern.ch/e-groups/Egroup.do?egroupId=10076649][persistency-cluster-users]] | A. Valassi | - | Puppet users for heposlibs AI nodes. |
| [[https://e-groups.cern.ch/e-groups/Egroup.do?egroupId=10106256][heposlibs-users]] | A. Valassi | - | Mailing list for heposlibs rpm users. |
The last three e-groups above should be cleaned up to cleanly separate private Puppet nodes, CORAL/COOL and heposlibs.  

-- Main.AndreaValassi - 2016-04-09
Topic revision: r20 - 2020-11-27 - CharlesDelort
Persistency
PersistencyCommon
PersistencyRepository
SVN admin (WebSVN)
SVN COOL (trac)
SVN CORAL (trac)
GIT lcgcmake (gitlab)
AFS console
- Cern Search
- TWiki Search
- Google Search
Persistency All webs
Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback