This pages describes the services maintained by the LHCb Core Software teams and the associated maintenance procedures.

LHCb Software Management tools

Continuous Integration

The following diagram describes the LHCb Continuous Integration system:

LHCb Physics Software sources

The LHCb projects are hosted in the gitlab instance, hosted at CERN, in the "lhcb" group:

https://gitlab.cern.ch/lhcb

Nightly builds & Unit testing

The LHCb Core Software runs a continuous ntegration system described in:

https://twiki.cern.ch/twiki/bin/view/LHCb/LHCbNightlies

The status of the builds can be found at:

https://lhcb-nightlies.cern.ch/nightly/

The configuration for the system can be found in git at:

https://gitlab.cern.ch/lhcb-core/LHCbNightlyConf

(Some description of the Nightly build slots is here)

The nightly builds are driven by the following instance of Jenkins:

https://jenkins-lhcb-nightlies.web.cern.ch/

Installation of the nightly builds

After build the nightly slots are installed on the CVMFS volume: /cvmfs/lhcbdev.cern.ch.

When a slot is build, a message is pushed to RabbitMQ BuildReadyCIAgent queue. The message is then converted by CIAgent to a message for RabbitMQ CVMFSDevActions queue and assigned a low priority. This queue combines messages from Jenkins Remote Cron Jobs with a higher priority and build ready messages with a low priority. The messages are consumed on this priority.

In order to debug the installation system, please refer to https://twiki.cern.ch/twiki/bin/view/LHCb/NightlyBuildsInstallationDebug

CVMFS Dev release documentation: https://twiki.cern.ch/twiki/bin/view/LHCb/CVMFSDevReleaseDocumentation

Messaging between Jenkins and the CVMFS LHCb Stratum-0 node (cvmfs-lhcbdev) is hosted via an instance of the rabbitmq messaging engine described below.

CVMFS dev disk usage statistics:

or see here

Monitoring of the CVMFS dev stratum 0:

http://cernvm-monitor.cern.ch/cvmfs-monitor/cb/browser/lhcbdev.cern.ch/latest/?page=0

Releases

• Main documentation:

https://twiki.cern.ch/twiki/bin/view/LHCb/ProjectRelease

• The status of the build can be seen:

https://lhcb-nightlies.cern.ch/release/

• Deployment task management system:

https://sft.its.cern.ch/jira/projects/LHCBDEP

Infrastructure Services

Jenkins for physics projects

• Jenkins: https://lhcb-jenkins.cern.ch/jenkins/

Jenkins for Core Software tools

• Jenkins: https://jenkins-lhcb-core-soft.web.cern.ch/

Local Pypi repository

• Usage: https://twiki.cern.ch/twiki/bin/view/LHCb/PythonPyPIServer

• Location: https://lhcb-pip.cern.ch/

Neo4j graph database

• Neo4J: https://ariadne-lhcb.cern.ch/webadmin/

• URL for requested releases JSON: http://ariadne-lhcb.cern.ch/cgi-bin/getreleases

RabbitMQ messaging engine

The server runs on lbmessagingbroker.cern.ch

To connect to the admin interface use port http://lbmessagingbroker.cern.ch:15672.

LHCb Installation and environment configuration tools

Most of the core software tools are versioned in gitlab, at the following address:

https://gitlab.cern.ch/lhcb-core

LbInstall

* Git: https://gitlab.cern.ch/lhcb-core/lbinstall

* Doc: http://lbinstall.web.cern.ch/lbinstall/

LbScripts & LbLogin

https://gitlab.cern.ch/lhcb-core/lbscripts

To release:

https://twiki.cern.ch/twiki/bin/view/LHCb/LbScriptsRelease

-- BenjaminCouturier - 2016-04-21