Big PanDA RPM Build System

Introduction

• This page is evolving. Please keep checking.
• This page contains information about BigPanDA RPM Build System. We use Jenkins CI for BigPanDA RPM builds.
• Feel free to contact JaroslavaSchovancova and TadashiMaeno and TorreWenaus with questions.

Usage of the build system

• Upon every commit to SVN/Git, a RPM package is built.
  • RPM is built for following PanDA components:
    • panda-server, panda-common, panda-jedi: NOARCH, SRC
    • monitor, pandamon (Classic and Platform monitoring for ATLAS): NOARCH, SRC
    • bigpandamon-core, bigpandamon-atlas: STABLE-NOARCH, STABLE-SRC, DEV-NOARCH, DEV-SRC
  • Build dashboard is available, too.
• Instructions for manual RPM build, tagging, merging: BigPanDARPMbuildManual

Automatic smoke test of deployed monitoring packages

• Please see BigPanDARPMAutoSmokeTest for more details.

Installation of the RPM packages

• As of 2014-Mar-17 the RPM repository is available world-wide.
• As of 2014-Mar-10 the RPM repository is available only inside the CERN network.
• pandabuild.repo file location: /etc/yum.repos.d/pandabuild.repo or /etc/yum-puppet.repos.d/pandabuild.repo
• pandabuild.repo file content:

  # cat /etc/yum-puppet.repos.d/pandabuild.repo
  [pandabuild]
  name=BigPanDA Repository
  baseurl=https://pandabuild.cern.ch/$basearch
  sslcacert=/etc/grid-security/certificates/CERN-GridCA.pem
  enabled=1
  gpgcheck=0
  protect=1
  priority=20
  

• currently available:
  • stable:
    • https://pandabuild.cern.ch/x86_64/repodata/repomd.xml
    • https://pandabuild.cern.ch/SRPMS/repodata/repomd.xml
  • continuous/unstable:
    • https://pandabuild.cern.ch/unstable/repodata/repomd.xml
    • https://pandabuild.cern.ch/SRPMS_unstable/repodata/repomd.xml
• test that repository is available for you:

  # repoquery --location bigpandamon-lsst-0.0.1-1.noarch 
  https://pandabuild.cern.ch/x86_64/bigpandamon-lsst-0.0.1-1.noarch.rpm
  

Administration of the build system

• Packages are built by Jenkins instance on aipanda004. It runs under atlpan account. Ask JaroslavaSchovancova and TadashiMaeno for more details.
• Packages repository is in /data/build

The PanDA build machine

• The PanDA RPM repository is available also outside the CERN network - DNS alias pandabuild.
• creation of the RPM repository:

  # yum install createrepo
  # mkdir -p /var/www/html/build/{SRPMS,x86_64}
  # mkdir -p /var/www/html/apt/
  # ./create-my-repo.sh
  # service httpd restart
  

  • where

    # cat create-my-repo.sh
    #!/bin/sh
    
    destdir="/var/www/html/build/"
    
    for arch in x86_64
    do
        pushd ${destdir}/${arch} >/dev/null 2>&1
            createrepo .
        popd >/dev/null 2>&1
    done
    
    

• issues: ASPDA-38, ASPDA-45, ASPDA-46,
• related issues: ASPDA-61

Major updates:

-- JaroslavaSchovancova - 10 Mar 2014

Responsible: JaroslavaSchovancova