Release Checklist
This page presents the list of items, which
should be verified before the release/host is deployed into the production:
- Prepare the new hardware machines from scratch
- activate TSM backup system
- firewall rules in place (lcg-fw package present) (predefined set IT GD GD_ETICS_CONDOR_SERVER in netops)
- make sure a proper link is in place for repository->datastore (datastore -> /afs/cern.ch/project/etics/repository/datastore) (/home/repository)
- make sure a proper link is in place for FSRepositoryRoot (in etics.server.conf->fs_registered_repository_root) (/afs/cern.ch/project/etics/repository)
- make sure a proper link is in place for FSVolatileRoot (in etics.server.conf->fs_volatile_repository_root) (/afs/cern.ch/project/etics/builds)
- Install and configure the new etics software in the new hardware machines
- add necessary ssh-keys (Alberto, ...)
- Stop Etics
- disable services monitoring nn monitoring node (*/5 * * * * python /home/etics/SLS/sls.py; in etics-aux as etics user)
- Change Alias (contact Gyorgy Balazs)
- Backup Production DB
- databases imported (etics and nmi_history) and post_install script launched
- active ('Running') builds imported via database transfer removed from the active queue(nmi_rm)
- all available test-suites passed correctly (see /opt/etics/deployment/test/)
- query cache size correctly set for MySQL database (/etc/my.cnf 48MB)
- min/max memory heap set for tomcat (/etc/tomcat5/tomcat5.conf JAVA_OPTS="-Xms2048m -Xmx2048m")
- automatic updates disabled (/etc/sysconfig/yum-autoupdate YUMUPDATE=0)
- etics-certificates imported into keystore (run test scripts in /opt/etics/deployment/test/ or do it manually with keytool)
- verify the presence of 'ETICS CA' in the keystore(the same)
- deactivate the parallel submission/registration if needed (/opt/etics/etc/nmi)
- databases backup script in place (to be run manually) (set afs password and mysql password)
- disable any other backups (from previous production node)
- MySQL database password for root not empty (set manually)
- RSS feeds on the 'Welcome' page copied from old production server (/opt/etics/share)
- New RSS feed added (related to new Release)
- restart the node and verify all services are operational
- restart repository service (needed for correct SSL-handshaking)
- Start Etics
- enable services monitoring
- service available under https://etics.cern.ch
(server restart is recommended after the DNS change)
- service available under https://etics-repository.cern.ch
(repository restart is recommended after the DNS change)
- check whether SLS status is reported correctly (http://sls.cern.ch/sls/service.php?id=ETICS
) after activating SLS check.
- https://etics-repository.cern.ch/repository/services/RepositoryService?method=refreshHostName
- connection to repository server (try statistics refresh)
- build/test submission correctly completed (test of entire chain)
- new features tested
--
AlbertoRescoPerez- 16-Feb-2010