Difference: ATPComponents (1 vs. 9)

Revision 92011-03-03 - unknown

Line: 1 to 1
 
META TOPICPARENT name="LCG.ATP"

ATP COMPONENTS

Line: 47 to 47
  ATP synchronizer runs all the synchronizers defined in [run_synchronizer] section of the file /etc/atp_synchro.conf by default. However, each individual synchronizer can be turned on/off by entering "Yes"/"No" for its corresponding entry.
Added:
>
>
The configuration of VO feeds is done using /etc/atp/vo_feeds.conf file. A sample VO feeds configuration is given below:
                [vo_feeds]
                 # feed definition: - <vo_name>_topology = url,<yes> or <no>
                 # <vo_name> - name of vo
                 # <yes>/<no>: determines the run-state in atp synchronizer

                alice_topology = http://pmendez.web.cern.ch/pmendez/alice/Alice-Voboxes-For-Nagios.xml,no
                atlas_topology = http://atlas-agis-api-dev.cern.ch/request/atp/xml/,no
                cms_topology = http://dashb-cms-job.cern.ch/dashboard/request.py/cmssitemap,yes
                lhcb_topology = http://santinel.web.cern.ch/santinel/ATP/lhcb_topology_example.xml,yes
                
 
  • Logging configuration: This defines various parameters for logging the run-time information of ATP synchronizer and this is done in /etc/atp_logging_files.conf. The logged data is saved in /var/log/atp/atp.log by default but the location can be changed if required.

Once the correct configuration is done, the synchronizer can be run by giving these files as a command line arguments.

Revision 82010-02-16 - unknown

Line: 1 to 1
 
META TOPICPARENT name="LCG.ATP"

ATP COMPONENTS

Line: 45 to 45
  By default, certificate files are assumed to be present in /etc/nagios/globus directory. Please make sure that the certificate and key files are present in this directory or change the path of this to the directory where these are present. If this is not done , ATP synchronizer will not run properly.
Changed:
<
<
ATP synchronizer runs all the synchronizers defined in
[run_synchronizer] 
section of
 /etc/atp_synchro.conf 
file by default. However, each of these synchronizer can be turned on/off by entering "Yes"/"No" for its corresponding entry.
>
>
ATP synchronizer runs all the synchronizers defined in [run_synchronizer] section of the file /etc/atp_synchro.conf by default. However, each individual synchronizer can be turned on/off by entering "Yes"/"No" for its corresponding entry.
 
  • Logging configuration: This defines various parameters for logging the run-time information of ATP synchronizer and this is done in /etc/atp_logging_files.conf. The logged data is saved in /var/log/atp/atp.log by default but the location can be changed if required.

Revision 72010-02-16 - unknown

Line: 1 to 1
 
META TOPICPARENT name="LCG.ATP"

ATP COMPONENTS

Line: 45 to 45
  By default, certificate files are assumed to be present in /etc/nagios/globus directory. Please make sure that the certificate and key files are present in this directory or change the path of this to the directory where these are present. If this is not done , ATP synchronizer will not run properly.
Added:
>
>
ATP synchronizer runs all the synchronizers defined in
[run_synchronizer] 
section of
 /etc/atp_synchro.conf 
file by default. However, each of these synchronizer can be turned on/off by entering "Yes"/"No" for its corresponding entry.
 
  • Logging configuration: This defines various parameters for logging the run-time information of ATP synchronizer and this is done in /etc/atp_logging_files.conf. The logged data is saved in /var/log/atp/atp.log by default but the location can be changed if required.

Once the correct configuration is done, the synchronizer can be run by giving these files as a command line arguments.

Revision 62010-02-11 - unknown

Line: 1 to 1
 
META TOPICPARENT name="LCG.ATP"

ATP COMPONENTS

Line: 8 to 8
  ATP main package
Changed:
<
<
This contains ATP synchroniser, a python based package, for synchronizing the data from various topology providers like GOCDB, OIM, VO feeds etc. It synchronizes data from these providers with ATP repository periodically and this synchronization frequency can be changed, if desired.The package, also, has all necessary scripts for Oracle and MYSQL databases creation/re-creation and migration.
>
>
This contains the database schema for MySQL and Oracle, plus the ATP synchroniser (a python based package, for synchronizing the data from various topology providers like GOCDB, OIM, VO feeds etc). It synchronizes data from these providers with ATP repository periodically and this synchronization frequency can be changed, if desired.The package, also, has all necessary scripts for Oracle and MYSQL databases creation/re-creation and migration.
  ATP web package
Line: 71 to 71
 The detailed instructions on how to install and configure Django for working with multiple databases are available on Django site. Please follow them.
Changed:
<
<
As far as ATP web package configuration is concerned, the configuration is done through
atp.ini 
file. The .ini file has various sections like database configuration, base_url path, debug settings etc. which are more or less self explanatory. The important parameters that need to be configured in are database specific settings and base_url.
>
>
As far as ATP web package configuration is concerned, the configuration is done through the atp.ini file. The .ini file has various sections like database configuration, base_url path, debug settings etc. which are more or less self explanatory. The important parameters that need to be configured in are database specific settings and base_url.
 Typical database settings for ATP are:
       [database]
Line: 96 to 96
 
  1. DABASE_PORT: port to use when connecting to the database
Changed:
<
<
For the
 base_url 
setting, you have to specify the base_url path e.g.
 http://www.cern.ch 
ATP front-end will then be available at
 http://www.cern.ch/atp
It is recommend that all settings in debug section should be false in productive environment in
 atp.ini 
file.
>
>
For the base_url setting, you have to specify the base_url path e.g. http://www.cern.ch ATP front-end will then be available at http://www.cern.ch/atp It is recommend that all settings in debug section should be false in productive environment in atp.ini file.
 

Revision 52010-02-11 - unknown

Line: 1 to 1
 
META TOPICPARENT name="LCG.ATP"

ATP COMPONENTS

Deleted:
<
<

INTRODUCTION

The distribution of the ATP is done in two different RPMs.

 

COMPONENTS

Changed:
<
<
  • ATP main package
>
>
ATP main package
  This contains ATP synchroniser, a python based package, for synchronizing the data from various topology providers like GOCDB, OIM, VO feeds etc. It synchronizes data from these providers with ATP repository periodically and this synchronization frequency can be changed, if desired.The package, also, has all necessary scripts for Oracle and MYSQL databases creation/re-creation and migration.
Changed:
<
<
  • ATP web package
>
>
ATP web package
  This acts as a front-end for the ATP repository. It is developed using Django, a high level python framework. The search interface for finding topologies of grid resources as well as programmatic feeds for exposure of ATP data through JSON/XML interfaces are available.

Installation and configuration

Changed:
<
<
ATP packages can be installed from koji repository at CERN.
>
>
For the two components mentioned above, there are two separate rpms, one corresponding to core functionality while the other handling the web interface portion for ATP. These are available on koji repository at CERN. and will typically have names like atp-x.x-x.el5.noarch.rpm and atp-web-x.x-x.el5.noarch.rpm. Just download and install them on the target system.
 
Changed:
<
<

ATP main package

>
>

ATP main package

 
Changed:
<
<
As explained above, the package contains ATP synchronizer modules and MYSQL/Oracle database scripts for ATP.
>
>
As explained above, this package contains ATP synchronizer modules and MYSQL/Oracle database scripts for ATP.
 
Changed:
<
<
ATP Synchronizer
>
>

ATP Synchronizer

  The main module of ATP Synchronizer is
atp_synchro 
and it picks up configuration information from different files as described below:
Line: 56 to 51
  e.g.
 atp_synchro -c /etc/atp/atp_synchro.conf -d /etc/atp/atp_db.conf -l /etc/atp/atp_logging_files.conf  
and the logs can be seen in
 /var/log/atp/atp.log 
Changed:
<
<
ATP DB scripts for Oracle/MySQL
>
>

ATP DB scripts for Oracle/MySQL

  The ready-made SQL scripts for creation of tables, procedures/functions, triggers are available in this module. They can be used for creation/re-creation of Oracle/MySQL databases. In case, there is a version change in ATP database schema , the migration script for migrating existing ATP database to the new version is also present here.

Changed:
<
<

ATP Web package

>
>

ATP Web package

The front-end for ATP is developed using Django, a high level python framework. There are several pre-requisites before we move towards configuration of Django settings for ATP. The following softwares must be installed and configured on the target system:

  1. python (2.4.3 or higher)
  2. MYSQL(5.1 or higher) or Oracle 10g
  3. Apache
  4. mod_wsgi
  5. Django 1.0/1.1
  6. Django-pagination
  7. Python module for accessing Oracle database - cx_Oracle
  8. Python module for accessing MYSQL database - MySQLdb

The detailed instructions on how to install and configure Django for working with multiple databases are available on Django site. Please follow them.

As far as ATP web package configuration is concerned, the configuration is done through

atp.ini 
file. The .ini file has various sections like database configuration, base_url path, debug settings etc. which are more or less self explanatory. The important parameters that need to be configured in are database specific settings and base_url. Typical database settings for ATP are:
       [database]
       DATABASE_USER: username
       DATABASE_PASSWORD:passwd
       DATABASE_HOST:localhost
       DATABASE_PORT:
       DATABASE_ENGINE: mysql # for mysql, only a DATABASE_NAME is needed
       DATABASE_NAME: atp
       
Explanations:
  1. DATABASE_USER username to use when connecting to the database
  2. DATABASE_PASSWORD password to use when connecting to the database.
  3. DATABASE_NAME: name of the database to use.
  4. DATABASE_ENGINE: database backend to use. The built-in database backends are oracle, mysql
  5. DATABASE_HOST host to use when connecting to the database.
  6. DABASE_PORT: port to use when connecting to the database

For the

 base_url 
setting, you have to specify the base_url path e.g.
 http://www.cern.ch 
ATP front-end will then be available at
 http://www.cern.ch/atp
It is recommend that all settings in debug section should be false in productive environment in
 atp.ini 
file.
 

Revision 42010-02-11 - unknown

Line: 1 to 1
 
META TOPICPARENT name="LCG.ATP"

ATP COMPONENTS

Line: 8 to 8
 

INTRODUCTION

The distribution of the ATP is done in two different RPMs.

Added:
>
>
 

COMPONENTS

Deleted:
<
<
  • ATP main package This contains ATP synchroniser, a python based program, for synchronizing the data from various topology providers like GOCDB, OIM, VO feeds etc. It synchronizes data from these providers with ATP repository periodically and this frequency can be changed if desired.The component, also, has all the necessary scripts for Oracle and MysQL databases creation/re-creation.
  • ATP web package This acts as a front-end for ATP repository. It is developed using Django, a high level python framework. The search interface for finding topologies of grid resources as well as programmatic feeds for exposure of ATP data through JSON/XML interfaces is available.
 
Changed:
<
<

Installation issues

>
>
  • ATP main package

This contains ATP synchroniser, a python based package, for synchronizing the data from various topology providers like GOCDB, OIM, VO feeds etc. It synchronizes data from these providers with ATP repository periodically and this synchronization frequency can be changed, if desired.The package, also, has all necessary scripts for Oracle and MYSQL databases creation/re-creation and migration.

  • ATP web package

This acts as a front-end for the ATP repository. It is developed using Django, a high level python framework. The search interface for finding topologies of grid resources as well as programmatic feeds for exposure of ATP data through JSON/XML interfaces are available.

Installation and configuration

ATP packages can be installed from koji repository at CERN.
 

ATP main package

Changed:
<
<
The configuration is divided in three parts: Database configuration( /etc/atp_db.conf), Synchronizer configuration(/etc/atp_synchro.conf) and Logging configuration(/etc/atp_logging_files.conf).
  • Database configuration This is done in /etc/atp_db.conf. Typical configuration looks like this:
>
>
As explained above, the package contains ATP synchronizer modules and MYSQL/Oracle database scripts for ATP.

ATP Synchronizer

The main module of ATP Synchronizer is

atp_synchro 
and it picks up configuration information from different files as described below:

  • Database configuration: This contains database specific settings and they are done in /etc/atp_db.conf

Typical database configuration looks like this:

 [database] # enter mysql or oracle db_type=mysql
Line: 29 to 44
 passwd= #enter 'Y' or 'N' commit=
Changed:
<
<
  • Synchronizer configuration This have various sections on logging, certificate/key file , synchronizer specific configurations, field mappings between GOCDB and ATP, messaging broker etc and they need to be set appropriately for successful running of synchronizer.
>
>

  • Synchronizer configuration: This configuration file has various sections on logging, certificate/key files, different synchronizer specific configurations, field mappings between GOCDB and ATP repositories, messaging broker configuration etc and they need to be tuned appropriately for successful running of synchronizer. This configuration file usually resides in /etc/atp_synchro.conf

By default, certificate files are assumed to be present in /etc/nagios/globus directory. Please make sure that the certificate and key files are present in this directory or change the path of this to the directory where these are present. If this is not done , ATP synchronizer will not run properly.

  • Logging configuration: This defines various parameters for logging the run-time information of ATP synchronizer and this is done in /etc/atp_logging_files.conf. The logged data is saved in /var/log/atp/atp.log by default but the location can be changed if required.

Once the correct configuration is done, the synchronizer can be run by giving these files as a command line arguments.

e.g.

 atp_synchro -c /etc/atp/atp_synchro.conf -d /etc/atp/atp_db.conf -l /etc/atp/atp_logging_files.conf  
and the logs can be seen in
 /var/log/atp/atp.log 

ATP DB scripts for Oracle/MySQL

The ready-made SQL scripts for creation of tables, procedures/functions, triggers are available in this module. They can be used for creation/re-creation of Oracle/MySQL databases. In case, there is a version change in ATP database schema , the migration script for migrating existing ATP database to the new version is also present here.

ATP Web package

 

Revision 32010-02-10 - unknown

Line: 1 to 1
 
META TOPICPARENT name="LCG.ATP"

ATP COMPONENTS

Line: 7 to 7
 

INTRODUCTION

Changed:
<
<
The distribution of the ATP is done in two different RPMs,
>
>
The distribution of the ATP is done in two different RPMs.
 

COMPONENTS

\ No newline at end of file
Added:
>
>
  • ATP main package This contains ATP synchroniser, a python based program, for synchronizing the data from various topology providers like GOCDB, OIM, VO feeds etc. It synchronizes data from these providers with ATP repository periodically and this frequency can be changed if desired.The component, also, has all the necessary scripts for Oracle and MysQL databases creation/re-creation.
  • ATP web package This acts as a front-end for ATP repository. It is developed using Django, a high level python framework. The search interface for finding topologies of grid resources as well as programmatic feeds for exposure of ATP data through JSON/XML interfaces is available.

Installation issues

ATP main package

The configuration is divided in three parts: Database configuration( /etc/atp_db.conf), Synchronizer configuration(/etc/atp_synchro.conf) and Logging configuration(/etc/atp_logging_files.conf).
  • Database configuration This is done in /etc/atp_db.conf. Typical configuration looks like this:
[database] # enter mysql or oracle db_type=mysql db_name= host= user= passwd= #enter 'Y' or 'N' commit=
  • Synchronizer configuration This have various sections on logging, certificate/key file , synchronizer specific configurations, field mappings between GOCDB and ATP, messaging broker etc and they need to be set appropriately for successful running of synchronizer.

 \ No newline at end of file

Revision 22010-01-25 - unknown

Line: 1 to 1
 
META TOPICPARENT name="LCG.ATP"

ATP COMPONENTS

Revision 12010-01-25 - unknown

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="LCG.ATP"

ATP COMPONENTS

INTRODUCTION

The distribution of the ATP is done in two different RPMs,

COMPONENTS

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback