FTS Server Installation Guide 1.5

This is the installation guide for FTS server 1.5. It covers both the agent servers (FTA) and the web-service (FTS) components.

It refers to FTS version 1.5 from gLite release 3.0.

Changes from release 1.4 are described in FtsChangesFrom14To15.

If you are upgrading from 1.4 please read the above changes and then follow the instructions in FtsServerUpgrade14to15 instead.

Administration of the service is described in FtsServerAdmin15.

Service procedures specific to 1.5 can be found in FtsProcedures15.

Requirements

1. You should install the FTS and FTA servers on reasonable Scientific Linux 3 machines, ideally of mid-range server-class. It is recommended to have a least 512M memory, and a modern processor. Large amounts of disk space is not critical, so a disk-server class machine is not needed.
2. There should be a valid hostcert and hostkey in /etc/grid-security/. The installation and configuration procedure should download the CA hash files and CRL lists specified in the current release at http://www.eugridpma.org/distribution/. If these already exist on the system, they will will be upgraded if necessary.
3. The configuration makes changes to the password file (it creates 2 users). Your system (and in particular the file /etc/security/limits.conf) should allow these users to obtain a shell, although there is no requirement for remote login to these accounts.
4. Your system should have Java installed on it, this is available from http://java.sun.com. This is not provided by gLite for redistribution licensing restrictions. The recommended default is j2re1.4.2_08.
5. Your system should have Oracle instantclient installed on it. This is available at http://www.oracle.com/technology/software/tech/oci/instantclient/index.html. The recommended version is currently 10.2.0.1.
6. For the host running the FTS web-service, the firewall should be open for incoming on port tcp/8443 for the web-service. The connection from the client to the web-service is secured with GSI.
7. For the host running the FTA agent daemons, the outgoing firewall (if present) should allow access to your MyProxy server, the database, all source SRM/gridFTP clusters and all destination SRM/gridFTP clusters.

Choose deployment scenario

Examine the possible deployment scenarios from FtsServerDeploy13 and decide which you want.

The miniumum suggested configuration is:

• one machine for the FTS web-service
• one machine for all the FTA agent daemons (both the VO agents and the channel agents)

Both the web-service instances (if there is more than one) and the agent dameons can be (and should be) spread across machines for scalability.

Prepare the site-info.def file

This the site wide config file for YAIM. It should be prepared in advance.

The file will contain the configuration for all of the FTA agents (VO and channel) and the web-service(s).

We describe the configuration of the agent daemons first, and give an example.

FTA agents

The yaim variables for configuring the FTA agents are all prefixed with FTA_ in the site-info.def file. Any variable with prefix FTA_ that the configuration script does not understand will cause the script to fail.

What agents go where

Identify:

• the hostname of the machines you want to be running the FTA agents
• which agents will run on which machine.

In the example, we assume two VO agents (for dteam and atlas) and two channel agents (CERN-CERN and CERN-BNL). We choose to run:

• the dteam VO agent and CERN-CERN channel agent together on the host fts001.test.ch
• the atlas VO agent and CERN-BNL channel agent together on host fts002.test.ch

In the YAIM variable FTA_MACHINES, specify a tag for each node that will be installed (typically ONE, TWO, THREE). In the example:

FTA_MACHINES="ONE TWO"

For each machine, specify its hostname, and which agents will run on it. Construct the YAIM variable name using the tag specified above.

FTA_AGENTS_ONE_HOSTNAME="fts001.test.ch"
FTA_AGENTS_ONE="DTEAM CERN-CERN"

FTA_AGENTS_TWO_HOSTNAME="fts002.test.ch"
FTA_AGENTS_TWO="ATLAS CERN-BNL"

For each agent listed, specify its type. The type is either:

• URLCOPY for a 3rd party copy channel agent.
• SRMCOPY for an SRM copy channel agent.
• VOAGENT_PYTHON for a VO agent.

Construct the YAIM variable to use as FTA_[agent-name]. Since the underlying shell of YAIM is bash, agent names with a dash '-' should substitute an underscore instead, '_'. For the example:

FTA_CERN_CERN="URLCOPY"
FTA_CERN_BNL="URLCOPY"
FTA_DTEAM="VOAGENT_PYTHON"
FTA_ATLAS="VOAGENT_PYTHON"

This fully specifies which agent of what type will run on which nodes.

Global variables

There are a few global variables that MUST be set in order to make the FTA agents work (mostly the DB connection parameters). Global variables can be identified with the prefix FTA_GLOBAL_. They are applied to all agents.

You must specify the DB type as ORACLE (MYSQL is not yet supported fully by the YAIM configuration):

FTA_GLOBAL_DBTYPE=ORACLE

You must specify the database connection string (as an InstantClient OCI connection string), the DB username and the DB password. Ask your database administrator for these. For example:

FTA_GLOBAL_DB_CONNECTSTRING="(DESCRIPTION=(LOAD_BALANCE=no)(ADDRESS=(PROTOCOL=TCP)(HOST=lcgr1-v.cern.ch)(PORT=1521))(ADDRESS=(PROTOCOL=TCP)(HOST=lcgr2-v.cern.ch)(PORT=1521))(CONNECT_DATA=(SERVICE_NAME=lcg_fts.cern.ch)))"
FTA_GLOBAL_DB_USER=lcg_fts_prod_w
FTA_GLOBAL_DB_PASSWORD=xxxxxxxx

It is recommended to set the logging level of the agent to slightly higher than the default:

FTA_GLOBAL_LOG_PRIORITY=INFO

The default will be changed to this in a future release, so specifying it explicitly here will not be needed (see bug 16521).

It is not recommended to set any other FTA_GLOBAL_ variables.

Agent variables

The non-global FTA agent configuration parameters can be controlled in two ways.

• TYPEDEFAULT. The parameter in question is applied to all agent instances of that type, e.g. all URLCOPY agents.
• Instance specific. The parameter in question is applied only to the named instance.

The prefix of the variable control whether it is applied as a type default or to a specific instance. For example, the parameter GUC_TRANSFERTIMEOUT (which controls the globus-url-copy global timeout):

FTA_TYPEDEFAULT_URLCOPY_GUC_TRANSFERTIMEOUT=1800

will apply the value to all URLCOPY agents. Whereas:

FTA_CERN_RAL_GUC_TRANSFERTIMEOUT=3600

will apply the value only to the CERN-RAL agent.

The instance parameters override the TYPEDEFAULT parameters, i.e. if the same variable is set in the TYPEDEFAULT and is also set in the instance, then the instance value will be used.

If neither the TYPEDEFAULT nor the instance specifies a variable, then the agent default value will be used. There are a large number of configuration parameters that could be set for the agents, but for the majority of them, the default value is fine.

Type specific variables

For each agent type specified ("VOAGENT_PYHTON", "URLCOPY", or "SRMCOPY"), you may specify variables which are to be applied to all agents of that type. If you do not specify any value here, the agent internal default value will be used. Very few of the configuration parameters need to be varied from the default.

Type specific variables are recognized by the prefix FTA_TYPEDEFAULT_[agent type], e.g. FTA_TYPEDEFAULT_URLCOPY_

Channel agent types

It is recommended to set:

FTA_TYPEDEFAULT_URLCOPY_GUC_LOGLEVEL=DEBUG
FTA_TYPEDEFAULT_SRMCOPY_GUC_LOGLEVEL=DEBUG

which varies the default transfer logging level of URLCOPY and SRMCOPY agents to DEBUG. The default will be changed to this in a future release, so specifying it explicitly here will not be needed (see bug 16521).

For a basic setup, it is not recommended to vary any other defaults.

VO agent type

For the VO agents, some configuration parameters MUST be specified (i.e. the default is not appropriate):

FTA_TYPEDEFAULT_VOAGENT_PYTHON_PYTHON_PYTHONPATH="${GLITE_LOCATION}/lib/python2.2/site-packages:${GLITE_LOCATION}/lib/python/glite/fts/strategies/"
FTA_TYPEDEFAULT_VOAGENT_PYTHON_ACTIONS_RETRYMODULE=smarter_retry
FTA_TYPEDEFAULT_VOAGENT_PYTHON_ACTIONS_RETRYPARAMS="MaxFailures = 3 ; HoldEnabled = false ; OverwriteFailedFiles = true ; OverwriteExistingFiles = false ; DefaultRetryDelay = 300 ; RetryDelayForTimeoutOnGet = 1800 ; RetryDelayForDestFileExists = 300 ;"

This tells them which retry plugin to use and defines the necessary variables to be passed to the plugin. The default will be changed to this in a future release, so specifying it explicitly here will not be needed (see bug 16520).

Instance specific variables

Instance specific configuration parameters are applied only to the named FTA agent daemon.

Instance specific variables are prefixed with FTA_[instance-name]_. Since the underlying shell of YAIM is bash, agent names with a dash '-' should substitute an underscore instead, '_'. As an example, for the CERN-BNL agent:

FTA_CERN_BNL_LOG_PRIORITY=DEBUG

will set the agent logging level to DEBUG for that specific agent, overriding the global default set from FTA_GLOBAL_LOG_PRIORITY above.

Example configuration for FTA agents

Given the example above, the YAIM variable that need to be specified are summarised in FtsServerInstall15YaimExample.

FTS web-service

[to do]

RPM installation

The RPM installation is managed by YAIM.

See the YAIM installation guide for more details on how to install yaim.

http://grid-deployment.web.cern.ch/grid-deployment/documentation/LCG2-Manual-Install/

There are two distinct server types to install, FTS (the web-service dameons) and FTA (the agent dameons). From the deployment model you have chosen, identify which machines will be running FTS web-service and which machines will be running FTA agents.

FTS web-service

Run the YAIM install_node script:

/opt/glite/yaim/scripts/install_node site-info.def glite-FTS_oracle

This will check that an appropriate version of Oracle instantclient is installed.

FTA agents

Run the YAIM install_node script:

/opt/glite/yaim/scripts/install_node site-info.def glite-FTA_oracle

This will check that an appropriate version of Oracle instantclient is installed.

Run the configuration script

On each node, run the yaim configuration script, dependent on the node type.

FTS web-service

For the web-service nodes, run:

/opt/glite/yaim/scripts/configure_node site-info.def FTS

FTA agents

For the agent nodes, run:

/opt/glite/yaim/scripts/configure_node site-info.def FTA

Starting the service

FTS web-service

To start the FTS web-service:

service tomcat5 start

A single daemon will start under the tomcat4:tomcat4 user.

FTA agents

To start the FTA agent daemons:

service transfer-agents start

Every agent daemon that you have chosen to configure on the box will be started in sequence.

To start a single agent daemon:

service transfer-agents start --instance glite-transfer-channel-agent-srmcopy-CERN-FNAL

where the instance name is described above.

[ incomplete ]

Last edit: FlaviaDonno on 2007-02-02 - 10:03

Maintainer: GavinMcCance