The File Transfer Monitor
A new node type glite-FTM for SL4 has been created. The File Transfer Monitor node queries the FTS database currently
performs a number of functions.
- A web page summary is created at hourly, daily and weekly intervals. This is performed by the glite-transfer-monitor-report package.
- Two summary files are created of recent transfers from the database. This is performed by the glite-transfer-monitor-gridview package.
- These summary files are published into gridview via the gridview packages. This is done by the gridview-wsclient-fts package.
Other packages are gridview-wsclient-common which are required by gridview-wsclient-fts and glite-transfer-schema which contains the schema
additions for the FTS database.
The whole lot is configured by glite-yaim-fts and the ftm2 target.
Install Guide
- Install Oracle Instant Client in such a way that it works
E.g if you run # sqlplus -V
it should work, you may need to echo "/usr/lib/oracle/10.2.0.1/client/lib" > /etc/ld.so.conf.d/oracle.conf && ldconfig
. It all depends how you installed Oracle Instant Client.
- Install FTM with GenericInstallGuide310.
- You may see a dependency problem during the installation with
perl-SOAP-Lite
. The problem is that the gridview packages require a newer version of perl-SOAP-Lite
than is available in the SL4. The newer version is available from Dag however. Of course if you are protecting your OS from Dag upgrades with yum protectbase you will have to install this package manually to override the operating system version.
# wget http://dag.wieers.com/rpm/packages/perl-SOAP-Lite/perl-SOAP-Lite-0.69-1.el4.rf.noarch.rpm
# yum localinstall perl-SOAP-Lite-0.69-1.el4.rf.noarch.rpm
- Configure your
site-info.def
as below.
- Configure FTM
/opt/glite/yaim/bin/yaim -c -s /root/siteinfo/site-info.def -n FTM2
- Note that yaim will exit prematurely if some schema for the FTM is not loaded. It will exit with a message describing what schema should be loaded. When the schema is loaded an error may be seen
Trigger created with compilation errors
. This is understood Savannah #30372
and can be safely ignored.
Configuration With YAIM
This is the minimum set of YAIM configuration that works.
YAIM Variable |
Example Setting |
Comments |
BDII_HOST |
lcg-bdii.cern.ch |
Top Level BDII to resolve Sites from SRM Endpoints |
GLITE_USER |
edginfo |
Various crons run as this user |
INSTALL_ROOT |
/opt |
Ehere glite is. |
GLITE_LOCATION |
/opt/glite |
|
ORACLE_LOCATION |
/usr/lib/oracle/10.2.0.1 |
|
FTM_TYPES |
gridview report |
Space delimeted list of reporting you which to start, this is the full set of options |
FTM_REPORT_INSTANCE |
tiertwo-fts-ws.cern.ch |
The name of the FTS server you are reporting on. |
FTM_REPORT_PERIODS |
hourly daily weekly |
space separated list of reporting periods, note hourly can create considerable strain on a busy FTS |
FTM_DB_CONNECT |
Most likely the same as $FTA_GLOBAL_DB_CONNECTSTRING |
Oracle connection parameters. |
FTM_DB_USER |
Most likely the same as $FTA_GLOBAL_DB_USER |
Oracle connection parameters |
FTM_DB_PASS |
Most likely the same as $FTA_GLOBAL_DB_PASSWORD |
Oracle connection parameters |
GRIDVIEW_WSDL |
http://gvarch.cern.ch:8080/wsarch/services/WebArchiverAdv?wsdl |
The endpoint of the gridview webservice to publish to |
FTS_HOST_ALIAS |
|
the hostname of the FTS instance |
The current recommended production GRIDVIEW endpoint is (see
GridviewInstConf):
Results
Log files are created in /var/log/glite/transfer-monitor-{report,gridview} and published on your host at
- http://yourhost.example.org/transfer-monitor-report
- http://yourhost.example.org/transfer-monitor-gridview/gridview.dat
- http://yourhost.example.org/transfer-monitor-gridview/gridview-summary.dat
You need to wait long enough the various crons to run. After an hour there should be some results everywhere.
Debugging
To confirm if entries are correctly being inserted into gridview you can increase the logging level to 4 in its
configuration.
$Publisher_Log_Level = 4;
--
SteveTraylen - 08 Aug 2007
Topic revision: r14 - 2009-10-30
- unknown