Show Children Hide Children

Main FTS Pages
FtsRelease22
Install
Configuration
Administration
Procedures
Operations
Development
Previous FTSes
FtsRelease21
FtsRelease21
All FTS Pages
FtsWikiPages
Last Page Update
Main.unknown
2009-10-30

The File Transfer Monitor

A new node type glite-FTM for SL4 has been created. The File Transfer Monitor node queries the FTS database currently performs a number of functions.

  • A web page summary is created at hourly, daily and weekly intervals. This is performed by the glite-transfer-monitor-report package.
  • Two summary files are created of recent transfers from the database. This is performed by the glite-transfer-monitor-gridview package.
  • These summary files are published into gridview via the gridview packages. This is done by the gridview-wsclient-fts package.

Other packages are gridview-wsclient-common which are required by gridview-wsclient-fts and glite-transfer-schema which contains the schema additions for the FTS database.

The whole lot is configured by glite-yaim-fts and the ftm2 target.

Install Guide

  1. Install Oracle Instant Client in such a way that it works smile E.g if you run # sqlplus -V it should work, you may need to echo "/usr/lib/oracle/10.2.0.1/client/lib" > /etc/ld.so.conf.d/oracle.conf && ldconfig. It all depends how you installed Oracle Instant Client.
  2. Install FTM with GenericInstallGuide310.
  3. You may see a dependency problem during the installation with perl-SOAP-Lite. The problem is that the gridview packages require a newer version of perl-SOAP-Lite than is available in the SL4. The newer version is available from Dag however. Of course if you are protecting your OS from Dag upgrades with yum protectbase you will have to install this package manually to override the operating system version.
      # wget http://dag.wieers.com/rpm/packages/perl-SOAP-Lite/perl-SOAP-Lite-0.69-1.el4.rf.noarch.rpm
      # yum localinstall perl-SOAP-Lite-0.69-1.el4.rf.noarch.rpm
     
  4. Configure your site-info.def as below.

  1. Configure FTM /opt/glite/yaim/bin/yaim -c -s /root/siteinfo/site-info.def -n FTM2
  2. Note that yaim will exit prematurely if some schema for the FTM is not loaded. It will exit with a message describing what schema should be loaded. When the schema is loaded an error may be seen Trigger created with compilation errors. This is understood Savannah #30372 and can be safely ignored.

Configuration With YAIM

This is the minimum set of YAIM configuration that works.

YAIM Variable Example Setting Comments
BDII_HOST lcg-bdii.cern.ch Top Level BDII to resolve Sites from SRM Endpoints
GLITE_USER edginfo Various crons run as this user
INSTALL_ROOT /opt Ehere glite is.
GLITE_LOCATION /opt/glite  
ORACLE_LOCATION /usr/lib/oracle/10.2.0.1  
FTM_TYPES gridview report Space delimeted list of reporting you which to start, this is the full set of options
FTM_REPORT_INSTANCE tiertwo-fts-ws.cern.ch The name of the FTS server you are reporting on.
FTM_REPORT_PERIODS hourly daily weekly space separated list of reporting periods, note hourly can create considerable strain on a busy FTS
FTM_DB_CONNECT Most likely the same as $FTA_GLOBAL_DB_CONNECTSTRING Oracle connection parameters.
FTM_DB_USER Most likely the same as $FTA_GLOBAL_DB_USER Oracle connection parameters
FTM_DB_PASS Most likely the same as $FTA_GLOBAL_DB_PASSWORD Oracle connection parameters
GRIDVIEW_WSDL http://gvarch.cern.ch:8080/wsarch/services/WebArchiverAdv?wsdl The endpoint of the gridview webservice to publish to
FTS_HOST_ALIAS   the hostname of the FTS instance

The current recommended production GRIDVIEW endpoint is (see GridviewInstConf):

Results

Log files are created in /var/log/glite/transfer-monitor-{report,gridview} and published on your host at
  • http://yourhost.example.org/transfer-monitor-report
  • http://yourhost.example.org/transfer-monitor-gridview/gridview.dat
  • http://yourhost.example.org/transfer-monitor-gridview/gridview-summary.dat

You need to wait long enough the various crons to run. After an hour there should be some results everywhere.

Debugging

To confirm if entries are correctly being inserted into gridview you can increase the logging level to 4 in its configuration.
$Publisher_Log_Level = 4;

-- SteveTraylen - 08 Aug 2007

Edit | Attach | Watch | Print version | History: r14 < r13 < r12 < r11 < r10 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r14 - 2009-10-30 - unknown
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright &© 2008-2023 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback