• Scripts - RT
    • Probably modify the '''radiant-load-generator''' script to account for the oplapro nodes that will be in use.
    • Write cleanup script to wipe out disk/filesystem on Rembrandt cluster.
  • Logging
    • Parse gridftp logs and put stuff in postgres. - RT
Done. On rembrandt[5-8] there are cron jobs running that parses the gridftp logs and inserts the entries of the past hour in a postgres database that is running on This database can be queried at
    • Parse gridftp logs and put the last so many entries in http server. - RT
    • Make sure that '''''' files are archived. - RT
Done. In /afs/ there is a script called that does this job. It starts up the daemon and saves the existing /var/log/radiant/radiant-NL.log to ${HOME}/var/log/radiant/radiant-NL.log_`date +%s`
    • Ganglia - ???
    • MRTG graphs - ???
  • Configuration Rembrandt cluster
    • kernel - ???
    • disk - ???
  • Configuration Network - ???
  • Preliminary tests - ???

Configuration Information - Monitoring

GridFTP logs

The scripts used for the gridftp logs may be found at: [].

Web Page

On the rembrandt nodes cron jobs ([]) are running every two minutes (every even minute) that do a tail -100 of /var/log/gsiftp.log and copy that into /home/rembrandt0/ron/var/www/gsiftp_rembrandt[3-6].log. On rembrandt5 a cron job runs ( every odd minute that merges these files and does a sort based on end time on these files. Finally, this cron jobs parses the gridftp log output to a html file and copies it to were it can be viewed at [].

Postgres Database

On the rembrandt nodes cron jobs ( run every hour that parse the entries in the gridftp logs of the past hour and inserts them in a postgres database. The postgres database can be queried at: " target="_blank">]]. The SQL table is called gridftp and contains the following data:

CREATE TABLE gridftp (
   host text,
   VO text,
   username text,
   src text,
   dest text,
   block_size bigint,
   nstreams bigint,
   buffer_size bigint,
   nbytes bigint,
   nstripes bigint,
   throughput double precision,
   volume text,
   file text,
   code int,
   start_year int,
   start_month int,
   start_day int,
   start_hour int,
   start_minute int,
   start_second int,
   start_microseconds int,
   end_year int,
   end_month int,
   end_day int,
   end_hour int,
   end_minute int,
   end_second int,
   end_microseconds int,
   start_date date,
   end_date date

SET DateStyle TO 'European';


* Individual GigE channel in the 10GigE can be seen on:

-- JamesCasey - 17 Jun 2005

Edit | Attach | Watch | Print version | History: r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r1 - 2005-06-17 - unknown
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback