Given attributes for a node or cluster more information can be found. The following table shows how given one value you can obtain another value.

For example take nodename in the first column then you can use CDBDump to find the clustername or the Operational Procedures to find the sysadmin procedures for a given nodename.

A more complicated example. Suppose you have a clustername and you want to find the remedy category. The table tells you to Get nodenames. To get from clustername to nodenames the table suggests the use of CDBHosts. Now you have the nodenames you can use the table to find the remedy category for each node with CDBDump.

For details on how to use particular tools like CDBHosts or Operational Procedures see below.

Known/Unknown clustername subclustername nodename remedy category lemon alarms sysadmin procedures
clustername = Get nodenames CDBHosts Get nodenames Get nodename Operational Procedures
subclustername Get nodenames = CDBHosts Get nodenames Get nodenames Operational Procedures
nodename CDDump CDBDump = CDBDump lemon-cli Operational Procedures
remedy category ? ? ? = ? ?
lemon alarms ? ? ? ? = Get clustername
sysadmin procedures ? ? Get clustername first ? Get clustername =

Use of CDBDump

On lxplus given a node name you can obtain CDB cluster, subcluster, function, SMS status and contact address for a node. e.g CDBDump fts114 Only nodes in CDB will show anything.
$ CDBDump fts114
#####################################
#
# Hostname "fts114"
#
# Cluster          "gridfts" - subcluster "prod"
# Function         "ftsws"  (Comment: "FTS Web Service")
# State            "production", importance "80"
# Contracttype     "D"
# IT-section       "FIO-FS"
# IT-contact       "FTS.Support@cern.ch"
# User-contact     "FTS.Support@cern.ch"
# ITCM cc-email    ""
#
# Hardware         "ex_06_6" (elonex)
# Serial Number    "ch620-636-32"
# Warranty until   "10-OCT-09"
#
# Operating System "slc3" - kernel "2.4.21-47.0.1.EL.cernsmp" - tpl "pro_type_gridfts_slc3"
#
#
#        information retrieved by CDBDump at Tue Jul 17 10:16:10 2007
#
#####################################

The returned User-contact is the remedy category for the service?

Use of CDBHosts

On lxplus given a cluster name find all the hosts in that cluster. e.g. CDBHosts --cluster gridfts.
$ CDBHosts --cluster gridfts
fts006
fts101
fts102
fts103
fts104
fts105
fts106
fts107
fts108
fts109
fts110
fts111
fts112
fts113
fts114
fts115

Again on lxplus given a subcluster you can find all the hosts in a subcluster. I think this assumes that there is a unique namespace for subclusters though which is probably the case? e.g. CDBHosts --cluster=all --subcluster gridwms

$ CDBHosts  --cluster=all --subcluster gridwms
wms101
wms102

Use of Remedy

To obtain remedy category from a clustername?

Use of lemon-cli

To obtain the list of metrics for a given node use lemon-cli from lxplus. e.g. $ lemon-cli --nodes fts114 --server
> lemon-cli --nodes=fts114 --server
[INFO] lemon-cli version 1.0.0 started by straylen at Tue Jul 17 12:55:06 2007 on lxplus206.cern.ch
[VERB] Nodes:      fts114 
[VERB] Metrics:    35,43,44,46,807,901,902,910,911,4001,4003,4005,4006,4007,4008,4009,4012,4014,401 ...
[VERB] Method:     Latest
[VERB] 
[INFO] remote:  fts114  43      Tue Jul 17 12:46:13 2007        1
[INFO] remote:  fts114  44      Tue Jul 17 12:46:13 2007        1
[INFO] remote:  fts114  46      Tue Jul 17 12:46:13 2007        1
[INFO] remote:  fts114  807     Tue Jul 17 11:05:13 2007        23-NOV-2007
[INFO] remote:  fts114  901     Tue Jul 17 12:50:13 2007        0 0 0 0
[INFO] remote:  fts114  902     Tue Jul 17 12:50:13 2007        0 0 0 0 0 50 0 0 28 0 0 0 0 50000 6334 98.5 1.5 99.6 .4 1611.3 0
[INFO] remote:  fts114  910     Tue Jul 17 12:05:13 2007        0
[INFO] remote:  fts114  911     Tue Jul 17 12:05:13 2007        0
[INFO] remote:  fts114  4003    Tue Jul 17 12:46:13 2007        1
[INFO] remote:  fts114  4006    Tue Jul 17 12:46:13 2007        1
[INFO] remote:  fts114  4008    Tue Jul 17 12:46:13 2007        1
[INFO] remote:  fts114  4012    Tue Jul 17 12:46:13 2007        1
[INFO] remote:  fts114  4014    Tue Jul 17 12:46:13 2007        1
[INFO] remote:  fts114  4016    Tue Jul 17 12:46:13 2007        1
[INFO] remote:  fts114  4022    Tue Jul 17 12:05:13 2007        1
[INFO] remote:  fts114  4102    Fri Jul  6 20:12:59 2007        134217728
[INFO] remote:  fts114  4105    Tue Jul 17 12:50:13 2007        1
[INFO] remote:  fts114  4109    Mon Jul  9 10:55:33 2007        Linux 2.4.21-47.0.1.EL.cernsmp i386 Scientific_Linux_CERN_Release_3.0.8_(SL)
[INFO] remote:  fts114  4111    Fri Jul  6 20:12:59 2007        2
[INFO] remote:  fts114  4113    Tue Jul 17 11:35:13 2007        0
[INFO] remote:  fts114  4115    Sat Jul  7 20:13:00 2007        GenuineIntel Intel(R)_Xeon(TM)_CPU_3.00GHz 3000 11980 2 2
[INFO] remote:  fts114  5003    Tue Jul 17 11:10:13 2007        -1
[INFO] remote:  fts114  5004    Tue Jul 17 11:30:13 2007        -1
[INFO] remote:  fts114  5005    Tue Jul 17 12:05:13 2007        -1
[INFO] remote:  fts114  5006    Tue Jul 17 12:05:13 2007        -1
[INFO] remote:  fts114  5007    Tue Jul 17 12:05:13 2007        -1
[INFO] remote:  fts114  5008    Tue Jul 17 12:05:13 2007        -1
[INFO] remote:  fts114  5010    Tue Jul 17 12:05:13 2007        10546432
[INFO] remote:  fts114  5014    Tue Jul 17 12:05:13 2007        -1
[INFO] remote:  fts114  5033    Tue Jul 17 12:46:13 2007        1
[INFO] remote:  fts114  5037    Tue Jul 17 11:30:13 2007        -1
[INFO] remote:  fts114  5101    Mon Jul  9 10:55:33 2007        -1
[INFO] remote:  fts114  5102    Tue Jul 17 11:05:17 2007        0 OK
[INFO] remote:  fts114  5120    Tue Jul 17 12:46:13 2007        1
[INFO] remote:  fts114  5121    Tue Jul 17 12:05:13 2007        0
[INFO] remote:  fts114  5122    Tue Jul 17 12:05:13 2007        0
[INFO] remote:  fts114  5123    Tue Jul 17 12:45:13 2007        1
[INFO] remote:  fts114  5124    Tue Jul 17 12:45:13 2007        1
[INFO] remote:  fts114  5125    Tue Jul 17 12:05:13 2007        0
[INFO] remote:  fts114  5127    Tue Jul 17 12:05:13 2007        0
[INFO] remote:  fts114  5130    Tue Jul 17 12:05:13 2007        0
[INFO] remote:  fts114  5131    Tue Jul 17 12:05:13 2007        0
[INFO] remote:  fts114  5133    Tue Jul 17 12:05:13 2007        0
[INFO] remote:  fts114  6002    Tue Jul 17 12:51:27 2007        OK
[INFO] remote:  fts114  6100    Tue Jul 17 12:05:14 2007        23.5 1.5
[INFO] remote:  fts114  6101    Tue Jul 17 09:05:17 2007        1800 229.455878111675
[INFO] remote:  fts114  6102    Tue Jul 17 07:05:17 2007        3.392
[INFO] remote:  fts114  6103    Tue Jul 17 12:30:14 2007        27 0 1
[INFO] remote:  fts114  6104    Tue Jul 17 11:20:14 2007        39 7 0 OK
[INFO] remote:  fts114  6105    Tue Jul 17 12:35:17 2007        1800 229.455878111675 3
[INFO] remote:  fts114  6107    Tue Jul 17 12:30:14 2007        27 -11.9601328903654
[INFO] remote:  fts114  6130    Tue Jul 17 11:05:15 2007        0 OK
[INFO] remote:  fts114  6131    Tue Jul 17 11:05:15 2007        29 0
[INFO] remote:  fts114  6132    Tue Jul 17 11:05:16 2007        0 OK
[INFO] remote:  fts114  6309    Tue Jul 17 12:05:13 2007        0
[INFO] remote:  fts114  9001    Tue Jul 17 12:05:13 2007        14509664
[INFO] remote:  fts114  9011    Tue Jul 17 12:50:13 2007        8.23 0 .39 91.01 .35 .01 .01 300.05 0
[INFO] remote:  fts114  9012    Tue Jul 17 12:50:13 2007        135.19 40556
[INFO] remote:  fts114  9013    Tue Jul 17 12:50:13 2007        285.26 85577
[INFO] remote:  fts114  9022    Tue Jul 17 12:50:13 2007        0 0 0 0
[INFO] remote:  fts114  9023    Tue Jul 17 12:50:13 2007        0 0 90.08 27024
[INFO] remote:  fts114  9025    Tue Jul 17 12:50:13 2007        4192880 0 2929236 298780 0 149740 3941300 0 96.34 -1 -1
[INFO] remote:  fts114  9031    Tue Jul 17 12:50:13 2007        130
[INFO] remote:  fts114  9032    Tue Jul 17 12:50:13 2007        2.93 880
[INFO] remote:  fts114  9102    Tue Jul 17 12:50:13 2007        230680 7475 223205 0 90.1
[INFO] remote:  fts114  9103    Tue Jul 17 12:15:13 2007        sda6 0 .1
[INFO] remote:  fts114  9103    Tue Jul 17 12:30:13 2007        sda4 0 0
[INFO] remote:  fts114  9103    Tue Jul 17 12:30:13 2007        sda7 0 0
[INFO] remote:  fts114  9103    Tue Jul 17 12:30:13 2007        sda8 0 0
[INFO] remote:  fts114  9103    Tue Jul 17 12:40:13 2007        sda1 0 0
[INFO] remote:  fts114  9103    Tue Jul 17 12:50:13 2007        sda2 0 .1
[INFO] remote:  fts114  9103    Tue Jul 17 12:50:13 2007        sda3 0 68.3
[INFO] remote:  fts114  9103    Tue Jul 17 12:50:13 2007        sda5 0 21.6
[INFO] remote:  fts114  9104    Tue Jul 17 12:30:13 2007        / ext3 rw 10317860 33 -1 -1 12 1
[INFO] remote:  fts114  9104    Tue Jul 17 12:30:13 2007        /boot ext3 rw 497829 16 -1 -1 1 1
[INFO] remote:  fts114  9104    Tue Jul 17 12:30:13 2007        /tmp ext3 rw 20641788 1 -1 -1 1 1
[INFO] remote:  fts114  9104    Tue Jul 17 12:30:13 2007        /usr/vice/cache ext2 rw 2063504 1 -1 -1 20 1
[INFO] remote:  fts114  9104    Tue Jul 17 12:30:13 2007        /var ext3 rw 202696296 3 -1 -1 1 1
[INFO] remote:  fts114  9200    Tue Jul 17 11:05:13 2007        eth0 128.142.173.219 255.255.0.0 128.142.255.255 128.142.1.1 00:30:48:78:9F:98 1500 1 1024000
[INFO] remote:  fts114  9200    Tue Jul 17 11:05:13 2007        lo 127.0.0.1 255.0.0.0 undefined undefined undefined 16436 -1 -1
[INFO] remote:  fts114  9201    Tue Jul 17 12:50:13 2007        88 21 24 0
[INFO] remote:  fts114  9208    Tue Jul 17 12:50:13 2007        eth0 2185373 5.54 1694320 8.63
[INFO] remote:  fts114  9208    Tue Jul 17 12:50:13 2007        eth1 0 0 0 0
[INFO] remote:  fts114  10000   Fri Jul  6 20:12:59 2007        2.15.0-1
[INFO] remote:  fts114  10001   Tue Jul 17 11:05:13 2007        148
[INFO] remote:  fts114  10002   Wed Jul 11 20:13:04 2007        afscm lemon-sensor-afscm 2.0-4
[INFO] remote:  fts114  10002   Wed Jul 11 20:13:04 2007        exception N/A 1.2.1-2
[INFO] remote:  fts114  10002   Wed Jul 11 20:13:04 2007        file N/A 2.15.0-1
[INFO] remote:  fts114  10002   Wed Jul 11 20:13:04 2007        fio N/A -1
[INFO] remote:  fts114  10002   Wed Jul 11 20:13:04 2007        hwprobe lemon-sensor-hwprobe 1.0-2
[INFO] remote:  fts114  10002   Wed Jul 11 20:13:04 2007        hwscan lemon-sensor-hwscan 1.0-2
[INFO] remote:  fts114  10002   Wed Jul 11 20:13:04 2007        ipmi lemon-sensor-ipmi 1.2-3
[INFO] remote:  fts114  10002   Wed Jul 11 20:13:04 2007        linux N/A 2.15.0-1
[INFO] remote:  fts114  10002   Wed Jul 11 20:13:04 2007        parseLog lemon-sensor-parse-log 1.0.4-1
[INFO] remote:  fts114  10002   Wed Jul 11 20:13:04 2007        smart lemon-sensor-smart 1.0.5-0
[INFO] remote:  fts114  10002   Wed Jul 11 20:13:04 2007        sure lemon-sensor-sure 1.1.0-1
[INFO] remote:  fts114  10002   Wed Jul 11 20:13:04 2007        tw lemon-sensor-tw 1.0-11
[INFO] remote:  fts114  10003   Tue Jul 17 12:45:18 2007        1 13 13
[INFO] remote:  fts114  10004   Tue Jul 17 12:45:18 2007        438009 36900 .01 5532 2324 .06 .06 101504 64664 1.58
[INFO] remote:  fts114  10005   Tue Jul 17 12:50:18 2007        660
[INFO] remote:  fts114  10006   Tue Jul 17 11:35:48 2007        0 9
[INFO] remote:  fts114  10007   Tue Jul 17 12:15:13 2007        0 0 0 0
[INFO] remote:  fts114  10008   Tue Jul 17 11:07:13 2007        1
[INFO] remote:  fts114  20002   Tue Jul 17 12:53:13 2007        .16
[INFO] remote:  fts114  20003   Tue Jul 17 12:30:13 2007        0
[INFO] remote:  fts114  20044   Tue Jul 17 12:05:13 2007        -1
[INFO] remote:  fts114  20047   Tue Jul 17 12:05:13 2007        0
[INFO] remote:  fts114  30001   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30002   Tue Jul 17 12:30:43 2007        0 000 (null)
[INFO] remote:  fts114  30003   Tue Jul 17 12:30:43 2007        0 000 (null)
[INFO] remote:  fts114  30004   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30006   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30007   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30008   Tue Jul 17 12:08:43 2007        0 000 (null)
[INFO] remote:  fts114  30009   Tue Jul 17 12:30:43 2007        0 000 (null)
[INFO] remote:  fts114  30010   Tue Jul 17 12:30:43 2007        0 000 (null)
[INFO] remote:  fts114  30011   Tue Jul 17 12:30:43 2007        0 000 (null)
[INFO] remote:  fts114  30012   Tue Jul 17 12:30:43 2007        0 000 (null)
[INFO] remote:  fts114  30016   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30020   Tue Jul 17 12:08:43 2007        0 000 (null)
[INFO] remote:  fts114  30021   Tue Jul 17 12:08:43 2007        0 000 (null)
[INFO] remote:  fts114  30022   Tue Jul 17 12:08:43 2007        0 000 (null)
[INFO] remote:  fts114  30023   Tue Jul 17 12:08:43 2007        0 000 (null)
[INFO] remote:  fts114  30024   Tue Jul 17 12:08:43 2007        0 000 (null)
[INFO] remote:  fts114  30026   Tue Jul 17 12:08:43 2007        0 000 (null)
[INFO] remote:  fts114  30028   Tue Jul 17 12:08:43 2007        0 000 (null)
[INFO] remote:  fts114  30032   Tue Jul 17 12:08:43 2007        0 000 (null)
[INFO] remote:  fts114  30033   Tue Jul 17 12:10:43 2007        0 000 (null)
[INFO] remote:  fts114  30041   Tue Jul 17 12:30:43 2007        0 000 (null)
[INFO] remote:  fts114  30048   Tue Jul 17 12:10:43 2007        0 000 (null)
[INFO] remote:  fts114  30056   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30064   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30068   Tue Jul 17 12:15:43 2007        0 000 (null)
[INFO] remote:  fts114  30069   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30070   Tue Jul 17 12:10:43 2007        0 000 (null)
[INFO] remote:  fts114  30072   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30077   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30079   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30099   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30303   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30304   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30306   Tue Jul 17 12:35:43 2007        0 000 (null)
[INFO] remote:  fts114  30318   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30319   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30320   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30501   Tue Jul 17 11:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30502   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30503   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30504   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30505   Tue Jul 17 12:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30522   Tue Jul 17 11:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30523   Tue Jul 17 11:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30530   Tue Jul 17 11:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30535   Tue Jul 17 11:05:43 2007        0 000 (null)
[INFO] remote:  fts114  30538   Tue Jul 17 12:30:43 2007        0 000 (null)
[INFO] remote:  fts114  30539   Tue Jul 17 12:40:43 2007        0 000 (null)
[INFO] remote:  fts114  30540   Tue Jul 17 12:40:43 2007        0 000 (null)
[INFO] remote:  fts114  30606   Mon Jul  9 10:55:35 2007        0 000 (null)
[INFO] remote:  fts114  30902   Tue Jul 17 12:45:23 2007        2 000 (null)
[INFO] remote:  fts114  30903   Tue Jul 17 12:50:23 2007        2 000 (null)
[INFO] remote:  fts114  32004   Tue Jul 17 12:30:43 2007        0 000 (null)
[VERB] 
[VERB] Total: 161 results

To get details of a particular metric. $ lemon-cli --info --verbose --metrics=4003 --nodes=fts114

$ lemon-cli --info --verbose --metrics=4003 --nodes=fts114
[INFO] lemon-cli version 1.0.0 started by straylen at Tue Jul 17 13:13:13 2007 on lxplus203.cern.ch
[INFO] 4003
[INFO]          Name:   klogd
[INFO]          Class:  system.numberOfProcesses

Use of Operational Procedures

Given a cluster or nodename visit https://cern.ch/service-cc-opm and enter the node, subcluster or cluster in the search box.

-- SteveTraylen - 17 Jul 2007

Edit | Attach | Watch | Print version | History: r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r1 - 2007-07-17 - SteveTraylen
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    LCG All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback