-- AlexandreEline - 17-May-2012

AMS cluster is:

9 Servers 8 Arrays 12 File systems 4 FC Switches
pcamsj0.grdl fcsoc00 /fcdat0 sanbox01.hrdl
pcamsj1.grdl fcsoc01 /fcdat1 sanbox02.grdl
pcamsf8.grdl fcsoc02 /r0fc00 sanbox04.hrdl
pcamsj2.grdl fcsoc03 /fc03dat0 sanbox05.grdl
pcamsj3.grdl fcsoc04 /fc03dat1  
pcamsr0.grdl gfs00 /fc03dat2  
pcamsr1.grdl users /scratch  
scamsfs0.grdl fcpoc00 /fc02dat1  
scamsfs1.grdl   /fc01dat1  
    /f2users  
    /fc00dat1  
    /fcpoc00  

If one or two servers inaccessible but all file systems still visible, it may be enough to reboot bad machines via DRACs HardWare by power reset. In worst case when one or any file systems are disappear, full cluster has to be restarted. For that: switch off all servers, switch on all servers.

If you have console on some servers be check that 'cman', 'clvmd' and 'multipathd' services are started normally ( [OK] )

When boot processes on all servers are finished, check that cluster is ready: on all servers run pvs as root, output should be like: [root@pcamss0 ~]# pvs

PV VG Fmt Attr PSize PFree

/dev/dm-10 fcsoc00 lvm2 a- 52.75T 18.41G

/dev/dm-11 fcsoc00 lvm2 a- 52.75T 4.09G

/dev/dm-12 f2users lvm2 a- 10.00T 3.84G

/dev/dm-13 gfs00 lvm2 a- 12.30T 0

/dev/dm-14 gfs00 lvm2 a- 13.43T 3.12G

/dev/dm-15 gfs00 lvm2 a- 13.43T 0

/dev/dm-4 fcsoc02-2 lvm2 a- 52.75T 18.41G

/dev/dm-5 fcsoc02 lvm2 a- 52.75T 24.56G

/dev/dm-6 fcsoc02-2 lvm2 a- 52.75T 0

/dev/dm-7 fcsoc01 lvm2 a- 52.75T 24.56G

/dev/dm-8 scratch lvm2 a- 52.75T 24.56G

/dev/dm-9 fcsoc00 lvm2 a- 52.75T 0

if not on one or two servers, reboot this server again.

When everything is OK, read ExpertOnly and do what is written here.

Topic revision: r7 - 2014-01-06 - AlexandreEline
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    AMS All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2018 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback