Clean-up space on pcpos[p,c][0,1]

1. Receive a warning from nagios

Notes:

- nagios: was setup by Pavel, contains a lot of stuff which is not (yet?) in ams-stats (Oleg has duplicated only a part of it)

- ams-stats: Oleg's toy

1.1 Have a look at the graphs: http://ams-stats.cern.ch:3000/dashboard/db/pocc?refresh=10s&orgId=1

2. Send an e-mail to Mike to ask for the FRAMES and BLOCKS numbers

2.1 Reply from Mike:

p0: FRAMES through 2899, BLOCKS through 2889

c0: FRAMES through 2889, BLOCKS through 2899

3. Check those are BACK-UP'ed.

3.1 on ams-backup check RULES table and rule for SCIBPB/RT

CASTOR status should be equal to STAGED

link: https://ams-backup.cern.ch/frames/rule/2/

4. For pcposXX in pcpos[p,c][0,1] do:

4.0. Change user to ams: su ams

4.1. Execute on p0 and c0 (with different numbers!!!) : [apashnin@pcposp1 ~]$ /home/ams/bin/delete_frames_blocks_data.sh XXXX YYYY

where: XXX = frame number, YYY = block number

Example:

[ams@pcposp0: /dat0/Data/BLOCKS/SCIBPB/RT ] /home/ams/bin/delete_frames_blocks_data.sh 2899 2889
/Data/FRAMES/SCIBPB/RT 2881 2899
Filesystem Size Used Avail Use% Mounted on
/dev/sda3 9.0T 7.9T 621G 93% /dat0
/Data/FRAMES/SCIBPB/RT/2881:

...

5. Check

5.1 check the completion of the executed command

...

/Data/BLOCKS/SCIBPB/RT/2889: OK
Filesystem Size Used Avail Use% Mounted on
/dev/sda3 9.0T 6.3T 2.3T 74% /dat0

5.2 check in ams-stats that all 4 machines are ok.


This topic: Main > WebPreferences > SpaceCleanUpOnServers
Topic revision: r2 - 2017-06-19 - AndreyPashnin
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback