DPM Cluster Administration

This guide give some insight on how to operate a DPM

VO support

Adding a VO

Head and disk nodes

Have all nodes (head and disks) trust the VOMS servers to be supported

Under /etc/grid-security/vomsdir, add a <vo-name> directory for each VO to be supported. Inside it add a ''lsc'' file corresponding to the VOMS server(s) for that VO, containing the DN of the server and CA issuing it:

# mkdir -p /etc/grid-security/vomsdir/dteam
# vim /etc/grid-security/vomsdir/dteam/lxbra2309.cern.ch.lsc
/DC=ch/DC=cern/OU=computers/CN=lxbra2309.cern.ch
/DC=ch/DC=cern/CN=CERN Trusted Certification Authority

Head node

Add the VO to /etc/lcgdm-mkgridmap.conf

Create the initial directory structure (repeat for each domain / VO you support)

From the dmlite-shell;

> cd /dpm/domain.org/home
> mkdir newvo01
> chmod newvo01 775
> groupadd newvo01 
> chgrp newvo01 newvo01 # NB - Dome is lazy, you may have to wait a few seconds for the group to be recognised
> acl newvo01 d:u::rwx,d:g::rwx,d:o::r-x,u::rwx,g::rwx,o::r-x set

Ensure that the VO has a quota

> quotatokenset /dpm/domain.org/home/newvo01/ pool pool01 size 1GB desc newvo01qt01 groups newvo01

Removing a VO

Remove the files created in "adding a VO section above".

To remove the data, do the following from the dmlite-shell;

>rmdir /dpm/domain.org/home/oldvo -r

Pool Management

Adding a new pool

To add a "traditional" filesystem-based pool:

pooladd <newpoolname> filesystem

You can then add filesystems using fsadd.

Removing a pool

To remove a "traditional" filesystem-based pool:

pooldel <poolname>

Disk Server Management

Commission a new disk server

This process is described in the deployment guide - https://twiki.cern.ch/twiki/bin/view/DPM/DpmSetupManualInstallation#Deploying_a_Disk_Node

Retire a disk server

To retire a disk server, you should

  • drain the data from its filesystems
  • remove its filesystems from their pools
  • clean up config on the head node

Remove the files from a broken disk server from the namespace

One case this might be needed: a disk server with files you do not care about dies, and the pool its filesystem(s) belong to also has filesystems from other disk servers.

TODO: Update dpm-disk-to-dpns to use dmlite.

Filesystems

Add a filesystem to a pool

fsadd <fsname> <pool> <server>

Mark a filesystem read-only

fsmodify <filesystem> <server> <pool> <status>

The statuses are as follows

  • ENABLED : active r/w
  • DISABLED : disabled
  • RDONLY : read-only

Draining

The draining tools are now integrated into the dmlite-shell.

https://twiki.cern.ch/twiki/bin/view/DPM/DpmAdminDmliteShell#drain

Quota Token Management

To see all your quotatokens

> quotatokenget / -s

Basic management tasks include

> quotatokenset <path> pool <pool> size <size> desc <qt name> groups <group>
> quotatokenmod ...
> quotatokendel ...

Service Migration

You'll need to have the database in a separate host for this.

You can then setup the service in a new node, pointing to the same database instance. When you're done do a DNS switch to redirect the traffic to the new node when ready.

Edit | Attach | Watch | Print version | History: r13 < r12 < r11 < r10 < r9 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r13 - 2018-12-20 - OliverKeeble
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    DPM All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback