Difference: CernLbdDiskSpace (31 vs. 32)

Revision 322012-01-26 - ThomasRuf

Line: 1 to 1
 
META TOPICPARENT name="CernLbd"

CernLbdDiskSpace

This is the LHCb CERN LBD group page describing locally available disk space

Line: 32 to 33
 
    • All Lbd members can get an expansion of their Afs home directory to 2GB and an additional 3GB scratch space softlinked from their home directory.
    • Your Afs space is for code development, and storing documents, ntuples, grid jobs, that you want backed up, but are not massive files.
    • fs listquota to get the quota/usage, use separately in each scratch space
Changed:
<
<
    • To obtain this increase contact RobLambert, who will forward your request
>
>
    • To obtain this increase contact Thomas Ruf , who will forward your request
 
  • Castor Space:
    • All CERN users have a castor home directory, where you can store almost anything you like, put things here if they cannot fit on your Afs dir, and need it to be backed up for a long time.
Line: 65 to 66
 
    • to see the usage call fs listquota on each volume
    • The access list is maintained as a subgroup of z5, z5:cernlbd, to see if you are there call pts mem z5:cernlbd
    • To see the usage and check for problems call: /afs/cern.ch/project/lbcern/scripts/check1TB.py
Changed:
<
<
    • To be added to the acces list contact RobLambert
    • to change the access list of directories you have created, you need to be added to admin your own directories, contact RobLambert for that
>
>
    • To be added to the acces list contact Thomas Ruf
    • to change the access list of directories you have created, you need to be added to admin your own directories, contact Thomas Ruf for that
 
  • t3 Castor space:
    • We have a group disk pool on Castor. Like the grid resource it is always on disk, however it does not count towards your Grid quota.
Line: 84 to 85
 

-Access:

Changed:
<
<
The access list of the t3 castor is maintained by Joel Closier. If you find yourself without access, you should get in touch with RobLambert or ThomasRuf. To see the access list call stager_listprivileges -S lhcbt3. Any lbd members should be granted access.
>
>
The access list of the t3 castor is maintained by Joel Closier. If you find yourself without access, you should get in touch with ThomasRuf. To see the access list call stager_listprivileges -S lhcbt3. Any lbd members should be granted access.
 

-How to use:

Line: 106 to 105
 
lhcbt3_mv.py Move files between stagers from a given directory or list /afs/cern.ch/project/lbcern/scripts/lhcbt3_mv.py <target> <svc1> [<svc2>]
stager_listprivileges To see the access list stager_listprivileges -S lhcbt3
lhcbt3_cp.py Copy new file, or a list of new files to lhcbt31 /afs/cern.ch/project/lbcern/scripts/lhcbt3_cp.py <source(s)> <destination>
Changed:
<
<
STAGE_SVCCLASS Set lhcbt3 as your default staging pool unsafe2 export STAGE_SVCCLASS="lhcbt3"
>
>
STAGE_SVCCLASS Set lhcbt3 as your default staging pool unsafe2 export STAGE_SVCCLASS="lhcbt3"
 
rfcp Copy new file to lhcbt3 rfcp <source> <destination> [after setting STAGE_SVCCLASS ]
castorQuota.py Disk usage from you of all castor elements, including lhcbt3 (can be slow) /afs/cern.ch/project/lbcern/scripts/castorQuota.py
check30TB.py Disk usage of all users of lhcbt3 castor element (cached from the night before) /afs/cern.ch/project/lbcern/scripts/check30TB.py
  1. lhcbt3_cp.py avoids the need to set STAGE_SVCCLASS because it spawns a subshell
Changed:
<
<
  1. It's not a great idea to set STAGE_SVCCLASS, because if you forget to unset it, then every file you touch could be staged into the non-standard service class, causing bookkeeping problems
>
>
  1. It's not a great idea to set STAGE_SVCCLASS, because if you forget to unset it, then every file you touch could be staged into the non-standard service class, causing bookkeeping problems
 

-Use in Ganga

Line: 121 to 120
 [LHCb] cp_cmd = /afs/cern.ch/project/lbcern/scripts/lhcbt3_cp.py
Changed:
<
<
  1. If you want to access files on, stage files to and write files to lhcbt3, if and only if you are running ganga on the LSF backend, then you can edit the line in your .gangarc:
>
>
  1. If you want to access files on, stage files to and write files to lhcbt3, if and only if you are running ganga on the LSF backend, then you can edit the line in your .gangarc:
 [LSF] preexecute = import os os.environ['STAGE_SVCCLASS']='lhcbt3'
Line: 134 to 132
  If you are using a significant fraction of the space and somebody else needs some, you will be asked to clean up.
Changed:
<
<
Removal in this respect is done sporadically or on request by RobLambert at the moment, only cleaning up if there is more than 2TB used this way, or if the files are more than 50% of the free space.
>
>
Removal in this respect is done sporadically or on request by Thomas Ruf at the moment, only cleaning up if there is more than 2TB used this way, or if the files are more than 50% of the free space.
 

-Other service classes

Line: 218 to 215
 

Can I share my afs disk space with other people?

Changed:
<
<
Yes, this should be possible. You should have admin rights on your own directory, call fs listacl. If not, contact RobLambert to fix. Then you should be able to modify your directories to be readable or writable by others, but note that if you make them writable by others, anything they write will count against your usage.
>
>
Yes, this should be possible. You should have admin rights on your own directory, call fs listacl. If not, contact Thomas Ruf to fix. Then you should be able to modify your directories to be readable or writable by others, but note that if you make them writable by others, anything they write will count against your usage.
  To modify the access list you will need to do fs setacl <directory> <user or group> <setting>, e.g. fs setacl mydirectory myfreindbob read
Line: 234 to 231
  See CernLbdDiskManagement.
Changed:
<
<

>
>

  -- RobLambert - 11-Nov-2010
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback