Certification Report, DPM/LFC 1.7.4-7 SL4, 32-bit, Patch #4188

Installation and Configuration

DPM Head node

Clean install

• INSTALL_CLEAN_HEAD_32.txt: DPM Head Node, Clean Install

• YAIM_CLEAN_HEAD_32.txt: DPM Head Node Clean Config

Upgrade from Production

• INSTALL_PROD_HEAD32.txt: DPM Head Node Prod Install

• YAIM_PROD_HEAD32.txt: DPM Head Node Prod Config

• UPGRADE_PROD_HEAD32.txt: DPM Head Node, Certification upgrade

• YAIM_CERT_HEAD32.txt: DPM Head Node Cert Config

DPM Disk node

Clean install

• INSTALL_CLEAN_DISK_32.txt: DPM Disk Node Clean Install

• YAIM_CLEAN_DISK_32.txt: DPM Disk Node Clean Config

Upgrade from Production

• INSTALL_PROD_DISK32.txt: DPM Disk Node Prod Install

• YAIM_PROD_DISK32.txt: DPM Disk Node Prod Config

• UPGRADE_PROD_DISK32.txt: DPM Disk Node, Certification upgrade

• YAIM_CERT_DISK32.txt: DPM Disk Node Cert Config

LFC node MySQL

Clean install

• INSTALL_CLEAN_LFC32m.txt: LFC Node MySQL, Clean Install

• YAIM_CLEAN_LFC32m.txt: LFC Node MySQL Clean Config

Upgrade from production

• INSTALL_PROD_LFC32m.txt: LFC Node Mysql, Prod Install

• YAIM_PROD_LFC32m.txt: LFC Node Mysql, Prod Config

• UPGRADE_PROD_LFC32m.txt: LFC Node Mysql, Certification Upgrade

• YAIM_CERT_LFC32m.txt: LFC Node Mysql, Cert Config

LFC node Oracle

Clean install

• INSTALL_CLEAN_LFC32o.txt: LFC Node Oracle, Clean Install

• YAIM_CLEAN_LFC32o.txt: LFC Node Oracle clean config

Upgrade from production

• INSTALL_PROD_LFC32o.txt: LFC Node Mysql, Prod Install

• YAIM_PROD_LFC32o.txt: LFC Node Oracle, Prod Config

• UPGRADE_PROD_LFC32o.txt: LFC Node Oracle, Certification Upgrade

• YAIM_CERT_LFC32o.txt: LFC Node Oracle, Cert Config

Information System

DPM Testsuite

Run in the different configuration. Results as follow.

dpns_rewinddir failure is a known bug: https://savannah.cern.ch/bugs/?65514

[shoo@ui32 DPM]$ ./DPM-certtest.sh
--------------------------------------------------------------
START: Thu Jun 16 16:58:57 CEST 2010

- CLIENT RPMS installed -
DPM-client-1.7.3-1sec.slc4
DPM-httpd-client-1.2.1-2sec.slc4
DPM-interfaces-1.7.3-1sec.slc4
DPM-interfaces2-1.7.3-1sec.slc4
LFC-client-1.7.3-1sec.slc4
LFC-interfaces-1.7.3-1sec.slc4
LFC-interfaces2-1.7.3-1sec.slc4
lcg-dm-common-1.7.3-1sec.slc4

- SERVER RPMS installed -
DPM-DSI-1.7.4-4sec.slc4
DPM-copy-server-mysql-1.7.4-7sec.slc4
DPM-httpd-1.2.2-2sec.slc4
DPM-httpd-cgi-1.3.2-3sec.slc4
DPM-httpd-client-1.2.1-3sec.slc4
DPM-name-server-mysql-1.7.4-7sec.slc4
DPM-rfio-server-1.7.4-7sec.slc4
DPM-server-mysql-1.7.4-7sec.slc4
DPM-srm-server-mysql-1.7.4-7sec.slc4
DPM-xrootd-2.1.4-1sec.slc4

- Other settings -
VO used: org.glite.voms-test
LFC Host: lfc64m.cern.ch
DPM Host: head5.cern.ch
DPNS Host: head5.cern.ch
--------------------------------------------------------------
*Executing Service PING tests


Target node is head5.cern.ch. Date: Thu Jun 16 16:58:58 CEST 2010
Testing the default DPM services:
  Testing service rfiod on port 5001                                           [  OK  ]
  Testing service mysqld on port 3306                                          [  OK  ]
  Testing service dpnsdaemon on port 5010                                      [  OK  ]
  Testing service dpm on port 5015                                             [  OK  ]
  Testing service bdii on port 2170                                            [  OK  ]
  Testing service sshd on port 22                                              [  OK  ]
  Testing service srmv1 on port 8443                                           [  OK  ]
  Testing service srmv2.2 on port 8446                                         [  OK  ]
  Testing service globus-gridftp on port 2811                                  [  OK  ]

  Overall Service Ping test result:                                            [  OK  ]
--------------------------------------------------------------
*Executing DPNS CLI tests

Executing CLI-dpns-chgrp
CLI-dpns-chgrp PASSED

Executing CLI-dpns-chown
CLI-dpns-chown PASSED

Executing CLI-dpns-mkdir
CLI-dpns-mkdir PASSED

Executing CLI-dpns-chmod
CLI-dpns-chmod PASSED

Executing CLI-dpns-ls
CLI-dpns-ls PASSED

Executing CLI-dpns-ln
CLI-dpns-ln PASSED

Executing CLI-dpns-rm
CLI-dpns-rm PASSED

Executing CLI-dpns-rename
CLI-dpns-rename PASSED

Executing CLI-dpns-getacl
CLI-dpns-getacl PASSED

Executing CLI-dpns-setacl
CLI-dpns-setacl PASSED

Executing CLI-dpns-usrmap
CLI-dpns-usrmap PASSED

Executing CLI-dpns-grpmap
CLI-dpns-grpmap PASSED

Executing CLI-dpns-ping
CLI-dpns-ping PASSED
OVERALL RESULT: SUCCESS
--------------------------------------------------------------
*Executing DPM CLI tests

Executing dpm-drain
dpm-drain PASSED

Executing dpm-addfs
dpm-addfs PASSED

Executing dpm-getspacetokens
dpm-getspacetokens PASSED

Executing dpm-modifypool
dpm-modifypool PASSED

Executing dpm-reservespace
dpm-reservespace PASSED

Executing dpm-rmpool
dpm-rmpool PASSED

Executing dpm-addpool
dpm-addpool PASSED

Executing dpm-getspacemd
dpm-getspacemd PASSED

Executing dpm-modifyfs
dpm-modifyfs PASSED

Executing dpm-releasespace
dpm-releasespace PASSED

Executing dpm-rmfs
dpm-rmfs PASSED

Executing dpm-updatespace
dpm-updatespace PASSED
OVERALL RESULT: SUCCESS
--------------------------------------------------------------
*Executing DPNS-API-C tests

Compiling item
Executing DPNS_aborttrans
DPNS_aborttrans PASSED


Compiling item
Executing DPNS_rewinddir
DPNS_rewinddir FAILED


Compiling item
Executing DPNS_addreplica
DPNS_addreplica PASSED


Compiling item
Executing DPNS_chdir
DPNS_chdir PASSED


Compiling item
Executing DPNS_chmod
DPNS_chmod PASSED


Compiling item
Executing DPNS_closedir
DPNS_closedir PASSED


Compiling item
Executing DPNS_delreplica
DPNS_delreplica PASSED


Compiling item
Executing DPNS_endtrans
DPNS_endtrans PASSED


Compiling item
Executing DPNS_getacl
DPNS_getacl PASSED


Compiling item
Executing DPNS_opendir
DPNS_opendir PASSED


Compiling item
Executing DPNS_readdir
DPNS_readdir PASSED


Compiling item
Executing DPNS_session
DPNS_session PASSED


Compiling item
Executing DPNS_setacl
DPNS_setacl PASSED


Compiling item
Executing DPNS_setatime
DPNS_setatime PASSED


Compiling item
Executing DPNS_setfsize
DPNS_setfsize PASSED


Compiling item
Executing DPNS_setfsizec
DPNS_setfsizec PASSED


Compiling item
Executing DPNS_setptime
DPNS_setptime PASSED


Compiling item
Executing DPNS_setratime
DPNS_setratime PASSED


Compiling item
Executing DPNS_setrltime
DPNS_setrltime PASSED


Compiling item
Executing DPNS_setrstatus
DPNS_setrstatus PASSED


Compiling item
Executing DPNS_setrtype
DPNS_setrtype PASSED


Compiling item
Executing DPNS_symlink
DPNS_symlink PASSED


Compiling item
Executing DPNS_umask
DPNS_umask PASSED


Compiling item
Executing DPNS_utime
DPNS_utime PASSED

OVERALL RESULT: FAILURE

The following tests have failed:
DPNS_rewinddir: results in tests/dpns-api-c/DPNS_rewinddir_result.txt
--------------------------------------------------------------
*Executing DPNS-API-PYTHON tests

Executing dpns_getreplica.sh
dpns_getreplica.sh PASSED
OVERALL RESULT: FAILURE

The following tests have failed:
--------------------------------------------------------------
*Executing RFIO tests

Executing DPM-test-rfio-cli.sh

Target node is head5.cern.ch. Thu Jun 16 16:11:29 CEST 2010
Launching RFIO CLI tests:
  Creating directory [ rfmkdir ]                                               [  OK  ]
  Copying file       [ rfcp ]                                                  [  OK  ]
  Reading file       [ rfcat ]                                                 [  OK  ]
  Renaming file      [ rfrename ]                                              [  OK  ]
  Acessing file      [ rfstat ]                                                [  OK  ]
  Changing permission[ rfstat ]                                                [  OK  ]
  Removing file      [ rfrm ]                                                  [  OK  ]
  Permission denied  [ rfmkdir ]                                               [  OK  ]
  Removing dir       [ rfrename ]                                              [  OK  ]

  Overall RFIO CLI test result:                                                [  OK  ]

--------------------------------------------------------------
*Executing DPM INFOSYS tests


Target node is head5.cern.ch. Date: Thu Jun 16 16:11:34 CEST 2010
Testing the Information System:
  Resource BDII port is open:                                                  [  OK  ]
  Resource BDII bind string:                                                   [  OK  ]
  AccessProtocol rfio published:                                               [  OK  ]
  AccessProtocol gsiftp published:                                             [  OK  ]
  ControlProtocol srmv1 published:                                             [  OK  ]
  ControlProtocol srmv2 published:                                             [  OK  ]
  Service httpg://head5.cern.ch:8443/srm/managerv1 published:                  [  OK  ]
  Service httpg://head5.cern.ch:8446/srm/managerv2 published:                  [  OK  ]
  AcessControlRule published backward compatible way:                          [  OK  ]
  Unconfigured or default attributes present:                                  [  OK  ]

  Overall Information System test result:                                      [  OK  ]


--------------------------------------------------------------
END: Thu Jun 16 16:11:34 CEST 2010
--------------------------------------------------------------
OVERALL RESULT: FAILURE
--------------------------------------------------------------

SRM Testsuite

AbortFiles: OK: SRM_SUCCESS, file level return code: SRM_SUCCESS
AbortRequest: OK: SRM_ABORTED
BringOnline: OK: SRM_REQUEST_QUEUED
ExtendFileLifeTime: OK: SRM_SUCCESS
GetRequestSummary: OK: SRM_SUCCESS
GetRequestTokens: OK: SRM_SUCCESS
GetSpaceMetaData: OK: SRM_SUCCESS
GetSpaceTokens: OK: SRM_SUCCESS
GetTransferProtocols: OK: SRM_SUCCESS
Ls: OK: SRM_SUCCESS
Ls: Ls is synchronous
Mkdir: OK: SRM_SUCCESS
Mv: OK: SRM_SUCCESS
Ping: OK
PrepareToGet: OK: SRM_REQUEST_QUEUED
PrepareToPut: OK: SRM_REQUEST_QUEUED
PutDone: OK: SRM_SUCCESS
ReleaseFiles: OK: SRM_SUCCESS, file level return code: SRM_SUCCESS
ReleaseSpace: OK: SRM_SUCCESS
ReserveSpace: OK: SRM_SUCCESS
Rm: OK: SRM_SUCCESS
Rmdir: OK: SRM_SUCCESS
StatusOfBringOnlineRequest: OK: SRM_REQUEST_INPROGRESS
StatusOfGetRequest: OK: SRM_SUCCESS
StatusOfPutRequest: OK: SRM_SUCCESS
StatusOfReserveSpaceRequest: srmReserveSpace synchronous

LFC Testsuite

LFC_HOST=lfc32m.cern.ch
*Running CLI test set*
Executing LFC-CLI-dchmod
LFC-CLI-dchmod PASSED
Executing LFC-cli-delcom
LFC-cli-delcom PASSED
Executing LFC-CLI-dren
LFC-CLI-dren PASSED
Executing LFC-CLI-fchmod
LFC-CLI-fchmod PASSED
Executing LFC-CLI-fren
LFC-CLI-fren PASSED
Executing LFC-cli-getacl
LFC-cli-getacl PASSED
Executing LFC-cli-ln
LFC-cli-ln PASSED
Executing LFC-cli-mkdir
LFC-cli-mkdir PASSED
Executing LFC-CLI-mkdir
LFC-CLI-mkdir PASSED
Executing LFC-cli-ping
LFC-cli-ping PASSED
Executing LFC-cli-rename
LFC-cli-rename PASSED
Executing LFC-cli-rmdir
LFC-cli-rmdir PASSED
Executing LFC-CLI-rmdir
LFC-CLI-rmdir PASSED
Executing LFC-CLI-rmfile
LFC-CLI-rmfile PASSED
Executing LFC-cli-setacl
LFC-cli-setacl PASSED
Executing LFC-cli-setcom
LFC-cli-setcom PASSED
*Running API_PYTHON test set*
Executing LFC-addreplica
LFC-addreplica PASSED
Executing LFC-addreplicax
LFC-addreplicax PASSED
Executing LFC-chdir
LFC-chdir PASSED
Executing LFC-creatg
LFC-creatg PASSED
Executing LFC-del
LFC-del PASSED
Executing LFC-delcomment
LFC-delcomment PASSED
Executing LFC-fsize
LFC-fsize PASSED
Executing LFC-getacl
LFC-getacl PASSED
Executing LFC-getcwd
LFC-getcwd PASSED
Executing LFC-getreplica
LFC-getreplica PASSED
Executing LFC-getreplicas
LFC-getreplicas WARNING
Executing LFC-ls
LFC-ls PASSED
Executing LFC-mkdir
LFC-mkdir PASSED
Executing LFC-mkdirg
LFC-mkdirg PASSED
Executing LFC-opendir
LFC-opendir PASSED
Executing LFC-opendirg
LFC-opendirg PASSED
Executing LFC-rename
LFC-rename PASSED
Executing LFC-rmdir
LFC-rmdir PASSED
Executing LFC-setacl
LFC-setacl PASSED
Executing LFC-setatime
LFC-setatime PASSED
Executing LFC-setcomment
LFC-setcomment PASSED
Executing LFC-setfsizeg
LFC-setfsizeg PASSED
Executing LFC-stat
LFC-stat PASSED
Executing LFC-statg
LFC-statg PASSED
Executing LFC-statr
LFC-statr PASSED
Executing LFC-statx
LFC-statx PASSED
Executing LFC-undelete
LFC-undelete PASSED
Executing LFC-unlink
LFC-unlink PASSED
Executing LFC-writefile
LFC-writefile PASSED

./LFC-getreplicas lfc32m.cern.ch
<pre>
Start test: get  the  replica entries associated with a list of GUIDs (lfc_getreplicas)
1. Prepare environment
2. Start test run()
Test OK:                                                    [OK]
Test SE filter:                                             [OK]
Test guid length exeeds CA_MAXGUIDLEN (EINVAL) (bug):       [FAILED]
Test SE name length exeeds CA_MAXNAMELEN (EINVAL):          [OK]
Test existing replica nonexisting file (ENOENT) (bug):      [FAILED]
3. Ret test code: False
Exit
</pre>
Test is failure (BUG)

DM Testsuite

[shoo@ui32 DM]$ ./DM-certtest.sh
Using ./DM-certconfig
DPM HOST: head64.cern.ch
WARNING: no dCache host selected
CASTOR HOST: head32.cern.ch
WARNING: no STORM host selected
LFC HOST: lfc64m.cern.ch
LFC host is: lfc64m.cern.ch
START Tue Jun 15 16:19:37 CEST 2010
------------------------------------------------
**Running LCG_UTILS tests**
*Target SE is head64.cern.ch
Executing DM-lcg-alias.sh
DM-lcg-alias.sh PASSED
Executing DM-lcg-cp-gsiftp.sh
DM-lcg-cp-gsiftp.sh PASSED
Executing DM-lcg-cp.sh
DM-lcg-cp.sh PASSED
Executing DM-lcg-cr-gsiftp.sh
DM-lcg-cr-gsiftp.sh PASSED
Executing DM-lcg-cr.sh
DM-lcg-cr.sh PASSED
Executing DM-lcg-list.sh
DM-lcg-list.sh PASSED
Executing DM-lcg-ls.sh
DM-lcg-ls.sh PASSED
Executing DM-lcg-rf.sh
DM-lcg-rf.sh PASSED
Executing DM-lcg-rep.sh
DM-lcg-rep.sh PASSED
Executing DM-lcg-get-checksum.sh
DM-lcg-get-checksum.sh PASSED
*Target SE is head32.cern.ch
Executing DM-lcg-alias.sh
DM-lcg-alias.sh PASSED
Executing DM-lcg-cp-gsiftp.sh
DM-lcg-cp-gsiftp.sh PASSED
Executing DM-lcg-cp.sh
DM-lcg-cp.sh PASSED
Executing DM-lcg-cr-gsiftp.sh
DM-lcg-cr-gsiftp.sh PASSED
Executing DM-lcg-cr.sh
DM-lcg-cr.sh PASSED
Executing DM-lcg-list.sh
DM-lcg-list.sh PASSED
Executing DM-lcg-ls.sh
DM-lcg-ls.sh PASSED
Executing DM-lcg-rf.sh
DM-lcg-rf.sh PASSED
Executing DM-lcg-rep.sh
DM-lcg-rep.sh PASSED
Executing DM-lcg-get-checksum.sh
DM-lcg-get-checksum.sh PASSED
**Running SAME tests**
TEST_PASSED

[shoo@ui32 DM]$ ./DM-certtest.sh
Using ./DM-certconfig
DPM HOST: head32.cern.ch
WARNING: no dCache host selected
CASTOR HOST: head64.cern.ch
WARNING: no STORM host selected
LFC HOST: lfc64m.cern.ch
LFC host is: lfc64m.cern.ch
START Tue Jun 15 16:55:17 CEST 2010
------------------------------------------------
**Running LCG_UTILS tests**
*Target SE is head32.cern.ch
Executing DM-lcg-alias.sh
DM-lcg-alias.sh PASSED
Executing DM-lcg-cp-gsiftp.sh
DM-lcg-cp-gsiftp.sh PASSED
Executing DM-lcg-cp.sh
DM-lcg-cp.sh PASSED
Executing DM-lcg-cr-gsiftp.sh
DM-lcg-cr-gsiftp.sh PASSED
Executing DM-lcg-cr.sh
DM-lcg-cr.sh PASSED
Executing DM-lcg-list.sh
DM-lcg-list.sh PASSED
Executing DM-lcg-ls.sh
DM-lcg-ls.sh PASSED
Executing DM-lcg-rf.sh
DM-lcg-rf.sh PASSED
Executing DM-lcg-rep.sh
DM-lcg-rep.sh PASSED
Executing DM-lcg-get-checksum.sh
DM-lcg-get-checksum.sh PASSED
*Target SE is head64.cern.ch
Executing DM-lcg-alias.sh
DM-lcg-alias.sh PASSED
Executing DM-lcg-cp-gsiftp.sh
DM-lcg-cp-gsiftp.sh PASSED
Executing DM-lcg-cp.sh
DM-lcg-cp.sh PASSED
Executing DM-lcg-cr-gsiftp.sh
DM-lcg-cr-gsiftp.sh PASSED
Executing DM-lcg-cr.sh
DM-lcg-cr.sh PASSED
Executing DM-lcg-list.sh
DM-lcg-list.sh PASSED
Executing DM-lcg-ls.sh
DM-lcg-ls.sh PASSED
Executing DM-lcg-rf.sh
DM-lcg-rf.sh PASSED
Executing DM-lcg-rep.sh
DM-lcg-rep.sh PASSED
Executing DM-lcg-get-checksum.sh
DM-lcg-get-checksum.sh PASSED
**Running SAME tests**
TEST_PASSED

HTTP Access

[shoo@ui32 ~]$ voms-proxy-init -voms email
Cannot find file or dir: /home/shoo/.glite/vomses
Your identity: /DC=CH/DC=CERN/OU=REGCA/CN=Test user 1
Creating temporary proxy ............................... Done
Contacting  vomsm.cern.ch:15001 [/DC=CH/DC=CERN/OU=REGCA/CN=vomsm.cern.ch] "email" Done
Creating proxy ................................................. Done
Your proxy is valid until Sat Jun 19 00:16:06 2010

[shoo@ui32 ~]$ dpm-httpd-cp /bin/bash https://head32.cern.ch/dpm/cern.ch/home/email/bash_7
#1 Retrieve Access token ...
#2 Upload File ...
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  597k    0     0  100  597k      0  73.8M --:--:-- --:--:-- --:--:--  116M
#3 Register File ...
#4 File Upload successfull!

Bugs

avoid srmv2.2 daemon crash when permission denied on a GetSpaceMetadata

Reproduced and fix was confirmed

avoid rfio_lseek64 error after hitting eof in pre-read mode

Not reproduced during certification.

avoid crashes in some methods when using Python 2.5

Reproduced and fixed.