-- JoelCasutt - 19-Apr-2011

EMI Test Report for Task #18586: Argus v.1.3.0

*********************************
EMI Test Report  
*********************************

- Component: ARGUS

- Savannah task: https://savannah.cern.ch/task/?18586

- ETICS Subsystem Configuration Name:

- VCS Tag:

- EMI Major Release:

- Platform: 

- Author: 

- Date:

*************
Summary 
*************

1. Deployment log: 
   1.1. Clean Installation - PASS
   1.2. Upgrade Installation - NA 
2. Static Code Analysis - NA
3. Unit Tests Execution - NO
4. System tests:
  4.1. Basic Functionality tests - PASS
  4.2. Regression tests - PASS
  4.3. Performance/Scalability tests - NA
  4.4. Standard Compliance/Conformance tests - NA
REMARKS:

*************************** Detailed Testing Report ***************************************

1. Deployment log 
************************

1.1. Clean Installation
-----------------------------

1.1.1 Installing the necessary software, additional to the Argus packages:

Getting the IGTF-bundle and Fetch-crl:
vim /etc/yum.repos.d/egi-trustanchors.repo

content:
[EGI-trustanchors]
name=EGI-trustanchors
baseurl=http://repository.egi.eu/sw/production/cas/1/current/
gpgkey=http://repository.egi.eu/sw/production/cas/1/GPG-KEY-EUGridPMA-RPM-3
gpgcheck=1
enabled=1

install:
yum install ca-policy-egi-core
yum install fetch-crl

activate the cron-job:
service fetch-crl-cron start

Getting slcs-init to obtain short lived certificates:

install:
yum install java
mkdir /usr/local/slcs && cd /usr/local/slcs/
wget https://slcs.switch.ch/download/glite-slcs-ui-1.5.0-1-jdk1.5.tar.gz
tar ...

for further use in the testplan get a certificate and link it to the appropriate directory:
as user: slcs-init
as root: mkdir /root/user_certificates && cd /root/user_certificates
ln -s /home/casutt/.globus/userkey.pem  test_user_1_key.pem
ln -s /home/casutt/.globus/usercert.pem  test_user_1_cert.pem
chown root /home/casutt/.globus/userkey.pem
vim password ->contains the password for the slcs

Getting voms-clients

install:
yum install voms-clients

1.1.2 Installing Argus:

Getting the Repository:
wget --no-check-certificate https://twiki.cern.ch/twiki/pub/EMI/EMI-1/rc4.repo

- YUM Install command:
yum makecache
yum install emi-argus

- YUM log: 
--------------------------------
Loaded plugins: kernel-module
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package emi-argus.x86_64 0:1.3.0-4.sl5 set to be updated
--> Processing Dependency: argus-pepcli for package: emi-argus
--> Processing Dependency: argus-pap for package: emi-argus
--> Processing Dependency: emi-version for package: emi-argus
--> Processing Dependency: argus-pdp for package: emi-argus
--> Processing Dependency: yaim-argus_server for package: emi-argus
--> Processing Dependency: argus-pep-server for package: emi-argus
--> Running transaction check
---> Package argus-pap.noarch 0:1.3.1-3.sl5 set to be updated
---> Package argus-pdp.noarch 0:1.3.0-5.sl5 set to be updated
---> Package argus-pep-server.noarch 0:1.3.0-6.sl5 set to be updated
---> Package argus-pepcli.x86_64 0:2.0.0-1.sl5 set to be updated
--> Processing Dependency: argus-pep-api-c for package: argus-pepcli
--> Processing Dependency: libargus-pep.so.2()(64bit) for package: argus-pepcli
---> Package emi-version.x86_64 0:1.0.0-1.sl5 set to be updated
---> Package yaim-argus_server.noarch 0:1.3.0-2.sl5 set to be updated
--> Processing Dependency: glite-yaim-core for package: yaim-argus_server
--> Running transaction check
---> Package argus-pep-api-c.x86_64 0:2.0.2-1.sl5 set to be updated
---> Package glite-yaim-core.noarch 0:5.0.0-1.sl5 set to be updated
--> Finished Dependency Resolution
Beginning Kernel Module Plugin
Finished Kernel Module Plugin

Dependencies Resolved

==================================================================================================================================
 Package                              Arch                      Version                        Repository                    Size
==================================================================================================================================
Installing:
 emi-argus                            x86_64                    1.3.0-4.sl5                    EMI-1-RC4                    3.6 k
Installing for dependencies:
 argus-pap                            noarch                    1.3.1-3.sl5                    EMI-1-RC4                     14 M
 argus-pdp                            noarch                    1.3.0-5.sl5                    EMI-1-RC4                     16 M
 argus-pep-api-c                      x86_64                    2.0.2-1.sl5                    EMI-1-RC4                    135 k
 argus-pep-server                     noarch                    1.3.0-6.sl5                    EMI-1-RC4                     13 M
 argus-pepcli                         x86_64                    2.0.0-1.sl5                    EMI-1-RC4                     26 k
 emi-version                          x86_64                    1.0.0-1.sl5                    EMI-1-RC4                    2.0 k
 glite-yaim-core                      noarch                    5.0.0-1.sl5                    EMI-1-RC4                    119 k
 yaim-argus_server                    noarch                    1.3.0-2.sl5                    EMI-1-RC4                    9.7 k

Transaction Summary
==================================================================================================================================
Install       9 Package(s)
Upgrade       0 Package(s)

Total download size: 43 M
Is this ok [y/N]: y
Downloading Packages:
(1/9): emi-version-1.0.0-1.sl5.x86_64.rpm                                                                  | 2.0 kB     00:00     
(2/9): emi-argus-1.3.0-4.sl5.x86_64.rpm                                                                    | 3.6 kB     00:00     
(3/9): yaim-argus_server-1.3.0-2.sl5.noarch.rpm                                                            | 9.7 kB     00:00     
(4/9): argus-pepcli-2.0.0-1.sl5.x86_64.rpm                                                                 |  26 kB     00:00     
(5/9): glite-yaim-core-5.0.0-1.sl5.noarch.rpm                                                              | 119 kB     00:00     
(6/9): argus-pep-api-c-2.0.2-1.sl5.x86_64.rpm                                                              | 135 kB     00:00     
(7/9): argus-pep-server-1.3.0-6.sl5.noarch.rpm                                                             |  13 MB     00:00     
(8/9): argus-pap-1.3.1-3.sl5.noarch.rpm                                                                    |  14 MB     00:01     
(9/9): argus-pdp-1.3.0-5.sl5.noarch.rpm                                                                    |  16 MB     00:01     
----------------------------------------------------------------------------------------------------------------------------------
Total                                                                                             9.8 MB/s |  43 MB     00:04     
Running rpm_check_debug
Running Transaction Test
Finished Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing     : argus-pep-api-c                                                                                            1/9 
  Installing     : argus-pepcli                                                                                               2/9 
  Installing     : emi-version                                                                                                3/9 
  Installing     : glite-yaim-core                                                                                            4/9 
  Installing     : yaim-argus_server                                                                                          5/9 
  Installing     : argus-pdp                                                                                                  6/9 
  Installing     : argus-pep-server                                                                                           7/9 
  Installing     : argus-pap                                                                                                  8/9 
  Installing     : emi-argus                                                                                                  9/9 

Installed:
  emi-argus.x86_64 0:1.3.0-4.sl5                                                                                                  

Dependency Installed:
  argus-pap.noarch 0:1.3.1-3.sl5             argus-pdp.noarch 0:1.3.0-5.sl5              argus-pep-api-c.x86_64 0:2.0.2-1.sl5     
  argus-pep-server.noarch 0:1.3.0-6.sl5      argus-pepcli.x86_64 0:2.0.0-1.sl5           emi-version.x86_64 0:1.0.0-1.sl5         
  glite-yaim-core.noarch 0:5.0.0-1.sl5       yaim-argus_server.noarch 0:1.3.0-2.sl5     

Complete!
---------------------------------

- Configuration log:

first set up the site-info-def file:

# Argus service hostname
ARGUS_HOST=loki.switch.ch

# PAP administrator DN allowed to use 'pap-admin' command
PAP_ADMIN_DN="/DC=com/DC=quovadisglobal/DC=grid/DC=switch/DC=hosts/C=CH/ST=Zuerich/L=Zuerich/O=SWITCH/CN=loki.switch.ch"

# Users and Groups definition for grid and group mapfile
USERS_CONF=/opt/glite/yaim/examples/users.conf
GROUPS_CONF=/opt/glite/yaim/examples/groups.conf

# Supported VOs
VOS="dteam"

VO_DTEAM_VOMSES="'dteam voms.hellasgrid.gr 15004 /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr dteam' 'dteam voms2.hellasgrid.gr 15004 /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr dteam'"
VO_DTEAM_VOMS_CA_DN="'/C=GR/O=HellasGrid/OU=Certification Authorities/CN=HellasGrid CA 2006' '/C=GR/O=HellasGrid/OU=Certification Authorities/CN=HellasGrid CA 2006'"

now run Yaim:
/opt/glite/yaim/bin/yaim -c -s site-info.def -n ARGUS_server

--------------------------------
WARNING: 
   WARNING: *****************************************************************************
   WARNING: Your siteinfo directory is world readable. This is generally a bad idea      
   WARNING: as configuration files may contain passwords and other sensitive information.
   WARNING: *****************************************************************************
   WARNING: 
   INFO: Using site configuration file: site-info.def
   INFO: Sourcing service specific configuration file: ./services/glite-argus_server
   INFO: 
         ###################################################################
         
         .             /'.-. ')
         .     yA,-"-,( ,m,:/ )   .oo.     oo    o      ooo  o.     .oo
         .    /      .-Y a  a Y-.     8. .8'    8'8.     8    8b   d'8
         .   /           ~ ~ /         8'    .8oo88.     8    8  8'  8
         . (_/         '===='          8    .8'     8.   8    8  Y   8
         .   Y,-''-,Yy,-.,/           o8o  o8o    o88o  o8o  o8o    o8o
         .    I_))_) I_))_)
         
         
         current working directory: /opt/glite/yaim/examples/siteinfo
         site-info.def date: Apr 20 08:16 site-info.def
         yaim command: -c -s site-info.def -n ARGUS_server
         log file: /opt/glite/yaim/bin/../log/yaimlog
         Wed Apr 20 10:07:48 CEST 2011 : /opt/glite/yaim/bin/yaim
         
         Installed YAIM versions:
         glite-yaim-argus-server 1.3-0
         glite-yaim-core 5.0.0-1
         
         ####################################################################
   INFO: The default location of the grid-env.(c)sh files will be: /usr/libexec
   INFO: Sourcing the utilities in /opt/glite/yaim/functions/utils
   INFO: Detecting environment
   INFO: Executing function: config_host_certs_check 
   INFO: Executing function: config_edgusers_check 
   INFO: Executing function: config_vomsmap_check 
   INFO: Executing function: config_vomsdir_check 
   INFO: Executing function: config_pap_service_check 
   INFO: Executing function: config_pdp_service_check 
   INFO: Executing function: config_pep_service_check 
   INFO: Executing function: config_host_certs 
   INFO: Executing function: config_crl 
   INFO: Now updating the CRLs - this may take a few minutes...
   INFO: Executing function: config_edgusers 
   INFO: Executing function: config_vomsmap_setenv 
   INFO: Executing function: config_vomsmap 
   INFO: Creating grid-map directory in /etc/grid-security/gridmapdir
   INFO: Creating voms grid-map file in /etc/grid-security/voms-grid-mapfile
   INFO: Creating voms groupmap file in /etc/grid-security/groupmapfile
   INFO: Copying the /etc/grid-security/voms-grid-mapfile in the standard location /etc/grid-security/grid-mapfile
   INFO: Executing function: config_vomsdir_setenv 
   INFO: Executing function: config_vomsdir 
   INFO: Executing function: config_pap_service_setenv 
   INFO: Executing function: config_pap_service 
   INFO: Stopping PAP service...
PAP  server is not running!
   INFO: Create the PAP /usr/share/argus/pap/conf/pap_configuration.ini file
   INFO: Create the PAP /usr/share/argus/pap/conf/pap_authorization.ini file
   INFO: Create the PAP /usr/share/argus/pap/conf/pap-admin.properties file
   INFO: Fixing files and directory permissions in /usr/share/argus/pap
   INFO: Starting PAP service...
   INFO: Executing function: config_pdp_service_setenv 
   INFO: Executing function: config_pdp_service 
   INFO: Stopping PDP service...
Unable to connect to localhost.localdomain:8153, perhaps the service is not running
   INFO: Create the PDP /etc/argus/pdp/pdp.ini file
   INFO: Fixing files and directory permissions
   INFO: Register /etc/init.d/argus-pdp...
   INFO: Starting PDP service...
   INFO: Executing function: config_pep_service_setenv 
   INFO: Executing function: config_pep_service 
   INFO: Stopping PEP daemon service...
Unable to connect to localhost.localdomain:8155, perhaps the service is not running
   INFO: Create the PEP daemon /etc/argus/pepd/pepd.ini file
   INFO: Fixing files and directory permissions in /usr/share/argus/pepd
   INFO: Starting PEP daemon service...
   INFO: Configuration Complete.                                               [  OK  ]
   INFO: YAIM terminated succesfully.
---------------------------------


1.2. Upgrade Installation
--------------------------------
Not Applicable since there is no former Version

2. Static Code Analysis
******************************
Not Applicable

3. Unit Tests
*****************
Not Applicable

4. System tests 
*********************

4.1. Basic Functionality tests
**************************************

4.1.1: test-PAP-FUNC1.sh
-----------------------------------


4.1.2: test-PAP-FUNC2.sh
-----------------------------------
Wed Apr 20 10:14:50 CEST 2011
---Test-PAP-FUNC-2---
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
1) testing missing configuration file
OK
2) testing missing argus file
PAP encountered an error that could not be dealt with, shutting down!
Error: PAP Authorization configuration file not found: /usr/share/argus/pap/conf/pap_authorization.ini
org.glite.authz.pap.common.exceptions.PAPConfigurationException: PAP Authorization configuration file not found: /usr/share/argus/pap/conf/pap_authorization.ini
        at org.glite.authz.pap.authz.AuthorizationEngine.<init>(AuthorizationEngine.java:55)
        at org.glite.authz.pap.authz.AuthorizationEngine.initialize(AuthorizationEngine.java:80)
        at org.glite.authz.pap.server.PAPService.start(PAPService.java:97)
        at org.glite.authz.pap.server.PAPContextListener.contextInitialized(PAPContextListener.java:76)
        at org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:548)
        at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
        at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1239)
        at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:517)
        at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:466)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
        at org.mortbay.jetty.Server.doStart(Server.java:224)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.glite.authz.pap.server.standalone.PAPServer.<init>(PAPServer.java:172)
        at org.glite.authz.pap.server.standalone.PAPServer.main(PAPServer.java:451)
OK
---Test-PAP-FUNC-2: TEST PASSED---


4.1.3: test-list-policies.sh
--------------------------------- 
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:16:58 CEST 2011
---Test-List-Policies---
1) testing list policies on an empty repository

default (local):
No policies has been found.
OK
2) testing list policies
OK
2) testing list policies with wrong pap-alias
org.glite.authz.pap.repository.exceptions.NotFoundException: Not found: papAlias=dummy_pap
OK
---Test-List-Polices: TEST PASSED---
Wed Apr 20 10:17:26 CEST 2011


4.1.4: test-ban-unban.sh
---------------------------------
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:17:30 CEST 2011
---Test-BAN/UNBAN---
1) testing user ban
OK
2) testing user unban
OK
3) testing unbanning non existing subject
ban policy not found.
OK
---Test-BAN/UNBAND: TEST PASSED---
Wed Apr 20 10:17:42 CEST 2011


4.1.5: test-ban-unban-fqan.sh
---------------------------------------
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:17:42 CEST 2011
---Test-BAN/UNBAN-FQAN---
1) testing fqan ban
OK
2) testing fqan unban
OK
3) testing unbanning non existing fqan
ban policy not found.
OK
---Test-BAN/UNBAND-FQAN: TEST PASSED---
Wed Apr 20 10:17:55 CEST 2011


4.1.6: test-remove-all-policies.sh
-------------------------------------------
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:17:59 CEST 2011
---Test-Remove-All-Policies---
1) testing remove all policies 
OK
---Test-Remove-All-Polices: TEST PASSED---
Wed Apr 20 10:18:19 CEST 2011


4.1.7: test-remove-policies.sh
---------------------------------------
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:18:23 CEST 2011
---Test-Remove-Policies---
1) testing removal with non existing id
error.
org.glite.authz.pap.repository.exceptions.NotFoundException: Id not found: dummy_id
OK
2) testing removal with resource id
ID=cdf15aca-36e9-4641-b0b1-6cd72bfb225f
OK
3) testing removal with action id
ID=public-21153508-1a6d-4ae0-a73e-ba5192fce1cb
OK
4) testing removal with rule id
ID=81bc3754-9c22-4837-adbd-4ede443dc940
OK
5) testing removal with multiple rules
ID=a250c7b5-6156-44dd-928b-2a52afe92e33
c8b56015-da1d-43bc-b9b6-22bea1c81aab
b4a99862-b582-4c86-b00c-51b8e17cd6ec
OK
6) testing removal with multiple rules and one wrong
ID=1fcf6853-6448-44bb-a74a-c25e1b7f2d58
1e3401bb-1329-4c18-86b0-7389ab5e68a8
46a8f911-926c-4e4a-9646-517917d12447
error.
org.glite.authz.pap.repository.exceptions.NotFoundException: Id not found: another-non-existing-id
OK
7) testing removal with empty repository
error.
org.glite.authz.pap.repository.exceptions.NotFoundException: Id not found: 1fcf6853-6448-44bb-a74a-c25e1b7f2d58
OK
---Test-Remove-Polices: TEST PASSED---
Wed Apr 20 10:20:38 CEST 2011


4.1.8: test-policy-from-file.sh
--------------------------------------
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:20:42 CEST 2011
---Test-APF---
1) testing add policy from file
OK
2) testing add policy from file with error
Syntax error no policies has been added from file:/home/casutt/org.glite.testsuites.ctb/Argus/tests/PAP-CLI/policyfile.txt
Reason:
org.glite.authz.pap.encoder.parser.ParseException: Encountered "deni" at line 4, column 14.
Was expecting one of:
    "permit" ...
    "deny" ...
    
OK
---Test-APF: TEST PASSED---
Wed Apr 20 10:21:03 CEST 2011


4.1.9: test-upp-from-file.sh
-----------------------------------
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:21:07 CEST 2011
---Test-Update-Policy-From-File---
1) testing upf with non existing file
Error: file "/home/casutt/org.glite.testsuites.ctb/Argus/tests/PAP-CLI/dummy.txt" does not exists.
OK
2) testing upf with non existing resource id
Error: resource id "dummy-id-999" does not exists.
OK
3) testing upf with correct resource id 
ID=39cae7ee-1e3f-47cf-b83b-98b0ab0663a0
OK
4) testing upf with changing only an action 
ID=public-7892c347-075a-4cb4-9b74-3b08dee88849
OK
---Test-Update-Policy-From-File: TEST PASSED---
Wed Apr 20 10:21:48 CEST 2011


4.1.10: add-remove-localpap.sh
------------------------------------------
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:21:48 CEST 2011
---Add/Remove-local-PAP---
1) testing apap with existing alias
pap already exists.
OK
2) testing apap with wrong endpoint
Error contacting the PAP service. Caused by java.net.ConnectException: Connection refused.
OK
3) testing apap local
OK
3) test removing local pap
OK
4) test removing local default pap
org.glite.authz.pap.papmanagement.PapManagerException: Deleting the default pap is not allowed
OK
5) test removing non-existing pap
PAP not found: Dummy
OK
---Test-Add/Remove-local-PAP: TEST PASSED---
Wed Apr 20 10:22:15 CEST 2011


4.1.11: en-disable-pap.sh
---------------------------------
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:22:15 CEST 2011
---Test-Enable/Disable-PAP---
1) testing dpap with non existing pap
PAP not found: mypap
OK
2) testing dpap with already disabled pap
OK
3) testing epap with wrong alias
PAP not found: Dummy
OK
4) testing epap with good alias
OK
4) testing dpap with good alias
OK
5) testing dpap default pap
OK
6) testing epap default pap
OK
---Test-Enable/Disable-PAP: TEST PASSED---
Wed Apr 20 10:23:06 CEST 2011


4.1.12: pap-ping.sh
--------------------------
AP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:23:06 CEST 2011
---Test-PAP-Ping---
1) test PAP ping
Contacting PAP at "https://loki.switch.ch:8150/pap/services/"... ok (PAP version: 1.3.1)
OK
---Test-PAP-Ping: TEST PASSED---
Wed Apr 20 10:23:10 CEST 2011


4.1.13: refresh-cache.sh
--------------------------------
AP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:23:10 CEST 2011
---Test-Refesh-Cache---
1) testing rc with non existing alias
Refreshing cache for pap "Do-Not-Exist"... error: pap doesn't exist
OK
2) testing rc with a local pap
Refreshing cache for pap "default"...error: org.glite.authz.pap.common.exceptions.PAPException: "default" is local, nothing to refresh
OK
---Test-Refesh-Cache: TEST PASSED---
Wed Apr 20 10:23:18 CEST 2011


4.1.14: set-get-pap-orders.sh
--------------------------------------
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:23:18 CEST 2011
---Test-Set/Get-paps-order---
1) testing gpo with no order
No ordering has been defined
OK
2) testing spo with 3 paps
OK
2) Inverting the order
OK
3) using a non existing alias
org.glite.authz.pap.distribution.DistributionConfigurationException: Error in remote paps order: unknown alias "local-pp3"
OK
---Test-Set/Get-paps-order: TEST PASSED---
Wed Apr 20 10:23:56 CEST 2011


4.1.15: set-get-poll-interval.sh
---------------------------------------
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:23:56 CEST 2011
---Test-Set/Get-Poll-Interval---
1) Setting polling time
OK
2) Retrieving polling time
OK
---Test-Set/Get-Poll-Interval: TEST PASSED---
Wed Apr 20 10:24:04 CEST 2011


4.1.16: test-authz.sh
---------------------------
Wed Apr 20 11:10:56 CEST 2011
---Test-argus---
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
1) testing lp with no authorization
OK
2) testing lp with anyone full power
OK
---Test-argus: TEST PASSED---
Wed Apr 20 11:12:01 CEST 2011


4.1.17: PDP: test-configuration.sh
---------------------------------------------
PDP_CTRL set to: argus-pdp
Argus
Wed Apr 20 11:14:50 CEST 2011
---Test-PDP-Configuration---
1) testing pdp status
OK
---Test-PDP-Configuration: TEST PASSED---
Wed Apr 20 11:14:51 CEST 2011


4.1.18: PEP: test-configuration.sh
---------------------------------------------
PEP_CTRL set to: argus-pepd
PEP_INFO set to: Argus PEP Server
Wed Apr 20 10:25:16 CEST 2011
---Test-PEP-Configuration---
1) testing pep status
OK
2) testing pep with SSL
OK
3) testing pep with no config file
/usr/sbin/pepdctl: ERROR: config file /usr/share/argus/pepd/conf/pepd.ini not readable
OK
Unable to connect to localhost.localdomain:8155, perhaps the service is not running
---Test-PEP-Configuration: TEST PASSED---
Wed Apr 20 10:25:49 CEST 2011


4.2. Regression tests
*****************************

4.2.1: Tests from Patch 4367
--------------------------------------

4.2.1.1: bug 60044
-------------------------
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:25:56 CEST 2011
Testing bug 60044.
test_bug_60044.sh: passed lp by resource.
test_bug_60044.sh: passed lp by valid action.
test_bug_60044.sh: passed lp by INvalid action.
---test_bug_60044.sh: TEST PASSED---
Wed Apr 20 10:26:39 CEST 2011


4.2.1.2: bug 63180
-------------------------
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:26:44 CEST 2011
---test_bug_63180.sh: TEST PASSED---
Wed Apr 20 10:27:11 CEST 2011


4.2.1.3: bug 64340
-------------------------
PEP_CTRL set to: /etc/rc.d/init.d/pep
PDP_CTRL set to: /etc/rc.d/init.d/argus-pdp
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Running: test_bug_64340.sh
Wed Apr 20 10:27:11 CEST 2011
test_bug_64340.sh: Stopping PEPd.
test_bug_64340.sh: Starting PEPd.

default (local):

id=d8af4bb3-2acc-436e-b514-6d22b96aed7a
resource "resource_1" {
    obligation "http://glite.org/xacml/obligation/local-environment-map" {
    }

    id=public_e877c0d7-40cb-4521-83c0-6ceaa5cb5aab
    action "testwerfer" {
        rule permit { subject="CN=loki.switch.ch,O=SWITCH,L=Zuerich,ST=Zuerich,C=CH,DC=hosts,DC=switch,DC=grid,DC=quovadisglobal,DC=com" }
    }
}
./test_bug_64340.sh: line 135: -p: command not found
---test_bug_64340.sh: TEST PASSED---
Wed Apr 20 10:27:50 CEST 2011


4.2.1.4: bug 65542
-------------------------
PEP_CTRL set to: /etc/rc.d/init.d/pep
PDP_CTRL set to: /etc/rc.d/init.d/argus-pdp
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
argus-pap status returned 1. OK.
pdp status returned 0. OK.
pepd status returned 127. OK.
---test_bug_65542.sh: TEST PASSED---
Wed Apr 20 10:28:02 CEST 2011


4.2.1.5: bug 65802
-------------------------
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
PAP is not running
---test_bug_65802.sh: TEST PASSED---
Wed Apr 20 10:28:12 CEST 2011


4.2.1.6: bug 66669
-------------------------
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Wed Apr 20 10:28:17 CEST 2011
Running: test_bug_66669.sh

default (local):

resource "resource_1" {

    action ".*" {
        rule deny { subject="CN=user name/testslash,CN=999999,CN=user,OU=Users,OU=Organic Units,DC=cern,DC=ch" }
    }
}

resource "resource_1" {

    action ".*" {
        rule permit { subject="CN=user name,CN=999999,CN=user,OU=Users/slashtest,OU=Organic Units,DC=cern,DC=ch" }
    }
}
---test_bug_66669.sh: TEST PASSED---
Wed Apr 20 10:28:40 CEST 2011


4.2.1.7: bug 68595
-------------------------
PEP_CTRL set to: /etc/rc.d/init.d/pep
PDP_CTRL set to: /etc/rc.d/init.d/argus-pdp
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Running: test_bug_68595.sh
Wed Apr 20 10:28:40 CEST 2011
Unable to connect to localhost.localdomain:8153, perhaps the service is not running
PDP is not running. Starting one.
 subject string = /DC=ch/DC=switch/DC=slcs/O=SWITCH/CN=Joel Casutt D88E5396
/usr/share/argus/pap/bin/pap-admin ro 6e52d97a-4249-4da3-acf4-96ccea67ec66 http://glite.org/xacml/obligation/local-environment-map
---test_bug_68595.sh: TEST PASSED---
Wed Apr 20 10:29:38 CEST 2011


4.2.1.8: bug 68599
-------------------------
PEP_CTRL set to: /etc/rc.d/init.d/argus-pepd
PDP_CTRL set to: /etc/rc.d/init.d/argus-pdp
PAP_CTRL set to: /etc/rc.d/init.d/argus-pap
Running: test_bug_68599.sh
Wed Apr 20 10:29:38 CEST 2011
---test_bug_68599.sh: TEST PASSED---
Wed Apr 20 10:30:24 CEST 2011


4.2.1.9: bug 68805
-------------------------


---------------End of System Test Summary ------------------

Test Report in detail

Component

The Test Report must specify the name of the EMI component that is being tested.

Savannah Task

The Test Report must specify the unique id for the Savannah task in the EMI release project where the component release is being tracked.

EMI major release and Platform

The Test Report must specify the EMI major release and platform of the component release.

Author

The Test Report must contain the name and mail addresses of the PT members who have performed the testing of the component release.

Summary

In order to have a quick summary of the results of the tests, PTs should fill in the summary section of the template, where PASS means all the tests have passed; FAIL means that at least one test has failed; NA means the test is not applicable for the component:

Important remarks about the result of the tests can be added in the summary.

Deployment log

Clean Installation

The Test Report must contain a test for a clean installation, that is an installation of the component release including the change on a clean machine.

Don't forget to include:

  • the testing yum repo file with the details of the yum repository that is used to do the installation.
  • the yum command used to install the component release.
  • the yum output.
  • configuration output (YAIM log or any other tool or set of commands run to configure the SW component)

Verify that the packages (rpm or deb) included in the change have been correctly installed.

System tests

The Test Report must report on the results of the system tests defined in the Test Plan of the component.

Don't forget to include:

  • URL of the tests/testsuites (with the revision number in case of tests maintained on a VCS)
  • When tests are automated, a link to the tool-specific report, otherwise, please specify:
    • a short description of the tests run (1-2 lines should be enough)
    • the outcome of the tests, that is either PASSED or FAILED.
    • specific command to run the test and output of the test.

Basic functionality tests

The Test Report must contain the result of running the Basic Functionality tests described in the test plan of the component.

Regression tests

The Test Report must contain the result of running the existing tests associated to software defects (bugs) tracked in specific RfCs, as it should be specified in the test plan of the component.

Don't forget to include:

  • The RfC unique ID for which the regression test is written.
Edit | Attach | Watch | Print version | History: r6 < r5 < r4 < r3 < r2 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r3 - 2011-04-20 - unknown
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    EMI All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback