Authorization Services Testing Summary

Hardware Description

For the perfomance and aging tests, we installed:

  • EMI-1 Argus 1.4.0 (PAP, PDP and PEP Server):
    • 1 QEMU Virtual CPU 2.66GHz
    • 384 MB RAM

  • PEP client pepcli:
    • 3 hosts running the Grinder framework

Performance Tests

The performance testing of the Authorization Services was done using the hardware described above. The setup of the test was basically the same as described here, using the following options. Each agent (host running grinder-framework) opens two worker, and each worker opens 2 threads. Therefore a maximum of 12 (3*2*2) simultaneous requests are achieved.

Test Description (SSL enabled)

This is the most common case, since the default configuration with YAIM results in a PEPd with SSL enabled
On the Argus Server
The default configuration was used The policies needed for this test were added to the PAP
  • pap-admin ap permit pfqan="/dteam" --action "submit" --resource "ce1_.*"
  • pap-admin ap deny pfqan="/dteam" --action "submit" --resource "ce2_.*"
while the star denotes a number between 1 and 500, so in total the pap was loaded with 1'000 policies each one containing a rule and a obligation
The Test-Scripts
To assure that not only cached requests are used by the PEPd, but that the PEPd also sends requests to the PDP, more than 200 different sets of Action/Resource/Obligation have been defined in the properties file. This can easily be done by changing the resource (e.g. ce1_100, ce1_101, ...). More than that 100 certificates issued by the ARC instant online CA were randomly combined with those sets, leading to roughly 1'000 different possible requests.

Results and Metrics
  • Test ran for about 42h without interruption
  • 4'362'423 authorization requests processed
  • 28.9 requests per second sustained
  • 409 ms average round trip time (pepcli -> PEPd (-> PDP -> PEPd) -> pepcli)

  • Memory consumption of the 1.4.0 pdp during a load-test:
    load_test_pdp_mem_consumption_1.4.0V.png

  • Memory consumption of the 1.4.0 pepd during a load-test:
    load_test_pepd_mem_consumption_1.4.0V.png

  • Average requests per second during the load-test:
    load_test_requests_per_second_1.4.0V.png

Aging Tests

This test was done analogue to the performance test, but with only one Agent starting one worker starting one thread. This resulted in about 9 requests per second.

Test Description

The test was done using the same options as the performance test.

Results and Metrics

  • Test ran for about 190h without interruption
  • 7'332'606 authorization requests processed
  • 10.7 requests per second sustained
  • 89.1 ms average round trip time (pepcli -> PEPd (-> PDP -> PEPd) -> pepcli)

  • Memory consumption of the 1.4.0 pdp during a aging-test:
    aging_test_pdp_mem_consumption_1.4.0V.png

  • Memory consumption of the 1.4.0 pepd during a aging-test:
    aging_test_pepd_mem_consumption_1.4.0V.png

  • Average requests per second during the aging-test:
    aging_test_requests_per_second_1.4.0V.png
Topic attachments
I Attachment History Action Size Date Who Comment
PNGpng aging_test_pdp_mem_consumption_1.4.0V.png r1 manage 25.7 K 2011-11-29 - 15:12 UnknownUser Memory consumption of the 1.4.0 pdp during a aging-test
PNGpng aging_test_pepd_mem_consumption_1.4.0V.png r1 manage 26.4 K 2011-11-29 - 15:12 UnknownUser Memory consumption of the 1.4.0 pepd during a aging-test
PNGpng aging_test_requests_per_second_1.4.0V.png r1 manage 20.7 K 2011-11-29 - 15:11 UnknownUser Average requests per second during the aging-test
PNGpng load_test_pdp_mem_consumption_1.4.0V.png r1 manage 23.5 K 2011-12-01 - 10:09 UnknownUser Memory consumption of the 1.4.0 pdp during a load-test
PNGpng load_test_pepd_mem_consumption_1.4.0V.png r1 manage 25.1 K 2011-12-01 - 10:11 UnknownUser Memory consumption of the 1.4.0 pepd during a load-test
PNGpng load_test_requests_per_second_1.4.0V.png r1 manage 20.9 K 2011-12-01 - 10:12 UnknownUser Average requests per second during the load-test
Edit | Attach | Watch | Print version | History: r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r3 - 2016-07-05 - MaartenLitmaath
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    EGEE All webs login

This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright & by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Ask a support question or Send feedback