Authorization Services Testing Summary

Hardware Description

For the perfomance and aging tests, we installed:

  • EMI-1 Argus 1.3 (PAP, PDP and PEP Server):
    • 1 Xeon CPU 2.33GHz (Dual Core)
    • 5 GB RAM

  • PEP client pepcli:
    • 4 hosts running the Grinder framework

Update: Results for the 1.3.1 update using the same Hardware
There is a significant drop in memory consumption coming with the 1.3.1 update for the pepd and the pdp server. Find some load test using those Versions below.

Performance Tests

The performance testing of the Authorization Services was done using the hardware described above. The setup of the test was basically the same as described here, using the following options. Each agent (host running grinder-framework) opens two worker, and each worker opens 5 threads. Therefore a maximum of 40 (4*2*5) simultaneous requests are achieved.

Test Description (SSL enabled)

This is the most common case, since the default configuration with YAIM results in a PEPd with SSL enabled
On the Argus Server
The default configuration was used, only the cache-size was lowered to 200 requests
  • pepd.ini: maximumCachedResponses = 200
The obligations needed for this test were added to the PAP
  • pap-admin ap permit subject="CN=Joel Casutt D88E5396,O=SWITCH,DC=slcs,DC=switch,DC=ch" --action "submit" --resource "ce1_.*"
  • pap-admin ap deny subject="CN=Joel Casutt D88E5396,O=SWITCH,DC=slcs,DC=switch,DC=ch" --action "submit" --resource "ce2_.*"
The Test-Scripts
To assure that not only cached requests are used by the PEPd, but that the PEPd also sends requests to the PDP, more than 200 different requests need to be defined in the properties file. This can easily be done by changing the resource (e.g. ce1_100, ce1_101, ...)

Results and Metrics

  • Test ran for about 16h without interruption
  • 1'698'886 authorization requests processed
  • 30 requests per second sustained
  • 1340 ms average round trip time (pepcli -> PEPd (-> PDP -> PEPd) -> pepcli)

  • Memory usage of the PEPd during the load-test:
    PEP-memory-usage.png

  • Memory usage of the PDP during the load-test:
    PDP-memory-usage.png

Results and Metrics for the 1.3.1-update

  • Test ran for about 63h without interruption
  • ~6.9 M authorization requests processed
  • 30 requests per second sustained
  • 900 ms average round trip time (pepcli -> PEPd (-> PDP -> PEPd) -> pepcli)

  • Requests per second during the load test for the 1.3.1 update:
    requests_per_second_1.3.1.png

  • Memory usage of the pdp during the load test for the 1.3.1 update:
    pdp_memory_consumption_1.3.1.png

  • Memory usage of the pepd during the load test for the 1.3.1 update:
    pepd_memory_consumption_1.3.1.png

Aging Tests

This test was done analogue to the performance test, but with only one Agent starting one worker starting one thread. This resulted in about 10 requests per second.

Test Description

The test was done using the same options as the performance test.

Results and Metrics

  • Test ran for about 43h without interruption
  • 1'486'711 authorization requests processed
  • 10 requests per second sustained
  • 101 ms average round trip time (pepcli -> PEPd (-> PDP -> PEPd) -> pepcli)

  • Memory usage of the PDP during the long-test:
    PDP-memory-usage-long-test.png

  • Memory usage of the PEPd during the long-test:
    PEP-memory-usage-long-test.png
Topic attachments
I Attachment History Action Size Date Who Comment
PNGpng PDP-memory-usage-long-test.png r1 manage 30.2 K 2011-05-23 - 16:42 UnknownUser Memory usage of the PDP during the long-test
PNGpng PDP-memory-usage.png r2 r1 manage 30.2 K 2011-05-23 - 16:39 UnknownUser Memory usage of the PDP during the load-test
PNGpng PEP-memory-usage-long-test.png r1 manage 28.8 K 2011-05-23 - 16:43 UnknownUser Memory usage of the PEPd during the long-test
PNGpng PEP-memory-usage.png r2 r1 manage 28.8 K 2011-05-23 - 16:40 UnknownUser Memory usage of the PEPd during the load-test
PNGpng pdp_memory_consumption_1.3.1.png r1 manage 27.8 K 2011-07-04 - 10:39 UnknownUser Memory usage of the pdp during the load test for the 1.3.1 update
PNGpng pepd_memory_consumption_1.3.1.png r1 manage 28.6 K 2011-07-04 - 10:39 UnknownUser Memory usage of the pepd during the load test for the 1.3.1 update
PNGpng requests_per_second_1.3.1.png r1 manage 23.4 K 2011-07-04 - 10:38 UnknownUser Requests per second during the load test for the 1.3.1 update
Edit | Attach | Watch | Print version | History: r8 < r7 < r6 < r5 < r4 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r8 - 2016-07-05 - MaartenLitmaath
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    EGEE All webs login

This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright & by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Ask a support question or Send feedback