Authorization Services Testing Summary

Hardware Description

For the perfomance and aging tests, we installed:

  • EMI-1 Argus 1.4.0 (PAP, PDP and PEP Server):
    • 1 Xeon CPU 2.33GHz (Dual Core)
    • 5 GB RAM

  • PEP client pepcli:
    • 3 hosts running the Grinder framework

Performance Tests

The performance testing of the Authorization Services was done using the hardware described above. The setup of the test was basically the same as described here, using the following options. Each agent (host running grinder-framework) opens two worker, and each worker opens 2 threads. Therefore a maximum of 12 (3*2*2) simultaneous requests are achieved.

Test Description (SSL enabled)

This is the most common case, since the default configuration with YAIM results in a PEPd with SSL enabled
On the Argus Server
The default configuration was used The policies needed for this test were added to the PAP
  • pap-admin ap permit pfqan="/dteam" --action "submit" --resource "ce1_.*"
  • pap-admin ap deny pfqan="/dteam" --action "submit" --resource "ce2_.*"
while the star denotes a number between 1 and 500, so in total the pap was loaded with 1'000 policies each one containing a rule and a obligation
The Test-Scripts
To assure that not only cached requests are used by the PEPd, but that the PEPd also sends requests to the PDP, more than 200 different sets of Action/Resource/Obligation have been defined in the properties file. This can easily be done by changing the resource (e.g. ce1_100, ce1_101, ...). More than that 100 certificates issued by the ARC instant online CA were randomly combined with those sets, leading to roughly 1'000 different possible requests.

Results and Metrics

  • Test ran for about 26.5h without interruption
  • 4'078'768 authorization requests processed
  • 43 requests per second sustained
  • 274 ms average round trip time (pepcli -> PEPd (-> PDP -> PEPd) -> pepcli)

  • Memory consumption of the 1.4.0 pdp during a load-test:
    pdp_memory_consumption_1.4.1.png

  • Memory consumption of the 1.4.0 pepd during a load-test:
    pepd_memory_consumption_1.4.1.png

  • Average requests per second during the load-test:
    requests_per_second_1.4.1.png

Aging Tests

This test was done analogue to the performance test, but with only one Agent starting one worker starting one thread. This resulted in about 9 requests per second.

Test Description

The test was done using the same options as the performance test.

Results and Metrics

  • Test ran for about 140h without interruption
  • 4'951'677 authorization requests processed
  • 9 requests per second sustained
  • 97.5 ms average round trip time (pepcli -> PEPd (-> PDP -> PEPd) -> pepcli)

  • Memory consumption of the 1.4.0 pdp during a aging-test:
    aging_test_pdp_mem_consumption_1.4.1.png

  • Memory consumption of the 1.4.0 pepd during a aging-test:
    aging_test_pepd_mem_consumption_1.4.1.png

  • Average requests per second during the aging-test:
    aging_test_requests_per_second_1.4.1.png
Topic attachments
I Attachment History Action Size Date Who Comment
PNGpng aging_test_pdp_mem_consumption_1.4.1.png r1 manage 27.0 K 2011-11-21 - 15:17 UnknownUser Memory consumption of the 1.4.1 pdp during a aging-test
PNGpng aging_test_pepd_mem_consumption_1.4.1.png r1 manage 29.1 K 2011-11-21 - 15:18 UnknownUser Memory consumption of the 1.4.1 pepd during a aging-test
PNGpng aging_test_requests_per_second_1.4.1.png r1 manage 17.2 K 2011-11-21 - 15:18 UnknownUser Average requests per second during the aging-test
PNGpng pdp_memory_consumption_1.4.1.png r1 manage 25.4 K 2011-11-09 - 16:07 UnknownUser Memory consumption of the 1.4.1 pdp during a load-test
PNGpng pepd_memory_consumption_1.4.1.png r1 manage 26.3 K 2011-11-09 - 16:08 UnknownUser Memory consumption of the 1.4.1 pepd during a load-test
PNGpng requests_per_second_1.4.1.png r1 manage 19.4 K 2011-11-09 - 16:09 UnknownUser Average requests per second during the load-test
Edit | Attach | Watch | Print version | History: r5 < r4 < r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r5 - 2016-07-05 - MaartenLitmaath
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    EGEE All webs login

This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright & by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Ask a support question or Send feedback