Skip to end of metadata
Go to start of metadata

Since its beginning, ATutor has been developed with an eye for efficient use of computing power, ensuring that it will function effectively with as little strain as possible on the hosting server. Here we will gather a collection of load tests of Open Source LMS's as a mean of comparing the load of these systems.

Reports below are generated by Apache Bench (ab) run over a local network to the LMSs residing on the same system. In each case to system's login screen is hit with 200 simultaneous connections, for a period of 30 seconds. Ab is a tool for benchmarking the performance of your Apache HyperText Transfer Protocol (HTTP) server. It does this by giving you an indication of how many requests per second your Apache installation can serve.

-c = concurrent connections
-t = time limit
-n = # of requests

The UNIX uptime utility was also used to measure system load at resting, just prior to the test, and at the peak, run every one second during the test until the load reached a peak and began dropping as the ab test ended.

System Details

Intel Pentium 4 CPU 1.8GHz
Cache Size 265kb
Apache/2.2.3
PHP/5.2
Mysql/5.0.22

ATutor Output

Test 1

./ab -c 200 -t 30 -n 1000 http://testmachine.ca/atutor/index.php

uptime: resting load average: 0.10, 0.87, 6.47
uptime: peak load average: 5.07, 1.88, 6.60

Finished 1000 requests
Server Software: Apache/2.2.3
Server Hostname: greg-pc.atrc.utoronto.ca
Server Port: 80

Document Path: /atutorsvn/docs/index.php
Document Length: 0 bytes

Concurrency Level: 200
Time taken for tests: 12.080 seconds
Complete requests: 1000
Failed requests: 0
Broken pipe errors: 0
Non-2xx responses: 1000
Total transferred: 317000 bytes
HTML transferred: 0 bytes
Requests per second: 82.78 #/sec (mean)
Time per request: 2416.00 ms (mean)
Time per request: 12.08 ms (mean, across all concurrent requests)
Transfer rate: 26.24 Kbytes/sec received

Connnection Times (ms)
min mean+/-sd median max
Connect: 0 118 773.6 0 8999
Processing: 132 1568 838.0 1515 11202
Waiting: 113 1568 838.1 1514 11201
Total: 132 1687 1137.4 1521 11218

Percentage of the requests served within a certain time (ms)
50% 1521
66% 1574
75% 1603
80% 1642
90% 1763
95% 2384
98% 4764
99% 7561
100% 11218 (last request)

Test 2 (200 connections)

./ab -c 200 -t 30 -n 1000 http://testmachine.ca/atutor/index.php

uptime: resting load average: 0.10, 0.44, 3.61
uptime: peak load average: 4.27, 1.30, 3.64

Finished 1000 requests
Server Software: Apache/2.2.3
Server Hostname: greg-pc.atrc.utoronto.ca
Server Port: 80

Document Path: /atutorsvn/docs/index.php
Document Length: 0 bytes

Concurrency Level: 200
Time taken for tests: 12.916 seconds
Complete requests: 1000
Failed requests: 0
Broken pipe errors: 0
Non-2xx responses: 1000
Total transferred: 317000 bytes
HTML transferred: 0 bytes
Requests per second: 77.42 #/sec (mean)
Time per request: 2583.20 ms (mean)
Time per request: 12.92 ms (mean, across all concurrent requests)
Transfer rate: 24.54 Kbytes/sec received

Connnection Times (ms)
min mean+/-sd median max
Connect: 0 154 761.4 0 8999
Processing: 121 1681 808.0 1652 9175
Waiting: 87 1680 808.1 1652 9174
Total: 121 1835 1125.7 1662 10813

Percentage of the requests served within a certain time (ms)
50% 1662
66% 1751
75% 1801
80% 1816
90% 2113
95% 4550
98% 4828
99% 7987
100% 10813 (last request)

Test 3 (500 connections)

ab -c 500 -t 30 -n 1000 http://testmachine.ca/atutor/index.php

Finished 836 requests
Server Software: Apache/2.2.3
Server Hostname: greg-pc.atrc.utoronto.ca
Server Port: 80

Document Path: /atutorsvn/docs/login.php
Document Length: 415 bytes

Concurrency Level: 500
Time taken for tests: 30.005 seconds
Complete requests: 836
Failed requests: 0
Broken pipe errors: 0
Total transferred: 554931 bytes
HTML transferred: 347355 bytes
Requests per second: 27.86 #/sec (mean)
Time per request: 17945.57 ms (mean)
Time per request: 35.89 ms (mean, across all concurrent requests)
Transfer rate: 18.49 Kbytes/sec received

Connnection Times (ms)
min mean+/-sd median max
Connect: 0 66 384.2 1 3000
Processing: 2274 4866 4009.8 2823 21543
Waiting: 2272 4865 4009.9 2822 21543
Total: 2274 4932 4042.7 2832 21624

Percentage of the requests served within a certain time (ms)
50% 2832
66% 4561
75% 5486
80% 6831
90% 10840
95% 11689
98% 19062
99% 20310
100% 21624 (last request)

Moodle Output

Test 1

The system was unable to handle 200 or even 100 simultaneous connection from Moodle so we drop the connections to 100
./ab -c 100 -t 30 -n 1000 http://testmachine.ca/moodle/login/index.php

uptime: resting load average:load average: 0.31, 2.62, 6.40
uptime: peak load average:

Test 1

  • No labels