Skip to content

Commit

Permalink
Merge branch 'master' of gitlab.techempower.com:techempower/framework…
Browse files Browse the repository at this point in the history 
…benchmarks
  • Loading branch information
@pfalls-techempower
pfalls-techempower committed Apr 16, 2013
2 parents 2f9a607 + 98ddfde commit 8ffb3af
Show file tree
Hide file tree
Showing 158 changed files with 19,841 additions and 1 deletion.
2 changes: 1 addition & 1 deletion latest.json
View file
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
{
"i7": 20130415095717,
"ec2": 20130404200504
"ec2": 20130415193456
}
52 changes: 52 additions & 0 deletions results/ec2/20130415193456/db.csv
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,52 @@
Framework,8,16,32,64,128,256
unfiltered,3968,4149,4273,4253,4247,4114
kohana-raw,345,353,352,346,340,332
laravel-raw,292,292,289,286,278,270
codeigniter-raw,573,574,571,560,537,525
tornado-raw,1124,1142,1126,1138,1115,1089
play1,1466,1341,968,47,101,208
play1siena,2880,2625,2661,2632,2568,2585
Fuel,259,255,255,253,250,239
Slim,561,574,578,567,553,545
vertx,5466,6450,6670,6633,6827,6734
wicket,4999,5433,5493,5565,5583,5133
go,1076,1030,1011,1010,1009,1007
sinatra-ruby,1020,1024,1011,1007,1019,1016
sinatra-jruby,372,385,399,399,395,366
spring,4431,4731,4787,4941,4976,4724
tapestry,2800,3221,3334,3340,3438,3310
finagle-future-pool,1756,1833,1858,1848,1855,1858
nodejs-mongodb-raw,4388,3546,4703,4878,4785,4902
finagle,1871,1916,1895,1907,1903,1906
lift-stateless,603,608,605,622,626,623
nodejs-mysql-raw,2413,2469,2454,2430,2448,2455
cowboy,2759,3658,3824,3905,3940,3814
snap,2689,2519,2364,2738,2653,2533
cake,232,234,232,231,229,215
gemini,7584,8889,9169,9245,9140,8760
django,367,425,369,423,494,501
compojure,3754,3991,4225,4376,4386,4173
express-mongodb,2197,2814,2922,2953,2907,2913
grails,2483,2515,2517,2522,2408,2113
express-mysql,1164,1470,1586,1628,1611,1496
nodejs-mongodb,3105,3231,3262,3336,3289,3298
play,989,1078,1162,1221,1226,1189
php,612,624,624,613,594,566
nodejs-mysql,1197,1299,1749,1730,1663,1690
elli,2873,4134,4246,4236,4194,4084
php-raw,2943,3021,2979,2967,2887,2868
scalatra-raw,5038,5536,5676,5843,5774,5532
lithium,293,297,298,294,282,264
rails-jruby,713,708,688,679,662,621
rails-ruby,678,679,675,682,678,681
servlet-raw,6757,7938,8146,8337,8378,7431
symfony2,117,116,116,115,114,110
flask,699,698,788,819,812,809
phreeze,320,340,355,355,337,329
yesod,3079,3573,3608,3677,3678,3533
http-kit,6158,6149,6164,6187,6227,6041
rails-stripped-jruby,867,848,840,817,799,756
rails-stripped-ruby,804,820,812,808,809,809
django-stripped,500,503,552,548,609,610
play-scala,2396,2627,2736,2805,2753,2747
silex-raw,281,278,275,272,268,263
137 changes: 137 additions & 0 deletions results/ec2/20130415193456/db/Fuel/raw
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,137 @@
Welcome to Ubuntu 12.04.1 LTS (GNU/Linux 3.2.0-36-virtual x86_64)

* Documentation: https://help.ubuntu.com/

System information as of Tue Apr 16 14:30:13 UTC 2013

System load: 0.08 Processes: 70
Usage of /: 24.6% of 19.69GB Users logged in: 1
Memory usage: 8% IP address for eth0: 10.252.147.39
Swap usage: 0%

Graph this data and manage this system at https://landscape.canonical.com/

67 packages can be updated.
30 updates are security updates.

Get cloud support with Ubuntu Advantage Cloud Guest
http://www.ubuntu.com/business/services/cloud

Use Juju to deploy your cloud instances and workloads.
https://juju.ubuntu.com/#cloud-precise
*** System restart required ***

---------------------------------------------------------
Running Primer Fuel
wrk -d 60 -c 8 -t 8 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 5s test @ http://10.252.147.200:8080/db
8 threads and 8 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 33.61ms 15.75ms 130.92ms 77.82%
Req/Sec 0.00 0.00 0.00 100.00%
1239 requests in 5.01s, 284.03KB read
Requests/sec: 247.13
Transfer/sec: 56.65KB

---------------------------------------------------------
Running Warmup Fuel
wrk -d 60 -c 256 -t 4 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 1m test @ http://10.252.147.200:8080/db
4 threads and 256 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 992.13ms 335.40ms 2.08s 68.92%
Req/Sec 0.00 0.00 0.00 100.00%
15272 requests in 1.00m, 3.42MB read
Socket errors: connect 0, read 0, write 0, timeout 5
Requests/sec: 254.51
Transfer/sec: 58.36KB

---------------------------------------------------------
Concurrency: 8 for Fuel
wrk -d 60 -c 8 -t 4 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 1m test @ http://10.252.147.200:8080/db
4 threads and 8 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 30.79ms 15.61ms 159.41ms 76.76%
Req/Sec 0.00 0.00 0.00 100.00%
15573 requests in 1.00m, 3.49MB read
Requests/sec: 259.53
Transfer/sec: 59.49KB

---------------------------------------------------------
Concurrency: 16 for Fuel
wrk -d 60 -c 16 -t 4 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 1m test @ http://10.252.147.200:8080/db
4 threads and 16 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 66.38ms 53.33ms 648.97ms 85.89%
Req/Sec 0.00 0.00 0.00 100.00%
15323 requests in 1.00m, 3.43MB read
Requests/sec: 255.37
Transfer/sec: 58.54KB

---------------------------------------------------------
Concurrency: 32 for Fuel
wrk -d 60 -c 32 -t 4 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 1m test @ http://10.252.147.200:8080/db
4 threads and 32 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 140.58ms 142.09ms 1.21s 88.25%
Req/Sec 0.00 0.00 0.00 100.00%
15319 requests in 1.00m, 3.43MB read
Requests/sec: 255.30
Transfer/sec: 58.52KB

---------------------------------------------------------
Concurrency: 64 for Fuel
wrk -d 60 -c 64 -t 4 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 1m test @ http://10.252.147.200:8080/db
4 threads and 64 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 281.61ms 293.09ms 3.08s 87.67%
Req/Sec 0.00 0.00 0.00 100.00%
15218 requests in 1.00m, 3.41MB read
Socket errors: connect 0, read 0, write 0, timeout 7
Requests/sec: 253.62
Transfer/sec: 58.14KB

---------------------------------------------------------
Concurrency: 128 for Fuel
wrk -d 60 -c 128 -t 4 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 1m test @ http://10.252.147.200:8080/db
4 threads and 128 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 520.52ms 309.97ms 1.83s 71.27%
Req/Sec 0.00 0.00 0.00 100.00%
15020 requests in 1.00m, 3.36MB read
Requests/sec: 250.33
Transfer/sec: 57.38KB

---------------------------------------------------------
Concurrency: 256 for Fuel
wrk -d 60 -c 256 -t 4 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 1m test @ http://10.252.147.200:8080/db
4 threads and 256 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 1.07s 331.31ms 2.94s 74.08%
Req/Sec 0.00 0.00 0.00 100.00%
14345 requests in 1.00m, 3.21MB read
Socket errors: connect 0, read 0, write 0, timeout 22
Requests/sec: 239.04
Transfer/sec: 54.81KB
135 changes: 135 additions & 0 deletions results/ec2/20130415193456/db/Slim/raw
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,135 @@
Welcome to Ubuntu 12.04.1 LTS (GNU/Linux 3.2.0-36-virtual x86_64)

* Documentation: https://help.ubuntu.com/

System information as of Tue Apr 16 14:52:59 UTC 2013

System load: 0.02 Processes: 70
Usage of /: 24.6% of 19.69GB Users logged in: 1
Memory usage: 8% IP address for eth0: 10.252.147.39
Swap usage: 0%

Graph this data and manage this system at https://landscape.canonical.com/

67 packages can be updated.
30 updates are security updates.

Get cloud support with Ubuntu Advantage Cloud Guest
http://www.ubuntu.com/business/services/cloud

Use Juju to deploy your cloud instances and workloads.
https://juju.ubuntu.com/#cloud-precise
*** System restart required ***

---------------------------------------------------------
Running Primer Slim
wrk -d 60 -c 8 -t 8 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 5s test @ http://10.252.147.200:8080/db
8 threads and 8 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 14.36ms 7.50ms 50.97ms 76.95%
Req/Sec 0.00 0.00 0.00 100.00%
2720 requests in 5.01s, 663.38KB read
Requests/sec: 543.22
Transfer/sec: 132.49KB

---------------------------------------------------------
Running Warmup Slim
wrk -d 60 -c 256 -t 4 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 1m test @ http://10.252.147.200:8080/db
4 threads and 256 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 468.35ms 224.33ms 1.54s 70.06%
Req/Sec 0.00 0.00 0.00 100.00%
32049 requests in 1.00m, 7.63MB read
Requests/sec: 534.12
Transfer/sec: 130.26KB

---------------------------------------------------------
Concurrency: 8 for Slim
wrk -d 60 -c 8 -t 4 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 1m test @ http://10.252.147.200:8080/db
4 threads and 8 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 14.59ms 10.19ms 205.44ms 91.78%
Req/Sec 0.00 0.00 0.00 100.00%
33708 requests in 1.00m, 8.03MB read
Requests/sec: 561.77
Transfer/sec: 137.00KB

---------------------------------------------------------
Concurrency: 16 for Slim
wrk -d 60 -c 16 -t 4 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 1m test @ http://10.252.147.200:8080/db
4 threads and 16 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 31.07ms 53.25ms 614.19ms 92.38%
Req/Sec 0.00 0.00 0.00 100.00%
34483 requests in 1.00m, 8.21MB read
Requests/sec: 574.69
Transfer/sec: 140.15KB

---------------------------------------------------------
Concurrency: 32 for Slim
wrk -d 60 -c 32 -t 4 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 1m test @ http://10.252.147.200:8080/db
4 threads and 32 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 60.55ms 113.77ms 1.13s 90.76%
Req/Sec 0.00 0.00 0.00 100.00%
34700 requests in 1.00m, 8.26MB read
Requests/sec: 578.32
Transfer/sec: 141.04KB

---------------------------------------------------------
Concurrency: 64 for Slim
wrk -d 60 -c 64 -t 4 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 1m test @ http://10.252.147.200:8080/db
4 threads and 64 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 120.71ms 171.04ms 1.35s 88.67%
Req/Sec 0.00 0.00 0.00 100.00%
34038 requests in 1.00m, 8.11MB read
Socket errors: connect 0, read 0, write 0, timeout 4
Requests/sec: 567.27
Transfer/sec: 138.35KB

---------------------------------------------------------
Concurrency: 128 for Slim
wrk -d 60 -c 128 -t 4 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 1m test @ http://10.252.147.200:8080/db
4 threads and 128 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 238.86ms 167.96ms 999.40ms 68.27%
Req/Sec 0.00 0.00 0.00 100.00%
33238 requests in 1.00m, 7.92MB read
Requests/sec: 553.91
Transfer/sec: 135.09KB

---------------------------------------------------------
Concurrency: 256 for Slim
wrk -d 60 -c 256 -t 4 http://10.252.147.200:8080/db
---------------------------------------------------------

Running 1m test @ http://10.252.147.200:8080/db
4 threads and 256 connections
Thread Stats Avg Stdev Max +/- Stdev
Latency 470.43ms 165.15ms 1.84s 73.65%
Req/Sec 0.00 0.00 0.00 100.00%
32743 requests in 1.00m, 7.80MB read
Requests/sec: 545.65
Transfer/sec: 133.08KB
Loading

0 comments on commit 8ffb3af

Please sign in to comment.