Benchmarks to Björn, uvicorn etc.

[frosk1]

Hey,

I really like Rust being the new C++ backend technology for python, so I do appreciate these kind of projects. To push the project it would be necessary to include typical benchmarks against only python solutions like gunicorn and c solutions like Björn.

[sansyrox]

Hey @frosk1 ,

Thank you for your suggestion. We already have benchmarks for (flask and django) with gunicorn . I also didn't compare it with Björn. Will update the benchmarks :D

[sansyrox]

I am planning to do a thorough benchmark. But till then here are the results.

Björn(Default config, as I was unable to find the config options in the first attempt):

╰─ oha --no-tui --insecure -c 100 -n 100000 http://127.0.0.1:8000                                                 ─╯
Summary:
  Success rate: 1.0000
  Total:        19.5387 secs
  Slowest:      0.4404 secs
  Fastest:      0.0061 secs
  Average:      0.0195 secs
  Requests/sec: 5118.0556

  Total data:   1.24 MiB
  Size/request: 13 B
  Size/sec:     64.97 KiB

Response time histogram:
  0.005 [560]   |
  0.010 [747]   |
  0.014 [83658] |■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  0.019 [10856] |■■■■
  0.024 [2677]  |■
  0.029 [1368]  |
  0.033 [46]    |
  0.038 [33]    |
  0.043 [1]     |
  0.048 [1]     |
  0.052 [53]    |

Latency distribution:
  10% in 0.0180 secs
  25% in 0.0185 secs
  50% in 0.0189 secs
  75% in 0.0196 secs
  90% in 0.0211 secs
  95% in 0.0235 secs
  99% in 0.0305 secs

Details (average, fastest, slowest):
  DNS+dialup:   0.0028 secs, 0.0018 secs, 0.0042 secs
  DNS-lookup:   0.0000 secs, 0.0000 secs, 0.0001 secs

Status code distribution:
  [200] 100000 responses

Robyn (6 workers and 2 processes)

╰─ oha --no-tui --insecure -c 100 -n 100000 http://127.0.0.1:5000                                                 ─╯
Summary:
  Success rate: 1.0000
  Total:        11.8934 secs
  Slowest:      0.1895 secs
  Fastest:      0.0008 secs
  Average:      0.0119 secs
  Requests/sec: 8408.0518

  Total data:   1.24 MiB
  Size/request: 13 B
  Size/sec:     106.74 KiB

Response time histogram:
  0.003 [1828]  |■
  0.006 [23910] |■■■■■■■■■■■■■■■■■■■■
  0.009 [37022] |■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  0.013 [17165] |■■■■■■■■■■■■■■
  0.016 [6866]  |■■■■■
  0.019 [3258]  |■■
  0.022 [2319]  |■■
  0.025 [1724]  |■
  0.028 [1120]  |
  0.032 [942]   |
  0.035 [3846]  |■■■

Latency distribution:
  10% in 0.0056 secs
  25% in 0.0071 secs
  50% in 0.0090 secs
  75% in 0.0122 secs
  90% in 0.0197 secs
  95% in 0.0286 secs
  99% in 0.0620 secs

Details (average, fastest, slowest):
  DNS+dialup:   0.0077 secs, 0.0041 secs, 0.0088 secs
  DNS-lookup:   0.0000 secs, 0.0000 secs, 0.0005 secs

Status code distribution:
  [200] 100000 responses

[frosk1]

@sansyrox sry for not checking the already present benchmarks in the first place xD

And thanks a lot for the new benchmark including Björn.

The results look really promising, go on with the project I really do like it. 👌

[frosk1]

You really can use the benchmarks to show off and generere more attention to the project. (just a suggestion)

[sansyrox]

Thank you @frosk1 :D

Do you think adding the benchmarks on the main README will be of more help?

[frosk1]

Yes, absolutely ;)