Skip to content

Latest commit

 

History

History
220 lines (198 loc) · 46.3 KB

bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26-vs-base.md

File metadata and controls

220 lines (198 loc) · 46.3 KB

Results vs. base

  • fork: python
  • ref: a19bb261a327e1008f21
  • machine: linux-x86_64
  • commit hash: a19bb26
  • commit date: 2024-06-15
  • overall geometric mean: 1.17x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.11x slower
  • Memory change: 1.01x

Benchmarks with tag 'apps':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
2to3 293 ms 348 ms: 1.19x slower
chameleon 7.42 ms 8.85 ms: 1.19x slower
docutils 3.00 sec 3.46 sec: 1.16x slower
html5lib 75.7 ms 87.7 ms: 1.16x slower
tornado_http 118 ms 130 ms: 1.11x slower
Geometric mean (ref) 1.16x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
async_tree_io_tg 908 ms 878 ms: 1.03x faster
async_tree_memoization 464 ms 476 ms: 1.03x slower
async_tree_io 887 ms 915 ms: 1.03x slower
async_tree_cpu_io_mixed_tg 576 ms 602 ms: 1.05x slower
async_tree_cpu_io_mixed 610 ms 654 ms: 1.07x slower
async_tree_memoization_tg 423 ms 455 ms: 1.08x slower
async_tree_none_tg 340 ms 367 ms: 1.08x slower
async_tree_none 367 ms 401 ms: 1.09x slower
Geometric mean (ref) 1.05x slower

Benchmarks with tag 'math':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
pidigits 253 ms 255 ms: 1.01x slower
float 80.1 ms 96.2 ms: 1.20x slower
nbody 89.6 ms 122 ms: 1.36x slower
Geometric mean (ref) 1.18x slower

Benchmarks with tag 'regex':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
regex_dna 244 ms 245 ms: 1.00x slower
regex_v8 25.4 ms 25.9 ms: 1.02x slower
regex_compile 144 ms 218 ms: 1.51x slower
Geometric mean (ref) 1.11x slower

Benchmark hidden because not significant (1): regex_effbot

Benchmarks with tag 'serialize':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
xml_etree_parse 146 ms 145 ms: 1.01x faster
unpickle 15.4 us 15.3 us: 1.01x faster
json_loads 24.5 us 25.0 us: 1.02x slower
pickle_list 4.46 us 4.59 us: 1.03x slower
unpickle_list 4.66 us 4.81 us: 1.03x slower
json_dumps 10.8 ms 11.3 ms: 1.05x slower
pickle 10.3 us 11.0 us: 1.06x slower
pickle_dict 30.8 us 33.3 us: 1.08x slower
xml_etree_iterparse 104 ms 114 ms: 1.10x slower
xml_etree_generate 87.5 ms 96.2 ms: 1.10x slower
xml_etree_process 60.4 ms 68.0 ms: 1.13x slower
tomli_loads 2.42 sec 2.94 sec: 1.21x slower
unpickle_pure_python 226 us 304 us: 1.34x slower
pickle_pure_python 310 us 430 us: 1.39x slower
Geometric mean (ref) 1.10x slower

Benchmarks with tag 'startup':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
python_startup 13.2 ms 13.2 ms: 1.00x slower
python_startup_no_site 8.87 ms 8.93 ms: 1.01x slower
Geometric mean (ref) 1.00x slower

Benchmarks with tag 'template':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
django_template 38.2 ms 45.7 ms: 1.19x slower
genshi_xml 56.3 ms 68.1 ms: 1.21x slower
genshi_text 25.2 ms 32.6 ms: 1.29x slower
mako 10.3 ms 14.5 ms: 1.41x slower
Geometric mean (ref) 1.27x slower

All benchmarks:

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-pythonperf2-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
coverage 81.4 ms 75.9 ms: 1.07x faster
create_gc_cycles 2.05 ms 1.96 ms: 1.05x faster
async_tree_io_tg 908 ms 878 ms: 1.03x faster
xml_etree_parse 146 ms 145 ms: 1.01x faster
unpickle 15.4 us 15.3 us: 1.01x faster
python_startup 13.2 ms 13.2 ms: 1.00x slower
regex_dna 244 ms 245 ms: 1.00x slower
python_startup_no_site 8.87 ms 8.93 ms: 1.01x slower
pidigits 253 ms 255 ms: 1.01x slower
sqlite_synth 2.83 us 2.86 us: 1.01x slower
asyncio_tcp_ssl 1.58 sec 1.60 sec: 1.02x slower
json_loads 24.5 us 25.0 us: 1.02x slower
regex_v8 25.4 ms 25.9 ms: 1.02x slower
async_tree_memoization 464 ms 476 ms: 1.03x slower
pickle_list 4.46 us 4.59 us: 1.03x slower
async_tree_io 887 ms 915 ms: 1.03x slower
unpickle_list 4.66 us 4.81 us: 1.03x slower
flaskblogging 4.73 ms 4.91 ms: 1.04x slower
generators 33.6 ms 34.9 ms: 1.04x slower
asyncio_tcp 376 ms 392 ms: 1.04x slower
gc_traversal 4.73 ms 4.94 ms: 1.04x slower
logging_format 7.03 us 7.35 us: 1.05x slower
bench_mp_pool 4.70 ms 4.92 ms: 1.05x slower
async_tree_cpu_io_mixed_tg 576 ms 602 ms: 1.05x slower
coroutines 21.7 ms 22.8 ms: 1.05x slower
json_dumps 10.8 ms 11.3 ms: 1.05x slower
thrift 883 us 933 us: 1.06x slower
pathlib 17.1 ms 18.1 ms: 1.06x slower
logging_simple 6.39 us 6.78 us: 1.06x slower
json 5.36 ms 5.68 ms: 1.06x slower
pickle 10.3 us 11.0 us: 1.06x slower
async_tree_cpu_io_mixed 610 ms 654 ms: 1.07x slower
async_tree_memoization_tg 423 ms 455 ms: 1.08x slower
dask 393 ms 424 ms: 1.08x slower
async_tree_none_tg 340 ms 367 ms: 1.08x slower
pickle_dict 30.8 us 33.3 us: 1.08x slower
telco 8.48 ms 9.22 ms: 1.09x slower
async_tree_none 367 ms 401 ms: 1.09x slower
xml_etree_iterparse 104 ms 114 ms: 1.10x slower
xml_etree_generate 87.5 ms 96.2 ms: 1.10x slower
tornado_http 118 ms 130 ms: 1.11x slower
gunicorn 1.05 ms 1.16 ms: 1.11x slower
async_generators 357 ms 398 ms: 1.12x slower
aiohttp 1.07 ms 1.19 ms: 1.12x slower
mdp 2.48 sec 2.77 sec: 1.12x slower
xml_etree_process 60.4 ms 68.0 ms: 1.13x slower
bench_thread_pool 907 us 1.02 ms: 1.13x slower
meteor_contest 129 ms 146 ms: 1.13x slower
richards 54.0 ms 61.3 ms: 1.13x slower
richards_super 60.5 ms 68.7 ms: 1.13x slower
typing_runtime_protocols 173 us 198 us: 1.14x slower
docutils 3.00 sec 3.46 sec: 1.16x slower
pylint 341 ms 394 ms: 1.16x slower
html5lib 75.7 ms 87.7 ms: 1.16x slower
dulwich_log 67.3 ms 78.1 ms: 1.16x slower
mypy2 771 ms 899 ms: 1.17x slower
bpe_tokeniser 5.10 sec 5.95 sec: 1.17x slower
deepcopy_reduce 3.45 us 4.04 us: 1.17x slower
sqlglot_normalize 120 ms 142 ms: 1.18x slower
2to3 293 ms 348 ms: 1.19x slower
chameleon 7.42 ms 8.85 ms: 1.19x slower
django_template 38.2 ms 45.7 ms: 1.19x slower
pycparser 1.25 sec 1.50 sec: 1.20x slower
float 80.1 ms 96.2 ms: 1.20x slower
sympy_integrate 23.4 ms 28.3 ms: 1.21x slower
sqlglot_optimize 59.1 ms 71.4 ms: 1.21x slower
genshi_xml 56.3 ms 68.1 ms: 1.21x slower
tomli_loads 2.42 sec 2.94 sec: 1.21x slower
sqlglot_parse 1.41 ms 1.74 ms: 1.23x slower
sympy_sum 156 ms 191 ms: 1.23x slower
sqlglot_transpile 1.79 ms 2.21 ms: 1.23x slower
go 162 ms 202 ms: 1.25x slower
sympy_expand 507 ms 634 ms: 1.25x slower
deepcopy 378 us 475 us: 1.26x slower
sympy_str 298 ms 375 ms: 1.26x slower
raytrace 263 ms 331 ms: 1.26x slower
pprint_pformat 1.67 sec 2.12 sec: 1.26x slower
pprint_safe_repr 818 ms 1.04 sec: 1.27x slower
crypto_pyaes 72.8 ms 93.1 ms: 1.28x slower
genshi_text 25.2 ms 32.6 ms: 1.29x slower
pyflate 490 ms 640 ms: 1.31x slower
chaos 61.0 ms 80.8 ms: 1.32x slower
nqueens 87.8 ms 117 ms: 1.34x slower
unpickle_pure_python 226 us 304 us: 1.34x slower
deltablue 3.39 ms 4.55 ms: 1.34x slower
scimark_sor 118 ms 160 ms: 1.36x slower
nbody 89.6 ms 122 ms: 1.36x slower
fannkuch 361 ms 500 ms: 1.38x slower
pickle_pure_python 310 us 430 us: 1.39x slower
scimark_fft 306 ms 428 ms: 1.40x slower
mako 10.3 ms 14.5 ms: 1.41x slower
scimark_lu 97.3 ms 142 ms: 1.46x slower
scimark_monte_carlo 66.6 ms 98.6 ms: 1.48x slower
regex_compile 144 ms 218 ms: 1.51x slower
scimark_sparse_mat_mult 4.47 ms 6.75 ms: 1.51x slower
spectral_norm 96.2 ms 146 ms: 1.52x slower
deepcopy_memo 37.6 us 58.2 us: 1.55x slower
logging_silent 96.5 ns 153 ns: 1.58x slower
comprehensions 16.8 us 27.7 us: 1.65x slower
hexiom 6.34 ms 10.5 ms: 1.65x slower
Geometric mean (ref) 1.17x slower

Benchmark hidden because not significant (2): regex_effbot, asyncio_websockets

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.13x
  • 95% likely to have a slowdown of 1.12x
  • 99% likely to have a slowdown of 1.11x

Memory

  • memory change: 1.01x