Skip to content

Latest commit

 

History

History
213 lines (190 loc) · 25.1 KB

bm-20250208-linux-x86_64-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67-vs-3.13.0.md

File metadata and controls

213 lines (190 loc) · 25.1 KB

Results vs. 3.13.0

  • fork: python
  • ref: 29f8a67ae00081a36fdc
  • machine: linux-x86_64
  • commit hash: 29f8a67
  • commit date: 2025-02-08
  • overall geometric mean: 1.079x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.05x slower
  • Memory change: 1.23x

Benchmarks with tag 'apps':

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250208-linux-x86_64-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67
2to3 266 ms 303 ms: 1.14x slower
docutils 2.58 sec 2.81 sec: 1.09x slower
html5lib 63.4 ms 68.3 ms: 1.08x slower
sphinx 1.03 sec 1.11 sec: 1.08x slower
Geometric mean (ref) 1.10x slower

Benchmarks with tag 'asyncio':

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250208-linux-x86_64-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67
async_tree_io_tg 861 ms 551 ms: 1.56x faster
async_tree_memoization_tg 463 ms 326 ms: 1.42x faster
async_tree_io 838 ms 598 ms: 1.40x faster
async_tree_none_tg 319 ms 245 ms: 1.30x faster
async_tree_none 350 ms 288 ms: 1.22x faster
async_tree_memoization 437 ms 364 ms: 1.20x faster
async_tree_cpu_io_mixed_tg 543 ms 482 ms: 1.13x faster
async_tree_cpu_io_mixed 573 ms 525 ms: 1.09x faster
async_generators 433 ms 432 ms: 1.00x faster
coroutines 22.2 ms 23.7 ms: 1.07x slower
Geometric mean (ref) 1.19x faster

Benchmark hidden because not significant (1): asyncio_websockets

Benchmarks with tag 'math':

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250208-linux-x86_64-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67
float 78.7 ms 76.9 ms: 1.02x faster
pidigits 186 ms 190 ms: 1.02x slower
nbody 87.7 ms 136 ms: 1.55x slower
Geometric mean (ref) 1.16x slower

Benchmarks with tag 'regex':

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250208-linux-x86_64-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67
regex_effbot 3.77 ms 3.45 ms: 1.09x faster
regex_v8 26.9 ms 25.4 ms: 1.06x faster
regex_dna 220 ms 227 ms: 1.03x slower
regex_compile 132 ms 146 ms: 1.11x slower
Geometric mean (ref) 1.00x faster

Benchmarks with tag 'serialize':

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250208-linux-x86_64-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67
xml_etree_iterparse 101 ms 95.1 ms: 1.06x faster
xml_etree_parse 154 ms 148 ms: 1.04x faster
xml_etree_generate 86.8 ms 94.0 ms: 1.08x slower
tomli_loads 2.12 sec 2.33 sec: 1.10x slower
xml_etree_process 60.5 ms 66.8 ms: 1.10x slower
unpickle_pure_python 213 us 252 us: 1.18x slower
json_loads 27.2 us 32.6 us: 1.20x slower
pickle_pure_python 302 us 366 us: 1.21x slower
json_dumps 10.1 ms 12.6 ms: 1.25x slower
Geometric mean (ref) 1.11x slower

Benchmarks with tag 'startup':

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250208-linux-x86_64-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67
python_startup 12.7 ms 15.0 ms: 1.19x slower
python_startup_no_site 7.00 ms 9.35 ms: 1.34x slower
Geometric mean (ref) 1.26x slower

Benchmarks with tag 'template':

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250208-linux-x86_64-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67
genshi_xml 50.5 ms 60.6 ms: 1.20x slower
genshi_text 22.6 ms 28.0 ms: 1.24x slower
django_template 31.7 ms 40.1 ms: 1.27x slower
mako 10.7 ms 16.0 ms: 1.50x slower
Geometric mean (ref) 1.30x slower

All benchmarks:

Benchmark bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250208-linux-x86_64-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67
gc_traversal 4.90 ms 2.26 ms: 2.16x faster
async_tree_io_tg 861 ms 551 ms: 1.56x faster
async_tree_memoization_tg 463 ms 326 ms: 1.42x faster
async_tree_io 838 ms 598 ms: 1.40x faster
create_gc_cycles 2.45 ms 1.75 ms: 1.40x faster
async_tree_none_tg 319 ms 245 ms: 1.30x faster
async_tree_none 350 ms 288 ms: 1.22x faster
async_tree_memoization 437 ms 364 ms: 1.20x faster
deepcopy 354 us 304 us: 1.16x faster
async_tree_cpu_io_mixed_tg 543 ms 482 ms: 1.13x faster
regex_effbot 3.77 ms 3.45 ms: 1.09x faster
async_tree_cpu_io_mixed 573 ms 525 ms: 1.09x faster
sqlite_synth 2.90 us 2.72 us: 1.07x faster
xml_etree_iterparse 101 ms 95.1 ms: 1.06x faster
regex_v8 26.9 ms 25.4 ms: 1.06x faster
xml_etree_parse 154 ms 148 ms: 1.04x faster
pathlib 17.4 ms 16.9 ms: 1.03x faster
float 78.7 ms 76.9 ms: 1.02x faster
spectral_norm 113 ms 112 ms: 1.01x faster
pycparser 1.20 sec 1.19 sec: 1.01x faster
deepcopy_memo 38.4 us 38.2 us: 1.01x faster
async_generators 433 ms 432 ms: 1.00x faster
pidigits 186 ms 190 ms: 1.02x slower
k_core 2.37 sec 2.43 sec: 1.03x slower
regex_dna 220 ms 227 ms: 1.03x slower
bpe_tokeniser 4.69 sec 4.93 sec: 1.05x slower
json 5.32 ms 5.62 ms: 1.05x slower
coroutines 22.2 ms 23.7 ms: 1.07x slower
generators 28.8 ms 30.8 ms: 1.07x slower
dulwich_log 64.6 ms 69.2 ms: 1.07x slower
mdp 2.54 sec 2.74 sec: 1.08x slower
html5lib 63.4 ms 68.3 ms: 1.08x slower
sphinx 1.03 sec 1.11 sec: 1.08x slower
xml_etree_generate 86.8 ms 94.0 ms: 1.08x slower
docutils 2.58 sec 2.81 sec: 1.09x slower
sqlglot_normalize 108 ms 117 ms: 1.09x slower
telco 8.40 ms 9.16 ms: 1.09x slower
tomli_loads 2.12 sec 2.33 sec: 1.10x slower
xml_etree_process 60.5 ms 66.8 ms: 1.10x slower
regex_compile 132 ms 146 ms: 1.11x slower
pyflate 470 ms 520 ms: 1.11x slower
scimark_sor 122 ms 137 ms: 1.12x slower
sqlglot_optimize 53.4 ms 59.8 ms: 1.12x slower
scimark_fft 367 ms 417 ms: 1.14x slower
2to3 266 ms 303 ms: 1.14x slower
sympy_str 273 ms 314 ms: 1.15x slower
logging_silent 101 ns 116 ns: 1.15x slower
pprint_safe_repr 727 ms 838 ms: 1.15x slower
sympy_sum 150 ms 174 ms: 1.15x slower
richards 47.5 ms 55.0 ms: 1.16x slower
sympy_expand 456 ms 528 ms: 1.16x slower
logging_simple 5.65 us 6.58 us: 1.16x slower
pprint_pformat 1.48 sec 1.73 sec: 1.17x slower
shortest_path 487 ms 569 ms: 1.17x slower
connected_components 447 ms 526 ms: 1.18x slower
richards_super 53.7 ms 63.2 ms: 1.18x slower
sympy_integrate 19.8 ms 23.4 ms: 1.18x slower
comprehensions 16.5 us 19.5 us: 1.18x slower
unpickle_pure_python 213 us 252 us: 1.18x slower
thrift 800 us 947 us: 1.18x slower
logging_format 6.23 us 7.38 us: 1.18x slower
python_startup 12.7 ms 15.0 ms: 1.19x slower
crypto_pyaes 74.7 ms 88.6 ms: 1.19x slower
scimark_sparse_mat_mult 5.03 ms 6.01 ms: 1.19x slower
sqlalchemy_declarative 133 ms 159 ms: 1.20x slower
scimark_lu 114 ms 137 ms: 1.20x slower
json_loads 27.2 us 32.6 us: 1.20x slower
genshi_xml 50.5 ms 60.6 ms: 1.20x slower
sqlglot_transpile 1.57 ms 1.89 ms: 1.20x slower
pickle_pure_python 302 us 366 us: 1.21x slower
meteor_contest 108 ms 131 ms: 1.21x slower
nqueens 80.9 ms 98.3 ms: 1.21x slower
sqlalchemy_imperative 16.9 ms 20.8 ms: 1.23x slower
sqlglot_parse 1.26 ms 1.56 ms: 1.24x slower
genshi_text 22.6 ms 28.0 ms: 1.24x slower
json_dumps 10.1 ms 12.6 ms: 1.25x slower
many_optionals 857 us 1.08 ms: 1.25x slower
chaos 58.0 ms 72.9 ms: 1.26x slower
hexiom 6.08 ms 7.69 ms: 1.27x slower
django_template 31.7 ms 40.1 ms: 1.27x slower
typing_runtime_protocols 160 us 204 us: 1.27x slower
fannkuch 394 ms 510 ms: 1.30x slower
scimark_monte_carlo 66.8 ms 86.6 ms: 1.30x slower
coverage 82.8 ms 108 ms: 1.30x slower
python_startup_no_site 7.00 ms 9.35 ms: 1.34x slower
raytrace 262 ms 349 ms: 1.34x slower
deltablue 3.19 ms 4.72 ms: 1.48x slower
mako 10.7 ms 16.0 ms: 1.50x slower
nbody 87.7 ms 136 ms: 1.55x slower
subparsers 15.5 ms 24.7 ms: 1.60x slower
bench_mp_pool 24.0 ms 88.9 ms: 3.71x slower
bench_thread_pool 818 us 3.48 ms: 4.26x slower
Geometric mean (ref) 1.12x slower

Benchmark hidden because not significant (4): pylint, deepcopy_reduce, asyncio_websockets, go Ignored benchmarks (5) of results/bm-20241007-3.13.0-60403a5/bm-20241007-linux-x86_64-python-v3.13.0-3.13.0-60403a5.json: chameleon, djangocms, gevent_hub, gunicorn, tornado_http Ignored benchmarks (8) of results/bm-20250208-3.14.0a4+-29f8a67-NOGIL/bm-20250208-linux-x86_64-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json: asyncio_tcp, asyncio_tcp_ssl, pickle, pickle_dict, pickle_list, unpack_sequence, unpickle, unpickle_list

  • Geometric mean (including insignificant results): 1.079x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.07x
  • 95% likely to have a slowdown of 1.07x
  • 99% likely to have a slowdown of 1.05x

Memory

  • memory change: 1.23x