Skip to content

Latest commit

 

History

History
215 lines (189 loc) · 42.8 KB

bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67-vs-base.md

File metadata and controls

215 lines (189 loc) · 42.8 KB

Results vs. base

  • fork: python
  • ref: 29f8a67ae00081a36fdc
  • machine: windows-x86
  • commit hash: 29f8a67
  • commit date: 2025-02-08
  • overall geometric mean: 1.009x slower
  • HPT reliability: 93.66%
  • HPT 99th percentile: 1.00x slower
  • Memory change: unknown

Benchmarks with tag 'apps':

Benchmark results/bm-20250208-3.14.0a4+-29f8a67/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json results/bm-20250208-3.14.0a4+-29f8a67-JIT/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json
2to3 270 ms 272 ms: 1.01x slower
docutils 1.89 sec 1.97 sec: 1.04x slower
html5lib 47.2 ms 47.7 ms: 1.01x slower
sphinx 768 ms 761 ms: 1.01x faster
Geometric mean (ref) 1.01x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250208-3.14.0a4+-29f8a67/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json results/bm-20250208-3.14.0a4+-29f8a67-JIT/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json
coroutines 16.3 ms 15.8 ms: 1.03x faster
async_tree_io_tg 488 ms 477 ms: 1.02x faster
async_tree_none_tg 214 ms 209 ms: 1.02x faster
async_tree_io 491 ms 481 ms: 1.02x faster
async_tree_cpu_io_mixed_tg 479 ms 470 ms: 1.02x faster
async_tree_cpu_io_mixed 494 ms 486 ms: 1.02x faster
async_tree_memoization_tg 268 ms 264 ms: 1.01x faster
async_tree_memoization 283 ms 280 ms: 1.01x faster
async_tree_none 233 ms 231 ms: 1.01x faster
asyncio_tcp 711 ms 758 ms: 1.07x slower
async_generators 307 ms 335 ms: 1.09x slower
Geometric mean (ref) 1.00x faster

Benchmark hidden because not significant (2): asyncio_tcp_ssl, asyncio_websockets

Benchmarks with tag 'math':

Benchmark results/bm-20250208-3.14.0a4+-29f8a67/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json results/bm-20250208-3.14.0a4+-29f8a67-JIT/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json
float 59.8 ms 53.8 ms: 1.11x faster
nbody 93.9 ms 114 ms: 1.21x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark results/bm-20250208-3.14.0a4+-29f8a67/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json results/bm-20250208-3.14.0a4+-29f8a67-JIT/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json
regex_v8 16.4 ms 15.7 ms: 1.04x faster
regex_effbot 1.57 ms 1.55 ms: 1.01x faster
regex_dna 125 ms 126 ms: 1.01x slower
regex_compile 110 ms 117 ms: 1.07x slower
Geometric mean (ref) 1.01x slower

Benchmarks with tag 'serialize':

Benchmark results/bm-20250208-3.14.0a4+-29f8a67/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json results/bm-20250208-3.14.0a4+-29f8a67-JIT/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json
pickle_list 3.76 us 3.28 us: 1.15x faster
pickle_dict 20.8 us 18.7 us: 1.11x faster
unpickle 11.3 us 10.6 us: 1.06x faster
unpickle_list 3.04 us 2.95 us: 1.03x faster
pickle 9.66 us 9.54 us: 1.01x faster
xml_etree_iterparse 68.1 ms 67.4 ms: 1.01x faster
xml_etree_parse 108 ms 110 ms: 1.01x slower
tomli_loads 1.74 sec 1.83 sec: 1.05x slower
xml_etree_generate 67.7 ms 73.7 ms: 1.09x slower
pickle_pure_python 297 us 326 us: 1.10x slower
xml_etree_process 50.8 ms 55.9 ms: 1.10x slower
unpickle_pure_python 184 us 226 us: 1.23x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (2): json_loads, json_dumps

Benchmarks with tag 'startup':

Benchmark results/bm-20250208-3.14.0a4+-29f8a67/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json results/bm-20250208-3.14.0a4+-29f8a67-JIT/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json
python_startup_no_site 22.1 ms 21.9 ms: 1.01x faster
Geometric mean (ref) 1.00x faster

Benchmark hidden because not significant (1): python_startup

Benchmarks with tag 'template':

Benchmark results/bm-20250208-3.14.0a4+-29f8a67/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json results/bm-20250208-3.14.0a4+-29f8a67-JIT/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json
mako 8.13 ms 7.63 ms: 1.07x faster
django_template 37.9 ms 35.8 ms: 1.06x faster
genshi_text 23.8 ms 24.2 ms: 1.02x slower
genshi_xml 49.5 ms 52.1 ms: 1.05x slower
Geometric mean (ref) 1.01x faster

All benchmarks:

Benchmark results/bm-20250208-3.14.0a4+-29f8a67/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json results/bm-20250208-3.14.0a4+-29f8a67-JIT/bm-20250208-pythonperf1_win32-x86-python-29f8a67ae00081a36fdc-3.14.0a4+-29f8a67.json
sqlglot_normalize 246 ms 102 ms: 2.40x faster
generators 28.1 ms 23.4 ms: 1.20x faster
logging_silent 81.6 ns 69.9 ns: 1.17x faster
spectral_norm 76.9 ms 65.9 ms: 1.17x faster
pickle_list 3.76 us 3.28 us: 1.15x faster
raytrace 290 ms 253 ms: 1.15x faster
richards 42.4 ms 38.1 ms: 1.11x faster
float 59.8 ms 53.8 ms: 1.11x faster
pickle_dict 20.8 us 18.7 us: 1.11x faster
scimark_monte_carlo 56.1 ms 51.0 ms: 1.10x faster
thrift 807 us 741 us: 1.09x faster
scimark_sor 107 ms 98.7 ms: 1.09x faster
richards_super 47.5 ms 43.8 ms: 1.08x faster
logging_simple 8.80 us 8.21 us: 1.07x faster
mako 8.13 ms 7.63 ms: 1.07x faster
unpickle 11.3 us 10.6 us: 1.06x faster
pyflate 361 ms 340 ms: 1.06x faster
django_template 37.9 ms 35.8 ms: 1.06x faster
logging_format 9.40 us 8.90 us: 1.06x faster
scimark_lu 69.8 ms 66.2 ms: 1.05x faster
go 116 ms 111 ms: 1.05x faster
deepcopy_memo 22.4 us 21.4 us: 1.05x faster
chaos 59.3 ms 56.7 ms: 1.04x faster
regex_v8 16.4 ms 15.7 ms: 1.04x faster
coroutines 16.3 ms 15.8 ms: 1.03x faster
deepcopy_reduce 2.71 us 2.63 us: 1.03x faster
unpickle_list 3.04 us 2.95 us: 1.03x faster
sqlite_synth 1.92 us 1.87 us: 1.03x faster
deltablue 3.05 ms 2.97 ms: 1.02x faster
deepcopy 258 us 252 us: 1.02x faster
async_tree_io_tg 488 ms 477 ms: 1.02x faster
async_tree_none_tg 214 ms 209 ms: 1.02x faster
async_tree_io 491 ms 481 ms: 1.02x faster
async_tree_cpu_io_mixed_tg 479 ms 470 ms: 1.02x faster
async_tree_cpu_io_mixed 494 ms 486 ms: 1.02x faster
async_tree_memoization_tg 268 ms 264 ms: 1.01x faster
async_tree_memoization 283 ms 280 ms: 1.01x faster
pickle 9.66 us 9.54 us: 1.01x faster
xml_etree_iterparse 68.1 ms 67.4 ms: 1.01x faster
async_tree_none 233 ms 231 ms: 1.01x faster
json 4.56 ms 4.52 ms: 1.01x faster
sphinx 768 ms 761 ms: 1.01x faster
regex_effbot 1.57 ms 1.55 ms: 1.01x faster
python_startup_no_site 22.1 ms 21.9 ms: 1.01x faster
regex_dna 125 ms 126 ms: 1.01x slower
2to3 270 ms 272 ms: 1.01x slower
html5lib 47.2 ms 47.7 ms: 1.01x slower
xml_etree_parse 108 ms 110 ms: 1.01x slower
many_optionals 560 us 568 us: 1.01x slower
sqlglot_transpile 1.44 ms 1.46 ms: 1.02x slower
genshi_text 23.8 ms 24.2 ms: 1.02x slower
sympy_sum 112 ms 114 ms: 1.02x slower
k_core 1.39 sec 1.44 sec: 1.03x slower
sympy_expand 395 ms 409 ms: 1.03x slower
gc_traversal 1.79 ms 1.85 ms: 1.03x slower
sympy_integrate 16.5 ms 17.1 ms: 1.04x slower
sympy_str 226 ms 234 ms: 1.04x slower
docutils 1.89 sec 1.97 sec: 1.04x slower
coverage 52.9 ms 55.1 ms: 1.04x slower
tomli_loads 1.74 sec 1.83 sec: 1.05x slower
genshi_xml 49.5 ms 52.1 ms: 1.05x slower
sqlglot_optimize 47.3 ms 50.2 ms: 1.06x slower
mdp 1.70 sec 1.81 sec: 1.06x slower
asyncio_tcp 711 ms 758 ms: 1.07x slower
regex_compile 110 ms 117 ms: 1.07x slower
hexiom 5.55 ms 5.93 ms: 1.07x slower
pprint_pformat 1.48 sec 1.59 sec: 1.07x slower
pycparser 901 ms 968 ms: 1.07x slower
xml_etree_generate 67.7 ms 73.7 ms: 1.09x slower
telco 7.24 ms 7.89 ms: 1.09x slower
async_generators 307 ms 335 ms: 1.09x slower
pprint_safe_repr 709 ms 773 ms: 1.09x slower
pickle_pure_python 297 us 326 us: 1.10x slower
xml_etree_process 50.8 ms 55.9 ms: 1.10x slower
connected_components 270 ms 300 ms: 1.11x slower
shortest_path 297 ms 332 ms: 1.12x slower
typing_runtime_protocols 154 us 173 us: 1.12x slower
bpe_tokeniser 3.43 sec 3.90 sec: 1.14x slower
scimark_sparse_mat_mult 2.88 ms 3.28 ms: 1.14x slower
comprehensions 14.0 us 16.4 us: 1.17x slower
meteor_contest 78.3 ms 92.3 ms: 1.18x slower
scimark_fft 219 ms 258 ms: 1.18x slower
nbody 93.9 ms 114 ms: 1.21x slower
unpack_sequence 44.7 ns 54.3 ns: 1.22x slower
crypto_pyaes 61.4 ms 74.6 ms: 1.22x slower
unpickle_pure_python 184 us 226 us: 1.23x slower
fannkuch 297 ms 380 ms: 1.28x slower
nqueens 79.7 ms 106 ms: 1.33x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (14): sqlglot_parse, subparsers, bench_mp_pool, json_loads, pidigits, pathlib, asyncio_tcp_ssl, dulwich_log, asyncio_websockets, json_dumps, python_startup, create_gc_cycles, pylint, bench_thread_pool

  • Geometric mean (including insignificant results): 1.009x slower

HPT report

  • Reliability score: 93.66% likely to be slow
  • 90% likely to have a slowdown of 1.00x
  • 95% likely to have a slowdown of 1.00x
  • 99% likely to have a slowdown of 1.00x

Memory

  • memory change: unknown