fork: python
ref: a19bb261a327e1008f21
machine: windows-x86
commit hash: a19bb26
commit date: 2024-06-15
overall geometric mean: 1.25x faster
HPT reliability: 100.00%
HPT 99th percentile: 1.26x faster
Memory change: unknown
Benchmarks with tag 'apps':
Benchmark
bm-20221024-pythonperf1_win32-x86-python-v3.11.0-3.11.0-deaf509
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
2to3
282 ms
233 ms: 1.21x faster
chameleon
8.08 ms
5.72 ms: 1.41x faster
docutils
2.10 sec
1.80 sec: 1.17x faster
html5lib
54.3 ms
45.9 ms: 1.18x faster
tornado_http
118 ms
93.8 ms: 1.26x faster
Geometric mean
(ref)
1.24x faster
Benchmarks with tag 'asyncio':
Benchmark
bm-20221024-pythonperf1_win32-x86-python-v3.11.0-3.11.0-deaf509
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
async_tree_none
343 ms
231 ms: 1.48x faster
async_tree_memoization_tg
378 ms
258 ms: 1.47x faster
async_tree_memoization
408 ms
279 ms: 1.46x faster
async_tree_none_tg
301 ms
206 ms: 1.46x faster
async_tree_io_tg
746 ms
532 ms: 1.40x faster
async_tree_io
754 ms
543 ms: 1.39x faster
async_tree_cpu_io_mixed_tg
577 ms
452 ms: 1.28x faster
async_tree_cpu_io_mixed
590 ms
477 ms: 1.24x faster
Geometric mean
(ref)
1.39x faster
Benchmarks with tag 'math':
Benchmark
bm-20221024-pythonperf1_win32-x86-python-v3.11.0-3.11.0-deaf509
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
nbody
126 ms
78.0 ms: 1.61x faster
float
76.1 ms
54.5 ms: 1.39x faster
pidigits
203 ms
199 ms: 1.02x faster
Geometric mean
(ref)
1.32x faster
Benchmarks with tag 'regex':
Benchmark
bm-20221024-pythonperf1_win32-x86-python-v3.11.0-3.11.0-deaf509
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
regex_compile
148 ms
99.7 ms: 1.48x faster
regex_dna
122 ms
124 ms: 1.02x slower
regex_effbot
1.82 ms
1.92 ms: 1.05x slower
regex_v8
15.2 ms
16.0 ms: 1.06x slower
Geometric mean
(ref)
1.07x faster
Benchmarks with tag 'serialize':
Benchmark
bm-20221024-pythonperf1_win32-x86-python-v3.11.0-3.11.0-deaf509
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
unpickle_pure_python
231 us
154 us: 1.50x faster
tomli_loads
2.31 sec
1.60 sec: 1.45x faster
pickle_pure_python
309 us
221 us: 1.40x faster
json_dumps
9.80 ms
7.23 ms: 1.36x faster
xml_etree_process
55.0 ms
42.6 ms: 1.29x faster
xml_etree_iterparse
75.6 ms
63.8 ms: 1.18x faster
xml_etree_generate
71.6 ms
60.6 ms: 1.18x faster
xml_etree_parse
114 ms
103 ms: 1.11x faster
unpickle_list
3.28 us
3.06 us: 1.07x faster
pickle_dict
20.1 us
20.5 us: 1.02x slower
json_loads
20.0 us
21.1 us: 1.05x slower
unpickle
9.23 us
9.99 us: 1.08x slower
pickle_list
3.27 us
3.58 us: 1.10x slower
Geometric mean
(ref)
1.15x faster
Benchmark hidden because not significant (1): pickle
Benchmarks with tag 'startup':
Benchmark
bm-20221024-pythonperf1_win32-x86-python-v3.11.0-3.11.0-deaf509
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
python_startup
22.0 ms
22.8 ms: 1.04x slower
Geometric mean
(ref)
1.02x slower
Benchmark hidden because not significant (1): python_startup_no_site
Benchmarks with tag 'template':
Benchmark
bm-20221024-pythonperf1_win32-x86-python-v3.11.0-3.11.0-deaf509
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
mako
10.3 ms
7.06 ms: 1.46x faster
genshi_xml
61.2 ms
44.9 ms: 1.36x faster
genshi_text
26.8 ms
20.1 ms: 1.33x faster
django_template
37.4 ms
30.4 ms: 1.23x faster
Geometric mean
(ref)
1.34x faster
Benchmark
bm-20221024-pythonperf1_win32-x86-python-v3.11.0-3.11.0-deaf509
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
typing_runtime_protocols
478 us
131 us: 3.64x faster
generators
52.2 ms
21.8 ms: 2.40x faster
logging_silent
119 ns
57.9 ns: 2.06x faster
pylint
418 ms
216 ms: 1.94x faster
comprehensions
22.1 us
11.6 us: 1.90x faster
deltablue
4.10 ms
2.25 ms: 1.82x faster
chaos
84.4 ms
47.6 ms: 1.77x faster
spectral_norm
122 ms
70.8 ms: 1.72x faster
raytrace
327 ms
194 ms: 1.69x faster
hexiom
7.51 ms
4.46 ms: 1.68x faster
richards_super
58.7 ms
35.2 ms: 1.67x faster
scimark_lu
102 ms
61.6 ms: 1.66x faster
nqueens
111 ms
68.6 ms: 1.62x faster
deepcopy_memo
40.0 us
24.7 us: 1.62x faster
nbody
126 ms
78.0 ms: 1.61x faster
sqlglot_parse
1.49 ms
936 us: 1.59x faster
scimark_sor
135 ms
86.9 ms: 1.56x faster
richards
48.8 ms
31.4 ms: 1.55x faster
sqlglot_transpile
1.78 ms
1.17 ms: 1.52x faster
scimark_sparse_mat_mult
4.23 ms
2.81 ms: 1.51x faster
coroutines
23.7 ms
15.7 ms: 1.51x faster
unpickle_pure_python
231 us
154 us: 1.50x faster
scimark_monte_carlo
70.8 ms
47.4 ms: 1.49x faster
pyflate
471 ms
317 ms: 1.49x faster
async_tree_none
343 ms
231 ms: 1.48x faster
regex_compile
148 ms
99.7 ms: 1.48x faster
async_tree_memoization_tg
378 ms
258 ms: 1.47x faster
async_tree_memoization
408 ms
279 ms: 1.46x faster
async_tree_none_tg
301 ms
206 ms: 1.46x faster
mako
10.3 ms
7.06 ms: 1.46x faster
logging_simple
10.8 us
7.44 us: 1.45x faster
tomli_loads
2.31 sec
1.60 sec: 1.45x faster
sympy_sum
149 ms
104 ms: 1.44x faster
crypto_pyaes
79.4 ms
55.4 ms: 1.43x faster
go
147 ms
104 ms: 1.42x faster
scimark_fft
291 ms
206 ms: 1.42x faster
chameleon
8.08 ms
5.72 ms: 1.41x faster
fannkuch
399 ms
284 ms: 1.40x faster
async_tree_io_tg
746 ms
532 ms: 1.40x faster
pickle_pure_python
309 us
221 us: 1.40x faster
logging_format
11.5 us
8.19 us: 1.40x faster
float
76.1 ms
54.5 ms: 1.39x faster
pprint_pformat
1.70 sec
1.22 sec: 1.39x faster
async_tree_io
754 ms
543 ms: 1.39x faster
sympy_str
283 ms
205 ms: 1.38x faster
pprint_safe_repr
819 ms
599 ms: 1.37x faster
genshi_xml
61.2 ms
44.9 ms: 1.36x faster
sympy_integrate
19.9 ms
14.6 ms: 1.36x faster
json_dumps
9.80 ms
7.23 ms: 1.36x faster
deepcopy
381 us
285 us: 1.34x faster
pycparser
1.04 sec
783 ms: 1.33x faster
genshi_text
26.8 ms
20.1 ms: 1.33x faster
sqlglot_optimize
51.8 ms
39.5 ms: 1.31x faster
sympy_expand
462 ms
357 ms: 1.29x faster
xml_etree_process
55.0 ms
42.6 ms: 1.29x faster
async_tree_cpu_io_mixed_tg
577 ms
452 ms: 1.28x faster
tornado_http
118 ms
93.8 ms: 1.26x faster
deepcopy_reduce
3.32 us
2.63 us: 1.26x faster
mdp
2.07 sec
1.66 sec: 1.24x faster
async_tree_cpu_io_mixed
590 ms
477 ms: 1.24x faster
django_template
37.4 ms
30.4 ms: 1.23x faster
meteor_contest
90.9 ms
74.6 ms: 1.22x faster
2to3
282 ms
233 ms: 1.21x faster
asyncio_tcp
787 ms
655 ms: 1.20x faster
bench_thread_pool
1.14 ms
956 us: 1.19x faster
xml_etree_iterparse
75.6 ms
63.8 ms: 1.18x faster
html5lib
54.3 ms
45.9 ms: 1.18x faster
xml_etree_generate
71.6 ms
60.6 ms: 1.18x faster
docutils
2.10 sec
1.80 sec: 1.17x faster
json
4.78 ms
4.24 ms: 1.13x faster
xml_etree_parse
114 ms
103 ms: 1.11x faster
sqlite_synth
2.15 us
1.95 us: 1.10x faster
unpickle_list
3.28 us
3.06 us: 1.07x faster
pidigits
203 ms
199 ms: 1.02x faster
asyncio_tcp_ssl
17.1 sec
16.8 sec: 1.01x faster
flaskblogging
2.03 sec
2.04 sec: 1.00x slower
pickle_dict
20.1 us
20.5 us: 1.02x slower
regex_dna
122 ms
124 ms: 1.02x slower
pathlib
79.9 ms
82.5 ms: 1.03x slower
python_startup
22.0 ms
22.8 ms: 1.04x slower
gc_traversal
1.38 ms
1.43 ms: 1.04x slower
async_generators
260 ms
272 ms: 1.05x slower
regex_effbot
1.82 ms
1.92 ms: 1.05x slower
json_loads
20.0 us
21.1 us: 1.05x slower
regex_v8
15.2 ms
16.0 ms: 1.06x slower
unpickle
9.23 us
9.99 us: 1.08x slower
pickle_list
3.27 us
3.58 us: 1.10x slower
telco
5.29 ms
6.14 ms: 1.16x slower
create_gc_cycles
618 us
743 us: 1.20x slower
sqlglot_normalize
113 ms
203 ms: 1.80x slower
coverage
58.0 ms
313 ms: 5.39x slower
thrift
801 us
9.91 ms: 12.37x slower
Geometric mean
(ref)
1.25x faster
Benchmark hidden because not significant (3): python_startup_no_site, bench_mp_pool, pickle
Ignored benchmarks (7) of results/bm-20221024-3.11.0-deaf509/bm-20221024-pythonperf1_win32-x86-python-v3.11.0-3.11.0-deaf509.json: aiohttp, dask, dulwich_log, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, unpack_sequence
Reliability score: 100.00% likely to be faster
90% likely to have a speedup of 1.30x
95% likely to have a speedup of 1.29x
99% likely to have a speedup of 1.26x