fork: python
ref: a19bb261a327e1008f21
machine: windows-x86
commit hash: a19bb26
commit date: 2024-06-15
overall geometric mean: 1.18x faster
HPT reliability: 100.00%
HPT 99th percentile: 1.17x faster
Memory change: unknown
Benchmarks with tag 'apps':
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
2to3
280 ms
233 ms: 1.20x faster
chameleon
7.75 ms
5.72 ms: 1.36x faster
docutils
1.98 sec
1.80 sec: 1.10x faster
tornado_http
105 ms
93.8 ms: 1.12x faster
Geometric mean
(ref)
1.19x faster
Benchmarks with tag 'asyncio':
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
async_tree_memoization_tg
350 ms
258 ms: 1.36x faster
async_tree_none_tg
278 ms
206 ms: 1.35x faster
async_tree_memoization
364 ms
279 ms: 1.31x faster
async_tree_none
298 ms
231 ms: 1.29x faster
async_tree_io
693 ms
543 ms: 1.28x faster
async_tree_io_tg
677 ms
532 ms: 1.27x faster
async_tree_cpu_io_mixed_tg
546 ms
452 ms: 1.21x faster
async_tree_cpu_io_mixed
564 ms
477 ms: 1.18x faster
Geometric mean
(ref)
1.28x faster
Benchmarks with tag 'math':
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
nbody
127 ms
78.0 ms: 1.63x faster
float
76.7 ms
54.5 ms: 1.41x faster
Geometric mean
(ref)
1.32x faster
Benchmark hidden because not significant (1): pidigits
Benchmarks with tag 'regex':
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
regex_compile
129 ms
99.7 ms: 1.30x faster
regex_effbot
2.04 ms
1.92 ms: 1.06x faster
regex_dna
127 ms
124 ms: 1.02x faster
regex_v8
15.0 ms
16.0 ms: 1.06x slower
Geometric mean
(ref)
1.07x faster
Benchmarks with tag 'serialize':
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
tomli_loads
2.20 sec
1.60 sec: 1.38x faster
unpickle_pure_python
210 us
154 us: 1.36x faster
pickle_pure_python
286 us
221 us: 1.30x faster
xml_etree_process
53.2 ms
42.6 ms: 1.25x faster
xml_etree_iterparse
77.6 ms
63.8 ms: 1.22x faster
xml_etree_generate
72.1 ms
60.6 ms: 1.19x faster
xml_etree_parse
113 ms
103 ms: 1.09x faster
json_dumps
7.40 ms
7.23 ms: 1.02x faster
pickle
7.79 us
7.99 us: 1.02x slower
pickle_dict
19.9 us
20.5 us: 1.03x slower
unpickle
9.71 us
9.99 us: 1.03x slower
json_loads
20.4 us
21.1 us: 1.04x slower
unpickle_list
2.95 us
3.06 us: 1.04x slower
pickle_list
3.37 us
3.58 us: 1.06x slower
Geometric mean
(ref)
1.10x faster
Benchmarks with tag 'startup':
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
python_startup_no_site
19.1 ms
18.8 ms: 1.02x faster
python_startup
22.4 ms
22.8 ms: 1.02x slower
Geometric mean
(ref)
1.00x slower
Benchmarks with tag 'template':
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
mako
9.96 ms
7.06 ms: 1.41x faster
django_template
36.9 ms
30.4 ms: 1.21x faster
Geometric mean
(ref)
1.31x faster
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
generators
38.5 ms
21.8 ms: 1.77x faster
logging_silent
101 ns
57.9 ns: 1.75x faster
comprehensions
19.2 us
11.6 us: 1.65x faster
nbody
127 ms
78.0 ms: 1.63x faster
deltablue
3.58 ms
2.25 ms: 1.59x faster
raytrace
308 ms
194 ms: 1.59x faster
deepcopy_memo
38.4 us
24.7 us: 1.55x faster
hexiom
6.82 ms
4.46 ms: 1.53x faster
scimark_lu
93.2 ms
61.6 ms: 1.51x faster
scimark_sor
130 ms
86.9 ms: 1.49x faster
spectral_norm
104 ms
70.8 ms: 1.47x faster
chaos
69.4 ms
47.6 ms: 1.46x faster
mako
9.96 ms
7.06 ms: 1.41x faster
float
76.7 ms
54.5 ms: 1.41x faster
scimark_monte_carlo
66.4 ms
47.4 ms: 1.40x faster
tomli_loads
2.20 sec
1.60 sec: 1.38x faster
scimark_sparse_mat_mult
3.86 ms
2.81 ms: 1.38x faster
nqueens
93.7 ms
68.6 ms: 1.37x faster
unpickle_pure_python
210 us
154 us: 1.36x faster
async_tree_memoization_tg
350 ms
258 ms: 1.36x faster
chameleon
7.75 ms
5.72 ms: 1.36x faster
async_tree_none_tg
278 ms
206 ms: 1.35x faster
pyflate
424 ms
317 ms: 1.34x faster
sqlglot_parse
1.25 ms
936 us: 1.33x faster
coroutines
20.9 ms
15.7 ms: 1.33x faster
go
137 ms
104 ms: 1.32x faster
richards_super
46.5 ms
35.2 ms: 1.32x faster
scimark_fft
271 ms
206 ms: 1.32x faster
richards
41.3 ms
31.4 ms: 1.31x faster
logging_simple
9.75 us
7.44 us: 1.31x faster
async_tree_memoization
364 ms
279 ms: 1.31x faster
sqlglot_transpile
1.53 ms
1.17 ms: 1.30x faster
pickle_pure_python
286 us
221 us: 1.30x faster
regex_compile
129 ms
99.7 ms: 1.30x faster
async_tree_none
298 ms
231 ms: 1.29x faster
async_tree_io
693 ms
543 ms: 1.28x faster
async_tree_io_tg
677 ms
532 ms: 1.27x faster
logging_format
10.4 us
8.19 us: 1.27x faster
deepcopy
360 us
285 us: 1.27x faster
xml_etree_process
53.2 ms
42.6 ms: 1.25x faster
crypto_pyaes
69.2 ms
55.4 ms: 1.25x faster
pycparser
978 ms
783 ms: 1.25x faster
fannkuch
354 ms
284 ms: 1.24x faster
pprint_pformat
1.50 sec
1.22 sec: 1.23x faster
deepcopy_reduce
3.23 us
2.63 us: 1.23x faster
sqlglot_optimize
48.5 ms
39.5 ms: 1.23x faster
xml_etree_iterparse
77.6 ms
63.8 ms: 1.22x faster
django_template
36.9 ms
30.4 ms: 1.21x faster
async_tree_cpu_io_mixed_tg
546 ms
452 ms: 1.21x faster
2to3
280 ms
233 ms: 1.20x faster
pprint_safe_repr
721 ms
599 ms: 1.20x faster
sympy_integrate
17.5 ms
14.6 ms: 1.20x faster
xml_etree_generate
72.1 ms
60.6 ms: 1.19x faster
sympy_sum
123 ms
104 ms: 1.19x faster
async_tree_cpu_io_mixed
564 ms
477 ms: 1.18x faster
sympy_str
240 ms
205 ms: 1.17x faster
meteor_contest
86.9 ms
74.6 ms: 1.16x faster
async_generators
313 ms
272 ms: 1.15x faster
bench_thread_pool
1.10 ms
956 us: 1.15x faster
mdp
1.91 sec
1.66 sec: 1.15x faster
tornado_http
105 ms
93.8 ms: 1.12x faster
sympy_expand
398 ms
357 ms: 1.11x faster
pathlib
91.4 ms
82.5 ms: 1.11x faster
docutils
1.98 sec
1.80 sec: 1.10x faster
xml_etree_parse
113 ms
103 ms: 1.09x faster
bench_mp_pool
75.4 ms
70.8 ms: 1.06x faster
regex_effbot
2.04 ms
1.92 ms: 1.06x faster
sqlite_synth
2.07 us
1.95 us: 1.06x faster
asyncio_tcp_ssl
17.7 sec
16.8 sec: 1.05x faster
json_dumps
7.40 ms
7.23 ms: 1.02x faster
regex_dna
127 ms
124 ms: 1.02x faster
python_startup_no_site
19.1 ms
18.8 ms: 1.02x faster
gc_traversal
1.44 ms
1.43 ms: 1.01x faster
json
4.15 ms
4.24 ms: 1.02x slower
python_startup
22.4 ms
22.8 ms: 1.02x slower
pickle
7.79 us
7.99 us: 1.02x slower
pickle_dict
19.9 us
20.5 us: 1.03x slower
unpickle
9.71 us
9.99 us: 1.03x slower
json_loads
20.4 us
21.1 us: 1.04x slower
unpickle_list
2.95 us
3.06 us: 1.04x slower
typing_runtime_protocols
126 us
131 us: 1.04x slower
pickle_list
3.37 us
3.58 us: 1.06x slower
regex_v8
15.0 ms
16.0 ms: 1.06x slower
telco
5.51 ms
6.14 ms: 1.11x slower
create_gc_cycles
652 us
743 us: 1.14x slower
sqlglot_normalize
100 ms
203 ms: 2.03x slower
coverage
48.4 ms
313 ms: 6.46x slower
Geometric mean
(ref)
1.18x faster
Benchmark hidden because not significant (2): asyncio_tcp, pidigits
Ignored benchmarks (7) of results/bm-20231002-3.12.0-0fb18b0/bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0.json: aiohttp, dask, dulwich_log, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, unpack_sequence
Ignored benchmarks (6) of results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-pythonperf1_win32-x86-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json: flaskblogging, genshi_text, genshi_xml, html5lib, pylint, thrift
Reliability score: 100.00% likely to be faster
90% likely to have a speedup of 1.20x
95% likely to have a speedup of 1.19x
99% likely to have a speedup of 1.17x