fork: python
ref: 6fcac09401e336b25833
machine: linux-aarch64
commit hash: 6fcac09
commit date: 2025-08-23
overall geometric mean: 1.018x faster
HPT reliability: 99.62%
HPT 99th percentile: 1.00x faster
Memory change: 1.10x
Benchmarks with tag 'apps':
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250823-arminc-aarch64-python-6fcac09401e336b25833-3.15.0a0-6fcac09
docutils
2.96 sec
3.08 sec: 1.04x slower
html5lib
65.6 ms
61.9 ms: 1.06x faster
sphinx
1.20 sec
1.16 sec: 1.03x faster
Geometric mean
(ref)
1.01x faster
Benchmark hidden because not significant (1): 2to3
Benchmarks with tag 'asyncio':
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250823-arminc-aarch64-python-6fcac09401e336b25833-3.15.0a0-6fcac09
async_tree_memoization_tg
663 ms
465 ms: 1.43x faster
async_tree_memoization
664 ms
472 ms: 1.40x faster
async_tree_none
504 ms
371 ms: 1.36x faster
async_tree_none_tg
484 ms
371 ms: 1.30x faster
async_tree_io_tg
1.16 sec
897 ms: 1.30x faster
async_tree_io
1.14 sec
884 ms: 1.29x faster
async_tree_cpu_io_mixed_tg
801 ms
644 ms: 1.24x faster
async_tree_cpu_io_mixed
789 ms
656 ms: 1.20x faster
async_generators
500 ms
481 ms: 1.04x faster
Geometric mean
(ref)
1.22x faster
Benchmark hidden because not significant (2): asyncio_websockets, coroutines
Benchmarks with tag 'math':
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250823-arminc-aarch64-python-6fcac09401e336b25833-3.15.0a0-6fcac09
float
95.8 ms
81.8 ms: 1.17x faster
nbody
118 ms
126 ms: 1.07x slower
Geometric mean
(ref)
1.03x faster
Benchmark hidden because not significant (1): pidigits
Benchmarks with tag 'regex':
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250823-arminc-aarch64-python-6fcac09401e336b25833-3.15.0a0-6fcac09
regex_effbot
5.10 ms
3.92 ms: 1.30x faster
regex_v8
32.5 ms
25.9 ms: 1.26x faster
regex_dna
263 ms
220 ms: 1.20x faster
regex_compile
134 ms
122 ms: 1.10x faster
Geometric mean
(ref)
1.21x faster
Benchmarks with tag 'serialize':
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250823-arminc-aarch64-python-6fcac09401e336b25833-3.15.0a0-6fcac09
json_dumps
14.2 ms
12.1 ms: 1.17x faster
tomli_loads
2.67 sec
2.30 sec: 1.16x faster
xml_etree_parse
203 ms
181 ms: 1.12x faster
xml_etree_iterparse
159 ms
144 ms: 1.10x faster
xml_etree_generate
118 ms
109 ms: 1.08x faster
xml_etree_process
82.1 ms
76.1 ms: 1.08x faster
Geometric mean
(ref)
1.08x faster
Benchmark hidden because not significant (3): unpickle_pure_python, json_loads, pickle_pure_python
Benchmarks with tag 'startup':
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250823-arminc-aarch64-python-6fcac09401e336b25833-3.15.0a0-6fcac09
python_startup
16.0 ms
15.2 ms: 1.06x faster
python_startup_no_site
8.79 ms
8.60 ms: 1.02x faster
Geometric mean
(ref)
1.04x faster
Benchmarks with tag 'template':
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250823-arminc-aarch64-python-6fcac09401e336b25833-3.15.0a0-6fcac09
mako
14.0 ms
13.0 ms: 1.08x faster
django_template
39.4 ms
38.3 ms: 1.03x faster
genshi_xml
61.6 ms
62.9 ms: 1.02x slower
Geometric mean
(ref)
1.03x faster
Benchmark hidden because not significant (1): genshi_text
Benchmark
bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5
bm-20250823-arminc-aarch64-python-6fcac09401e336b25833-3.15.0a0-6fcac09
mdp
3.45 sec
1.66 sec: 2.08x faster
deepcopy_memo
53.0 us
36.4 us: 1.45x faster
deepcopy
479 us
335 us: 1.43x faster
async_tree_memoization_tg
663 ms
465 ms: 1.43x faster
async_tree_memoization
664 ms
472 ms: 1.40x faster
async_tree_none
504 ms
371 ms: 1.36x faster
async_tree_none_tg
484 ms
371 ms: 1.30x faster
regex_effbot
5.10 ms
3.92 ms: 1.30x faster
async_tree_io_tg
1.16 sec
897 ms: 1.30x faster
async_tree_io
1.14 sec
884 ms: 1.29x faster
regex_v8
32.5 ms
25.9 ms: 1.26x faster
async_tree_cpu_io_mixed_tg
801 ms
644 ms: 1.24x faster
async_tree_cpu_io_mixed
789 ms
656 ms: 1.20x faster
regex_dna
263 ms
220 ms: 1.20x faster
richards
54.5 ms
45.8 ms: 1.19x faster
deepcopy_reduce
4.24 us
3.57 us: 1.19x faster
richards_super
60.8 ms
51.3 ms: 1.19x faster
json_dumps
14.2 ms
12.1 ms: 1.17x faster
float
95.8 ms
81.8 ms: 1.17x faster
spectral_norm
143 ms
123 ms: 1.17x faster
tomli_loads
2.67 sec
2.30 sec: 1.16x faster
scimark_sor
164 ms
144 ms: 1.14x faster
scimark_fft
463 ms
409 ms: 1.13x faster
generators
40.3 ms
35.7 ms: 1.13x faster
xml_etree_parse
203 ms
181 ms: 1.12x faster
bpe_tokeniser
6.02 sec
5.38 sec: 1.12x faster
xml_etree_iterparse
159 ms
144 ms: 1.10x faster
regex_compile
134 ms
122 ms: 1.10x faster
sqlite_synth
4.08 us
3.71 us: 1.10x faster
pyflate
582 ms
530 ms: 1.10x faster
pathlib
24.3 ms
22.3 ms: 1.09x faster
logging_format
8.10 us
7.45 us: 1.09x faster
xml_etree_generate
118 ms
109 ms: 1.08x faster
go
164 ms
152 ms: 1.08x faster
xml_etree_process
82.1 ms
76.1 ms: 1.08x faster
mako
14.0 ms
13.0 ms: 1.08x faster
thrift
1.01 ms
941 us: 1.07x faster
logging_simple
7.25 us
6.77 us: 1.07x faster
k_core
2.99 sec
2.80 sec: 1.07x faster
html5lib
65.6 ms
61.9 ms: 1.06x faster
python_startup
16.0 ms
15.2 ms: 1.06x faster
async_generators
500 ms
481 ms: 1.04x faster
logging_silent
135 ns
129 ns: 1.04x faster
sphinx
1.20 sec
1.16 sec: 1.03x faster
django_template
39.4 ms
38.3 ms: 1.03x faster
python_startup_no_site
8.79 ms
8.60 ms: 1.02x faster
djangocms
66.2 us
65.0 us: 1.02x faster
genshi_xml
61.6 ms
62.9 ms: 1.02x slower
typing_runtime_protocols
197 us
204 us: 1.04x slower
connected_components
547 ms
568 ms: 1.04x slower
docutils
2.96 sec
3.08 sec: 1.04x slower
shortest_path
565 ms
590 ms: 1.04x slower
sympy_str
265 ms
282 ms: 1.06x slower
comprehensions
20.8 us
22.2 us: 1.06x slower
crypto_pyaes
84.9 ms
90.6 ms: 1.07x slower
nbody
118 ms
126 ms: 1.07x slower
raytrace
310 ms
333 ms: 1.07x slower
scimark_sparse_mat_mult
6.66 ms
7.32 ms: 1.10x slower
pprint_safe_repr
962 ms
1.08 sec: 1.12x slower
pprint_pformat
1.99 sec
2.27 sec: 1.14x slower
create_gc_cycles
3.39 ms
3.89 ms: 1.15x slower
gc_traversal
5.92 ms
6.82 ms: 1.15x slower
many_optionals
626 us
972 us: 1.55x slower
subparsers
20.3 ms
47.2 ms: 2.32x slower
telco
10.5 ms
163 ms: 15.60x slower
bench_mp_pool
8.07 ms
3.18 sec: 393.77x slower
Geometric mean
(ref)
1.04x slower
Benchmark hidden because not significant (24): scimark_monte_carlo, pylint, unpickle_pure_python, json, meteor_contest, genshi_text, nqueens, fannkuch, scimark_lu, sympy_sum, deltablue, sympy_integrate, chaos, coverage, json_loads, asyncio_websockets, 2to3, pidigits, pycparser, coroutines, hexiom, bench_thread_pool, sympy_expand, pickle_pure_python
Ignored benchmarks (10) of results/bm-20241007-3.13.0-60403a5/bm-20241007-arminc-aarch64-python-v3.13.0-3.13.0-60403a5.json: chameleon, gevent_hub, gunicorn, sqlalchemy_declarative, sqlalchemy_imperative, sqlglot_normalize, sqlglot_optimize, sqlglot_parse, sqlglot_transpile, tornado_http
Ignored benchmarks (13) of results/bm-20250823-3.15.0a0-6fcac09-JIT/bm-20250823-arminc-aarch64-python-6fcac09401e336b25833-3.15.0a0-6fcac09.json: asyncio_tcp, asyncio_tcp_ssl, dulwich_log, pickle, pickle_dict, pickle_list, sqlglot_v2_normalize, sqlglot_v2_optimize, sqlglot_v2_parse, sqlglot_v2_transpile, unpack_sequence, unpickle, unpickle_list
Geometric mean (including insignificant results): 1.018x faster
Reliability score: 99.62% likely to be faster
90% likely to have a speedup of 1.02x
95% likely to have a speedup of 1.01x
99% likely to have a speedup of 1.00x