pyperformance comparison, py37 with pgo enabled

py37_pgo_comparison.txt (text/plain), 7.02 KB, created by Joel Berendzen on 2020-05-19 18:23:17 UTC

py37-nosemantic-O3-flto.json
============================

Performance version: 1.0.1
Report on Linux-5.6.13-gentoo-x86_64-x86_64-Intel-R-_Core-TM-_i7-6700K_CPU_@_4.00GHz-with-gentoo-2.7
Number of logical CPUs: 8
Start date: 2020-05-18 17:20:43.865114
End date: 2020-05-18 17:41:42.228507

py37-pgo-O3-flto.json
=====================

Performance version: 1.0.1
Report on Linux-5.6.13-gentoo-x86_64-x86_64-Intel-R-_Core-TM-_i7-6700K_CPU_@_4.00GHz-with-gentoo-2.7
Number of logical CPUs: 8
Start date: 2020-05-19 08:59:46.489201
End date: 2020-05-19 09:19:08.010979

### 2to3 ###
Mean +- std dev: 393 ms +- 4 ms -> 340 ms +- 6 ms: 1.15x faster
Significant (t=57.19)

### chameleon ###
Mean +- std dev: 12.9 ms +- 0.2 ms -> 10.1 ms +- 0.1 ms: 1.28x faster
Significant (t=112.14)

### chaos ###
Mean +- std dev: 154 ms +- 2 ms -> 128 ms +- 1 ms: 1.20x faster
Significant (t=73.45)

### crypto_pyaes ###
Mean +- std dev: 135 ms +- 1 ms -> 123 ms +- 1 ms: 1.10x faster
Significant (t=55.74)

### deltablue ###
Mean +- std dev: 10.1 ms +- 0.4 ms -> 8.1 ms +- 0.2 ms: 1.25x faster
Significant (t=34.14)

### django_template ###
Mean +- std dev: 79.4 ms +- 1.5 ms -> 67.1 ms +- 9.4 ms: 1.18x faster
Significant (t=9.99)

### dulwich_log ###
Mean +- std dev: 85.9 ms +- 0.5 ms -> 74.1 ms +- 2.9 ms: 1.16x faster
Significant (t=31.47)

### fannkuch ###
Mean +- std dev: 596 ms +- 3 ms -> 570 ms +- 77 ms: 1.05x faster
Significant (t=2.69)

### float ###
Mean +- std dev: 137 ms +- 1 ms -> 123 ms +- 5 ms: 1.11x faster
Significant (t=22.36)

### genshi_text ###
Mean +- std dev: 40.9 ms +- 0.6 ms -> 32.6 ms +- 0.6 ms: 1.25x faster
Significant (t=75.05)

### genshi_xml ###
Mean +- std dev: 83.3 ms +- 1.0 ms -> 67.6 ms +- 1.1 ms: 1.23x faster
Significant (t=80.53)

### go ###
Mean +- std dev: 341 ms +- 2 ms -> 276 ms +- 3 ms: 1.23x faster
Significant (t=137.09)

### hexiom ###
Mean +- std dev: 13.8 ms +- 0.2 ms -> 11.5 ms +- 0.2 ms: 1.20x faster
Significant (t=64.66)

### json_dumps ###
Mean +- std dev: 14.7 ms +- 0.1 ms -> 13.0 ms +- 0.1 ms: 1.13x faster
Significant (t=77.32)

### json_loads ###
Mean +- std dev: 30.1 us +- 0.3 us -> 25.4 us +- 0.3 us: 1.18x faster
Significant (t=93.71)

### logging_format ###
Mean +- std dev: 14.0 us +- 0.2 us -> 11.1 us +- 0.2 us: 1.25x faster
Significant (t=77.62)

### logging_silent ###
Mean +- std dev: 246 ns +- 7 ns -> 204 ns +- 5 ns: 1.20x faster
Significant (t=37.35)

### logging_simple ###
Mean +- std dev: 12.7 us +- 0.2 us -> 10.3 us +- 0.6 us: 1.23x faster
Significant (t=29.93)

### mako ###
Mean +- std dev: 23.2 ms +- 0.2 ms -> 20.9 ms +- 0.8 ms: 1.11x faster
Significant (t=22.16)

### meteor_contest ###
Mean +- std dev: 123 ms +- 4 ms -> 111 ms +- 2 ms: 1.11x faster
Significant (t=22.47)

### nbody ###
Mean +- std dev: 146 ms +- 1 ms -> 129 ms +- 8 ms: 1.13x faster
Significant (t=15.29)

### nqueens ###
Mean +- std dev: 126 ms +- 2 ms -> 109 ms +- 2 ms: 1.16x faster
Significant (t=58.72)

### pathlib ###
Mean +- std dev: 23.8 ms +- 0.3 ms -> 21.3 ms +- 0.8 ms: 1.12x faster
Significant (t=23.20)

### pickle ###
Mean +- std dev: 13.3 us +- 0.1 us -> 9.7 us +- 0.3 us: 1.37x faster
Significant (t=99.79)

### pickle_dict ###
Mean +- std dev: 38.3 us +- 0.1 us -> 29.4 us +- 0.3 us: 1.30x faster
Significant (t=211.15)

### pickle_list ###
Mean +- std dev: 4.93 us +- 0.04 us -> 3.67 us +- 0.05 us: 1.34x faster
Significant (t=152.80)

### pickle_pure_python ###
Mean +- std dev: 617 us +- 8 us -> 517 us +- 15 us: 1.19x faster
Significant (t=44.57)

### pidigits ###
Mean +- std dev: 177 ms +- 1 ms -> 163 ms +- 1 ms: 1.08x faster
Significant (t=88.88)

### pyflate ###
Mean +- std dev: 861 ms +- 8 ms -> 715 ms +- 7 ms: 1.21x faster
Significant (t=105.19)

### python_startup ###
Mean +- std dev: 8.29 ms +- 0.06 ms -> 7.73 ms +- 0.04 ms: 1.07x faster
Significant (t=112.22)

### python_startup_no_site ###
Mean +- std dev: 5.76 ms +- 0.04 ms -> 5.34 ms +- 0.04 ms: 1.08x faster
Significant (t=109.80)

### raytrace ###
Mean +- std dev: 676 ms +- 7 ms -> 559 ms +- 7 ms: 1.21x faster
Significant (t=89.21)

### regex_compile ###
Mean +- std dev: 237 ms +- 2 ms -> 198 ms +- 2 ms: 1.20x faster
Significant (t=96.01)

### regex_dna ###
Mean +- std dev: 173 ms +- 2 ms -> 154 ms +- 7 ms: 1.12x faster
Significant (t=19.08)

### regex_effbot ###
Mean +- std dev: 3.02 ms +- 0.04 ms -> 2.77 ms +- 0.16 ms: 1.09x faster
Significant (t=11.56)

### regex_v8 ###
Mean +- std dev: 23.9 ms +- 0.2 ms -> 22.1 ms +- 0.5 ms: 1.08x faster
Significant (t=26.72)

### richards ###
Mean +- std dev: 102 ms +- 2 ms -> 80 ms +- 2 ms: 1.27x faster
Significant (t=57.32)

### scimark_fft ###
Mean +- std dev: 406 ms +- 16 ms -> 353 ms +- 24 ms: 1.15x faster
Significant (t=14.23)

### scimark_lu ###
Mean +- std dev: 232 ms +- 6 ms -> 199 ms +- 12 ms: 1.16x faster
Significant (t=19.21)

### scimark_monte_carlo ###
Mean +- std dev: 131 ms +- 3 ms -> 123 ms +- 17 ms: 1.07x faster
Significant (t=3.74)

### scimark_sor ###
Mean +- std dev: 249 ms +- 4 ms -> 208 ms +- 4 ms: 1.20x faster
Significant (t=59.01)

### scimark_sparse_mat_mult ###
Mean +- std dev: 5.27 ms +- 0.69 ms -> 4.15 ms +- 0.10 ms: 1.27x faster
Significant (t=12.38)

### spectral_norm ###
Mean +- std dev: 156 ms +- 1 ms -> 136 ms +- 2 ms: 1.14x faster
Significant (t=67.61)

### sqlalchemy_declarative ###
Mean +- std dev: 193 ms +- 3 ms -> 179 ms +- 3 ms: 1.08x faster
Significant (t=29.23)

### sqlalchemy_imperative ###
Mean +- std dev: 40.6 ms +- 0.4 ms -> 36.8 ms +- 1.1 ms: 1.10x faster
Significant (t=26.00)

### sqlite_synth ###
Mean +- std dev: 3.25 us +- 0.03 us -> 2.87 us +- 0.18 us: 1.13x faster
Significant (t=16.25)

### sympy_expand ###
Mean +- std dev: 747 ms +- 6 ms -> 683 ms +- 40 ms: 1.09x faster
Significant (t=12.33)

### sympy_integrate ###
Mean +- std dev: 36.2 ms +- 0.3 ms -> 35.7 ms +- 2.3 ms: 1.01x faster
Not significant

### sympy_str ###
Mean +- std dev: 476 ms +- 4 ms -> 429 ms +- 5 ms: 1.11x faster
Significant (t=58.33)

### sympy_sum ###
Mean +- std dev: 291 ms +- 3 ms -> 268 ms +- 8 ms: 1.08x faster
Significant (t=21.50)

### telco ###
Mean +- std dev: 7.95 ms +- 0.16 ms -> 6.55 ms +- 0.12 ms: 1.21x faster
Significant (t=55.64)

### tornado_http ###
Mean +- std dev: 182 ms +- 2 ms -> 167 ms +- 4 ms: 1.09x faster
Significant (t=23.36)

### unpack_sequence ###
Mean +- std dev: 61.3 ns +- 3.8 ns -> 50.8 ns +- 4.1 ns: 1.21x faster
Significant (t=14.45)

### unpickle ###
Mean +- std dev: 16.4 us +- 0.8 us -> 13.6 us +- 0.9 us: 1.21x faster
Significant (t=17.95)

### unpickle_list ###
Mean +- std dev: 4.66 us +- 0.06 us -> 4.43 us +- 0.25 us: 1.05x faster
Significant (t=6.86)

### unpickle_pure_python ###
Mean +- std dev: 480 us +- 3 us -> 434 us +- 26 us: 1.11x faster
Significant (t=13.58)

### xml_etree_generate ###
Mean +- std dev: 130 ms +- 1 ms -> 123 ms +- 12 ms: 1.06x faster
Significant (t=4.58)

### xml_etree_iterparse ###
Mean +- std dev: 117 ms +- 1 ms -> 115 ms +- 5 ms: 1.02x faster
Not significant

### xml_etree_parse ###
Mean +- std dev: 151 ms +- 2 ms -> 149 ms +- 4 ms: 1.01x faster
Not significant

### xml_etree_process ###
Mean +- std dev: 111 ms +- 2 ms -> 99 ms +- 15 ms: 1.12x faster
Significant (t=6.09)