Dev Builds » 20230531-0654

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:57:30 1100284 3344 1383 338 1623 +112.33 +/- 5.48 0 55 561 1012 44 +240.11 +/- 14.38
ncm-dbt-02 09:53:23 1231304 3322 1382 308 1632 +116.5 +/- 5.37 0 55 507 1069 30 +256.75 +/- 15.14
ncm-dbt-03 09:56:43 1240946 3352 1392 319 1641 +115.27 +/- 5.55 0 61 527 1042 46 +247.84 +/- 14.85
ncm-dbt-04 09:57:28 1224983 3332 1364 293 1675 +115.78 +/- 5.29 1 48 523 1067 27 +256.02 +/- 14.9
ncm-dbt-05 09:53:16 1233166 3308 1374 310 1624 +115.86 +/- 5.4 0 51 524 1043 36 +252.75 +/- 14.89
ncm-dbt-06 09:56:25 1229979 3342 1425 315 1602 +119.94 +/- 5.33 2 46 495 1096 32 +267.16 +/- 15.32
20000 8320 1883 9797 +115.94 +/- 2.21 3 316 3137 6329 215 +253.31 +/- 6.08

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
190076 ncm-dbt-05 1240400 308 131 34 143 +113.27 +/- 18.37 0 5 52 92 5 +239.42 +/- 47.77
190075 ncm-dbt-02 1221613 322 133 25 164 +121.22 +/- 16.79 0 3 51 103 4 +266.95 +/- 48.18
190074 ncm-dbt-04 1200330 332 136 20 176 +126.73 +/- 16.02 0 2 50 110 4 +284.66 +/- 48.62
190073 ncm-dbt-01 1103165 344 141 31 172 +115.13 +/- 17.61 0 6 56 104 6 +243.36 +/- 46.04
190072 ncm-dbt-06 1233175 342 147 36 159 +116.99 +/- 15.9 0 4 54 111 2 +261.91 +/- 46.86
190071 ncm-dbt-03 1229085 352 150 40 162 +112.33 +/- 16.8 0 5 61 105 5 +238.98 +/- 43.95
190064 ncm-dbt-05 1241412 500 211 46 243 +119.11 +/- 14.36 0 13 62 172 3 +268.17 +/- 43.29
190063 ncm-dbt-02 1242804 500 208 44 248 +118.33 +/- 13.86 0 9 72 165 4 +263.42 +/- 40.52
190062 ncm-dbt-04 1204919 500 200 36 264 +118.33 +/- 14.2 1 7 74 163 5 +263.42 +/- 39.97
190061 ncm-dbt-03 1242551 500 205 54 241 +108.3 +/- 15.13 0 12 84 145 9 +223.94 +/- 37.43
190060 ncm-dbt-01 1096935 500 217 45 238 +124.6 +/- 14.31 0 5 79 155 11 +265.78 +/- 38.54
190059 ncm-dbt-06 1228062 500 214 45 241 +122.24 +/- 14.17 1 7 69 168 5 +275.45 +/- 41.43
190052 ncm-dbt-05 1229297 500 202 43 255 +114.45 +/- 13.21 0 3 91 150 6 +247.41 +/- 35.47
190051 ncm-dbt-02 1244290 500 215 48 237 +120.67 +/- 13.32 0 5 78 162 5 +268.17 +/- 38.8
190050 ncm-dbt-03 1238747 500 208 40 252 +121.45 +/- 13.49 0 6 75 164 5 +270.57 +/- 39.67
190049 ncm-dbt-04 1240777 500 213 47 240 +119.89 +/- 14.02 0 8 74 162 6 +263.42 +/- 39.97
190048 ncm-dbt-06 1214542 500 203 40 257 +117.55 +/- 13.36 0 8 73 167 2 +265.78 +/- 40.25
190047 ncm-dbt-01 1089046 500 200 44 256 +112.14 +/- 14.22 0 7 88 147 8 +236.51 +/- 36.44
190040 ncm-dbt-05 1231384 500 206 44 250 +116.77 +/- 14.04 0 10 72 164 4 +258.75 +/- 40.49
190039 ncm-dbt-02 1221041 500 202 50 248 +109.07 +/- 14.84 0 15 72 159 4 +236.51 +/- 40.23
190038 ncm-dbt-03 1232306 500 206 59 235 +105.25 +/- 14.35 0 8 95 139 8 +217.85 +/- 34.98
190037 ncm-dbt-04 1235102 500 213 49 238 +118.33 +/- 12.81 0 3 84 159 4 +263.42 +/- 37.11
190036 ncm-dbt-01 1098902 500 213 62 225 +108.3 +/- 13.73 0 9 84 154 3 +236.51 +/- 37.42
190035 ncm-dbt-06 1245681 500 209 49 242 +115.22 +/- 13.38 0 6 82 158 4 +254.16 +/- 37.82
190028 ncm-dbt-05 1232257 500 215 49 236 +119.89 +/- 14.35 0 8 76 158 8 +258.75 +/- 39.42
190027 ncm-dbt-03 1248846 500 203 42 255 +116.0 +/- 14.05 0 10 73 163 4 +256.44 +/- 40.21
190026 ncm-dbt-02 1220155 500 201 47 252 +110.6 +/- 13.56 0 5 92 147 6 +236.51 +/- 35.43
190025 ncm-dbt-04 1233319 500 197 49 254 +106.01 +/- 13.22 0 7 90 151 2 +232.26 +/- 35.99
190024 ncm-dbt-01 1110709 500 196 65 239 +93.2 +/- 13.6 0 10 101 137 2 +198.34 +/- 33.9
190023 ncm-dbt-06 1228331 500 216 62 222 +110.6 +/- 13.56 0 7 86 153 4 +240.82 +/- 36.9
190016 ncm-dbt-03 1246927 500 208 37 255 +123.81 +/- 15.13 0 9 73 156 12 +261.07 +/- 40.24
190015 ncm-dbt-05 1227930 500 205 51 244 +110.6 +/- 13.05 0 5 89 153 3 +243.0 +/- 36.1
190014 ncm-dbt-02 1219941 500 213 49 238 +118.33 +/- 13.86 0 9 72 165 4 +263.42 +/- 40.52
190013 ncm-dbt-01 1110674 500 213 47 240 +119.89 +/- 14.51 0 11 68 165 6 +263.42 +/- 41.6
190012 ncm-dbt-06 1242781 500 221 35 244 +135.76 +/- 13.57 0 7 56 181 6 +315.35 +/- 46.07
190011 ncm-dbt-04 1224683 500 203 54 243 +106.77 +/- 14.05 0 11 82 154 3 +232.26 +/- 37.9
190004 ncm-dbt-03 1248160 500 212 47 241 +119.11 +/- 14.03 0 11 66 170 3 +268.17 +/- 42.21
190003 ncm-dbt-06 1217284 500 215 48 237 +120.67 +/- 14.83 1 7 75 158 9 +261.07 +/- 39.69
190002 ncm-dbt-05 1229484 500 204 43 253 +116.0 +/- 14.05 0 7 82 154 7 +249.64 +/- 37.86
190001 ncm-dbt-02 1249290 500 210 45 245 +119.11 +/- 13.69 0 9 70 168 3 +268.17 +/- 41.1
190000 ncm-dbt-01 1092557 500 203 44 253 +114.45 +/- 14.21 0 7 85 150 8 +243.0 +/- 37.13
189999 ncm-dbt-04 1235756 500 202 38 260 +118.33 +/- 13.86 0 10 69 168 3 +265.78 +/- 41.36

Commit

Commit ID 07bd8adcbce41f076c36f4b65c7f9a786de0b02d
Author Linmiao Xu
Date 2023-05-31 06:54:38 UTC
Simplify nnue eval complexity calculation Remove a multiplier when blending nnue complexity with semi-classical complexity. Passed non-regression STC: https://tests.stockfishchess.org/tests/view/6473a71dd29264e4cfa75839 LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 124768 W: 33180 L: 33060 D: 58528 Ptnml(0-2): 314, 13797, 34030, 13941, 302 Passed non-regression LTC: https://tests.stockfishchess.org/tests/view/6474af3dd29264e4cfa768f4 LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 108180 W: 29008 L: 28884 D: 50288 Ptnml(0-2): 29, 10420, 33075, 10530, 36 closes https://github.com/official-stockfish/Stockfish/pull/4592 bench 2316827
Copyright 2011–2024 Next Chess Move LLC