Dev Builds » 20230203-1907

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 04:59:04 1122567 1676 691 170 815 +111.7 +/- 7.81 1 34 261 527 15 +243.56 +/- 21.13
ncm-dbt-02 04:57:47 1235683 1664 680 171 813 +109.79 +/- 7.47 0 24 289 505 14 +238.1 +/- 20.02
ncm-dbt-03 04:59:53 1237322 1670 702 163 805 +116.29 +/- 7.61 1 26 256 537 15 +256.87 +/- 21.34
ncm-dbt-04 05:00:20 1221267 1674 702 157 815 +117.38 +/- 7.26 0 17 273 532 15 +259.45 +/- 20.58
ncm-dbt-05 04:57:26 1219839 1648 692 169 787 +114.2 +/- 7.57 0 26 263 521 14 +250.61 +/- 21.04
ncm-dbt-06 05:00:45 1232512 1668 680 166 822 +110.66 +/- 8.14 0 40 264 506 24 +234.13 +/- 21.0
ncm-et-3 06:25:04 1299563 1658 659 176 823 +104.23 +/- 7.74 0 37 283 498 11 +224.64 +/- 20.28
ncm-et-4 06:24:00 1303818 1662 703 185 774 +112.01 +/- 8.18 2 33 267 503 26 +237.83 +/- 20.89
ncm-et-9 06:25:02 1297279 1676 669 170 837 +106.67 +/- 7.77 0 29 303 484 22 +224.57 +/- 19.55
ncm-et-10 06:24:38 1297012 1668 702 170 796 +114.82 +/- 8.04 1 34 254 522 23 +247.14 +/- 21.41
ncm-et-13 06:25:28 1308498 1674 687 162 825 +112.76 +/- 7.79 0 31 270 516 20 +242.65 +/- 20.77
ncm-et-15 06:24:14 1294642 1662 672 186 804 +104.65 +/- 8.06 1 40 280 492 18 +222.09 +/- 20.39
20000 8239 2045 9716 +111.25 +/- 2.25 6 371 3263 6143 217 +239.9 +/- 5.96

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
201497 ncm-dbt-05 1225422 148 62 18 68 +106.5 +/- 24.7 0 3 24 47 0 +237.9 +/- 71.53
201496 ncm-dbt-02 1235008 164 67 18 79 +107.07 +/- 24.91 0 3 29 48 2 +226.61 +/- 64.59
201495 ncm-dbt-06 1210918 168 66 17 85 +104.36 +/- 24.49 0 4 28 51 1 +225.71 +/- 65.87
201494 ncm-dbt-03 1224894 170 66 21 83 +94.21 +/- 26.33 0 7 27 50 1 +199.12 +/- 66.38
201493 ncm-dbt-01 1126425 176 71 20 85 +103.64 +/- 26.59 0 7 25 54 2 +218.26 +/- 68.72
201492 ncm-dbt-04 1219870 174 73 15 86 +120.41 +/- 21.31 0 1 28 57 1 +272.5 +/- 65.56
201491 ncm-dbt-05 1227312 500 204 51 245 +109.83 +/- 14.37 0 11 80 154 5 +236.51 +/- 38.38
201490 ncm-dbt-06 1251433 500 205 52 243 +109.83 +/- 14.84 0 13 77 154 6 +234.38 +/- 39.07
201489 ncm-dbt-02 1244170 500 200 46 254 +110.6 +/- 13.39 0 7 85 155 3 +243.0 +/- 37.13
201488 ncm-dbt-03 1244489 500 210 50 240 +115.23 +/- 14.05 1 5 83 155 6 +251.89 +/- 37.57
201487 ncm-dbt-01 1125204 500 199 52 249 +105.25 +/- 13.56 0 9 87 152 2 +230.16 +/- 36.73
201486 ncm-dbt-04 1229798 500 203 42 255 +116.0 +/- 13.2 0 7 77 164 2 +261.07 +/- 39.14
201485 ncm-dbt-05 1212099 500 213 53 234 +115.22 +/- 13.72 0 6 84 154 6 +249.64 +/- 37.33
201484 ncm-dbt-06 1228469 500 210 50 240 +115.22 +/- 14.69 0 11 75 157 7 +247.41 +/- 39.65
201483 ncm-dbt-01 1121692 500 211 50 239 +116.0 +/- 13.88 0 8 78 159 5 +254.16 +/- 38.89
201482 ncm-dbt-02 1229056 500 205 48 247 +112.91 +/- 12.86 0 5 85 158 2 +251.89 +/- 37.03
201481 ncm-dbt-04 1206774 500 211 52 237 +114.45 +/- 13.72 0 5 88 150 7 +245.2 +/- 36.32
201480 ncm-dbt-03 1214578 500 221 45 234 +127.76 +/- 13.39 0 7 64 175 4 +293.29 +/- 43.07
201479 ncm-dbt-05 1214523 500 213 47 240 +119.89 +/- 13.16 0 6 75 166 3 +270.57 +/- 39.67
201478 ncm-dbt-01 1116949 500 210 48 242 +116.78 +/- 14.85 1 10 71 162 6 +256.44 +/- 40.73
201477 ncm-dbt-02 1234500 500 208 59 233 +106.77 +/- 14.36 0 9 90 144 7 +223.94 +/- 36.07
201476 ncm-dbt-04 1228628 500 215 48 237 +120.67 +/- 13.15 0 4 80 161 5 +268.17 +/- 38.21
201475 ncm-dbt-06 1239229 500 199 47 254 +109.07 +/- 15.29 0 12 84 144 10 +223.94 +/- 37.43
201474 ncm-dbt-03 1265327 500 205 47 248 +113.68 +/- 13.55 0 7 82 157 4 +249.64 +/- 37.86
165868 ncm-et-3 1299167 158 66 24 68 +94.62 +/- 25.32 0 4 30 44 1 +199.76 +/- 63.37
165867 ncm-et-15 1298460 162 69 19 74 +110.84 +/- 28.4 0 5 25 47 4 +223.89 +/- 69.62
165866 ncm-et-4 1304916 162 71 14 77 +127.7 +/- 24.94 0 2 23 53 3 +279.59 +/- 73.46
165865 ncm-et-10 1301770 168 72 15 81 +122.74 +/- 23.55 0 1 28 52 3 +265.1 +/- 65.44
165864 ncm-et-13 1316188 174 74 12 88 +129.47 +/- 20.98 0 1 24 61 1 +302.12 +/- 71.69
165863 ncm-et-9 1290148 176 73 16 87 +116.72 +/- 24.54 0 4 25 57 2 +254.73 +/- 69.94
165862 ncm-et-3 1303798 500 200 64 236 +96.94 +/- 14.57 0 14 90 142 4 +204.07 +/- 36.13
165861 ncm-et-4 1306460 500 209 66 225 +102.22 +/- 15.79 1 15 82 144 8 +211.87 +/- 37.79
165860 ncm-et-15 1293872 500 202 52 246 +107.54 +/- 15.13 1 12 79 152 6 +230.16 +/- 38.58
165859 ncm-et-10 1294873 500 214 50 236 +118.33 +/- 15.15 1 11 68 163 7 +258.75 +/- 41.54
165858 ncm-et-13 1311565 500 199 42 259 +112.91 +/- 13.89 0 8 82 155 5 +245.2 +/- 37.88
165857 ncm-et-9 1295179 500 207 47 246 +115.22 +/- 14.53 0 6 89 144 11 +238.66 +/- 36.16
165856 ncm-et-4 1304612 500 208 56 236 +109.07 +/- 14.05 0 9 85 151 5 +234.38 +/- 37.19
165855 ncm-et-15 1284711 500 207 53 240 +110.6 +/- 13.73 0 8 84 154 4 +240.82 +/- 37.4
165854 ncm-et-3 1294460 500 196 43 261 +109.83 +/- 13.4 0 8 83 157 2 +243.0 +/- 37.64
165853 ncm-et-10 1291371 500 206 61 233 +103.73 +/- 14.65 0 13 84 148 5 +219.87 +/- 37.42
165852 ncm-et-13 1298412 500 207 59 234 +106.01 +/- 15.12 0 14 81 148 7 +221.9 +/- 38.08
165851 ncm-et-9 1296801 500 188 46 266 +101.46 +/- 14.01 0 9 95 141 5 +213.85 +/- 35.03
165850 ncm-et-4 1299286 500 215 49 236 +119.89 +/- 14.99 1 7 77 155 10 +256.44 +/- 39.15
165849 ncm-et-15 1301527 500 194 62 244 +93.95 +/- 14.67 0 15 92 139 4 +196.45 +/- 35.72
165848 ncm-et-10 1300035 500 210 44 246 +119.89 +/- 14.51 0 9 74 159 8 +258.75 +/- 39.96
165847 ncm-et-13 1307828 500 207 49 244 +113.68 +/- 14.22 0 8 83 152 7 +243.0 +/- 37.64
165846 ncm-et-3 1300828 500 197 45 258 +109.07 +/- 14.21 0 11 80 155 4 +236.51 +/- 38.38
165845 ncm-et-9 1306989 500 201 61 238 +99.95 +/- 14.0 0 10 94 142 4 +211.87 +/- 35.26

Commit

Commit ID 5a30b087c3a3c4435e680e6c61082d5432fa0ace
Author MinetaS
Date 2023-02-03 19:07:56 UTC
Expand statistics tools for engine development This patch adds more debugging slots up to 32 per type and provide tools to calculate standard deviation and Pearson's correlation coefficient. However, due to slot being 0 at default, dbg_hit_on(c, b) has to be removed. Initial idea from snicolet/Stockfish@d8ab604 closes https://github.com/official-stockfish/Stockfish/pull/4354 No functional change
Copyright 2011–2024 Next Chess Move LLC