Dev Builds » 20240519-0737

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:37:04 1195454 4016 1758 310 1948 +131.17 +/- 4.72 0 38 537 1380 53 +297.76 +/- 14.71
ncm-dbt-02 11:29:43 1233698 3994 1780 317 1897 +133.46 +/- 4.68 0 36 513 1397 51 +306.19 +/- 15.05
ncm-dbt-03 11:34:13 1240675 4024 1770 291 1963 +133.96 +/- 4.75 1 34 524 1391 62 +304.6 +/- 14.89
ncm-dbt-05 11:31:35 1197331 3976 1752 285 1939 +134.53 +/- 4.86 0 37 518 1362 71 +302.84 +/- 14.98
ncm-dbt-06 11:34:18 1226374 3990 1756 320 1914 +130.9 +/- 4.76 1 33 548 1355 58 +295.43 +/- 14.55
20000 8816 1523 9661 +132.8 +/- 2.13 2 178 2640 6885 295 +301.33 +/- 6.62

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
368034 ncm-dbt-01 1188957 16 6 2 8 +88.68 +/- 65.24 0 0 4 4 0 +190.76 +/- 189.19
368033 ncm-dbt-03 1237284 24 11 3 10 +120.37 +/- 84.63 0 1 3 7 1 +231.91 +/- 271.45
368032 ncm-dbt-05 1195657 476 205 29 242 +134.85 +/- 14.06 0 4 63 162 9 +302.48 +/- 43.41
368031 ncm-dbt-06 1249095 490 219 37 234 +135.53 +/- 13.77 0 3 67 165 10 +302.73 +/- 41.97
368030 ncm-dbt-02 1228301 494 220 42 232 +131.07 +/- 14.16 0 6 66 166 9 +290.8 +/- 42.41
368029 ncm-dbt-01 1194692 500 229 35 236 +142.25 +/- 14.12 0 5 58 175 12 +321.19 +/- 45.36
368028 ncm-dbt-03 1233236 500 228 41 231 +136.56 +/- 13.17 0 1 71 168 10 +306.84 +/- 40.47
368027 ncm-dbt-05 1198272 500 214 46 240 +121.45 +/- 14.83 0 10 71 160 9 +261.07 +/- 40.78
368026 ncm-dbt-02 1222769 500 220 29 251 +139.81 +/- 12.87 0 4 57 183 6 +330.23 +/- 45.79
368025 ncm-dbt-06 1236532 500 217 33 250 +134.15 +/- 12.27 0 3 63 181 3 +318.25 +/- 43.39
368024 ncm-dbt-01 1202238 500 224 46 230 +129.35 +/- 13.72 0 7 64 173 6 +293.29 +/- 43.07
368023 ncm-dbt-03 1225428 500 214 28 258 +135.76 +/- 13.57 0 6 59 178 7 +312.48 +/- 44.93
368022 ncm-dbt-05 1198198 500 218 36 246 +132.54 +/- 13.65 0 6 63 174 7 +301.33 +/- 43.45
368021 ncm-dbt-02 1243873 500 222 42 236 +130.94 +/- 12.76 0 4 66 176 4 +304.07 +/- 42.38
368020 ncm-dbt-06 1225325 500 218 38 244 +130.94 +/- 14.04 0 4 73 162 11 +285.49 +/- 40.16
368019 ncm-dbt-03 1256715 500 211 36 253 +126.97 +/- 13.58 0 3 78 160 9 +277.93 +/- 38.66
368018 ncm-dbt-01 1231275 500 213 35 252 +129.35 +/- 12.61 0 2 73 170 5 +295.94 +/- 39.99
368017 ncm-dbt-02 1235121 500 223 36 241 +136.56 +/- 12.79 0 2 66 175 7 +315.35 +/- 42.24
368016 ncm-dbt-05 1196413 500 214 33 253 +131.74 +/- 13.12 0 3 70 170 7 +298.62 +/- 41.01
368015 ncm-dbt-06 1212917 500 219 52 229 +120.67 +/- 13.84 0 7 75 162 6 +265.78 +/- 39.69
368014 ncm-dbt-03 1250695 500 213 22 265 +139.81 +/- 12.67 0 4 56 185 5 +333.32 +/- 46.21
368013 ncm-dbt-01 1185006 500 220 32 248 +137.37 +/- 11.94 0 3 58 187 2 +333.32 +/- 45.35
368012 ncm-dbt-05 1190037 500 226 37 237 +138.18 +/- 13.32 0 4 61 177 8 +318.25 +/- 44.18
368011 ncm-dbt-02 1223962 500 219 39 242 +130.94 +/- 12.95 0 4 67 174 5 +301.33 +/- 42.04
368010 ncm-dbt-06 1210259 500 218 40 242 +129.35 +/- 12.8 0 2 74 168 6 +293.29 +/- 39.69
368009 ncm-dbt-03 1234662 500 222 43 235 +130.14 +/- 13.34 0 3 73 166 8 +290.66 +/- 40.08
368008 ncm-dbt-01 1196289 500 221 41 238 +130.94 +/- 13.87 0 4 72 164 10 +288.06 +/- 40.46
368007 ncm-dbt-05 1194380 500 227 42 231 +134.95 +/- 13.41 0 4 65 173 8 +306.84 +/- 42.73
368006 ncm-dbt-02 1232515 500 224 43 233 +131.74 +/- 13.12 0 5 64 176 5 +304.07 +/- 43.1
368005 ncm-dbt-06 1218939 500 221 36 243 +134.95 +/- 13.03 0 3 66 174 7 +309.64 +/- 42.33
368004 ncm-dbt-01 1189243 500 222 43 235 +130.14 +/- 13.52 0 2 77 161 10 +285.49 +/- 38.83
368003 ncm-dbt-03 1234085 500 215 45 240 +123.02 +/- 13.29 0 6 72 168 4 +277.93 +/- 40.53
368002 ncm-dbt-02 1233040 500 234 33 233 +148.02 +/- 12.32 0 1 55 186 8 +356.21 +/- 46.49
368001 ncm-dbt-05 1198075 500 239 24 237 +159.78 +/- 13.39 0 2 46 187 15 +381.7 +/- 51.25
368000 ncm-dbt-06 1218735 500 222 48 230 +126.18 +/- 14.12 1 5 70 167 7 +282.94 +/- 41.13
367999 ncm-dbt-03 1256389 500 229 40 231 +138.18 +/- 14.59 1 5 59 174 11 +312.48 +/- 44.93
367998 ncm-dbt-01 1190513 500 214 40 246 +126.17 +/- 14.12 0 10 61 174 5 +285.49 +/- 43.92
367997 ncm-dbt-02 1250007 500 218 53 229 +119.11 +/- 14.52 0 10 72 161 7 +258.75 +/- 40.49
367996 ncm-dbt-06 1239194 500 222 36 242 +135.76 +/- 13.76 0 6 60 176 8 +309.64 +/- 44.55
367995 ncm-dbt-05 1207619 500 209 38 253 +123.81 +/- 13.63 0 4 79 159 8 +270.57 +/- 38.47
367994 ncm-dbt-03 1237582 500 227 33 240 +142.25 +/- 13.18 0 5 53 185 7 +336.46 +/- 47.52
367993 ncm-dbt-01 1180873 500 209 36 255 +125.38 +/- 12.89 0 5 70 172 3 +288.06 +/- 41.11

Commit

Commit ID 2d3258162387bf38551962bf2c9dd1d47e72b4dd
Author Viren6
Date 2024-05-19 07:37:22 UTC
Revert "Simplify Away Quadruple Extensions" This reverts commit 4edd1a3 The unusual result of (combined) +12.0 +- 3.7 in the 2 VVLTC simplification SPRTs ran was the result of base having only 64MB of hash instead of 512MB (Asymmetric hash). Vizvezdenec was the one to notice this. closes https://github.com/official-stockfish/Stockfish/pull/5265 bench 1404295 Co-Authored-By: Michael Chaly <26898827+Vizvezdenec@users.noreply.github.com>
Copyright 2011–2024 Next Chess Move LLC