Dev Builds » 20240329-0909

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:47:14 1199657 4006 1738 325 1943 +128.05 +/- 4.79 4 42 536 1379 42 +292.28 +/- 14.73
ncm-dbt-02 11:43:16 1236104 3972 1755 261 1956 +137.43 +/- 4.81 2 37 474 1411 62 +316.83 +/- 15.67
ncm-dbt-03 11:44:41 1228330 4006 1756 348 1902 +127.55 +/- 4.77 2 43 547 1367 44 +289.34 +/- 14.58
ncm-dbt-05 11:44:23 1226644 3998 1762 293 1943 +133.92 +/- 4.88 1 50 486 1403 59 +305.35 +/- 15.46
ncm-dbt-06 11:46:37 1231607 4018 1780 294 1944 +134.89 +/- 4.75 0 42 496 1414 57 +309.15 +/- 15.31
20000 8791 1521 9688 +132.34 +/- 2.15 9 214 2539 6974 264 +302.36 +/- 6.76

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
339309 ncm-dbt-03 1224085 6 3 1 2 +120.22 +/- 109.7 0 0 1 2 0 +279.24 +/- 576.89
339308 ncm-dbt-01 1178813 6 3 0 3 +190.46 +/- 18.51 0 0 0 3 0 +1199.83 +/- 276.48
339307 ncm-dbt-06 1239461 18 8 2 8 +120.38 +/- 87.61 0 1 1 7 0 +279.59 +/- 559.02
339306 ncm-dbt-02 1245353 472 214 26 232 +146.49 +/- 12.87 0 2 51 176 7 +351.91 +/- 48.47
339305 ncm-dbt-05 1255602 498 228 46 224 +133.13 +/- 14.56 1 5 64 169 10 +297.8 +/- 43.09
339304 ncm-dbt-01 1202287 500 230 47 223 +133.34 +/- 13.63 1 5 59 180 5 +312.48 +/- 44.93
339303 ncm-dbt-03 1222640 500 219 40 241 +130.14 +/- 13.34 0 5 67 172 6 +295.94 +/- 42.08
339302 ncm-dbt-06 1221059 500 234 30 236 +150.51 +/- 13.24 0 3 51 185 11 +356.21 +/- 48.54
339301 ncm-dbt-02 1229090 500 214 24 262 +138.99 +/- 12.7 0 4 57 184 5 +330.23 +/- 45.79
339300 ncm-dbt-05 1224850 500 222 30 248 +140.62 +/- 13.24 0 3 61 177 9 +324.17 +/- 44.15
339299 ncm-dbt-01 1179427 500 221 37 242 +134.15 +/- 11.86 0 2 64 182 2 +321.19 +/- 42.95
339298 ncm-dbt-03 1220388 500 217 39 244 +129.35 +/- 13.17 0 4 70 170 6 +293.29 +/- 41.07
339297 ncm-dbt-06 1223142 500 218 37 245 +131.74 +/- 14.03 0 8 60 175 7 +298.62 +/- 44.44
339296 ncm-dbt-02 1230078 500 214 41 245 +125.39 +/- 14.3 1 5 72 164 8 +277.93 +/- 40.53
339295 ncm-dbt-05 1217787 500 210 43 247 +120.67 +/- 13.15 0 8 68 173 1 +277.93 +/- 41.74
339294 ncm-dbt-01 1197880 500 209 41 250 +121.45 +/- 13.31 0 8 68 172 2 +277.93 +/- 41.74
339293 ncm-dbt-03 1228751 500 223 38 239 +134.95 +/- 13.41 1 3 62 178 6 +315.35 +/- 43.81
339292 ncm-dbt-06 1239555 500 215 37 248 +129.35 +/- 13.36 0 5 68 171 6 +293.29 +/- 41.75
339291 ncm-dbt-02 1233533 500 218 37 245 +131.74 +/- 14.03 0 6 66 169 9 +293.29 +/- 42.41
339290 ncm-dbt-05 1234199 500 218 25 257 +141.44 +/- 13.59 0 5 56 180 9 +327.18 +/- 46.19
339289 ncm-dbt-01 1226654 500 208 42 250 +119.89 +/- 14.35 0 10 70 164 6 +263.42 +/- 41.06
339288 ncm-dbt-03 1224355 500 221 53 226 +121.46 +/- 14.83 1 11 62 171 5 +273.0 +/- 43.39
339287 ncm-dbt-06 1210805 500 230 34 236 +143.89 +/- 13.7 0 5 54 181 10 +333.32 +/- 47.06
339286 ncm-dbt-02 1238328 500 214 41 245 +125.38 +/- 13.96 0 7 70 166 7 +277.93 +/- 41.14
339285 ncm-dbt-05 1215250 500 216 41 243 +126.97 +/- 13.94 0 8 65 171 6 +285.49 +/- 42.7
339284 ncm-dbt-01 1211162 500 212 46 242 +119.89 +/- 14.68 2 6 72 164 6 +268.17 +/- 40.54
339283 ncm-dbt-03 1235164 500 219 42 239 +128.55 +/- 13.01 0 6 64 177 3 +298.62 +/- 43.1
339282 ncm-dbt-06 1242508 500 224 49 227 +126.97 +/- 12.66 0 1 79 164 6 +285.49 +/- 38.15
339281 ncm-dbt-02 1226930 500 227 32 241 +143.07 +/- 13.54 0 4 57 179 10 +330.23 +/- 45.79
339280 ncm-dbt-05 1226851 500 217 40 243 +128.55 +/- 14.26 0 9 62 172 7 +288.06 +/- 43.65
339279 ncm-dbt-06 1228957 500 223 41 236 +132.54 +/- 13.83 0 7 61 175 7 +301.33 +/- 44.13
339278 ncm-dbt-01 1167337 500 220 38 242 +132.54 +/- 12.91 0 4 65 176 5 +306.84 +/- 42.73
339277 ncm-dbt-03 1241338 500 209 46 245 +117.55 +/- 12.82 0 6 76 167 1 +268.17 +/- 39.39
339276 ncm-dbt-02 1238533 500 234 36 230 +145.54 +/- 14.2 1 5 49 185 10 +342.85 +/- 49.35
339275 ncm-dbt-03 1238412 500 224 39 237 +134.95 +/- 14.48 0 6 65 167 12 +295.94 +/- 42.75
339274 ncm-dbt-05 1207695 500 224 37 239 +136.56 +/- 13.73 0 6 59 177 8 +312.48 +/- 44.93
339273 ncm-dbt-06 1245669 500 210 32 258 +129.35 +/- 12.61 0 3 70 173 4 +298.62 +/- 41.01
339272 ncm-dbt-01 1195483 500 217 38 245 +130.14 +/- 13.52 0 4 71 167 8 +290.66 +/- 40.76
339271 ncm-dbt-03 1219845 500 221 50 229 +123.81 +/- 12.73 0 2 80 163 5 +277.93 +/- 38.02
339270 ncm-dbt-06 1233310 500 218 32 250 +135.76 +/- 13.94 0 9 52 183 6 +315.35 +/- 47.52
339269 ncm-dbt-02 1246994 500 220 24 256 +143.89 +/- 12.71 0 4 52 188 6 +346.12 +/- 48.03
339268 ncm-dbt-05 1230920 500 227 31 242 +143.89 +/- 13.7 0 6 51 184 9 +336.46 +/- 48.37
339267 ncm-dbt-01 1237878 500 218 36 246 +132.54 +/- 13.83 1 3 67 171 8 +301.33 +/- 42.04

Commit

Commit ID e636f73ab83da13fd352658e1eeecd369479c491
Author xoto10
Date 2024-03-29 09:09:42 UTC
Vary time use with eval Adjust time use depending on the current eval. Passed STC : LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 101696 W: 26651 L: 26238 D: 48807 Ptnml(0-2): 400, 11602, 26459, 11959, 428 https://tests.stockfishchess.org/tests/live_elo/660187a50ec64f0526c557f6 Passed LTC : LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 60648 W: 15550 L: 15187 D: 29911 Ptnml(0-2): 40, 6356, 17171, 6715, 42 https://tests.stockfishchess.org/tests/live_elo/660298ed0ec64f0526c566d0 Values were found using two tunes with the final values taken from the ltc tune after 62k games : stc - https://tests.stockfishchess.org/tests/view/65fb526b0ec64f0526c50694 ltc - https://tests.stockfishchess.org/tests/view/65fd36e60ec64f0526c5214b Ideas for future work; * tune these values with the other TM adjustments * try narrower bands * calculate adjustment for exact eval by interpolation closes https://github.com/official-stockfish/Stockfish/pull/5138 No functional change
Copyright 2011–2024 Next Chess Move LLC