Dev Builds » 20231210-2223

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 14:47:24 1103364 5022 2188 449 2385 +125.5 +/- 4.32 2 53 726 1664 66 +279.84 +/- 12.64
ncm-dbt-02 14:45:40 1233164 4974 2127 389 2458 +126.74 +/- 4.22 0 57 683 1699 48 +287.76 +/- 13.04
ncm-dbt-03 14:51:24 1232483 5028 2158 384 2486 +128.09 +/- 4.3 0 52 710 1678 74 +285.63 +/- 12.78
ncm-dbt-05 14:43:04 1228042 4976 2159 392 2425 +128.99 +/- 4.18 0 44 690 1697 57 +292.83 +/- 12.96
20000 8632 1614 9754 +127.32 +/- 2.13 2 206 2809 6738 245 +286.45 +/- 6.42

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
211380 ncm-dbt-01 1112620 22 7 1 14 +97.15 +/- 74.11 0 0 6 4 1 +170.33 +/- 140.48
211379 ncm-dbt-03 1230684 28 11 1 16 +129.76 +/- 47.61 0 0 4 10 0 +311.17 +/- 229.57
211378 ncm-dbt-05 1208277 476 208 41 227 +127.3 +/- 13.64 0 6 63 165 4 +291.23 +/- 43.43
211377 ncm-dbt-02 1221059 474 195 35 244 +122.06 +/- 14.14 0 8 65 160 4 +274.36 +/- 42.7
211376 ncm-dbt-01 1092884 500 221 39 240 +132.54 +/- 14.18 0 4 72 162 12 +288.06 +/- 40.46
211375 ncm-dbt-03 1212100 500 210 43 247 +120.67 +/- 14.01 0 7 76 160 7 +263.42 +/- 39.41
211374 ncm-dbt-05 1234891 500 219 35 246 +134.15 +/- 13.24 0 4 65 174 7 +306.84 +/- 42.73
211373 ncm-dbt-02 1242095 500 215 45 240 +123.02 +/- 12.93 0 4 76 166 4 +277.93 +/- 39.29
211372 ncm-dbt-01 1095242 500 215 51 234 +118.33 +/- 12.99 1 4 76 168 1 +273.0 +/- 39.35
211371 ncm-dbt-03 1223348 500 212 43 245 +122.24 +/- 13.3 0 6 73 167 4 +275.45 +/- 40.24
211370 ncm-dbt-05 1221097 500 220 47 233 +125.38 +/- 13.79 0 6 72 165 7 +277.93 +/- 40.53
211369 ncm-dbt-02 1225515 500 204 36 260 +121.45 +/- 13.14 0 3 82 159 6 +268.17 +/- 37.61
211368 ncm-dbt-01 1092831 500 199 44 257 +111.37 +/- 14.22 0 8 86 149 7 +236.51 +/- 36.93
211367 ncm-dbt-03 1241482 500 210 42 248 +121.45 +/- 13.49 0 5 78 161 6 +268.17 +/- 38.8
211366 ncm-dbt-05 1235226 500 215 42 243 +125.38 +/- 12.89 0 3 76 166 5 +282.94 +/- 39.21
211365 ncm-dbt-02 1219070 500 220 33 247 +136.56 +/- 13.55 0 6 58 179 7 +315.35 +/- 45.33
211364 ncm-dbt-01 1109944 500 221 53 226 +121.45 +/- 13.84 0 7 74 163 6 +268.17 +/- 39.97
211363 ncm-dbt-03 1246048 500 214 38 248 +127.76 +/- 13.02 0 3 74 167 6 +288.06 +/- 39.79
211362 ncm-dbt-05 1226353 500 215 34 251 +131.74 +/- 12.93 0 4 66 175 5 +304.07 +/- 42.38
211361 ncm-dbt-02 1230315 500 220 39 241 +131.74 +/- 12.93 0 4 66 175 5 +304.07 +/- 42.38
211360 ncm-dbt-01 1095196 500 217 54 229 +117.55 +/- 14.04 0 9 74 162 5 +258.75 +/- 39.96
211359 ncm-dbt-03 1223592 500 211 27 262 +134.15 +/- 13.05 0 3 67 173 7 +306.84 +/- 41.99
211358 ncm-dbt-05 1242362 500 218 39 243 +130.14 +/- 12.59 0 5 63 180 2 +306.84 +/- 43.45
211357 ncm-dbt-02 1248483 500 211 35 254 +127.76 +/- 12.84 0 6 64 178 2 +298.62 +/- 43.1
211356 ncm-dbt-01 1115469 500 219 46 235 +125.38 +/- 13.79 0 6 72 165 7 +277.93 +/- 40.53
211355 ncm-dbt-03 1240687 500 222 30 248 +140.62 +/- 13.43 0 5 56 181 8 +327.18 +/- 46.19
211354 ncm-dbt-05 1225750 500 211 40 249 +123.81 +/- 12.92 0 5 72 170 3 +282.94 +/- 40.5
211353 ncm-dbt-01 1113966 500 233 38 229 +143.07 +/- 12.75 0 2 59 181 8 +336.46 +/- 44.87
211352 ncm-dbt-02 1231107 500 223 41 236 +132.54 +/- 12.91 0 5 62 179 4 +309.64 +/- 43.82
211351 ncm-dbt-03 1235052 500 212 37 251 +126.97 +/- 14.11 0 7 69 166 8 +280.42 +/- 41.44
211350 ncm-dbt-05 1234475 500 214 46 240 +121.45 +/- 13.49 0 5 78 161 6 +268.17 +/- 38.8
211349 ncm-dbt-01 1106641 500 221 44 235 +128.55 +/- 14.42 0 7 69 164 10 +280.42 +/- 41.44
211348 ncm-dbt-02 1238080 500 204 40 256 +118.33 +/- 13.17 0 6 77 164 3 +265.78 +/- 39.12
211347 ncm-dbt-03 1231808 500 214 41 245 +125.38 +/- 14.13 0 8 68 167 7 +277.93 +/- 41.74
211346 ncm-dbt-05 1217164 500 215 40 245 +126.97 +/- 13.94 0 5 74 162 9 +277.93 +/- 39.92
211345 ncm-dbt-01 1098897 500 221 34 245 +136.56 +/- 12.39 0 3 61 182 4 +324.17 +/- 44.15
211344 ncm-dbt-02 1216497 500 220 46 234 +126.17 +/- 14.62 0 8 70 162 10 +273.0 +/- 41.13
211343 ncm-dbt-03 1235904 500 226 47 227 +130.14 +/- 14.23 0 3 78 156 13 +277.93 +/- 38.66
211342 ncm-dbt-05 1234828 500 224 28 248 +143.89 +/- 12.71 0 1 61 179 9 +336.46 +/- 43.96
211341 ncm-dbt-01 1103323 500 214 45 241 +122.24 +/- 13.48 1 3 77 164 5 +275.45 +/- 39.01
211340 ncm-dbt-02 1259420 500 215 39 246 +127.76 +/- 13.21 0 7 63 177 3 +295.94 +/- 43.42
211339 ncm-dbt-03 1236614 500 216 35 249 +131.74 +/- 13.67 0 5 67 170 8 +295.94 +/- 42.08

Commit

Commit ID 36db936e769a2e7a95fc4032eec3b79251bbaef5
Author Muzhen Gaming
Date 2023-12-10 22:23:28 UTC
VLTC Search parameters tune The SPSA tuning was done for 44k games at 120+1.2. https://tests.stockfishchess.org/tests/view/656ee2a76980e15f69c7767f. Note that the tune was originally done in combination with the recent dual NNUE idea (see #4910). VLTC: https://tests.stockfishchess.org/tests/view/65731ccbf09ce1261f12246e LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 52806 W: 13069 L: 12760 D: 26977 Ptnml(0-2): 19, 5498, 15056, 5815, 15 VLTC SMP: https://tests.stockfishchess.org/tests/view/65740ffaf09ce1261f1239ba LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 27630 W: 6934 L: 6651 D: 14045 Ptnml(0-2): 1, 2643, 8243, 2928, 0 Estimated close to neutral at LTC: https://tests.stockfishchess.org/tests/view/6575485a8ec68176cf7d9423 Elo: -0.59 ± 1.8 (95%) LOS: 26.6% Total: 32060 W: 7859 L: 7913 D: 16288 Ptnml(0-2): 20, 3679, 8676, 3645, 10 nElo: -1.21 ± 3.8 (95%) PairsRatio: 0.99 closes https://github.com/official-stockfish/Stockfish/pull/4912 Bench: 1283323
Copyright 2011–2024 Next Chess Move LLC