Dev Builds » 20231230-1119

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:52:36 1217041 3356 1460 277 1619 +127.96 +/- 5.34 1 43 451 1138 45 +287.28 +/- 16.06
ncm-dbt-02 09:42:09 1222143 3280 1415 244 1621 +129.75 +/- 5.28 1 32 446 1117 44 +293.16 +/- 16.14
ncm-dbt-03 09:56:09 1237937 3352 1450 232 1670 +132.29 +/- 5.19 0 33 438 1159 46 +300.84 +/- 16.29
ncm-dbt-04 09:52:36 1224483 3344 1453 281 1610 +127.16 +/- 5.38 1 33 488 1093 57 +280.09 +/- 15.41
ncm-dbt-05 09:45:59 1237519 3304 1448 239 1617 +133.31 +/- 5.19 0 29 432 1144 47 +303.65 +/- 16.4
ncm-dbt-06 09:52:37 1234656 3364 1454 257 1653 +129.28 +/- 5.4 0 48 440 1143 51 +288.93 +/- 16.26
20000 8680 1530 9790 +129.95 +/- 2.16 3 218 2695 6794 290 +292.17 +/- 6.56

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
243304 ncm-dbt-02 1206535 280 115 16 149 +128.38 +/- 16.93 0 2 39 97 2 +296.51 +/- 55.51
243303 ncm-dbt-05 1232575 304 133 20 151 +135.64 +/- 16.66 0 3 36 110 3 +318.02 +/- 58.11
243302 ncm-dbt-04 1224454 344 148 34 162 +119.66 +/- 18.15 1 7 45 115 4 +266.58 +/- 51.31
243301 ncm-dbt-03 1247692 352 157 30 165 +131.26 +/- 16.57 0 4 47 119 6 +292.96 +/- 50.51
243300 ncm-dbt-01 1180519 356 143 30 183 +114.22 +/- 15.54 0 4 59 113 2 +253.93 +/- 44.7
243299 ncm-dbt-06 1246516 364 163 30 171 +133.09 +/- 15.56 0 3 48 126 5 +303.59 +/- 49.94
243298 ncm-dbt-02 1223475 500 213 36 251 +128.55 +/- 12.82 0 2 75 167 6 +290.66 +/- 39.4
243297 ncm-dbt-05 1250049 500 227 43 230 +134.15 +/- 13.05 0 4 64 176 6 +309.64 +/- 43.08
243296 ncm-dbt-01 1238155 500 212 41 247 +123.81 +/- 12.92 0 5 72 170 3 +282.94 +/- 40.5
243295 ncm-dbt-04 1219369 500 207 37 256 +123.02 +/- 13.82 0 6 75 162 7 +270.57 +/- 39.67
243294 ncm-dbt-03 1229112 500 214 33 253 +131.74 +/- 14.03 0 6 66 169 9 +293.29 +/- 42.41
243293 ncm-dbt-06 1246832 500 217 36 247 +131.74 +/- 13.67 0 6 64 173 7 +298.62 +/- 43.1
243292 ncm-dbt-02 1258892 500 215 32 253 +133.34 +/- 13.45 0 5 64 174 7 +304.07 +/- 43.1
243291 ncm-dbt-05 1257931 500 229 39 232 +138.99 +/- 12.7 0 2 63 178 7 +324.17 +/- 43.32
243290 ncm-dbt-03 1260608 500 224 35 241 +138.18 +/- 14.06 0 5 62 172 11 +309.64 +/- 43.82
243289 ncm-dbt-04 1234396 500 209 34 257 +126.97 +/- 13.58 0 3 78 160 9 +277.93 +/- 38.66
243288 ncm-dbt-06 1231033 500 209 33 258 +127.76 +/- 13.75 0 7 66 171 6 +288.06 +/- 42.4
243287 ncm-dbt-01 1175473 500 214 42 244 +124.6 +/- 13.62 1 4 72 168 5 +282.94 +/- 40.5
243286 ncm-dbt-02 1218024 500 218 35 247 +133.34 +/- 13.63 0 5 65 172 8 +301.33 +/- 42.75
243285 ncm-dbt-05 1217396 500 217 35 248 +132.54 +/- 13.65 0 4 69 168 9 +295.94 +/- 41.39
243284 ncm-dbt-01 1250725 500 221 40 239 +131.74 +/- 14.71 0 10 58 173 9 +293.29 +/- 44.99
243283 ncm-dbt-06 1234581 500 219 40 241 +130.14 +/- 14.06 0 7 65 170 8 +290.66 +/- 42.73
243282 ncm-dbt-03 1236110 500 213 36 251 +128.55 +/- 12.63 0 4 68 175 3 +298.62 +/- 41.71
243281 ncm-dbt-04 1214596 500 225 45 230 +130.94 +/- 13.32 0 3 72 167 8 +293.29 +/- 40.39
243280 ncm-dbt-02 1219667 500 215 36 249 +130.14 +/- 13.34 0 5 67 172 6 +295.94 +/- 42.08
243279 ncm-dbt-05 1235077 500 219 29 252 +138.99 +/- 12.3 0 1 64 179 6 +327.18 +/- 42.83
243278 ncm-dbt-06 1232053 500 217 40 243 +128.55 +/- 13.91 0 6 69 167 8 +285.49 +/- 41.44
243277 ncm-dbt-01 1249191 500 224 41 235 +133.34 +/- 14.68 0 8 62 169 11 +293.29 +/- 43.72
243276 ncm-dbt-04 1246318 500 221 39 240 +132.54 +/- 13.83 0 4 70 166 10 +293.29 +/- 41.07
243275 ncm-dbt-03 1234925 500 219 24 257 +143.07 +/- 12.75 0 3 56 184 7 +339.63 +/- 46.2
243274 ncm-dbt-02 1209657 500 213 40 247 +125.39 +/- 14.13 1 7 65 172 5 +285.49 +/- 42.7
243273 ncm-dbt-05 1217361 500 219 39 242 +130.94 +/- 14.22 0 6 68 166 10 +288.06 +/- 41.76
243272 ncm-dbt-06 1221137 500 210 32 258 +129.35 +/- 14.07 0 6 69 166 9 +285.49 +/- 41.44
243271 ncm-dbt-04 1206844 500 213 48 239 +119.11 +/- 13.34 0 5 80 160 5 +263.42 +/- 38.27
243270 ncm-dbt-01 1249284 500 220 39 241 +131.74 +/- 13.85 0 6 65 171 8 +295.94 +/- 42.75
243269 ncm-dbt-03 1229064 500 211 33 256 +129.35 +/- 12.61 0 3 70 173 4 +298.62 +/- 41.01
243268 ncm-dbt-02 1218751 500 226 49 225 +128.55 +/- 14.26 0 6 71 163 10 +280.42 +/- 40.83
243267 ncm-dbt-05 1252245 500 204 34 262 +123.02 +/- 14.16 0 9 68 167 6 +273.0 +/- 41.7
243266 ncm-dbt-06 1230441 500 219 46 235 +125.38 +/- 15.12 0 13 59 170 8 +275.45 +/- 44.28
243265 ncm-dbt-04 1225405 500 230 44 226 +135.76 +/- 14.64 0 5 68 163 14 +293.29 +/- 41.75
243264 ncm-dbt-01 1175943 500 226 44 230 +132.54 +/- 13.65 0 6 63 174 7 +301.33 +/- 43.45
243263 ncm-dbt-03 1228052 500 212 41 247 +123.81 +/- 13.98 0 8 69 167 6 +275.45 +/- 41.43

Commit

Commit ID 1a69efbb404fd4389651ab9f45127fb012c0cf94
Author Shahin M. Shahin
Date 2023-12-30 11:19:48 UTC
Fix scores from reverse futility pruning This fixes futility pruning return values after recent tweaks, `eval` is guaranteed to be less than the mate-in range but it can be as low value such that the average between eval and beta can still fall in the mated-in range when beta is as low in mated range. i.e. (eval + beta) / 2 being at mated-range which can break mates. Passed non-regression STC: https://tests.stockfishchess.org/tests/view/658f3eed79aa8af82b955139 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 117408 W: 29891 L: 29761 D: 57756 Ptnml(0-2): 386, 13355, 31120, 13429, 414 Passed non-regression LTC: https://tests.stockfishchess.org/tests/view/658f8b7a79aa8af82b9557bd LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 60240 W: 14962 L: 14786 D: 30492 Ptnml(0-2): 22, 6257, 17390, 6425, 26 changes signature at higher depth e.g. `128 1 15` closes https://github.com/official-stockfish/Stockfish/pull/4944 Bench: 1304666
Copyright 2011–2024 Next Chess Move LLC