Dev Builds » 20240117-1712

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:48:19 1180007 3332 1461 230 1641 +134.73 +/- 5.13 0 28 425 1167 46 +309.14 +/- 16.54
ncm-dbt-02 09:45:37 1232261 3322 1444 246 1632 +131.19 +/- 5.19 1 26 455 1132 47 +296.98 +/- 15.96
ncm-dbt-03 09:49:10 1237149 3354 1468 291 1595 +127.33 +/- 5.43 2 41 464 1118 52 +282.97 +/- 15.83
ncm-dbt-04 09:49:20 1227439 3344 1452 247 1645 +131.08 +/- 5.16 0 28 458 1139 47 +296.33 +/- 15.91
ncm-dbt-05 09:44:23 1238023 3296 1433 251 1612 +130.39 +/- 5.22 0 36 433 1140 39 +296.99 +/- 16.39
ncm-dbt-06 09:48:53 1230485 3352 1475 241 1636 +134.2 +/- 5.07 0 27 431 1175 43 +308.67 +/- 16.42
20000 8733 1506 9761 +131.48 +/- 2.12 3 186 2666 6871 274 +298.35 +/- 6.59

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
257524 ncm-dbt-05 1234664 296 120 17 159 +126.16 +/- 16.01 0 3 39 106 0 +298.58 +/- 55.65
257523 ncm-dbt-02 1220667 322 142 24 156 +133.53 +/- 18.22 1 2 43 108 7 +298.39 +/- 52.87
257522 ncm-dbt-01 1179239 332 143 26 163 +127.92 +/- 16.33 0 4 44 115 3 +292.46 +/- 52.27
257521 ncm-dbt-04 1255291 344 148 31 165 +123.07 +/- 15.75 0 3 52 114 3 +277.18 +/- 47.76
257520 ncm-dbt-06 1214317 352 158 28 166 +134.67 +/- 14.87 0 2 45 126 3 +316.5 +/- 51.6
257519 ncm-dbt-03 1221400 354 158 30 166 +131.57 +/- 16.79 0 5 45 121 6 +294.12 +/- 51.64
257518 ncm-dbt-05 1227758 500 218 42 240 +127.76 +/- 13.21 0 5 69 171 5 +290.66 +/- 41.43
257517 ncm-dbt-02 1234254 500 225 40 235 +134.95 +/- 12.84 0 3 65 176 6 +312.48 +/- 42.67
257516 ncm-dbt-01 1158907 500 221 36 243 +134.95 +/- 13.41 0 1 74 164 11 +298.62 +/- 39.56
257515 ncm-dbt-04 1211345 500 220 40 240 +130.94 +/- 13.32 0 4 69 170 7 +295.94 +/- 41.39
257514 ncm-dbt-03 1256966 500 226 45 229 +131.74 +/- 13.49 0 5 66 172 7 +298.62 +/- 42.41
257513 ncm-dbt-06 1261887 500 219 27 254 +140.62 +/- 12.64 0 3 58 183 6 +333.32 +/- 45.35
257512 ncm-dbt-02 1244312 500 206 40 254 +119.89 +/- 13.51 0 6 77 162 5 +265.78 +/- 39.12
257511 ncm-dbt-05 1252394 500 224 27 249 +144.71 +/- 12.68 0 4 51 189 6 +349.43 +/- 48.52
257510 ncm-dbt-01 1189219 500 216 38 246 +129.35 +/- 12.8 0 1 77 165 7 +290.66 +/- 38.7
257509 ncm-dbt-06 1231197 500 214 37 249 +128.55 +/- 13.56 0 5 70 168 7 +288.06 +/- 41.11
257508 ncm-dbt-03 1235136 500 228 42 230 +135.76 +/- 14.64 1 4 65 168 12 +301.33 +/- 42.75
257507 ncm-dbt-04 1227972 500 212 35 253 +128.55 +/- 13.01 0 5 67 174 4 +295.94 +/- 42.08
257506 ncm-dbt-05 1243571 500 217 45 238 +124.6 +/- 14.8 0 11 64 167 8 +273.0 +/- 42.83
257505 ncm-dbt-02 1218949 500 217 44 239 +125.38 +/- 14.13 0 6 74 161 9 +273.0 +/- 39.95
257504 ncm-dbt-01 1211378 500 212 28 260 +134.15 +/- 12.86 0 4 63 178 5 +312.48 +/- 43.44
257503 ncm-dbt-06 1214290 500 223 39 238 +134.15 +/- 13.97 0 3 72 163 12 +293.29 +/- 40.39
257502 ncm-dbt-04 1249260 500 225 35 240 +138.99 +/- 13.1 0 3 62 177 8 +321.19 +/- 43.77
257501 ncm-dbt-03 1230744 500 223 45 232 +129.35 +/- 14.24 0 6 70 164 10 +282.94 +/- 41.13
257500 ncm-dbt-05 1220764 500 217 37 246 +130.94 +/- 13.51 0 5 67 171 7 +295.94 +/- 42.08
257499 ncm-dbt-02 1240252 500 220 32 248 +137.37 +/- 12.36 0 0 69 174 7 +318.25 +/- 40.94
257498 ncm-dbt-06 1234002 500 216 41 243 +126.97 +/- 13.76 0 7 67 170 6 +285.49 +/- 42.08
257497 ncm-dbt-01 1166992 500 221 32 247 +138.18 +/- 13.12 0 6 54 185 5 +327.18 +/- 47.0
257496 ncm-dbt-04 1208771 500 206 32 262 +126.17 +/- 13.42 0 4 75 164 7 +280.42 +/- 39.57
257495 ncm-dbt-03 1232712 500 207 31 262 +127.76 +/- 13.21 0 7 63 177 3 +295.94 +/- 43.42
257494 ncm-dbt-05 1229451 500 220 37 243 +133.34 +/- 13.45 0 6 61 177 6 +306.84 +/- 44.17
257493 ncm-dbt-06 1230961 500 224 35 241 +138.18 +/- 12.53 0 3 60 182 5 +327.18 +/- 44.54
257492 ncm-dbt-01 1183814 500 226 35 239 +139.81 +/- 13.64 0 6 55 181 8 +324.17 +/- 46.56
257491 ncm-dbt-02 1233514 500 217 30 253 +136.56 +/- 13.92 0 5 63 172 10 +306.84 +/- 43.45
257490 ncm-dbt-04 1214048 500 221 41 238 +130.94 +/- 13.69 0 5 68 169 8 +293.29 +/- 41.75
257489 ncm-dbt-03 1250891 500 217 44 239 +125.39 +/- 14.63 1 6 71 163 9 +275.45 +/- 40.84
257488 ncm-dbt-05 1257559 500 217 46 237 +123.81 +/- 13.1 0 2 82 159 7 +273.0 +/- 37.5
257487 ncm-dbt-01 1170505 500 222 35 243 +136.56 +/- 13.55 0 6 58 179 7 +315.35 +/- 45.33
257486 ncm-dbt-02 1233884 500 217 36 247 +131.74 +/- 12.54 0 4 64 179 3 +309.64 +/- 43.08
257485 ncm-dbt-06 1226746 500 221 34 245 +136.56 +/- 12.59 0 4 59 183 4 +324.17 +/- 44.97
257484 ncm-dbt-03 1232198 500 209 54 237 +111.37 +/- 13.89 0 8 84 153 5 +240.82 +/- 37.4
257483 ncm-dbt-04 1225391 500 220 33 247 +136.56 +/- 13.73 0 4 65 171 10 +306.84 +/- 42.73

Commit

Commit ID 0c7f56dea6ee9a46a4be8481b2316711cb356f02
Author Shahin M. Shahin
Date 2024-01-17 17:12:16 UTC
Fix mated-in behaviour This addresses the issue where Stockfish may output non-proven checkmate scores if the search is prematurely halted, either due to a time control or node limit, before it explores other possibilities where the checkmate score could have been delayed or refuted. The fix also replaces staving off from proven mated scores in a multithread environment making use of the threads instead of a negative effect with multithreads (1t was better in proving mated in scores than more threads). Issue reported on mate tracker repo by and this PR is co-authored with @robertnurnberg Special thanks to @AndyGrant for outlining that a fix is eventually possible. Passed Adj off SMP STC: https://tests.stockfishchess.org/tests/view/65a125d779aa8af82b96c3eb LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 303256 W: 75823 L: 75892 D: 151541 Ptnml(0-2): 406, 35269, 80395, 35104, 454 Passed Adj off SMP LTC: https://tests.stockfishchess.org/tests/view/65a37add79aa8af82b96f0f7 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 56056 W: 13951 L: 13770 D: 28335 Ptnml(0-2): 11, 5910, 16002, 6097, 8 Passed all tests in matetrack without any better mate for opponent found in 1t and multithreads. Fixed bugs in https://github.com/official-stockfish/Stockfish/pull/4976 closes https://github.com/official-stockfish/Stockfish/pull/4990 Bench: 1308279 Co-Authored-By: Robert Nürnberg <28635489+robertnurnberg@users.noreply.github.com>
Copyright 2011–2024 Next Chess Move LLC