Dev Builds » 20231219-1722

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:53:40 1223866 3360 1474 260 1626 +131.47 +/- 5.09 1 27 449 1163 40 +300.93 +/- 16.08
ncm-dbt-02 09:49:40 1229730 3316 1426 255 1635 +128.21 +/- 5.29 0 43 440 1136 39 +289.85 +/- 16.26
ncm-dbt-03 09:53:35 1239214 3326 1409 219 1698 +130.06 +/- 5.15 0 23 475 1117 48 +292.44 +/- 15.6
ncm-dbt-04 09:53:04 1231417 3340 1448 275 1617 +127.44 +/- 5.36 1 42 456 1125 46 +285.14 +/- 15.97
ncm-dbt-05 09:49:36 1226097 3322 1437 277 1608 +126.65 +/- 5.39 1 38 473 1098 51 +280.59 +/- 15.67
ncm-dbt-06 09:53:23 1232174 3336 1428 244 1664 +128.92 +/- 5.31 0 40 451 1130 47 +289.14 +/- 16.06
20000 8622 1530 9848 +128.79 +/- 2.15 3 213 2744 6769 271 +289.62 +/- 6.5

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
243814 ncm-dbt-05 1209903 322 142 26 154 +131.04 +/- 17.62 1 4 37 116 3 +306.89 +/- 57.06
243813 ncm-dbt-02 1225309 316 142 20 154 +141.47 +/- 16.78 0 4 32 118 4 +335.54 +/- 61.66
243812 ncm-dbt-03 1227491 326 135 22 169 +125.63 +/- 16.58 0 2 51 105 5 +277.04 +/- 48.06
243811 ncm-dbt-06 1256806 336 145 29 162 +125.08 +/- 17.22 0 4 50 108 6 +272.25 +/- 48.83
243810 ncm-dbt-04 1238700 340 149 26 165 +131.65 +/- 18.17 0 6 43 113 8 +285.79 +/- 52.75
243809 ncm-dbt-01 1243506 360 154 23 183 +132.5 +/- 16.57 0 2 54 115 9 +286.63 +/- 46.71
243808 ncm-dbt-05 1227202 500 211 38 251 +125.38 +/- 12.89 0 3 76 166 5 +282.94 +/- 39.21
243807 ncm-dbt-02 1232616 500 215 29 256 +135.76 +/- 13.39 0 7 55 183 5 +318.25 +/- 46.48
243806 ncm-dbt-03 1211759 500 208 34 258 +126.17 +/- 13.06 0 4 73 168 5 +285.49 +/- 40.16
243805 ncm-dbt-06 1238062 500 211 41 248 +123.02 +/- 13.99 0 7 73 163 7 +270.57 +/- 40.25
243804 ncm-dbt-04 1213815 500 213 41 246 +124.6 +/- 13.62 0 7 69 169 5 +280.42 +/- 41.44
243803 ncm-dbt-01 1222397 500 212 32 256 +130.94 +/- 12.76 0 3 69 173 5 +301.33 +/- 41.33
243802 ncm-dbt-02 1222490 500 215 41 244 +126.17 +/- 12.68 0 3 74 169 4 +288.06 +/- 39.79
243801 ncm-dbt-03 1258928 500 218 23 259 +143.07 +/- 13.34 0 4 56 181 9 +333.32 +/- 46.21
243800 ncm-dbt-04 1223963 500 212 46 242 +119.89 +/- 13.16 0 6 75 166 3 +270.57 +/- 39.67
243799 ncm-dbt-05 1217135 500 208 39 253 +122.24 +/- 13.83 0 7 73 164 6 +270.57 +/- 40.25
243798 ncm-dbt-06 1225939 500 208 43 249 +119.11 +/- 14.19 0 8 76 159 7 +258.75 +/- 39.42
243797 ncm-dbt-01 1192244 500 215 38 247 +128.55 +/- 13.56 0 7 64 174 5 +293.29 +/- 43.07
243796 ncm-dbt-05 1223218 500 227 44 229 +133.34 +/- 14.51 0 7 64 168 11 +293.29 +/- 43.07
243795 ncm-dbt-06 1236669 500 216 35 249 +131.74 +/- 13.49 0 6 63 175 6 +301.33 +/- 43.45
243794 ncm-dbt-02 1229770 500 209 36 255 +125.38 +/- 14.13 0 7 71 164 8 +275.45 +/- 40.84
243793 ncm-dbt-03 1238078 500 216 29 255 +136.56 +/- 13.92 0 5 63 172 10 +306.84 +/- 43.45
243792 ncm-dbt-04 1250646 500 224 42 234 +132.54 +/- 14.7 0 9 60 171 10 +293.29 +/- 44.36
243791 ncm-dbt-01 1202500 500 224 49 227 +126.97 +/- 13.22 0 3 76 164 7 +282.94 +/- 39.21
243790 ncm-dbt-05 1231622 500 222 48 230 +126.17 +/- 14.62 0 9 67 165 9 +275.45 +/- 42.01
243789 ncm-dbt-04 1232146 500 214 37 249 +128.55 +/- 13.19 0 5 68 172 5 +293.29 +/- 41.75
243788 ncm-dbt-06 1214344 500 220 36 244 +134.15 +/- 13.97 0 5 66 169 10 +298.62 +/- 42.41
243787 ncm-dbt-02 1228327 500 221 39 240 +132.54 +/- 13.1 0 5 63 177 5 +306.84 +/- 43.45
243786 ncm-dbt-03 1252779 500 214 40 246 +126.17 +/- 12.87 0 3 75 167 5 +285.49 +/- 39.5
243785 ncm-dbt-01 1246250 500 227 37 236 +138.99 +/- 12.9 1 4 52 190 3 +339.63 +/- 47.98
243784 ncm-dbt-05 1240943 500 214 42 244 +124.6 +/- 14.31 0 6 76 158 10 +268.17 +/- 39.39
243783 ncm-dbt-04 1224518 500 220 45 235 +126.97 +/- 14.28 1 4 73 163 9 +280.42 +/- 40.21
243782 ncm-dbt-02 1246192 500 212 44 244 +121.45 +/- 14.01 0 8 72 164 6 +268.17 +/- 40.54
243781 ncm-dbt-06 1227795 500 216 30 254 +135.76 +/- 12.62 0 2 66 176 6 +315.35 +/- 42.24
243780 ncm-dbt-01 1214149 500 219 39 242 +130.94 +/- 13.32 0 5 66 173 6 +298.62 +/- 42.41
243779 ncm-dbt-03 1227479 500 210 37 253 +125.38 +/- 12.89 0 2 79 163 6 +280.42 +/- 38.28
243778 ncm-dbt-05 1232656 500 213 40 247 +125.38 +/- 13.07 0 2 80 161 7 +277.93 +/- 38.02
243777 ncm-dbt-04 1236136 500 216 38 246 +129.35 +/- 13.36 0 5 68 171 6 +293.29 +/- 41.75
243776 ncm-dbt-02 1223410 500 212 46 242 +119.89 +/- 14.35 0 9 73 161 7 +261.07 +/- 40.24
243775 ncm-dbt-06 1225603 500 212 30 258 +132.54 +/- 13.65 0 8 57 180 5 +306.84 +/- 45.58
243774 ncm-dbt-01 1246019 500 223 42 235 +131.74 +/- 12.74 0 3 68 174 5 +304.07 +/- 41.65
243773 ncm-dbt-03 1257988 500 208 34 258 +126.17 +/- 13.42 0 3 78 161 8 +277.93 +/- 38.66

Commit

Commit ID d9ec82e7438716671168d78eee26fae327249e8c
Author Michael Chaly
Date 2023-12-19 17:22:10 UTC
Adjust stand pat in qsearch on pv nodes Instead of immediately returning a fail high do this only at non-pv nodes, for pv nodes adjust bestValue to value between alpha and beta and continue searching. Idea is to do it the same way as it's done in search where we don't return positive beta cutoffs after ttHits / zero window search at PvNodes and instead fully search lines. Passed STC: https://tests.stockfishchess.org/tests/view/65739b0af09ce1261f122f33 LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 189216 W: 48142 L: 47598 D: 93476 Ptnml(0-2): 584, 22463, 48051, 22845, 665 Passed LTC: https://tests.stockfishchess.org/tests/view/657701214d789acf40aac194 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 82506 W: 20689 L: 20269 D: 41548 Ptnml(0-2): 56, 9236, 22268, 9618, 75 Two issues had to be resolved: - in rare cases it set alpha to the same value as beta and thus broke some asserts; - messed up with returning tb win values. Fix passed non-regression LTC vs this patch: https://tests.stockfishchess.org/tests/view/6578113b4d789acf40aad544 LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 277308 W: 68839 L: 68880 D: 139589 Ptnml(0-2): 167, 31580, 75212, 31517, 178 closes https://github.com/official-stockfish/Stockfish/pull/4922 Bench: 1069503 Co-Authored-By: Muzhen Gaming <61100393+XInTheDark@users.noreply.github.com> Co-Authored-By: Shahin M. Shahin <41402573+peregrineshahin@users.noreply.github.com> Co-Authored-By: fffelix-huang <72808219+fffelix-huang@users.noreply.github.com>
Copyright 2011–2024 Next Chess Move LLC