Dev Builds » 20231107-0728

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 12:04:47 1207413 4020 1705 340 1975 +122.85 +/- 4.73 0 46 593 1331 40 +274.96 +/- 13.99
ncm-dbt-02 11:57:00 1208075 3980 1724 323 1933 +127.76 +/- 4.83 0 53 529 1362 46 +288.65 +/- 14.82
ncm-dbt-03 12:01:34 1231632 4022 1765 338 1919 +128.87 +/- 4.86 1 41 563 1342 64 +286.95 +/- 14.36
ncm-dbt-05 11:57:56 1232179 3964 1725 338 1901 +126.93 +/- 4.83 2 40 559 1331 50 +285.22 +/- 14.41
ncm-dbt-06 12:03:32 1228135 4014 1743 305 1966 +130.24 +/- 4.81 2 44 527 1382 52 +295.66 +/- 14.85
20000 8662 1644 9694 +127.32 +/- 2.15 5 224 2771 6748 252 +286.2 +/- 6.47

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
208498 ncm-dbt-06 1223767 14 3 2 9 +24.85 +/- 84.38 0 1 4 2 0 +49.98 +/- 184.5
208497 ncm-dbt-03 1233349 22 10 4 8 +97.17 +/- 102.32 0 2 2 6 1 +170.39 +/- 273.69
208496 ncm-dbt-01 1227860 20 9 2 9 +126.91 +/- 57.06 0 0 3 7 0 +301.22 +/- 341.95
208495 ncm-dbt-05 1233502 464 203 42 219 +125.77 +/- 13.49 0 5 64 160 3 +288.73 +/- 43.06
208494 ncm-dbt-02 1200039 480 209 37 234 +130.28 +/- 13.7 0 5 64 165 6 +295.72 +/- 43.08
208493 ncm-dbt-06 1248347 500 233 43 224 +138.99 +/- 14.74 1 5 59 173 12 +312.48 +/- 44.93
208492 ncm-dbt-03 1214117 500 206 38 256 +121.46 +/- 13.31 1 3 77 165 4 +275.45 +/- 39.01
208491 ncm-dbt-01 1231276 500 209 45 246 +118.33 +/- 13.7 0 8 74 164 4 +263.42 +/- 39.97
208490 ncm-dbt-05 1230764 500 211 40 249 +123.81 +/- 13.63 0 6 73 165 6 +275.45 +/- 40.24
208489 ncm-dbt-02 1193160 500 214 43 243 +123.81 +/- 14.32 0 10 65 169 6 +275.45 +/- 42.59
208488 ncm-dbt-03 1236176 500 223 38 239 +134.95 +/- 13.22 0 4 64 175 7 +309.64 +/- 43.08
208487 ncm-dbt-06 1227525 500 218 30 252 +137.37 +/- 13.15 0 4 61 178 7 +318.25 +/- 44.18
208486 ncm-dbt-01 1191781 500 215 34 251 +131.74 +/- 13.85 0 6 65 171 8 +295.94 +/- 42.75
208485 ncm-dbt-02 1197234 500 216 31 253 +134.95 +/- 13.41 0 6 59 179 6 +312.48 +/- 44.93
208484 ncm-dbt-05 1229922 500 227 44 229 +133.34 +/- 15.02 1 7 61 170 11 +295.94 +/- 44.08
208483 ncm-dbt-03 1235077 500 221 37 242 +134.15 +/- 13.43 0 4 66 172 8 +304.07 +/- 42.38
208482 ncm-dbt-06 1203089 500 213 35 252 +129.35 +/- 12.61 0 3 70 173 4 +298.62 +/- 41.01
208481 ncm-dbt-01 1229122 500 209 40 251 +122.24 +/- 13.12 0 4 78 163 5 +273.0 +/- 38.74
208480 ncm-dbt-02 1205115 500 217 39 244 +129.35 +/- 12.41 0 3 69 175 3 +301.33 +/- 41.33
208479 ncm-dbt-05 1231131 500 215 34 251 +131.74 +/- 12.74 0 2 71 171 6 +301.33 +/- 40.6
208478 ncm-dbt-03 1238873 500 218 44 238 +126.17 +/- 13.6 0 3 79 159 9 +275.45 +/- 38.39
208477 ncm-dbt-06 1219121 500 215 47 238 +121.45 +/- 14.98 0 13 63 167 7 +265.78 +/- 42.97
208476 ncm-dbt-01 1227065 500 216 46 238 +123.02 +/- 12.93 0 4 76 166 4 +277.93 +/- 39.29
208475 ncm-dbt-02 1208372 500 218 35 247 +133.34 +/- 13.45 0 7 58 180 5 +309.64 +/- 45.27
208474 ncm-dbt-05 1231185 500 221 42 237 +130.14 +/- 13.16 0 5 66 174 5 +298.62 +/- 42.41
208473 ncm-dbt-03 1236745 500 231 43 226 +137.37 +/- 13.15 0 1 70 169 10 +309.64 +/- 40.79
208472 ncm-dbt-06 1231326 500 220 42 238 +129.35 +/- 12.41 0 3 69 175 3 +301.33 +/- 41.33
208471 ncm-dbt-01 1205213 500 212 46 242 +119.89 +/- 13.51 0 8 71 168 3 +270.57 +/- 40.83
208470 ncm-dbt-02 1198662 500 218 40 242 +129.35 +/- 13.54 0 5 69 169 7 +290.66 +/- 41.43
208469 ncm-dbt-03 1248078 500 216 35 249 +131.74 +/- 14.03 0 8 60 175 7 +298.62 +/- 44.44
208468 ncm-dbt-05 1236231 500 216 43 241 +125.38 +/- 13.07 0 6 68 173 3 +288.06 +/- 41.76
208467 ncm-dbt-06 1241001 500 212 39 249 +125.38 +/- 13.61 0 7 68 170 5 +282.94 +/- 41.76
208466 ncm-dbt-01 1172401 500 203 36 261 +120.67 +/- 12.97 0 4 79 163 4 +270.57 +/- 38.47
208465 ncm-dbt-02 1240845 500 213 52 235 +116.0 +/- 13.71 0 8 77 161 4 +256.44 +/- 39.15
208464 ncm-dbt-03 1233807 500 226 49 225 +128.55 +/- 15.24 0 8 71 157 14 +270.57 +/- 40.83
208463 ncm-dbt-05 1220872 500 208 43 249 +119.11 +/- 14.19 1 5 79 158 7 +261.07 +/- 38.58
208462 ncm-dbt-06 1234186 500 217 34 249 +133.34 +/- 13.26 0 4 66 173 7 +304.07 +/- 42.38
208461 ncm-dbt-01 1194743 500 211 47 242 +118.33 +/- 13.52 0 6 79 160 5 +261.07 +/- 38.58
208460 ncm-dbt-02 1221180 500 219 46 235 +125.38 +/- 14.63 0 9 68 164 9 +273.0 +/- 41.7
208459 ncm-dbt-03 1208467 500 214 50 236 +118.33 +/- 13.7 0 8 74 164 4 +263.42 +/- 39.97
208458 ncm-dbt-05 1243829 500 224 50 226 +126.17 +/- 13.77 0 4 77 160 9 +275.45 +/- 39.01
208457 ncm-dbt-06 1224853 500 212 33 255 +130.15 +/- 13.88 1 4 67 171 7 +295.94 +/- 42.08
208456 ncm-dbt-01 1187260 500 221 44 235 +128.55 +/- 13.73 0 6 68 169 7 +288.06 +/- 41.76

Commit

Commit ID 80b0e3754303c44bdcc53c01339a955d5677cd64
Author Stefan Geschwentner
Date 2023-11-07 07:28:43 UTC
Double weight of pawn history for quiet move ordering. I measured on my 1000 position bench the average additional added pawn history per depth. This shows on average negative value with even smaller values with increaing depth. A linear regression against depth get following formula: -1960 - 130 * depth For compensation add this to the used sort limit to maintain roughly the same proportion of sorted quiet moves. Remarks: 1. using no compensation failed here https://tests.stockfishchess.org/tests/view/6547664f136acbc5735265f0 2. using only the compensation failed at LTC: passed STC: https://tests.stockfishchess.org/tests/view/65477457136acbc5735266f8 failed LTC: https://tests.stockfishchess.org/tests/view/65487fc8136acbc573527d1c STC: LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 98528 W: 25109 L: 24699 D: 48720 Ptnml(0-2): 334, 11586, 25009, 12006, 329 https://tests.stockfishchess.org/tests/view/65475873136acbc5735264f7 LTC: LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 69726 W: 17467 L: 17073 D: 35186 Ptnml(0-2): 39, 7814, 18769, 8196, 45 https://tests.stockfishchess.org/tests/view/6547e759136acbc573527071 closes https://github.com/official-stockfish/Stockfish/pull/4866 Bench: 1379422
Copyright 2011–2024 Next Chess Move LLC