Dev Builds » 20210515-0807

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:43:45 582520 4000 330 1795 1875 -133.44 ± 4.93 81 1339 546 32 2 -296.61 ± 14.57
ncm-dbt-02 06:44:45 586516 4000 322 1793 1885 -134.05 ± 4.91 79 1350 534 37 0 -298.62 ± 14.75
ncm-dbt-03 06:45:12 584898 4016 346 1824 1846 -134.16 ± 5.07 88 1352 519 48 1 -296.43 ± 14.97
ncm-dbt-04 06:44:40 567014 4000 337 1790 1873 -132.24 ± 4.87 78 1329 561 32 0 -292.96 ± 14.37
ncm-dbt-05 06:45:23 581334 3984 318 1804 1862 -136.16 ± 5.06 91 1349 507 45 0 -301.54 ± 15.14
20000 1653 9006 9341 -134.01 ± 2.22 417 6719 2667 194 3 -297.21 ± 6.59

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
442276 ncm-dbt-03 583279 16 1 6 9 -112.26 ± 65.75 0 5 3 0 0 -254.61 ± 287.37
442275 ncm-dbt-05 584117 484 44 212 228 -125.82 ± 14.08 6 163 66 7 0 -281.32 ± 42.4
442274 ncm-dbt-04 566691 500 47 233 220 -135.76 ± 13.39 11 165 73 1 0 -301.33 ± 39.86
442273 ncm-dbt-02 584537 500 41 213 246 -124.6 ± 13.8 5 170 67 8 0 -280.42 ± 42.05
442272 ncm-dbt-01 579537 500 35 227 238 -140.62 ± 13.62 12 170 66 2 0 -315.35 ± 42.24
442271 ncm-dbt-03 583405 500 42 231 227 -138.18 ± 14.23 10 176 57 7 0 -312.48 ± 45.66
442270 ncm-dbt-05 578877 500 37 243 220 -152.18 ± 14.15 16 177 54 3 0 -346.12 ± 47.1
442269 ncm-dbt-01 583321 500 35 214 251 -130.14 ± 13.16 7 168 72 3 0 -293.29 ± 40.39
442268 ncm-dbt-04 566178 500 41 225 234 -134.15 ± 12.86 6 175 66 3 0 -309.64 ± 42.33
442267 ncm-dbt-02 586943 500 47 223 230 -127.76 ± 14.1 10 161 74 5 0 -277.93 ± 39.92
442266 ncm-dbt-03 586816 500 38 228 234 -138.99 ± 13.85 10 175 60 5 0 -315.35 ± 44.57
442265 ncm-dbt-05 585928 500 32 226 242 -142.25 ± 15.01 14 174 54 8 0 -315.35 ± 46.8
442264 ncm-dbt-01 581319 500 46 222 232 -127.76 ± 14.6 8 168 68 4 2 -288.06 ± 41.76
442263 ncm-dbt-04 565390 500 44 217 239 -125.38 ± 14.47 7 169 64 10 0 -277.93 ± 42.91
442262 ncm-dbt-02 585970 500 46 220 234 -126.17 ± 14.29 9 163 71 7 0 -275.45 ± 40.84
442261 ncm-dbt-03 587919 500 40 222 238 -132.54 ± 14.87 15 157 73 5 0 -280.42 ± 40.21
442260 ncm-dbt-05 578095 500 43 221 236 -129.35 ± 14.07 10 163 72 5 0 -282.94 ± 40.5
442259 ncm-dbt-04 565666 500 53 235 212 -132.54 ± 15.19 14 162 66 8 0 -282.94 ± 42.37
442258 ncm-dbt-02 585674 500 44 221 235 -128.55 ± 13.91 9 164 72 5 0 -282.94 ± 40.5
442257 ncm-dbt-01 581735 500 42 217 241 -126.97 ± 14.61 8 169 63 10 0 -280.42 ± 43.24
442256 ncm-dbt-03 587282 500 48 222 230 -126.18 ± 15.27 11 162 68 8 1 -273.0 ± 41.7
442255 ncm-dbt-05 580862 500 44 208 248 -118.33 ± 14.52 8 157 76 9 0 -254.16 ± 39.42
442254 ncm-dbt-04 568077 500 40 215 245 -126.97 ± 13.04 7 163 78 2 0 -282.94 ± 38.55
442253 ncm-dbt-02 586689 500 32 234 234 -148.85 ± 13.9 15 174 59 2 0 -336.46 ± 44.87
442252 ncm-dbt-01 582235 500 44 229 227 -134.95 ± 14.48 13 164 68 5 0 -293.29 ± 41.75
442251 ncm-dbt-03 582027 500 38 225 237 -136.56 ± 15.13 15 164 64 7 0 -293.29 ± 43.07
442250 ncm-dbt-05 580945 500 48 226 226 -129.35 ± 14.41 11 162 71 6 0 -280.42 ± 40.83
442249 ncm-dbt-04 569151 500 37 214 249 -128.55 ± 13.56 9 162 76 3 0 -282.94 ± 39.21
442248 ncm-dbt-02 586393 500 40 228 232 -137.37 ± 12.76 9 170 71 0 0 -312.47 ± 40.3
442247 ncm-dbt-03 584369 500 44 226 230 -132.54 ± 13.47 7 173 65 5 0 -301.33 ± 42.75
442246 ncm-dbt-01 584327 500 40 232 228 -140.62 ± 14.17 13 170 63 4 0 -312.48 ± 43.44
442245 ncm-dbt-05 584622 500 42 232 226 -138.99 ± 14.03 11 173 61 5 0 -312.48 ± 44.19
442244 ncm-dbt-01 583489 500 46 229 225 -133.34 ± 13.63 12 160 77 1 0 -290.66 ± 38.7
442243 ncm-dbt-03 583992 500 52 237 211 -134.95 ± 14.65 13 165 66 6 0 -293.29 ± 42.41
442242 ncm-dbt-04 566770 500 43 221 236 -129.35 ± 14.24 12 158 76 4 0 -277.93 ± 39.29
442241 ncm-dbt-02 587155 500 41 223 236 -132.54 ± 14.18 10 168 66 6 0 -293.29 ± 42.41
442240 ncm-dbt-01 584201 500 42 225 233 -133.34 ± 13.26 8 170 69 3 0 -301.33 ± 41.33
442239 ncm-dbt-04 568196 500 32 230 238 -145.54 ± 13.25 12 175 62 1 0 -333.32 ± 43.57
442238 ncm-dbt-03 585000 500 43 227 230 -134.15 ± 13.43 7 175 63 5 0 -306.84 ± 43.45
442237 ncm-dbt-05 577233 500 28 236 236 -153.86 ± 13.69 15 180 53 2 0 -356.21 ± 47.52
442236 ncm-dbt-02 588771 500 31 231 238 -147.19 ± 13.77 12 180 54 4 0 -339.63 ± 47.1

Commit

Commit ID 24b8b3098bc24ec576b7d03ffb72b2908e6c8c80
Author bmc4
Date 2021-05-15 08:07:40 UTC
Remove early return in Probcut code We simplify away early return in ProbCut, as it seems not to bring any strength anymore. STC: LLR: 2.93 (-2.94,2.94) <-2.50,0.50> Total: 42632 W: 3705 L: 3617 D: 35310 Ptnml(0-2): 123, 2947, 15110, 2991, 145 https://tests.stockfishchess.org/tests/view/609c49da7746e3dc74ffae02 LTC: LLR: 2.96 (-2.94,2.94) <-2.50,0.50> Total: 35384 W: 1314 L: 1251 D: 32819 Ptnml(0-2): 11, 1130, 15355, 1177, 19 https://tests.stockfishchess.org/tests/view/609c71467746e3dc74ffae47 --- While at it, we also update the Elo estimate of ProbCut (see https://tests.stockfishchess.org/tests/view/609bfb597746e3dc74ffabe3). closes https://github.com/official-stockfish/Stockfish/pull/3462 bench: 3764662
Copyright 2011–2025 Next Chess Move LLC