Dev Builds » 20211006-0953

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:53:43 584416 3996 732 1301 1963 -49.81 ± 5.17 11 772 992 221 2 -100.06 ± 10.78
ncm-dbt-02 06:53:22 586488 4010 742 1343 1925 -52.47 ± 5.12 11 790 995 207 2 -105.73 ± 10.76
ncm-dbt-03 06:52:40 587596 3996 746 1330 1920 -51.14 ± 5.28 19 779 968 231 1 -101.19 ± 10.93
ncm-dbt-04 06:54:02 571043 3998 751 1318 1929 -49.61 ± 5.12 11 765 1003 220 0 -99.25 ± 10.71
ncm-dbt-05 06:53:40 584508 4000 737 1303 1960 -49.49 ± 5.14 7 778 991 222 2 -100.14 ± 10.79
20000 3708 6595 9697 -50.51 ± 2.31 59 3884 4949 1101 7 -101.27 ± 4.83

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
400426 ncm-dbt-02 586731 10 4 3 3 +34.85 ± 119.9 0 1 2 2 0 +70.44 ± 307.49
400425 ncm-dbt-01 583572 496 84 157 255 -51.51 ± 14.29 0 99 123 26 0 -105.39 ± 30.69
400424 ncm-dbt-04 570749 498 111 164 223 -37.12 ± 14.76 1 86 127 35 0 -73.64 ± 30.23
400423 ncm-dbt-03 587537 496 104 179 213 -52.94 ± 14.77 1 101 118 28 0 -106.92 ± 31.42
400422 ncm-dbt-05 583279 500 90 158 252 -47.55 ± 13.71 0 92 134 24 0 -96.94 ± 29.13
400421 ncm-dbt-02 588302 500 88 184 228 -67.54 ± 14.65 3 111 115 21 0 -135.76 ± 31.8
400420 ncm-dbt-01 586604 500 93 174 233 -56.78 ± 13.77 0 102 127 21 0 -116.78 ± 30.03
400419 ncm-dbt-04 568752 500 85 175 240 -63.23 ± 13.91 1 107 123 19 0 -129.35 ± 30.56
400418 ncm-dbt-03 587113 500 90 163 247 -51.09 ± 14.31 1 96 129 23 1 -104.49 ± 29.82
400417 ncm-dbt-05 583698 500 89 169 242 -56.07 ± 14.15 0 103 125 21 1 -116.78 ± 30.34
400416 ncm-dbt-02 589069 500 92 169 239 -53.93 ± 14.73 2 100 121 27 0 -107.54 ± 30.99
400415 ncm-dbt-03 587962 500 102 156 242 -37.67 ± 15.5 4 84 124 38 0 -70.44 ± 30.65
400414 ncm-dbt-01 584369 500 82 162 256 -56.07 ± 14.96 2 104 116 28 0 -112.14 ± 31.71
400413 ncm-dbt-05 586477 500 101 163 236 -43.3 ± 15.08 2 92 122 34 0 -85.04 ± 30.9
400412 ncm-dbt-04 569949 500 94 164 242 -48.96 ± 14.47 1 96 125 28 0 -98.44 ± 30.45
400411 ncm-dbt-02 584495 500 101 170 229 -48.25 ± 14.57 2 93 127 28 0 -95.44 ± 30.17
400410 ncm-dbt-03 588387 500 80 170 250 -63.23 ± 14.75 1 113 111 25 0 -129.35 ± 32.44
400409 ncm-dbt-01 586097 500 97 167 236 -48.96 ± 15.63 1 105 107 37 0 -98.44 ± 32.95
400408 ncm-dbt-05 585379 500 85 167 248 -57.5 ± 14.08 1 102 125 22 0 -116.78 ± 30.34
400407 ncm-dbt-04 573163 500 98 161 241 -44.01 ± 14.33 1 90 130 29 0 -88.0 ± 29.77
400406 ncm-dbt-02 584790 500 91 147 262 -39.08 ± 14.44 1 85 134 29 1 -79.17 ± 29.25
400405 ncm-dbt-03 587409 500 98 174 228 -53.22 ± 16.08 6 98 112 34 0 -99.95 ± 32.27
400404 ncm-dbt-01 582360 500 89 168 243 -55.36 ± 13.7 1 97 132 20 0 -112.14 ± 29.29
400403 ncm-dbt-05 582819 500 88 160 252 -50.38 ± 15.2 2 100 116 32 0 -99.95 ± 31.72
400402 ncm-dbt-04 569669 500 95 149 256 -37.67 ± 14.61 1 86 129 34 0 -74.79 ± 29.96
400401 ncm-dbt-02 588217 500 93 165 242 -50.38 ± 14.14 1 95 129 25 0 -101.46 ± 29.84
400400 ncm-dbt-03 587537 500 94 172 234 -54.64 ± 14.63 1 103 119 27 0 -110.6 ± 31.28
400399 ncm-dbt-01 586308 500 105 156 239 -35.56 ± 14.61 2 80 136 31 1 -70.44 ± 29.01
400398 ncm-dbt-05 585506 500 89 164 247 -52.51 ± 14.66 0 104 117 29 0 -107.54 ± 31.57
400397 ncm-dbt-04 571712 500 91 162 247 -49.67 ± 14.51 1 97 124 28 0 -99.95 ± 30.58
400396 ncm-dbt-02 584706 500 89 160 251 -49.67 ± 14.51 0 100 121 29 0 -101.46 ± 31.01
400395 ncm-dbt-03 585970 500 83 166 251 -58.21 ± 15.06 3 104 116 27 0 -115.23 ± 31.71
400394 ncm-dbt-01 582068 500 85 157 258 -50.38 ± 14.68 2 95 127 25 1 -101.46 ± 30.14
400393 ncm-dbt-04 573568 500 99 173 228 -51.8 ± 14.22 3 91 133 23 0 -101.46 ± 29.24
400392 ncm-dbt-05 584832 500 103 165 232 -43.3 ± 15.33 1 96 118 34 1 -88.0 ± 31.44
400391 ncm-dbt-02 583656 500 96 163 241 -46.84 ± 14.22 0 94 130 25 1 -96.94 ± 29.72
400390 ncm-dbt-03 588856 500 95 150 255 -38.37 ± 14.13 2 80 139 29 0 -74.79 ± 28.56
400389 ncm-dbt-04 570789 500 78 170 252 -64.66 ± 14.8 2 112 112 24 0 -130.94 ± 32.29
400388 ncm-dbt-01 583950 500 97 160 243 -44.01 ± 15.11 3 90 124 33 0 -85.04 ± 30.63
400387 ncm-dbt-02 588430 500 88 182 230 -66.1 ± 14.45 2 111 116 21 0 -134.15 ± 31.65
400386 ncm-dbt-05 584076 500 92 157 251 -45.42 ± 14.01 1 89 134 26 0 -90.97 ± 29.17

Commit

Commit ID 371b522e9ed9cab91274ff111c0bf4b0f6ec3340
Author J. Oster
Date 2021-10-06 09:53:33 UTC
Time-management fix in MultiPV mode. When playing games in MultiPV mode we must take care to only track the best move changing for the first PV line. Otherwise, SF will spend most of its time for the initial moves after the book exit. This has been observed and reported on Discord, but can also be seen in games played in Stefan Pohl's MultiPV experiment. Tested with MultiPV=4. STC: https://tests.stockfishchess.org/tests/view/615c24b59d256038a969b990 LLR: 2.95 (-2.94,2.94) <-0.50,2.50> Total: 1744 W: 694 L: 447 D: 603 Ptnml(0-2): 32, 125, 358, 278, 79 LTC: https://tests.stockfishchess.org/tests/view/615c31769d256038a969b993 LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 2048 W: 723 L: 525 D: 800 Ptnml(0-2): 10, 158, 511, 314, 31 closes https://github.com/official-stockfish/Stockfish/pull/3729 Bench: 5714575
Copyright 2011–2025 Next Chess Move LLC