Dev Builds » 20210220-2122

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:42:34 582719 4016 326 1867 1823 -140.51 ± 5.04 110 1353 513 32 0 -310.1 ± 15.05
ncm-dbt-02 06:41:34 586017 4000 309 1786 1905 -134.65 ± 4.94 71 1383 500 44 2 -304.07 ± 15.25
ncm-dbt-03 06:42:36 585910 4000 312 1837 1851 -139.5 ± 4.9 91 1374 504 31 0 -313.19 ± 15.18
ncm-dbt-04 06:41:37 566892 3998 315 1817 1866 -137.25 ± 4.99 95 1347 522 35 0 -303.97 ± 14.92
ncm-dbt-05 06:41:55 582196 3986 300 1822 1864 -139.74 ± 5.07 112 1327 526 27 1 -306.83 ± 14.84
20000 1562 9129 9309 -138.33 ± 2.23 479 6784 2565 169 3 -307.61 ± 6.72

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
445956 ncm-dbt-01 581153 16 1 8 7 -162.9 ± 50.11 0 7 1 0 0 -470.09 ± 466.68
445955 ncm-dbt-05 582318 486 39 238 209 -151.12 ± 14.3 16 169 56 2 0 -340.5 ± 46.12
445954 ncm-dbt-04 566020 498 35 217 246 -133.13 ± 13.86 7 175 60 7 0 -303.25 ± 44.5
445953 ncm-dbt-02 583614 500 39 226 235 -136.56 ± 13.36 7 178 60 5 0 -315.35 ± 44.57
445952 ncm-dbt-03 586901 500 37 230 233 -141.44 ± 14.86 14 172 57 7 0 -312.48 ± 45.66
445951 ncm-dbt-01 580779 500 39 232 229 -141.44 ± 15.03 18 161 67 4 0 -301.33 ± 42.04
445950 ncm-dbt-05 584622 500 29 230 241 -148.02 ± 14.3 18 166 65 1 0 -324.17 ± 42.47
445949 ncm-dbt-04 569151 500 29 231 240 -148.85 ± 14.09 14 178 54 4 0 -339.63 ± 47.1
445948 ncm-dbt-02 587877 500 31 228 241 -144.71 ± 14.04 12 178 55 5 0 -330.23 ± 46.62
445947 ncm-dbt-03 583866 500 42 234 224 -140.62 ± 14.87 17 162 67 4 0 -301.33 ± 42.04
445946 ncm-dbt-01 582652 500 42 227 231 -134.95 ± 13.22 7 175 64 4 0 -309.64 ± 43.08
445945 ncm-dbt-05 578424 500 39 221 240 -132.54 ± 14.7 12 165 66 7 0 -288.06 ± 42.4
445944 ncm-dbt-04 565587 500 40 239 221 -146.36 ± 14.18 13 178 54 5 0 -333.32 ± 47.06
445943 ncm-dbt-02 582652 500 42 222 236 -130.94 ± 12.95 6 171 70 3 0 -298.62 ± 41.01
445942 ncm-dbt-03 586943 500 32 238 230 -152.18 ± 13.16 12 184 52 2 0 -359.68 ± 48.01
445941 ncm-dbt-01 583740 500 52 239 209 -136.56 ± 14.62 15 161 70 4 0 -293.29 ± 41.07
445940 ncm-dbt-05 580282 500 34 236 230 -148.85 ± 15.0 19 168 59 4 0 -324.17 ± 44.97
445939 ncm-dbt-04 564331 500 32 226 242 -142.25 ± 14.3 14 170 62 4 0 -315.35 ± 43.81
445938 ncm-dbt-02 586689 500 35 219 246 -134.15 ± 13.05 7 173 67 3 0 -306.84 ± 41.99
445937 ncm-dbt-03 588728 500 30 220 250 -138.99 ± 12.5 6 180 62 2 0 -327.18 ± 43.69
445936 ncm-dbt-01 581610 500 35 236 229 -148.02 ± 14.3 16 172 59 3 0 -330.23 ± 44.94
445935 ncm-dbt-05 583824 500 36 225 239 -138.18 ± 14.76 17 158 72 3 0 -293.29 ± 40.39
445934 ncm-dbt-04 567324 500 46 221 233 -126.97 ± 14.61 12 157 75 6 0 -270.57 ± 39.67
445933 ncm-dbt-02 587028 500 45 223 232 -129.35 ± 14.91 10 168 62 10 0 -282.94 ± 43.58
445932 ncm-dbt-03 585169 500 45 227 228 -132.54 ± 13.47 9 167 71 3 0 -295.94 ± 40.69
445931 ncm-dbt-01 582861 500 34 219 247 -134.95 ± 13.59 8 174 63 5 0 -306.84 ± 43.45
445930 ncm-dbt-04 568315 500 51 231 218 -130.94 ± 14.22 12 160 74 4 0 -282.94 ± 39.86
445929 ncm-dbt-05 581402 500 41 223 236 -132.54 ± 13.1 5 177 63 5 0 -306.84 ± 43.45
445928 ncm-dbt-02 587834 500 50 236 214 -135.76 ± 14.81 13 166 66 4 1 -298.62 ± 42.41
445927 ncm-dbt-03 584579 500 41 231 228 -138.99 ± 13.85 10 175 60 5 0 -315.35 ± 44.57
445926 ncm-dbt-01 584076 500 49 233 218 -134.15 ± 15.01 14 163 66 7 0 -288.06 ± 42.4
445925 ncm-dbt-04 567799 500 45 228 227 -133.34 ± 14.17 13 160 74 3 0 -288.06 ± 39.79
445924 ncm-dbt-05 581070 500 43 233 224 -138.99 ± 14.91 15 165 66 3 1 -304.07 ± 42.38
445923 ncm-dbt-02 587028 500 34 215 251 -131.74 ± 14.71 8 175 58 8 1 -298.62 ± 45.1
445922 ncm-dbt-03 586816 500 46 221 233 -126.97 ± 13.22 7 164 76 3 0 -282.94 ± 39.21
445921 ncm-dbt-01 583866 500 39 239 222 -147.19 ± 14.7 17 170 59 4 0 -324.17 ± 44.97
445920 ncm-dbt-04 566612 500 37 224 239 -136.56 ± 13.36 10 169 69 2 0 -306.84 ± 41.23
445919 ncm-dbt-05 585632 500 39 216 245 -128.55 ± 13.56 10 159 79 2 0 -280.42 ± 38.28
445918 ncm-dbt-02 585421 500 33 217 250 -134.15 ± 13.8 8 174 62 6 0 -304.07 ± 43.81
445917 ncm-dbt-03 584285 500 39 236 225 -144.71 ± 14.77 16 170 59 5 0 -318.25 ± 44.96
445916 ncm-dbt-01 583740 500 35 234 231 -146.36 ± 13.8 15 170 64 1 0 -327.18 ± 42.83

Commit

Commit ID 6294db7514798ac12536b4d6e77bc591f7e846da
Author Vizvezdenec
Date 2021-02-20 21:22:07 UTC
Tune search parameters (with Unai Corzo) The values used in this patch are taken from a SPSA parameter tuning session originated by Unai Corzo (@unaiic), but the final difference of his tune was multiplied x2 by hand. Most of the credits should go to him :-) STC: https://tests.stockfishchess.org/tests/view/602f03d07f517a561bc49d40 LLR: 2.94 (-2.94,2.94) {-0.25,1.25} Total: 67664 W: 6252 L: 6035 D: 55377 Ptnml(0-2): 256, 4799, 23527, 4972, 278 LTC: https://tests.stockfishchess.org/tests/view/602f41697f517a561bc49d5a LLR: 2.96 (-2.94,2.94) {0.25,1.25} Total: 26256 W: 1034 L: 906 D: 24316 Ptnml(0-2): 10, 804, 11377, 922, 15 Closes https://github.com/official-stockfish/Stockfish/pull/3363 Bench: 3957653
Copyright 2011–2025 Next Chess Move LLC