Dev Builds » 20210618-1800

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:46:39 582436 4012 414 1641 1957 -109.77 ± 4.84 34 1221 689 62 0 -237.97 ± 12.96
ncm-dbt-02 06:46:28 586806 3992 391 1654 1947 -113.83 ± 5.02 55 1217 660 64 0 -243.67 ± 13.25
ncm-dbt-03 06:44:22 585757 4000 429 1644 1927 -108.97 ± 5.11 66 1149 719 66 0 -227.3 ± 12.67
ncm-dbt-04 06:46:19 567343 4000 405 1614 1981 -108.4 ± 5.08 48 1194 677 81 0 -230.43 ± 13.1
ncm-dbt-05 06:47:02 581773 3996 399 1665 1932 -114.0 ± 5.23 71 1201 650 75 1 -240.06 ± 13.37
20000 2038 8218 9744 -110.98 ± 2.26 274 5982 3395 348 1 -235.82 ± 5.84

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
441927 ncm-dbt-01 581194 12 1 6 5 -154.02 ± 64.21 0 5 1 0 0 -416.21 ± 496.36
441926 ncm-dbt-02 588430 492 44 204 244 -117.24 ± 13.85 6 154 80 6 0 -255.31 ± 38.31
441925 ncm-dbt-05 582819 496 47 195 254 -106.92 ± 13.63 3 150 87 8 0 -232.62 ± 36.7
441924 ncm-dbt-04 569310 500 42 197 261 -111.37 ± 14.38 6 153 81 10 0 -238.66 ± 38.15
441923 ncm-dbt-03 583154 500 48 207 245 -114.45 ± 14.05 7 152 84 7 0 -245.2 ± 37.37
441922 ncm-dbt-01 581943 500 52 204 244 -109.07 ± 13.73 3 155 83 9 0 -238.66 ± 37.66
441921 ncm-dbt-02 586816 500 39 208 253 -122.24 ± 14.17 7 163 72 8 0 -268.17 ± 40.54
441920 ncm-dbt-05 582485 500 51 205 244 -110.6 ± 14.84 7 151 82 9 1 -236.51 ± 37.9
441919 ncm-dbt-03 586308 500 61 210 229 -106.77 ± 15.12 11 137 92 10 0 -215.85 ± 35.68
441918 ncm-dbt-04 568554 500 63 200 237 -97.69 ± 13.5 3 139 100 8 0 -207.95 ± 33.99
441917 ncm-dbt-01 581777 500 55 208 237 -109.83 ± 14.37 3 160 74 13 0 -240.82 ± 39.83
441916 ncm-dbt-02 587282 500 50 202 248 -109.07 ± 14.37 5 153 81 11 0 -234.38 ± 38.14
441915 ncm-dbt-03 588941 500 47 193 260 -104.49 ± 13.55 6 139 100 5 0 -219.87 ± 33.78
441914 ncm-dbt-05 577479 500 44 205 251 -116.0 ± 14.85 10 150 81 9 0 -243.0 ± 38.14
441913 ncm-dbt-04 562924 500 49 195 256 -104.49 ± 14.66 4 152 80 14 0 -223.94 ± 38.31
441912 ncm-dbt-01 583572 500 53 210 237 -112.91 ± 13.56 4 156 83 7 0 -247.41 ± 37.61
441911 ncm-dbt-02 585885 500 40 210 250 -123.02 ± 13.65 5 167 71 7 0 -275.45 ± 40.84
441910 ncm-dbt-03 585421 500 44 198 258 -110.6 ± 13.73 7 145 93 5 0 -234.38 ± 35.22
441909 ncm-dbt-05 581610 500 45 213 242 -121.45 ± 14.5 9 158 75 8 0 -261.07 ± 39.69
441908 ncm-dbt-04 564958 500 49 201 250 -109.07 ± 14.05 7 145 91 7 0 -230.16 ± 35.78
441907 ncm-dbt-01 583992 500 47 202 251 -111.37 ± 13.39 5 150 90 5 0 -240.82 ± 35.87
441906 ncm-dbt-02 587664 500 53 215 232 -116.77 ± 14.69 11 147 85 7 0 -243.0 ± 37.13
441905 ncm-dbt-03 585337 500 60 212 228 -109.07 ± 14.99 11 139 91 9 0 -221.9 ± 35.86
441904 ncm-dbt-04 567640 500 48 212 240 -118.33 ± 14.68 9 155 77 9 0 -251.89 ± 39.16
441903 ncm-dbt-05 582318 500 50 223 227 -125.38 ± 15.74 15 153 72 10 0 -258.75 ± 40.49
441902 ncm-dbt-01 582569 500 44 196 260 -109.07 ± 14.21 5 152 83 10 0 -234.38 ± 37.67
441901 ncm-dbt-03 585126 500 48 209 243 -116.0 ± 14.85 12 144 87 7 0 -238.66 ± 36.67
441900 ncm-dbt-02 585717 500 50 205 245 -111.37 ± 13.05 3 154 88 5 0 -245.2 ± 36.32
441899 ncm-dbt-04 566770 500 49 205 246 -112.14 ± 13.56 2 161 78 9 0 -249.64 ± 38.9
441898 ncm-dbt-05 585337 500 66 205 229 -99.2 ± 15.33 12 126 101 11 0 -194.57 ± 33.94
441897 ncm-dbt-01 586097 500 52 204 244 -109.07 ± 13.4 4 150 90 6 0 -236.51 ± 35.94
441896 ncm-dbt-02 586266 500 57 201 242 -102.97 ± 14.18 6 141 94 9 0 -215.85 ± 35.23
441895 ncm-dbt-03 585464 500 59 206 235 -105.25 ± 13.56 5 143 96 6 0 -223.94 ± 34.66
441894 ncm-dbt-04 567720 500 54 207 239 -109.83 ± 15.73 11 145 80 14 0 -223.94 ± 38.31
441893 ncm-dbt-05 580945 500 48 212 240 -118.33 ± 15.0 10 154 76 10 0 -249.64 ± 39.41
441892 ncm-dbt-01 578465 500 59 200 241 -100.7 ± 13.85 6 136 101 7 0 -209.91 ± 33.74
441891 ncm-dbt-03 586308 500 62 209 229 -105.25 ± 15.55 7 150 76 17 0 -219.87 ± 39.12
441890 ncm-dbt-02 586393 500 58 209 233 -108.3 ± 15.43 12 138 89 11 0 -217.85 ± 36.33
441889 ncm-dbt-04 570869 500 51 197 252 -104.49 ± 14.35 6 144 90 10 0 -219.87 ± 36.1
441888 ncm-dbt-05 581194 500 48 207 245 -114.45 ± 14.21 5 159 76 10 0 -249.64 ± 39.41
441887 ncm-dbt-01 582318 500 51 211 238 -115.22 ± 13.2 4 157 84 5 0 -254.16 ± 37.27

Commit

Commit ID 14b673d90f7f486becda4622eb1e8f4b63bb0785
Author ap
Date 2021-06-18 18:00:13 UTC
New default net nn-3b20abec10c1.nnue This net was created by @pleomati, who manually edited with an hex editor 10 values randomly chosen in the LCSFNet10 net (nn-6ad41a9207d0.nnue) to create this one. The LCSFNet10 net was trained by Joost VandeVondele from a dataset combining Stockfish games and Leela games (16x10^9 positions from SF self-play at depth 9, and 6.3x10^9 positions from Leela games, so overall 72% of Stockfish positions and 28% of Leela positions). passed STC 10+0.1: LLR: 2.94 (-2.94,2.94) <-0.50,2.50> Total: 50888 W: 5881 L: 5654 D: 39353 Ptnml(0-2): 281, 4290, 16085, 4497, 291 https://tests.stockfishchess.org/tests/view/60cbfa68457376eb8bcab49a passed LTC 60+0.6: LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 25480 W: 1498 L: 1338 D: 22644 Ptnml(0-2): 36, 1155, 10193, 1325, 31 https://tests.stockfishchess.org/tests/view/60cc4af8457376eb8bcab4d4 closes https://github.com/official-stockfish/Stockfish/pull/3564 Bench: 4904930
Copyright 2011–2025 Next Chess Move LLC