Dev Builds » 20230604-2101

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:56:06 1099557 3342 1359 343 1640 +109.07 +/- 5.46 0 70 541 1034 26 +236.76 +/- 14.66
ncm-dbt-02 09:51:51 1232844 3318 1357 355 1606 +108.3 +/- 5.59 0 70 555 996 38 +230.73 +/- 14.47
ncm-dbt-03 09:56:44 1234188 3346 1367 335 1644 +110.76 +/- 5.35 1 55 555 1035 27 +241.54 +/- 14.46
ncm-dbt-04 09:57:01 1240897 3356 1406 318 1632 +116.85 +/- 5.42 0 50 534 1050 44 +253.12 +/- 14.74
ncm-dbt-05 09:52:54 1225459 3298 1340 346 1612 +108.07 +/- 5.58 1 66 555 992 35 +231.3 +/- 14.47
ncm-dbt-06 09:56:04 1223716 3340 1382 336 1622 +112.59 +/- 5.46 0 59 543 1031 37 +243.11 +/- 14.63
20000 8211 2033 9756 +110.95 +/- 2.24 2 370 3283 6138 207 +239.36 +/- 5.94

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
190910 ncm-dbt-05 1225694 298 121 31 146 +108.31 +/- 19.77 1 6 48 90 4 +232.21 +/- 49.81
190909 ncm-dbt-02 1227114 318 127 33 158 +105.86 +/- 19.72 0 10 51 92 6 +216.58 +/- 48.13
190908 ncm-dbt-06 1242693 340 147 26 167 +129.3 +/- 16.69 0 4 46 115 5 +289.59 +/- 51.07
190907 ncm-dbt-01 1112249 342 133 37 172 +100.21 +/- 16.49 0 7 62 101 1 +217.63 +/- 43.63
190906 ncm-dbt-03 1252354 346 142 30 174 +116.66 +/- 16.39 0 6 51 114 2 +260.98 +/- 48.36
190905 ncm-dbt-04 1243643 356 148 35 173 +114.22 +/- 16.67 0 5 60 108 5 +244.51 +/- 44.36
190898 ncm-dbt-05 1224880 500 217 44 239 +125.38 +/- 13.61 0 6 71 167 6 +280.42 +/- 40.83
190897 ncm-dbt-02 1226028 500 223 43 234 +130.94 +/- 14.22 0 5 71 163 11 +285.49 +/- 40.81
190896 ncm-dbt-06 1212200 500 210 50 240 +115.22 +/- 14.53 0 11 74 159 6 +249.64 +/- 39.91
190893 ncm-dbt-04 1207383 500 212 49 239 +117.55 +/- 14.04 0 8 77 159 6 +256.44 +/- 39.15
190892 ncm-dbt-03 1220054 500 197 58 245 +99.2 +/- 14.6 1 11 90 144 4 +211.87 +/- 36.13
190891 ncm-dbt-01 1098935 500 186 51 263 +96.19 +/- 14.41 0 16 84 149 1 +207.95 +/- 37.36
190886 ncm-dbt-05 1233027 500 203 47 250 +112.14 +/- 14.53 0 11 78 155 6 +240.82 +/- 38.87
190885 ncm-dbt-02 1238621 500 205 56 239 +106.77 +/- 14.21 0 13 77 158 2 +234.38 +/- 39.07
190880 ncm-dbt-06 1205514 500 210 53 237 +112.91 +/- 14.22 0 10 78 157 5 +245.2 +/- 38.89
190879 ncm-dbt-03 1247187 500 218 48 234 +123.02 +/- 13.82 0 7 72 165 6 +273.0 +/- 40.54
190878 ncm-dbt-04 1236492 500 214 49 237 +119.11 +/- 14.36 0 10 71 163 6 +261.07 +/- 40.78
190876 ncm-dbt-01 1104887 500 205 54 241 +108.3 +/- 14.37 0 13 76 158 3 +236.51 +/- 39.32
190871 ncm-dbt-05 1229067 500 206 44 250 +116.77 +/- 14.53 0 9 78 155 8 +249.64 +/- 38.9
190869 ncm-dbt-02 1220863 500 205 52 243 +109.83 +/- 13.89 0 6 92 145 7 +232.26 +/- 35.5
190867 ncm-dbt-06 1232694 500 202 59 239 +102.22 +/- 13.21 0 7 95 146 2 +221.9 +/- 34.93
190866 ncm-dbt-03 1227605 500 203 54 243 +106.77 +/- 13.72 0 8 89 149 4 +230.16 +/- 36.26
190865 ncm-dbt-04 1239544 500 205 45 250 +115.22 +/- 13.55 0 5 86 153 6 +249.64 +/- 36.79
190863 ncm-dbt-01 1092379 500 220 49 231 +123.81 +/- 13.81 0 7 71 166 6 +275.45 +/- 40.84
190857 ncm-dbt-02 1209563 500 190 58 252 +93.95 +/- 14.07 0 13 94 141 2 +200.24 +/- 35.32
190856 ncm-dbt-05 1225470 500 199 59 242 +99.95 +/- 15.05 0 15 86 143 6 +207.95 +/- 36.95
190854 ncm-dbt-06 1221406 500 214 50 236 +118.33 +/- 14.52 0 7 82 151 10 +249.64 +/- 37.86
190853 ncm-dbt-04 1263024 500 212 51 237 +116.0 +/- 13.71 0 4 89 149 8 +247.41 +/- 36.02
190852 ncm-dbt-03 1227316 500 209 46 245 +117.55 +/- 13.53 0 6 80 159 5 +258.75 +/- 38.32
190851 ncm-dbt-01 1101391 500 195 41 264 +110.6 +/- 13.89 0 8 85 152 5 +238.66 +/- 37.17
190844 ncm-dbt-02 1234747 500 197 48 255 +106.77 +/- 14.05 0 11 82 154 3 +232.26 +/- 37.9
190843 ncm-dbt-05 1215889 500 194 60 246 +95.44 +/- 13.47 0 10 97 142 1 +206.01 +/- 34.66
190842 ncm-dbt-03 1231822 500 199 52 249 +105.25 +/- 14.04 0 9 90 146 5 +223.94 +/- 36.07
190841 ncm-dbt-06 1214363 500 198 52 250 +104.49 +/- 14.35 0 11 87 147 5 +221.9 +/- 36.76
190840 ncm-dbt-01 1085766 500 216 61 223 +111.37 +/- 14.22 0 10 80 155 5 +240.82 +/- 38.39
190839 ncm-dbt-04 1258516 500 203 44 253 +114.45 +/- 15.0 0 15 66 164 5 +249.64 +/- 41.87
190832 ncm-dbt-06 1237147 500 201 46 253 +111.37 +/- 13.89 0 9 81 156 4 +243.0 +/- 38.14
190831 ncm-dbt-02 1272976 500 210 65 225 +103.73 +/- 14.8 0 12 88 143 7 +215.85 +/- 36.55
190830 ncm-dbt-05 1224191 500 200 61 239 +99.2 +/- 13.83 0 9 97 140 4 +209.91 +/- 34.63
190829 ncm-dbt-03 1232979 500 199 47 254 +109.07 +/- 13.23 0 8 83 158 1 +243.0 +/- 37.64
190828 ncm-dbt-01 1101297 500 204 50 246 +110.6 +/- 14.06 0 9 83 153 5 +238.66 +/- 37.66
190827 ncm-dbt-04 1237678 500 212 45 243 +120.67 +/- 13.5 0 3 85 154 8 +261.07 +/- 36.86

Commit

Commit ID 5930c0defbe01576315d7d081447f94a01daf337
Author Guenther Demetz
Date 2023-06-04 21:01:14 UTC
Simplify away SEE verification After 4 simplificatons over PR#4453 the idea does not yield significant improvement anymore. Maybe also https://tests.stockfishchess.org/tests/view/640c88092644b62c3394c1c5 was a fluke. Passed non-regression bounds: STC: https://tests.stockfishchess.org/tests/view/64705389c079b6583146d873 LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 131936 W: 35040 L: 34930 D: 61966 Ptnml(0-2): 336, 14559, 36035, 14735, 303 LTC: https://tests.stockfishchess.org/tests/view/6471a2ade549d9cf2fb213cd LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 407700 W: 109999 L: 110164 D: 187537 Ptnml(0-2): 279, 39913, 123689, 39632, 337 closes https://github.com/official-stockfish/Stockfish/pull/4595 bench: 2675974
Copyright 2011–2024 Next Chess Move LLC