Dev Builds » 20231111-1426

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:50:52 1196892 4012 1730 333 1949 +126.26 +/- 4.85 0 45 577 1326 58 +280.11 +/- 14.18
ncm-dbt-02 11:49:12 1197256 3962 1731 328 1903 +128.6 +/- 4.89 0 49 536 1340 56 +288.04 +/- 14.73
ncm-dbt-03 11:54:05 1231953 4012 1757 311 1944 +131.11 +/- 4.77 0 41 534 1375 56 +296.55 +/- 14.75
ncm-dbt-05 11:47:50 1228006 3982 1737 351 1894 +126.2 +/- 4.83 0 38 589 1304 60 +279.17 +/- 14.02
ncm-dbt-06 11:54:11 1226278 4032 1762 356 1914 +126.46 +/- 4.83 1 45 572 1343 55 +282.08 +/- 14.25
20000 8717 1679 9604 +127.72 +/- 2.16 1 218 2808 6688 285 +285.11 +/- 6.42

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
208896 ncm-dbt-01 1178220 12 6 1 5 +154.02 +/- 64.21 0 0 1 5 0 +416.21 +/- 496.36
208895 ncm-dbt-03 1214233 12 5 0 7 +154.02 +/- 64.21 0 0 1 5 0 +416.21 +/- 496.36
208894 ncm-dbt-06 1225068 32 15 2 15 +149.74 +/- 40.15 0 0 3 13 0 +393.99 +/- 473.68
208893 ncm-dbt-02 1203914 462 199 36 227 +128.08 +/- 13.05 0 3 65 160 3 +296.37 +/- 42.61
208892 ncm-dbt-05 1241738 482 204 50 228 +115.03 +/- 14.57 0 7 81 145 8 +243.99 +/- 38.08
208891 ncm-dbt-01 1196807 500 217 37 246 +130.94 +/- 13.32 0 5 66 173 6 +298.62 +/- 42.41
208890 ncm-dbt-03 1248381 500 213 31 256 +132.54 +/- 12.71 0 3 67 175 5 +306.84 +/- 41.99
208889 ncm-dbt-06 1241449 500 216 53 231 +117.55 +/- 14.37 0 6 85 149 10 +247.41 +/- 37.09
208888 ncm-dbt-02 1196316 500 223 46 231 +128.55 +/- 14.59 0 9 64 168 9 +282.94 +/- 42.98
208887 ncm-dbt-05 1223400 500 221 39 240 +132.54 +/- 13.1 0 3 69 171 7 +301.33 +/- 41.33
208886 ncm-dbt-01 1197826 500 210 44 246 +119.89 +/- 14.19 0 8 75 160 7 +261.07 +/- 39.69
208885 ncm-dbt-06 1209760 500 226 45 229 +131.74 +/- 13.3 0 3 71 168 8 +295.94 +/- 40.69
208884 ncm-dbt-03 1223384 500 230 36 234 +142.25 +/- 13.37 0 5 54 183 8 +333.32 +/- 47.06
208883 ncm-dbt-02 1194863 500 209 49 242 +115.22 +/- 14.69 0 12 72 160 6 +249.64 +/- 40.41
208882 ncm-dbt-05 1225882 500 222 51 227 +123.81 +/- 13.81 0 4 80 157 9 +268.17 +/- 38.21
208881 ncm-dbt-01 1184642 500 215 47 238 +121.45 +/- 13.66 0 3 85 153 9 +261.07 +/- 36.86
208880 ncm-dbt-03 1217461 500 211 38 251 +125.38 +/- 13.25 0 5 72 168 5 +282.94 +/- 40.5
208879 ncm-dbt-06 1215887 500 213 37 250 +127.76 +/- 13.39 0 5 70 169 6 +288.06 +/- 41.11
208878 ncm-dbt-02 1195578 500 221 39 240 +132.54 +/- 14.18 0 4 72 162 12 +288.06 +/- 40.46
208877 ncm-dbt-05 1238143 500 212 40 248 +124.6 +/- 13.09 0 4 75 166 5 +280.42 +/- 39.57
208876 ncm-dbt-01 1213350 500 214 42 244 +124.6 +/- 12.9 0 4 74 168 4 +282.94 +/- 39.86
208875 ncm-dbt-03 1223224 500 222 38 240 +134.15 +/- 13.8 0 5 65 171 9 +301.33 +/- 42.75
208874 ncm-dbt-06 1236737 500 225 42 233 +133.34 +/- 13.81 0 5 66 170 9 +298.62 +/- 42.41
208873 ncm-dbt-02 1201194 500 227 39 234 +137.37 +/- 13.15 0 4 61 178 7 +318.25 +/- 44.18
208872 ncm-dbt-05 1223711 500 218 41 241 +128.55 +/- 13.73 0 2 80 157 11 +277.93 +/- 38.02
208871 ncm-dbt-01 1192948 500 206 34 260 +124.6 +/- 13.27 0 3 79 161 7 +275.45 +/- 38.39
208870 ncm-dbt-03 1228090 500 218 45 237 +125.38 +/- 13.79 0 6 72 165 7 +277.93 +/- 40.53
208869 ncm-dbt-06 1239145 500 216 47 237 +122.24 +/- 13.66 0 9 66 172 3 +277.93 +/- 42.33
208868 ncm-dbt-02 1199863 500 221 38 241 +133.34 +/- 13.08 0 3 68 172 7 +304.07 +/- 41.65
208867 ncm-dbt-05 1220411 500 218 48 234 +123.02 +/- 13.82 0 7 72 165 6 +273.0 +/- 40.54
208866 ncm-dbt-01 1197477 500 220 34 246 +135.76 +/- 13.76 0 5 63 173 9 +306.84 +/- 43.45
208865 ncm-dbt-06 1222504 500 225 37 238 +137.37 +/- 12.76 0 4 59 182 5 +324.17 +/- 44.97
208864 ncm-dbt-03 1256846 500 228 42 230 +135.76 +/- 13.2 0 3 66 173 8 +309.64 +/- 42.33
208863 ncm-dbt-02 1193105 500 214 39 247 +126.97 +/- 13.58 0 7 66 172 5 +288.06 +/- 42.4
208862 ncm-dbt-05 1231293 500 226 32 242 +142.25 +/- 12.16 0 1 60 183 6 +339.63 +/- 44.35
208861 ncm-dbt-01 1206838 500 220 35 245 +134.95 +/- 14.13 0 8 57 177 8 +306.84 +/- 45.58
208860 ncm-dbt-03 1250412 500 212 47 241 +119.11 +/- 13.69 0 6 79 159 6 +261.07 +/- 38.58
208859 ncm-dbt-06 1228616 500 208 52 240 +112.14 +/- 14.38 1 6 86 150 7 +240.82 +/- 36.9
208858 ncm-dbt-05 1219477 500 216 50 234 +119.89 +/- 14.68 0 10 72 160 8 +258.75 +/- 40.49
208857 ncm-dbt-01 1203923 500 222 59 219 +117.55 +/- 14.53 0 9 77 156 8 +251.89 +/- 39.16
208856 ncm-dbt-02 1193217 500 217 42 241 +126.97 +/- 13.94 0 7 68 168 7 +282.94 +/- 41.76
208855 ncm-dbt-03 1225547 500 218 34 248 +134.15 +/- 14.15 0 8 58 176 8 +304.07 +/- 45.19
208854 ncm-dbt-06 1217341 500 218 41 241 +128.55 +/- 13.91 0 7 66 170 7 +288.06 +/- 42.4

Commit

Commit ID fbc6b275051773b491c1c180fd7ff331194ca0f1
Author Linmiao Xu
Date 2023-11-11 14:26:56 UTC
Simplify away optimism average score offset params Passed non-regression STC: https://tests.stockfishchess.org/tests/view/654abf6b136acbc57352ac4b LLR: 2.97 (-2.94,2.94) <-1.75,0.25> Total: 49664 W: 12687 L: 12477 D: 24500 Ptnml(0-2): 138, 5840, 12703, 5976, 175 Passed non-regression LTC: https://tests.stockfishchess.org/tests/view/654b638e136acbc57352b961 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 347166 W: 85561 L: 85676 D: 175929 Ptnml(0-2): 206, 39569, 94150, 39450, 208 closes https://github.com/official-stockfish/Stockfish/pull/4871 bench 1257641
Copyright 2011–2024 Next Chess Move LLC