Dev Builds » 20231021-0837

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:54:49 1097012 3350 1381 319 1650 +114.07 +/- 5.42 0 61 523 1059 32 +249.04 +/- 14.91
ncm-dbt-02 09:48:31 1217605 3290 1433 293 1564 +125.59 +/- 5.5 0 43 474 1073 55 +275.19 +/- 15.66
ncm-dbt-03 09:54:49 1239776 3356 1434 259 1663 +127.02 +/- 5.07 0 30 477 1137 34 +288.05 +/- 15.59
ncm-dbt-04 09:54:45 1229463 3352 1447 245 1660 +130.38 +/- 5.24 0 35 452 1141 48 +293.65 +/- 16.04
ncm-dbt-05 09:49:10 1239845 3300 1385 302 1613 +118.4 +/- 5.44 1 54 490 1071 34 +261.29 +/- 15.4
ncm-dbt-06 09:53:47 1225638 3352 1458 296 1598 +125.65 +/- 5.38 1 39 484 1101 51 +277.61 +/- 15.49
20000 8538 1714 9748 +123.5 +/- 2.18 2 262 2900 6582 254 +273.73 +/- 6.32

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
206875 ncm-dbt-05 1221479 300 129 22 149 +129.61 +/- 17.79 0 4 39 103 4 +292.41 +/- 55.64
206874 ncm-dbt-02 1216380 290 126 17 147 +137.31 +/- 19.18 0 3 38 96 8 +298.99 +/- 56.42
206873 ncm-dbt-06 1222716 352 152 28 172 +127.87 +/- 16.34 0 3 52 115 6 +281.97 +/- 47.79
206872 ncm-dbt-01 1111497 350 140 33 177 +109.72 +/- 15.43 0 5 58 112 0 +247.1 +/- 45.16
206871 ncm-dbt-04 1251233 352 161 23 168 +143.91 +/- 15.14 0 3 36 133 4 +347.24 +/- 58.18
206870 ncm-dbt-03 1236500 356 156 32 168 +126.3 +/- 15.35 0 2 54 118 4 +284.32 +/- 46.7
206869 ncm-dbt-05 1230878 500 215 39 246 +127.76 +/- 14.44 0 10 61 172 7 +285.49 +/- 43.92
206868 ncm-dbt-02 1201670 500 222 53 225 +122.24 +/- 14.33 0 7 76 158 9 +263.42 +/- 39.41
206867 ncm-dbt-01 1091211 500 203 43 254 +115.22 +/- 13.88 0 8 79 158 5 +251.89 +/- 38.63
206866 ncm-dbt-03 1234801 500 223 37 240 +135.76 +/- 13.94 0 7 58 177 8 +309.64 +/- 45.27
206865 ncm-dbt-06 1231974 500 216 41 243 +126.97 +/- 13.41 1 5 65 176 3 +295.94 +/- 42.75
206864 ncm-dbt-04 1226956 500 220 39 241 +131.74 +/- 13.85 0 4 71 165 10 +290.66 +/- 40.76
206863 ncm-dbt-05 1249178 500 212 41 247 +123.81 +/- 13.81 0 6 74 163 7 +273.0 +/- 39.95
206862 ncm-dbt-02 1207220 500 218 38 244 +130.94 +/- 13.14 0 3 71 169 7 +295.94 +/- 40.69
206861 ncm-dbt-01 1098407 500 204 53 243 +108.3 +/- 13.23 0 7 87 154 2 +238.66 +/- 36.67
206860 ncm-dbt-03 1250160 500 209 34 257 +126.97 +/- 12.28 0 4 68 177 1 +298.62 +/- 41.71
206859 ncm-dbt-06 1223564 500 224 42 234 +132.54 +/- 14.18 0 4 72 162 12 +288.06 +/- 40.46
206858 ncm-dbt-04 1240775 500 210 33 257 +128.55 +/- 12.82 0 4 69 173 4 +295.94 +/- 41.39
206857 ncm-dbt-05 1239057 500 202 49 249 +109.83 +/- 13.73 0 9 82 156 3 +240.82 +/- 37.9
206856 ncm-dbt-02 1212940 500 208 39 253 +122.24 +/- 13.83 0 9 67 170 4 +275.45 +/- 42.01
206855 ncm-dbt-06 1234377 500 224 54 222 +123.02 +/- 13.82 0 5 78 159 8 +268.17 +/- 38.8
206854 ncm-dbt-01 1099150 500 211 45 244 +119.89 +/- 14.99 0 11 71 159 9 +256.44 +/- 40.73
206853 ncm-dbt-03 1248189 500 215 46 239 +122.24 +/- 13.3 0 4 79 161 6 +270.57 +/- 38.47
206852 ncm-dbt-04 1235300 500 214 39 247 +126.97 +/- 13.41 0 4 74 165 7 +282.94 +/- 39.86
206851 ncm-dbt-05 1217432 500 211 54 235 +112.91 +/- 13.04 0 7 80 162 1 +254.16 +/- 38.36
206850 ncm-dbt-02 1198166 500 228 50 222 +129.35 +/- 14.91 0 5 77 153 15 +270.57 +/- 39.07
206849 ncm-dbt-06 1209719 500 215 42 243 +125.38 +/- 14.13 0 7 71 164 8 +275.45 +/- 40.84
206848 ncm-dbt-01 1101411 500 209 47 244 +116.77 +/- 14.37 0 10 74 160 6 +254.16 +/- 39.94
206847 ncm-dbt-03 1238279 500 214 37 249 +128.55 +/- 12.82 0 1 78 164 7 +288.06 +/- 38.42
206846 ncm-dbt-04 1214206 500 214 37 249 +128.55 +/- 14.26 0 9 62 172 7 +288.06 +/- 43.65
206845 ncm-dbt-02 1241591 500 219 49 232 +123.02 +/- 13.99 0 7 73 163 7 +270.57 +/- 40.25
206844 ncm-dbt-05 1237507 500 211 48 241 +117.55 +/- 14.04 0 9 74 162 5 +258.75 +/- 39.96
206843 ncm-dbt-06 1241186 500 213 50 237 +117.55 +/- 14.2 0 9 75 160 6 +256.44 +/- 39.69
206842 ncm-dbt-01 1083706 500 195 54 251 +100.7 +/- 14.32 0 13 86 148 3 +215.85 +/- 36.98
206841 ncm-dbt-04 1210228 500 212 32 256 +130.94 +/- 13.32 0 3 72 167 8 +293.29 +/- 40.39
206840 ncm-dbt-03 1228739 500 199 40 261 +114.45 +/- 13.89 0 9 77 160 4 +251.89 +/- 39.16
206839 ncm-dbt-02 1245273 500 212 47 241 +119.11 +/- 14.03 0 9 72 164 5 +263.42 +/- 40.52
206838 ncm-dbt-05 1283385 500 205 49 246 +112.14 +/- 14.85 1 9 80 153 7 +240.82 +/- 38.39
206837 ncm-dbt-06 1215935 500 214 39 247 +126.97 +/- 13.94 0 6 71 165 8 +280.42 +/- 40.83
206836 ncm-dbt-03 1241768 500 218 33 249 +134.95 +/- 12.44 0 3 63 180 4 +318.25 +/- 43.39
206835 ncm-dbt-04 1227548 500 216 42 242 +126.17 +/- 14.29 0 8 68 166 8 +277.93 +/- 41.74
206834 ncm-dbt-01 1093708 500 219 44 237 +126.97 +/- 13.94 0 7 68 168 7 +282.94 +/- 41.76

Commit

Commit ID 8366ec48ae6fc57dffad849b20844d5b07f963b4
Author mstembera
Date 2023-10-21 08:37:27 UTC
Scale down stat bonus STC https://tests.stockfishchess.org/tests/view/652eff58de6d262d08d33353 LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 88224 W: 22618 L: 22228 D: 43378 Ptnml(0-2): 282, 10177, 22783, 10609, 261 LTC https://tests.stockfishchess.org/tests/view/652fd13bde6d262d08d3481a LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 143508 W: 36674 L: 36142 D: 70692 Ptnml(0-2): 92, 15240, 40534, 15820, 68 Reduces the stat bonus by 20%. Maybe future patches can tune the actual bonus calculations for different histories. closes https://github.com/official-stockfish/Stockfish/pull/4836 bench: 1185932
Copyright 2011–2024 Next Chess Move LLC