Dev Builds » 20231030-0651

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:02:44 1216824 3342 1449 316 1577 +122.64 +/- 5.52 0 53 484 1082 52 +267.52 +/- 15.5
ncm-dbt-02 09:59:34 1199294 3298 1413 289 1596 +123.34 +/- 5.43 2 43 475 1087 42 +273.84 +/- 15.64
ncm-dbt-03 10:03:25 1232782 3352 1440 251 1661 +128.84 +/- 5.24 0 38 454 1141 43 +290.51 +/- 16.0
ncm-dbt-04 10:03:09 1219419 3332 1408 276 1648 +122.92 +/- 5.35 0 53 462 1117 34 +274.88 +/- 15.86
ncm-dbt-05 09:59:56 1230941 3330 1446 277 1607 +127.38 +/- 5.23 1 32 471 1119 42 +286.44 +/- 15.7
ncm-dbt-06 10:05:09 1227039 3346 1418 269 1659 +124.36 +/- 5.28 0 41 483 1108 41 +276.86 +/- 15.51
20000 8574 1678 9748 +124.91 +/- 2.18 3 260 2829 6654 254 +278.24 +/- 6.4

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
207802 ncm-dbt-02 1197110 298 130 30 138 +121.28 +/- 18.39 0 6 40 100 3 +269.97 +/- 54.72
207801 ncm-dbt-05 1217501 330 150 29 151 +133.61 +/- 16.92 0 3 44 112 6 +299.28 +/- 52.25
207800 ncm-dbt-04 1203471 332 140 23 169 +127.92 +/- 17.94 0 7 40 114 5 +284.66 +/- 54.52
207799 ncm-dbt-01 1184532 342 155 26 161 +137.85 +/- 16.05 0 2 44 119 6 +314.84 +/- 52.2
207798 ncm-dbt-06 1237758 346 137 37 172 +103.36 +/- 17.75 0 8 62 98 5 +214.42 +/- 43.66
207797 ncm-dbt-03 1235440 352 155 27 170 +132.39 +/- 15.61 0 3 46 123 4 +304.45 +/- 51.07
207796 ncm-dbt-02 1203395 500 223 45 232 +129.35 +/- 13.9 0 7 65 171 7 +290.66 +/- 42.73
207795 ncm-dbt-05 1238571 500 214 45 241 +122.24 +/- 14.33 1 6 73 163 7 +270.57 +/- 40.25
207794 ncm-dbt-01 1245380 500 217 61 222 +112.14 +/- 13.56 0 5 90 149 6 +240.82 +/- 35.87
207793 ncm-dbt-04 1223462 500 208 43 249 +119.11 +/- 13.69 0 8 73 165 4 +265.78 +/- 40.25
207792 ncm-dbt-06 1229575 500 222 41 237 +131.74 +/- 13.85 0 7 62 174 7 +298.62 +/- 43.77
207791 ncm-dbt-03 1231730 500 211 35 254 +127.76 +/- 13.02 0 3 74 167 6 +288.06 +/- 39.79
207790 ncm-dbt-02 1201211 500 214 51 235 +117.55 +/- 13.7 0 5 84 154 7 +254.16 +/- 37.27
207789 ncm-dbt-05 1232192 500 222 32 246 +138.99 +/- 14.21 0 7 56 177 10 +315.35 +/- 46.07
207788 ncm-dbt-01 1244538 500 213 52 235 +116.0 +/- 15.0 0 13 70 160 7 +249.64 +/- 40.9
207787 ncm-dbt-04 1206646 500 205 44 251 +116.0 +/- 13.54 0 8 76 163 3 +258.75 +/- 39.42
207786 ncm-dbt-03 1220806 500 218 35 247 +133.34 +/- 12.69 0 4 63 179 4 +312.48 +/- 43.44
207785 ncm-dbt-06 1221964 500 213 44 243 +122.24 +/- 13.66 0 6 75 163 6 +270.57 +/- 39.67
207784 ncm-dbt-02 1194227 500 213 44 243 +122.24 +/- 14.66 2 4 75 161 8 +270.57 +/- 39.67
207783 ncm-dbt-05 1231988 500 210 35 255 +126.97 +/- 12.28 0 3 71 174 2 +295.94 +/- 40.69
207782 ncm-dbt-03 1238998 500 215 40 245 +126.97 +/- 13.41 0 6 68 171 5 +288.06 +/- 41.76
207781 ncm-dbt-04 1238276 500 215 31 254 +134.15 +/- 13.43 0 6 60 178 6 +309.64 +/- 44.55
207780 ncm-dbt-01 1212722 500 209 51 240 +113.68 +/- 13.38 0 8 78 162 2 +254.16 +/- 38.89
207779 ncm-dbt-06 1231854 500 214 37 249 +128.55 +/- 13.19 0 3 74 166 7 +288.06 +/- 39.79
207778 ncm-dbt-02 1196057 500 218 36 246 +132.54 +/- 12.91 0 3 68 173 6 +304.07 +/- 41.65
207777 ncm-dbt-05 1243153 500 216 58 226 +113.68 +/- 13.38 0 7 81 159 3 +251.89 +/- 38.11
207776 ncm-dbt-03 1257868 500 214 44 242 +123.02 +/- 14.82 0 9 72 159 10 +263.42 +/- 40.52
207775 ncm-dbt-04 1215329 500 208 49 243 +114.45 +/- 13.55 0 9 75 164 2 +256.44 +/- 39.69
207774 ncm-dbt-01 1199776 500 222 42 236 +130.94 +/- 15.05 0 8 67 162 13 +280.42 +/- 42.05
207773 ncm-dbt-06 1233527 500 214 46 240 +121.45 +/- 13.84 0 8 71 166 5 +270.57 +/- 40.83
207772 ncm-dbt-02 1188065 500 207 35 258 +124.6 +/- 13.8 0 7 70 167 6 +277.93 +/- 41.14
207771 ncm-dbt-05 1214843 500 215 33 252 +132.54 +/- 13.1 0 3 69 171 7 +301.33 +/- 41.33
207770 ncm-dbt-01 1191930 500 220 33 247 +136.56 +/- 15.13 0 7 64 164 15 +293.29 +/- 43.07
207769 ncm-dbt-04 1237416 500 223 40 237 +133.34 +/- 13.81 0 7 60 176 7 +304.07 +/- 44.5
207768 ncm-dbt-03 1216519 500 215 36 249 +130.14 +/- 13.16 0 5 66 174 5 +298.62 +/- 42.41
207767 ncm-dbt-06 1232322 500 204 34 262 +123.02 +/- 12.56 0 4 74 170 2 +282.94 +/- 39.86
207766 ncm-dbt-01 1238891 500 213 51 236 +116.77 +/- 13.88 0 10 71 166 3 +261.07 +/- 40.78
207765 ncm-dbt-02 1214993 500 208 48 244 +115.22 +/- 14.37 0 11 73 161 5 +251.89 +/- 40.18
207764 ncm-dbt-05 1238345 500 219 45 236 +126.17 +/- 13.24 0 3 77 163 7 +280.42 +/- 38.93
207763 ncm-dbt-04 1211337 500 209 46 245 +117.55 +/- 14.2 0 8 78 157 7 +254.16 +/- 38.89
207762 ncm-dbt-03 1228117 500 212 34 254 +129.35 +/- 14.41 0 8 65 168 9 +285.49 +/- 42.7
207761 ncm-dbt-06 1202276 500 214 30 256 +134.15 +/- 13.8 0 5 65 171 9 +301.33 +/- 42.75

Commit

Commit ID 908811c24ab53d2cb1bebc1138427e21fefa8054
Author Muzhen Gaming
Date 2023-10-30 06:51:27 UTC
Introduce asymmetric optimism Introduce asymmetric optimism for both side to move and opponent. Parameter tuning was done with 200k LTC games. STC: https://tests.stockfishchess.org/tests/view/653cc08fcc309ae8395622b3 LLR: 2.96 (-2.94,2.94) <0.00,2.00> Total: 98336 W: 25074 L: 24661 D: 48601 Ptnml(0-2): 339, 11612, 24890, 11951, 376 LTC: https://tests.stockfishchess.org/tests/view/653db595cc309ae839563140 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 83244 W: 20760 L: 20339 D: 42145 Ptnml(0-2): 51, 9306, 22498, 9705, 62 closes https://github.com/official-stockfish/Stockfish/pull/4853 Bench: 1371690
Copyright 2011–2024 Next Chess Move LLC