Dev Builds » 20240104-1454

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:49:20 1207032 3348 1470 268 1610 +130.55 +/- 5.29 0 36 451 1136 51 +293.01 +/- 16.06
ncm-dbt-02 09:44:06 1232182 3312 1449 261 1602 +130.42 +/- 5.24 0 31 454 1123 48 +293.55 +/- 15.99
ncm-dbt-03 09:48:40 1230489 3338 1481 253 1604 +134.1 +/- 5.23 1 32 422 1166 48 +306.57 +/- 16.6
ncm-dbt-04 09:49:51 1236733 3348 1468 260 1620 +131.27 +/- 5.27 1 40 426 1164 43 +298.98 +/- 16.53
ncm-dbt-05 09:45:27 1236937 3318 1423 232 1663 +130.52 +/- 5.14 0 29 451 1138 41 +296.73 +/- 16.04
ncm-dbt-06 09:49:23 1224491 3336 1439 225 1672 +132.51 +/- 5.3 1 31 443 1139 54 +298.65 +/- 16.2
20000 8730 1499 9771 +131.56 +/- 2.14 3 199 2647 6866 285 +297.88 +/- 6.62

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
243904 ncm-dbt-05 1226146 318 138 19 161 +136.65 +/- 16.52 0 1 44 108 6 +308.72 +/- 51.92
243903 ncm-dbt-02 1218979 312 131 19 162 +130.53 +/- 16.56 0 3 41 109 3 +300.46 +/- 54.22
243902 ncm-dbt-06 1217299 336 142 21 173 +130.99 +/- 18.04 1 5 39 118 5 +298.91 +/- 55.39
243901 ncm-dbt-03 1230043 338 158 22 158 +148.17 +/- 16.42 0 3 34 125 7 +348.86 +/- 59.95
243900 ncm-dbt-04 1235817 348 145 35 168 +113.71 +/- 16.06 0 6 53 114 1 +255.55 +/- 47.4
243899 ncm-dbt-01 1218356 348 153 29 166 +129.47 +/- 17.04 0 4 49 114 7 +283.21 +/- 49.39
243898 ncm-dbt-05 1241408 500 226 38 236 +137.37 +/- 12.56 0 2 64 178 6 +321.19 +/- 42.95
243897 ncm-dbt-02 1233002 500 217 48 235 +122.24 +/- 14.0 0 7 74 162 7 +268.17 +/- 39.97
243896 ncm-dbt-03 1229549 500 224 40 236 +134.15 +/- 13.24 0 5 62 177 6 +309.64 +/- 43.82
243895 ncm-dbt-06 1223438 500 215 31 254 +134.15 +/- 12.86 0 2 69 172 7 +306.84 +/- 41.23
243894 ncm-dbt-04 1231797 500 225 37 238 +137.37 +/- 13.34 0 5 59 179 7 +318.25 +/- 44.96
243893 ncm-dbt-01 1197299 500 209 29 262 +130.94 +/- 12.95 0 3 70 171 6 +298.62 +/- 41.01
243892 ncm-dbt-02 1226770 500 217 41 242 +127.76 +/- 12.84 0 4 70 172 4 +293.29 +/- 41.07
243891 ncm-dbt-05 1237307 500 210 35 255 +126.97 +/- 12.85 0 5 68 174 3 +293.29 +/- 41.75
243890 ncm-dbt-03 1233555 500 222 31 247 +139.81 +/- 13.64 0 7 52 184 7 +327.18 +/- 47.79
243889 ncm-dbt-01 1224066 500 235 43 222 +140.62 +/- 13.99 0 6 56 178 10 +321.19 +/- 46.14
243888 ncm-dbt-04 1254571 500 222 50 228 +124.6 +/- 14.8 1 7 70 163 9 +273.0 +/- 41.13
243887 ncm-dbt-06 1208139 500 218 39 243 +130.14 +/- 14.74 0 5 75 156 14 +275.45 +/- 39.63
243886 ncm-dbt-05 1241079 500 215 29 256 +135.76 +/- 13.76 0 4 66 170 10 +304.07 +/- 42.38
243885 ncm-dbt-02 1248334 500 220 45 235 +126.97 +/- 13.94 0 7 68 168 7 +282.94 +/- 41.76
243884 ncm-dbt-03 1219292 500 214 34 252 +130.94 +/- 12.95 0 2 73 168 7 +295.94 +/- 39.99
243883 ncm-dbt-01 1233697 500 222 42 236 +130.94 +/- 13.32 0 4 69 170 7 +295.94 +/- 41.39
243882 ncm-dbt-06 1239724 500 214 27 259 +136.56 +/- 13.17 0 4 62 177 7 +315.35 +/- 43.81
243881 ncm-dbt-04 1221310 500 222 41 237 +131.74 +/- 14.37 0 6 68 165 11 +288.06 +/- 41.76
243880 ncm-dbt-02 1220728 500 225 29 246 +143.89 +/- 13.12 0 2 60 178 10 +333.32 +/- 44.47
243879 ncm-dbt-05 1221413 500 208 39 253 +122.24 +/- 13.48 0 8 68 171 3 +277.93 +/- 41.74
243878 ncm-dbt-03 1239146 500 220 46 234 +126.17 +/- 13.24 0 5 71 169 5 +285.49 +/- 40.81
243877 ncm-dbt-01 1196034 500 214 41 245 +125.38 +/- 13.79 0 6 72 165 7 +277.93 +/- 40.53
243876 ncm-dbt-06 1229013 500 210 42 248 +121.45 +/- 14.01 0 7 75 161 7 +265.78 +/- 39.69
243875 ncm-dbt-04 1245922 500 214 31 255 +133.34 +/- 12.69 0 3 66 176 5 +309.64 +/- 42.33
243874 ncm-dbt-02 1221100 500 224 36 240 +137.37 +/- 14.08 0 4 66 168 12 +304.07 +/- 42.38
243873 ncm-dbt-05 1247696 500 211 38 251 +125.38 +/- 12.89 0 3 76 166 5 +282.94 +/- 39.21
243872 ncm-dbt-01 1192532 500 221 41 238 +130.94 +/- 13.51 0 5 67 171 7 +295.94 +/- 42.08
243871 ncm-dbt-03 1227185 500 216 39 245 +128.55 +/- 14.26 0 7 68 166 9 +282.94 +/- 41.76
243870 ncm-dbt-06 1205602 500 217 25 258 +140.62 +/- 13.24 0 2 64 174 10 +321.19 +/- 42.95
243869 ncm-dbt-04 1239439 500 219 38 243 +131.74 +/- 12.93 0 5 63 178 4 +306.84 +/- 43.45
243868 ncm-dbt-02 1256363 500 215 43 242 +124.6 +/- 13.09 0 4 75 166 5 +280.42 +/- 39.57
243867 ncm-dbt-03 1234653 500 227 41 232 +135.76 +/- 13.57 1 3 62 177 7 +315.35 +/- 43.81
243866 ncm-dbt-05 1243511 500 215 34 251 +131.74 +/- 13.85 0 6 65 171 8 +295.94 +/- 42.75
243865 ncm-dbt-01 1187246 500 216 43 241 +125.38 +/- 14.13 0 8 68 167 7 +277.93 +/- 41.74
243864 ncm-dbt-06 1248228 500 223 40 237 +133.34 +/- 13.08 0 6 59 181 4 +312.48 +/- 44.93
243863 ncm-dbt-04 1228278 500 221 28 251 +141.44 +/- 13.59 0 8 47 189 6 +336.46 +/- 50.04

Commit

Commit ID b987d4f0332f57a58157641bf3a6e437133e7879
Author Disservin
Date 2024-01-04 14:54:23 UTC
Use type aliases instead of enums for Value types The primary rationale behind this lies in the fact that enums were not originally designed to be employed in the manner we currently utilize them. The Value enum was used like a type alias throughout the code and was often misused. Furthermore, changing the underlying size of the enum to int16_t broke everything, mostly because of the operator overloads for the Value enum, were causing data to be truncated. Since Value is now a type alias, the operator overloads are no longer required. Passed Non-Regression STC: https://tests.stockfishchess.org/tests/view/6593b8bb79aa8af82b95b401 LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 235296 W: 59919 L: 59917 D: 115460 Ptnml(0-2): 743, 27085, 62054, 26959, 807 closes https://github.com/official-stockfish/Stockfish/pull/4960 No functional change
Copyright 2011–2024 Next Chess Move LLC