Dev Builds » 20230903-0607

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:51:03 1148877 3334 1434 258 1642 +128.05 +/- 5.17 0 25 488 1107 47 +286.3 +/- 15.39
ncm-dbt-02 09:51:43 1198194 3314 1422 286 1606 +124.12 +/- 5.47 1 44 480 1082 50 +273.0 +/- 15.56
ncm-dbt-03 09:54:44 1235765 3338 1440 287 1611 +125.16 +/- 5.23 0 38 479 1113 39 +280.09 +/- 15.57
ncm-dbt-04 09:54:31 1236487 3352 1445 277 1630 +126.35 +/- 5.29 0 41 470 1121 44 +282.09 +/- 15.73
ncm-dbt-05 09:51:24 1230440 3316 1399 298 1619 +119.9 +/- 5.33 0 45 504 1072 37 +264.44 +/- 15.18
ncm-dbt-06 09:56:19 1222435 3346 1434 266 1646 +126.6 +/- 5.14 0 34 473 1130 36 +285.89 +/- 15.67
20000 8574 1672 9754 +125.03 +/- 2.15 1 227 2894 6625 253 +278.55 +/- 6.33

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
202045 ncm-dbt-01 1193867 132 53 8 71 +123.37 +/- 27.66 0 2 19 43 2 +270.28 +/- 81.38
202044 ncm-dbt-02 1196587 314 127 23 164 +119.58 +/- 16.01 0 3 48 105 1 +273.03 +/- 49.78
202043 ncm-dbt-05 1215173 316 136 28 152 +123.72 +/- 17.3 0 4 46 104 4 +274.36 +/- 51.01
202042 ncm-dbt-03 1227219 338 142 30 166 +119.64 +/- 15.33 0 3 52 113 1 +273.49 +/- 47.74
202041 ncm-dbt-04 1235216 352 151 30 171 +124.5 +/- 16.7 0 5 50 116 5 +274.89 +/- 48.88
202040 ncm-dbt-06 1198063 346 142 34 170 +112.19 +/- 15.52 0 3 61 107 2 +247.81 +/- 43.72
202039 ncm-dbt-01 1188311 500 220 45 235 +126.97 +/- 13.22 0 3 76 164 7 +282.94 +/- 39.21
202038 ncm-dbt-02 1199969 500 215 42 243 +125.38 +/- 14.3 0 8 69 165 8 +275.45 +/- 41.43
202037 ncm-dbt-05 1246178 500 208 57 235 +108.3 +/- 13.89 0 10 82 155 3 +236.51 +/- 37.9
202036 ncm-dbt-04 1240266 500 219 35 246 +134.15 +/- 12.86 0 2 69 172 7 +306.84 +/- 41.23
202035 ncm-dbt-03 1241316 500 216 38 246 +129.35 +/- 12.8 0 3 71 171 5 +295.94 +/- 40.69
202034 ncm-dbt-06 1224138 500 209 50 241 +114.45 +/- 13.55 0 9 75 164 2 +256.44 +/- 39.69
202033 ncm-dbt-01 1187929 500 215 47 238 +121.45 +/- 13.14 0 3 82 159 6 +268.17 +/- 37.61
202032 ncm-dbt-05 1221201 500 195 41 264 +110.6 +/- 14.06 0 11 77 159 3 +243.0 +/- 39.13
202031 ncm-dbt-02 1198368 500 219 50 231 +122.24 +/- 14.0 0 6 77 159 8 +265.78 +/- 39.12
202030 ncm-dbt-03 1242299 500 214 47 239 +120.67 +/- 14.18 0 7 77 158 8 +261.07 +/- 39.14
202029 ncm-dbt-04 1223362 500 221 44 235 +128.55 +/- 13.38 0 6 66 173 5 +293.29 +/- 42.41
202028 ncm-dbt-06 1219668 500 207 26 267 +131.74 +/- 13.12 0 2 73 167 8 +295.94 +/- 39.99
202027 ncm-dbt-01 1216484 500 211 28 261 +133.34 +/- 12.49 0 3 65 178 4 +312.48 +/- 42.67
202026 ncm-dbt-05 1243742 500 219 51 230 +121.45 +/- 13.49 0 6 75 164 5 +270.57 +/- 39.67
202025 ncm-dbt-02 1197829 500 205 41 254 +118.33 +/- 14.2 1 3 86 151 9 +254.16 +/- 36.71
202024 ncm-dbt-03 1229733 500 212 47 241 +119.11 +/- 13.69 0 9 70 168 3 +268.17 +/- 41.1
202023 ncm-dbt-04 1250953 500 212 47 241 +119.11 +/- 14.84 0 11 71 160 8 +256.44 +/- 40.73
202022 ncm-dbt-06 1227332 500 211 43 246 +121.45 +/- 12.95 0 4 78 164 4 +273.0 +/- 38.74
202021 ncm-dbt-01 1097676 202 89 16 97 +131.49 +/- 22.06 0 3 25 70 3 +296.65 +/- 70.29
202020 ncm-dbt-05 1213026 500 202 46 252 +112.14 +/- 14.38 0 10 80 154 6 +240.82 +/- 38.39
202019 ncm-dbt-02 1192211 500 219 39 242 +130.94 +/- 14.56 0 7 67 165 11 +285.49 +/- 42.08
202018 ncm-dbt-03 1229515 500 220 34 246 +135.76 +/- 13.2 0 4 63 176 7 +312.48 +/- 43.44
202017 ncm-dbt-04 1251358 500 215 35 250 +130.94 +/- 13.32 0 4 69 170 7 +295.94 +/- 41.39
202016 ncm-dbt-01 1114055 500 212 43 245 +122.24 +/- 14.0 0 6 77 159 8 +265.78 +/- 39.12
202015 ncm-dbt-06 1227381 500 206 39 255 +120.67 +/- 13.32 0 6 75 165 4 +270.57 +/- 39.67
202014 ncm-dbt-05 1217652 500 215 36 249 +130.14 +/- 13.52 0 3 74 164 9 +288.06 +/- 39.79
202013 ncm-dbt-02 1197770 500 216 43 241 +125.38 +/- 13.96 0 8 67 169 6 +280.42 +/- 42.05
202012 ncm-dbt-03 1248792 500 218 37 245 +131.74 +/- 13.12 0 3 70 170 7 +298.62 +/- 41.01
202011 ncm-dbt-04 1223975 500 219 44 237 +126.97 +/- 13.58 0 6 69 169 6 +285.49 +/- 41.44
202010 ncm-dbt-06 1220583 500 232 36 232 +143.89 +/- 13.51 0 4 56 180 10 +333.32 +/- 46.21
202009 ncm-dbt-01 1098040 500 224 38 238 +135.76 +/- 13.39 0 2 70 168 10 +304.07 +/- 40.91
202008 ncm-dbt-05 1256110 500 224 39 237 +134.95 +/- 12.64 0 1 70 172 7 +309.64 +/- 40.79
202007 ncm-dbt-04 1230280 500 208 42 250 +119.89 +/- 13.85 0 7 76 161 6 +263.42 +/- 39.41
202006 ncm-dbt-01 1094655 500 210 33 257 +128.55 +/- 13.19 0 3 74 166 7 +288.06 +/- 39.79
202005 ncm-dbt-02 1204626 500 221 48 231 +125.38 +/- 14.3 0 9 66 168 7 +277.93 +/- 42.33
202004 ncm-dbt-03 1231485 500 218 54 228 +118.33 +/- 14.52 0 9 76 157 8 +254.16 +/- 39.42
202003 ncm-dbt-06 1239884 500 227 38 235 +138.18 +/- 13.32 0 6 55 183 6 +324.17 +/- 46.56

Commit

Commit ID 8cd5cbf6939d76b33a744f1379a6f84a4ac3a6cb
Author ttruscott
Date 2023-09-03 06:07:59 UTC
Omit two unneeded tests These redundant tests were intended as a speed-up, but they do not seem to provide any speed anymore. STC: https://tests.stockfishchess.org/tests/view/64e9079c85e3e95030fd8259 LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 134688 W: 34338 L: 34226 D: 66124 Ptnml(0-2): 426, 15122, 36124, 15258, 414 closes https://github.com/official-stockfish/Stockfish/pull/4767 No functional change
Copyright 2011–2024 Next Chess Move LLC