Dev Builds » 20230924-1804

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:56:59 1200996 3342 1456 318 1568 +123.23 +/- 5.43 1 40 503 1074 53 +269.31 +/- 15.19
ncm-dbt-02 09:50:24 1198766 3314 1399 308 1607 +118.8 +/- 5.32 4 31 529 1056 37 +262.54 +/- 14.78
ncm-dbt-03 09:55:54 1232692 3340 1419 287 1634 +122.6 +/- 5.36 0 53 467 1115 35 +273.54 +/- 15.78
ncm-dbt-04 09:55:49 1226737 3336 1445 283 1608 +126.3 +/- 5.43 0 43 474 1097 54 +278.09 +/- 15.66
ncm-dbt-05 09:52:11 1229430 3316 1425 286 1605 +124.4 +/- 5.42 2 40 480 1089 47 +275.35 +/- 15.56
ncm-dbt-06 09:56:23 1225476 3352 1419 329 1604 +117.23 +/- 5.34 2 52 504 1090 28 +260.4 +/- 15.19
20000 8563 1811 9626 +122.08 +/- 2.2 9 259 2957 6521 254 +269.79 +/- 6.26

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
204080 ncm-dbt-02 1197344 314 132 20 162 +129.62 +/- 15.35 0 0 48 106 3 +297.45 +/- 49.13
204079 ncm-dbt-05 1223850 316 146 23 147 +142.76 +/- 18.56 0 3 39 106 10 +311.9 +/- 55.7
204078 ncm-dbt-03 1221372 340 144 32 164 +118.88 +/- 16.56 0 7 45 117 1 +271.14 +/- 51.45
204077 ncm-dbt-04 1230314 336 143 35 158 +115.78 +/- 16.4 0 4 55 106 3 +254.73 +/- 46.37
204076 ncm-dbt-01 1222315 342 149 34 159 +121.55 +/- 15.84 0 2 56 109 4 +268.84 +/- 45.69
204075 ncm-dbt-06 1225720 352 149 36 167 +115.62 +/- 17.06 0 8 50 115 3 +254.73 +/- 48.73
204074 ncm-dbt-02 1195387 500 210 48 242 +116.77 +/- 13.19 0 3 88 153 6 +254.16 +/- 36.15
204073 ncm-dbt-05 1218426 500 216 49 235 +120.67 +/- 13.32 0 5 78 162 5 +268.17 +/- 38.8
204072 ncm-dbt-04 1243069 500 218 32 250 +135.76 +/- 13.57 0 2 71 166 11 +301.33 +/- 40.6
204071 ncm-dbt-03 1228559 500 209 47 244 +116.77 +/- 14.04 0 9 75 161 5 +256.44 +/- 39.69
204070 ncm-dbt-06 1207118 500 218 50 232 +121.45 +/- 14.5 0 10 69 164 7 +265.78 +/- 41.36
204069 ncm-dbt-01 1205219 500 213 49 238 +118.33 +/- 14.03 0 9 73 163 5 +261.07 +/- 40.24
204068 ncm-dbt-02 1195507 500 207 53 240 +110.6 +/- 13.89 1 4 91 148 6 +238.66 +/- 35.65
204067 ncm-dbt-05 1223149 500 207 47 246 +115.22 +/- 14.37 0 9 79 155 7 +247.41 +/- 38.64
204066 ncm-dbt-04 1217390 500 224 43 233 +131.74 +/- 15.04 0 10 60 169 11 +288.06 +/- 44.27
204065 ncm-dbt-01 1209733 500 218 51 231 +120.67 +/- 15.3 1 8 75 155 11 +256.44 +/- 39.69
204064 ncm-dbt-03 1232200 500 214 43 243 +123.81 +/- 14.15 0 9 67 168 6 +275.45 +/- 42.01
204063 ncm-dbt-06 1241857 500 214 48 238 +119.89 +/- 13.33 1 2 82 160 5 +268.17 +/- 37.61
204062 ncm-dbt-05 1249194 500 220 41 239 +130.14 +/- 13.16 0 3 72 168 7 +293.29 +/- 40.39
204061 ncm-dbt-04 1229481 500 205 47 248 +113.68 +/- 14.54 0 10 79 154 7 +243.0 +/- 38.64
204060 ncm-dbt-02 1195877 500 206 42 252 +118.33 +/- 14.36 2 7 69 169 3 +270.57 +/- 41.4
204059 ncm-dbt-06 1237590 500 215 54 231 +116.0 +/- 13.54 0 9 73 166 2 +261.07 +/- 40.24
204058 ncm-dbt-03 1234567 500 214 30 256 +134.15 +/- 13.97 0 6 63 172 9 +301.33 +/- 43.45
204057 ncm-dbt-01 1199706 500 217 50 233 +120.67 +/- 14.99 0 9 76 154 11 +254.16 +/- 39.42
204056 ncm-dbt-04 1223663 500 224 50 226 +126.17 +/- 12.68 0 4 71 172 3 +290.66 +/- 40.76
204055 ncm-dbt-02 1193245 500 225 49 226 +127.76 +/- 13.39 0 4 73 166 7 +285.49 +/- 40.16
204054 ncm-dbt-05 1226261 500 209 45 246 +118.33 +/- 14.03 0 9 73 163 5 +261.07 +/- 40.24
204053 ncm-dbt-03 1249016 500 204 48 248 +112.14 +/- 13.39 0 7 83 157 3 +247.41 +/- 37.61
204052 ncm-dbt-06 1207112 500 208 55 237 +109.83 +/- 14.22 0 12 76 159 3 +240.82 +/- 39.35
204051 ncm-dbt-01 1194042 500 227 51 222 +127.76 +/- 14.44 0 7 70 163 10 +277.93 +/- 41.14
204050 ncm-dbt-02 1194600 500 210 63 227 +105.25 +/- 14.51 1 7 93 142 7 +221.9 +/- 35.4
204049 ncm-dbt-05 1221172 500 208 43 249 +119.11 +/- 13.69 1 5 76 164 4 +268.17 +/- 39.39
204048 ncm-dbt-04 1212556 500 208 40 252 +121.45 +/- 14.5 0 10 69 164 7 +265.78 +/- 41.36
204047 ncm-dbt-06 1200182 500 212 44 244 +121.46 +/- 14.17 1 8 67 170 4 +275.45 +/- 42.01
204046 ncm-dbt-03 1218922 500 214 43 243 +123.81 +/- 14.15 0 9 67 168 6 +275.45 +/- 42.01
204045 ncm-dbt-01 1179778 500 216 44 240 +124.6 +/- 13.45 0 3 80 159 8 +273.0 +/- 38.12
204044 ncm-dbt-02 1219406 500 209 33 258 +127.76 +/- 13.39 0 6 67 172 5 +290.66 +/- 42.08
204043 ncm-dbt-05 1243963 500 219 38 243 +131.74 +/- 14.54 1 6 63 171 9 +295.94 +/- 43.42
204042 ncm-dbt-04 1230691 500 223 36 241 +136.56 +/- 13.92 0 3 69 166 12 +301.33 +/- 41.33
204041 ncm-dbt-03 1244211 500 220 44 236 +127.76 +/- 13.39 0 6 67 172 5 +290.66 +/- 42.08
204040 ncm-dbt-06 1258758 500 203 42 255 +116.0 +/- 12.84 0 3 87 156 4 +256.44 +/- 36.38
204039 ncm-dbt-01 1196185 500 216 39 245 +128.55 +/- 12.43 0 2 73 171 4 +295.94 +/- 39.99

Commit

Commit ID 22cdb6c1ea1f5ca429333bcbe26706c8b4dd38d7
Author Joost VandeVondele
Date 2023-09-24 18:04:42 UTC
Explicitly invoke shell in some cases the permission on the script might be incorrect (zip downloads?). Explicitly invoke the shell closes https://github.com/official-stockfish/Stockfish/pull/4803 No functional change
Copyright 2011–2024 Next Chess Move LLC