Dev Builds » 20240428-1927

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:42:01 1217276 4000 1743 290 1967 +132.24 +/- 4.78 0 40 525 1377 58 +299.63 +/- 14.88
ncm-dbt-02 11:39:16 1234456 3986 1776 282 1928 +136.89 +/- 4.69 0 31 497 1405 60 +315.0 +/- 15.29
ncm-dbt-03 11:41:31 1233804 4018 1778 321 1919 +131.99 +/- 4.84 0 44 527 1375 63 +297.19 +/- 14.85
ncm-dbt-05 11:39:08 1210620 3986 1752 308 1926 +131.85 +/- 4.64 0 35 524 1389 45 +302.67 +/- 14.89
ncm-dbt-06 11:42:13 1234142 4010 1771 278 1961 +135.89 +/- 4.6 0 23 525 1398 59 +311.92 +/- 14.84
20000 8820 1479 9701 +133.77 +/- 2.11 0 173 2598 6944 285 +305.18 +/- 6.68

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
360415 ncm-dbt-01 1217413 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
360414 ncm-dbt-06 1232674 10 5 0 5 +190.62 +/- 11.11 0 0 0 5 0 +1199.83 +/- 231.31
360413 ncm-dbt-03 1221917 18 6 1 11 +99.06 +/- 62.04 0 0 4 5 0 +217.54 +/- 198.33
360412 ncm-dbt-05 1191210 486 213 38 235 +130.97 +/- 12.78 0 4 63 173 3 +306.72 +/- 43.42
360411 ncm-dbt-02 1221269 486 232 35 219 +149.41 +/- 12.7 0 3 47 186 7 +364.88 +/- 50.66
360410 ncm-dbt-01 1233376 500 218 37 245 +131.74 +/- 13.3 0 5 65 174 6 +301.33 +/- 42.75
360409 ncm-dbt-06 1243257 500 220 45 235 +126.97 +/- 13.41 0 4 74 165 7 +282.94 +/- 39.86
360408 ncm-dbt-03 1229443 500 224 34 242 +138.99 +/- 12.9 0 3 61 179 7 +324.17 +/- 44.15
360407 ncm-dbt-05 1198727 500 214 35 251 +130.14 +/- 13.16 0 4 69 171 6 +295.94 +/- 41.39
360406 ncm-dbt-02 1227421 500 211 35 254 +127.76 +/- 13.75 0 9 60 177 4 +293.29 +/- 44.36
360405 ncm-dbt-01 1214640 500 212 37 251 +126.97 +/- 13.22 0 4 73 167 6 +285.49 +/- 40.16
360404 ncm-dbt-03 1246110 500 221 45 234 +127.76 +/- 13.21 0 6 66 174 4 +293.29 +/- 42.41
360403 ncm-dbt-06 1230328 500 231 30 239 +148.02 +/- 13.15 0 3 53 184 10 +349.43 +/- 47.56
360402 ncm-dbt-02 1234323 500 223 37 240 +135.76 +/- 13.39 0 6 58 180 6 +315.35 +/- 45.33
360401 ncm-dbt-05 1199081 500 227 44 229 +133.34 +/- 12.89 0 3 67 174 6 +306.84 +/- 41.99
360400 ncm-dbt-01 1211218 500 220 44 236 +127.76 +/- 13.57 0 4 74 164 8 +282.94 +/- 39.86
360399 ncm-dbt-06 1230123 500 214 33 253 +131.74 +/- 13.3 0 3 71 168 8 +295.94 +/- 40.69
360398 ncm-dbt-03 1235273 500 219 45 236 +126.17 +/- 14.62 0 9 67 165 9 +275.45 +/- 42.01
360397 ncm-dbt-02 1244463 500 221 40 239 +131.74 +/- 13.12 0 1 76 164 9 +293.29 +/- 38.98
360396 ncm-dbt-05 1198271 500 215 37 248 +129.35 +/- 13.54 0 6 66 172 6 +293.29 +/- 42.41
360395 ncm-dbt-01 1206590 500 227 38 235 +138.18 +/- 14.06 0 7 56 178 9 +315.35 +/- 46.07
360394 ncm-dbt-06 1235650 500 226 36 238 +138.99 +/- 12.3 0 2 61 182 5 +330.23 +/- 44.08
360393 ncm-dbt-03 1212506 500 221 45 234 +127.76 +/- 14.27 0 4 78 156 12 +273.0 +/- 38.74
360392 ncm-dbt-05 1207567 500 227 40 233 +136.56 +/- 13.17 0 4 62 177 7 +315.35 +/- 43.81
360391 ncm-dbt-02 1228077 500 220 28 252 +140.62 +/- 13.24 0 3 61 177 9 +324.17 +/- 44.15
360390 ncm-dbt-01 1195942 500 220 39 241 +131.74 +/- 13.67 0 5 67 170 8 +295.94 +/- 42.08
360389 ncm-dbt-06 1234750 500 225 33 242 +140.62 +/- 13.04 0 4 57 182 7 +330.23 +/- 45.79
360388 ncm-dbt-03 1245298 500 227 29 244 +145.54 +/- 12.85 0 4 51 188 7 +349.43 +/- 48.52
360387 ncm-dbt-05 1197704 500 213 37 250 +127.76 +/- 13.75 0 7 66 171 6 +288.06 +/- 42.4
360386 ncm-dbt-02 1229232 500 213 33 254 +130.94 +/- 12.37 0 2 70 174 4 +304.07 +/- 40.91
360385 ncm-dbt-01 1248565 500 216 30 254 +135.76 +/- 13.76 0 6 60 176 8 +309.64 +/- 44.55
360384 ncm-dbt-03 1256091 500 220 32 248 +137.37 +/- 13.53 0 6 57 180 7 +318.25 +/- 45.73
360383 ncm-dbt-06 1254746 500 223 32 245 +139.81 +/- 13.07 0 2 64 175 9 +321.19 +/- 42.95
360382 ncm-dbt-05 1244514 500 220 38 242 +132.54 +/- 13.28 0 5 64 175 6 +304.07 +/- 43.1
360381 ncm-dbt-01 1190012 500 211 39 250 +124.6 +/- 13.8 0 7 70 167 6 +277.93 +/- 41.14
360380 ncm-dbt-02 1254497 500 228 38 234 +138.99 +/- 13.48 0 4 61 176 9 +318.25 +/- 44.18
360379 ncm-dbt-03 1237765 500 230 44 226 +135.76 +/- 14.47 0 6 64 168 12 +298.62 +/- 43.1
360378 ncm-dbt-06 1224467 500 211 36 253 +126.97 +/- 12.85 0 4 71 171 4 +290.66 +/- 40.76
360377 ncm-dbt-01 1237734 500 219 26 255 +141.44 +/- 12.61 0 2 60 181 7 +333.32 +/- 44.47
360376 ncm-dbt-03 1219836 500 210 46 244 +118.33 +/- 13.52 0 6 79 160 5 +261.07 +/- 38.58
360375 ncm-dbt-05 1247893 500 223 39 238 +134.15 +/- 12.47 0 2 67 176 5 +312.48 +/- 41.9
360374 ncm-dbt-02 1236373 500 228 36 236 +140.62 +/- 13.8 0 3 64 171 12 +315.35 +/- 43.03
360373 ncm-dbt-06 1221283 500 216 33 251 +133.34 +/- 13.08 0 1 74 166 9 +298.62 +/- 39.56

Commit

Commit ID bc45cbc820a53a9fc405c06ca67bd7be3970344e
Author Joost VandeVondele
Date 2024-04-28 19:27:28 UTC
Output some basic info about the used networks Adds size in memory as well as layer sizes as in info string NNUE evaluation using nn-ae6a388e4a1a.nnue (132MiB, (22528, 3072, 15, 32, 1)) info string NNUE evaluation using nn-baff1ede1f90.nnue (6MiB, (22528, 128, 15, 32, 1)) For example, the size in MiB is useful to keep the fishtest memory sizes up-to-date, the L1-L3 sizes give a useful hint about the architecture used. closes https://github.com/official-stockfish/Stockfish/pull/5193 No functional change
Copyright 2011–2024 Next Chess Move LLC