Dev Builds » 20240521-0627

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:37:11 1207697 4004 1763 335 1906 +129.61 +/- 4.83 0 43 548 1351 60 +290.22 +/- 14.56
ncm-dbt-02 11:33:32 1236130 3994 1780 324 1890 +132.76 +/- 4.7 0 27 548 1361 61 +300.34 +/- 14.53
ncm-dbt-03 11:37:15 1230049 4016 1760 337 1919 +128.69 +/- 4.66 1 35 555 1374 43 +293.12 +/- 14.46
ncm-dbt-05 11:34:34 1200041 3986 1763 309 1914 +132.85 +/- 4.89 2 37 527 1359 68 +298.92 +/- 14.85
ncm-dbt-06 11:37:19 1230321 4000 1746 302 1952 +131.34 +/- 4.72 0 32 550 1360 58 +296.61 +/- 14.51
20000 8812 1607 9581 +131.04 +/- 2.13 3 174 2728 6805 290 +295.81 +/- 6.51

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
368392 ncm-dbt-06 1243126 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
368391 ncm-dbt-01 1242692 4 1 0 3 +88.51 +/- 137.63 0 0 1 1 0 +190.5 +/- 634.21
368390 ncm-dbt-03 1244008 16 7 1 8 +136.89 +/- 61.78 0 0 2 6 0 +337.87 +/- 515.83
368389 ncm-dbt-02 1239231 494 227 38 229 +140.05 +/- 12.97 0 1 65 172 9 +321.74 +/- 42.46
368388 ncm-dbt-05 1194917 486 211 37 238 +130.15 +/- 13.2 0 4 66 168 5 +298.27 +/- 42.36
368387 ncm-dbt-01 1201947 500 223 51 226 +124.6 +/- 12.71 0 3 76 167 4 +282.94 +/- 39.21
368386 ncm-dbt-06 1234096 500 216 44 240 +124.6 +/- 13.27 0 4 76 164 6 +277.93 +/- 39.29
368385 ncm-dbt-03 1242966 500 223 43 234 +130.94 +/- 13.14 0 3 71 169 7 +295.94 +/- 40.69
368384 ncm-dbt-02 1226551 500 222 34 244 +137.37 +/- 13.9 0 4 65 170 11 +306.84 +/- 42.73
368383 ncm-dbt-05 1195245 500 226 37 237 +138.18 +/- 13.12 0 1 69 170 10 +312.48 +/- 41.11
368382 ncm-dbt-01 1241732 500 227 41 232 +135.76 +/- 13.57 0 5 62 175 8 +309.64 +/- 43.82
368381 ncm-dbt-06 1235516 500 222 47 231 +126.97 +/- 14.11 0 6 72 163 9 +277.93 +/- 40.53
368380 ncm-dbt-03 1218157 500 217 37 246 +130.94 +/- 12.76 0 5 63 179 3 +306.84 +/- 43.45
368379 ncm-dbt-05 1190389 500 220 29 251 +139.81 +/- 14.01 0 5 60 174 11 +315.35 +/- 44.57
368378 ncm-dbt-02 1232558 500 225 39 236 +135.76 +/- 13.2 0 2 69 170 9 +306.84 +/- 41.23
368377 ncm-dbt-01 1231650 500 222 43 235 +130.14 +/- 13.52 0 4 71 167 8 +290.66 +/- 40.76
368376 ncm-dbt-06 1220506 500 207 37 256 +123.02 +/- 13.99 0 8 70 166 6 +273.0 +/- 41.13
368375 ncm-dbt-03 1209521 500 219 52 229 +120.67 +/- 13.15 0 4 80 161 5 +268.17 +/- 38.21
368374 ncm-dbt-02 1251993 500 215 43 242 +124.6 +/- 13.45 0 4 77 162 7 +275.45 +/- 39.01
368373 ncm-dbt-01 1198761 500 221 44 235 +128.55 +/- 13.91 0 8 63 173 6 +290.66 +/- 43.37
368372 ncm-dbt-05 1196993 500 218 33 249 +134.95 +/- 13.78 0 4 67 169 10 +301.33 +/- 42.04
368371 ncm-dbt-06 1219167 500 219 35 246 +134.15 +/- 12.67 0 1 71 171 7 +306.84 +/- 40.47
368370 ncm-dbt-03 1220835 500 223 39 238 +134.15 +/- 11.86 0 2 64 182 2 +321.19 +/- 42.95
368369 ncm-dbt-02 1230985 500 220 42 238 +129.35 +/- 12.8 0 4 68 174 4 +298.62 +/- 41.71
368368 ncm-dbt-01 1185350 500 227 28 245 +146.36 +/- 13.99 0 4 56 177 13 +333.32 +/- 46.21
368367 ncm-dbt-05 1193423 500 216 39 245 +128.55 +/- 13.56 0 5 70 168 7 +288.06 +/- 41.11
368366 ncm-dbt-06 1221392 500 221 34 245 +136.56 +/- 13.36 0 1 72 166 11 +304.07 +/- 40.16
368365 ncm-dbt-03 1243894 500 211 37 252 +126.17 +/- 13.77 0 6 71 166 7 +280.42 +/- 40.83
368364 ncm-dbt-02 1238060 500 230 42 228 +137.37 +/- 13.15 0 3 64 175 8 +315.35 +/- 43.03
368363 ncm-dbt-05 1215661 500 226 43 231 +133.34 +/- 14.34 1 4 66 169 10 +298.62 +/- 42.41
368362 ncm-dbt-01 1207669 500 208 44 248 +118.33 +/- 13.86 0 6 81 156 7 +256.44 +/- 38.07
368361 ncm-dbt-06 1240800 500 211 35 254 +127.76 +/- 13.02 0 6 65 176 3 +295.94 +/- 42.75
368360 ncm-dbt-03 1220893 500 211 43 246 +121.45 +/- 13.84 0 8 71 166 5 +270.57 +/- 40.83
368359 ncm-dbt-02 1235098 500 224 36 240 +137.37 +/- 12.96 0 4 60 180 6 +321.19 +/- 44.57
368358 ncm-dbt-01 1179512 500 213 50 237 +117.55 +/- 14.2 0 9 75 160 6 +256.44 +/- 39.69
368357 ncm-dbt-06 1222570 500 223 38 239 +134.95 +/- 12.64 0 2 67 175 6 +312.48 +/- 41.9
368356 ncm-dbt-05 1195794 500 224 40 236 +134.15 +/- 13.97 1 3 66 171 9 +304.07 +/- 42.38
368355 ncm-dbt-03 1241638 500 225 44 231 +131.74 +/- 12.74 0 2 71 171 6 +301.33 +/- 40.6
368354 ncm-dbt-02 1234570 500 217 50 233 +120.67 +/- 13.67 0 5 80 158 7 +263.42 +/- 38.27
368353 ncm-dbt-05 1217912 500 222 51 227 +123.81 +/- 14.48 0 11 63 170 6 +275.45 +/- 43.16
368352 ncm-dbt-06 1235716 500 227 32 241 +143.07 +/- 13.54 0 4 57 179 10 +330.23 +/- 45.79
368351 ncm-dbt-03 1228537 500 224 41 235 +133.34 +/- 14.17 1 5 62 174 8 +304.07 +/- 43.81
368350 ncm-dbt-01 1179962 500 221 34 245 +136.56 +/- 13.36 0 4 63 175 8 +312.48 +/- 43.44

Commit

Commit ID b8ccaf038a21effba4613dca95f30eb1bc3d77b9
Author FauziAkram
Date 2024-05-21 06:27:16 UTC
Use same shuffling Constant for both nets Passed STC: https://tests.stockfishchess.org/tests/view/664a42b15fc7b70b8817aeef LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 87840 W: 22759 L: 22594 D: 42487 Ptnml(0-2): 335, 10351, 22324, 10634, 276 Passed LTC: https://tests.stockfishchess.org/tests/view/664a46995fc7b70b8817af02 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 163122 W: 41443 L: 41367 D: 80312 Ptnml(0-2): 105, 18154, 44927, 18310, 65 closes https://github.com/official-stockfish/Stockfish/pull/5273 bench: 1190174
Copyright 2011–2024 Next Chess Move LLC