Dev Builds » 20240515-1419

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:44:32 1202514 4010 1777 313 1920 +132.98 +/- 4.84 0 38 535 1362 70 +298.12 +/- 14.73
ncm-dbt-02 11:41:15 1199761 3980 1744 290 1946 +133.07 +/- 4.76 0 43 502 1393 52 +304.43 +/- 15.22
ncm-dbt-03 11:45:06 1234766 4010 1786 276 1948 +137.6 +/- 4.67 0 30 497 1416 62 +316.94 +/- 15.29
ncm-dbt-05 11:41:43 1198245 3988 1767 288 1933 +135.3 +/- 4.91 0 46 493 1385 70 +305.88 +/- 15.36
ncm-dbt-06 11:44:01 1225672 4012 1762 338 1912 +128.93 +/- 4.64 0 27 580 1347 52 +290.63 +/- 14.1
20000 8836 1505 9659 +133.57 +/- 2.13 0 184 2607 6903 306 +303.04 +/- 6.67

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
368659 ncm-dbt-03 1236043 10 4 2 4 +70.41 +/- 134.07 0 1 1 3 0 +147.19 +/- 653.91
368658 ncm-dbt-01 1227137 10 4 0 6 +147.05 +/- 74.68 0 0 1 4 0 +381.35 +/- 516.06
368657 ncm-dbt-06 1202369 12 5 2 5 +88.71 +/- 118.59 0 1 1 4 0 +190.85 +/- 619.3
368656 ncm-dbt-02 1190913 480 205 33 242 +130.28 +/- 14.45 0 7 62 163 8 +290.23 +/- 43.77
368655 ncm-dbt-05 1194211 488 211 36 241 +130.39 +/- 13.16 0 5 63 172 4 +301.89 +/- 43.45
368654 ncm-dbt-03 1219815 500 227 30 243 +144.71 +/- 12.26 0 1 58 184 7 +346.12 +/- 45.18
368653 ncm-dbt-01 1155247 500 217 36 247 +131.74 +/- 13.85 0 5 68 168 9 +293.29 +/- 41.75
368652 ncm-dbt-06 1225429 500 213 39 248 +126.17 +/- 12.87 0 2 78 164 6 +282.94 +/- 38.55
368651 ncm-dbt-02 1193845 500 217 44 239 +125.38 +/- 13.79 0 4 78 159 9 +273.0 +/- 38.74
368650 ncm-dbt-05 1197475 500 217 36 247 +131.74 +/- 14.37 0 8 62 171 9 +293.29 +/- 43.72
368649 ncm-dbt-03 1216128 500 230 43 227 +136.56 +/- 13.55 0 3 67 170 10 +306.84 +/- 41.99
368648 ncm-dbt-06 1220439 500 233 44 223 +138.18 +/- 11.91 0 2 60 185 3 +333.32 +/- 44.47
368647 ncm-dbt-01 1195280 500 224 32 244 +140.62 +/- 13.43 0 3 62 175 10 +321.19 +/- 43.77
368646 ncm-dbt-02 1196697 500 216 34 250 +132.54 +/- 13.47 0 7 59 179 5 +306.84 +/- 44.88
368645 ncm-dbt-05 1197958 500 228 37 235 +139.81 +/- 14.19 0 6 58 175 11 +315.35 +/- 45.33
368644 ncm-dbt-01 1185219 500 221 37 242 +134.15 +/- 13.43 0 5 63 175 7 +306.84 +/- 43.45
368643 ncm-dbt-06 1230113 500 217 36 247 +131.74 +/- 12.74 0 2 71 171 6 +301.33 +/- 40.6
368642 ncm-dbt-03 1240279 500 226 29 245 +144.71 +/- 12.68 0 2 57 183 8 +342.85 +/- 45.71
368641 ncm-dbt-02 1196999 500 223 46 231 +128.55 +/- 14.26 0 8 65 169 8 +285.49 +/- 42.7
368640 ncm-dbt-05 1193335 500 229 33 238 +143.89 +/- 14.79 0 8 51 178 13 +324.17 +/- 48.12
368639 ncm-dbt-03 1261175 500 219 37 244 +132.54 +/- 13.47 0 5 65 173 7 +301.33 +/- 42.75
368638 ncm-dbt-01 1196162 500 221 33 246 +137.37 +/- 13.71 0 3 67 169 11 +306.84 +/- 41.99
368637 ncm-dbt-06 1241922 500 220 40 240 +130.94 +/- 13.51 0 4 70 168 8 +293.29 +/- 41.07
368636 ncm-dbt-02 1196319 500 222 39 239 +133.34 +/- 12.69 0 4 63 179 4 +312.48 +/- 43.44
368635 ncm-dbt-05 1197677 500 222 31 247 +139.81 +/- 14.01 0 4 63 171 12 +312.48 +/- 43.44
368634 ncm-dbt-03 1221452 500 217 36 247 +131.74 +/- 13.67 0 8 58 179 5 +304.07 +/- 45.19
368633 ncm-dbt-06 1220212 500 226 44 230 +132.54 +/- 13.65 0 5 66 171 8 +298.62 +/- 42.41
368632 ncm-dbt-01 1227221 500 220 42 238 +129.35 +/- 14.41 0 6 71 162 11 +280.42 +/- 40.83
368631 ncm-dbt-02 1201458 500 223 34 243 +138.18 +/- 12.53 0 3 60 182 5 +327.18 +/- 44.54
368630 ncm-dbt-03 1226248 500 225 37 238 +137.37 +/- 13.9 0 5 62 173 10 +309.64 +/- 43.82
368629 ncm-dbt-05 1196571 500 233 35 232 +145.54 +/- 13.64 0 5 52 183 10 +339.63 +/- 47.98
368628 ncm-dbt-06 1241206 500 221 37 242 +134.15 +/- 13.43 0 3 69 169 9 +301.33 +/- 41.33
368627 ncm-dbt-01 1233070 500 225 44 231 +131.74 +/- 13.49 0 3 72 166 9 +293.29 +/- 40.39
368626 ncm-dbt-02 1192912 500 220 25 255 +143.07 +/- 13.34 0 6 50 187 7 +339.63 +/- 48.85
368625 ncm-dbt-05 1211148 500 223 38 239 +134.95 +/- 12.64 0 2 67 175 6 +312.48 +/- 41.9
368624 ncm-dbt-01 1227790 500 225 33 242 +140.62 +/- 13.04 0 4 57 182 7 +330.23 +/- 45.79
368623 ncm-dbt-06 1240513 500 216 51 233 +119.11 +/- 13.69 0 3 88 150 9 +254.16 +/- 36.15
368622 ncm-dbt-03 1243083 500 212 31 257 +131.74 +/- 12.74 0 2 71 171 6 +301.33 +/- 40.6
368621 ncm-dbt-05 1197590 500 204 42 254 +116.77 +/- 13.88 0 8 77 160 5 +256.44 +/- 39.15
368620 ncm-dbt-06 1208852 500 211 45 244 +119.89 +/- 12.98 0 5 77 165 3 +270.57 +/- 39.07
368619 ncm-dbt-02 1228946 500 218 35 247 +133.34 +/- 13.08 0 4 65 175 6 +306.84 +/- 42.73
368618 ncm-dbt-01 1175501 500 220 56 224 +118.33 +/- 14.2 0 9 74 161 6 +258.75 +/- 39.96
368617 ncm-dbt-03 1248674 500 226 31 243 +143.07 +/- 13.15 0 3 58 180 9 +333.32 +/- 45.35

Commit

Commit ID 09dba1f0806a973d1f9f4ebf04b7a45d81683168
Author mstembera
Date 2024-05-15 14:19:04 UTC
Call adjustEval with correct parameters after rescore Set smallNet to false after rescoring so we call adjustEval() w/ correct parameters. STC: https://tests.stockfishchess.org/tests/view/664308687134c82f3f7a4003 LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 146912 W: 37856 L: 37756 D: 71300 Ptnml(0-2): 566, 17562, 37122, 17618, 588 LTC: https://tests.stockfishchess.org/tests/view/6643a0821f32a966da7485d6 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 390414 W: 98015 L: 98173 D: 194226 Ptnml(0-2): 162, 43555, 107929, 43401, 160 closes https://github.com/official-stockfish/Stockfish/pull/5244 Bench: 1819318
Copyright 2011–2024 Next Chess Move LLC