Dev Builds » 20240518-1608

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:54:22 1087620 4072 1790 297 1985 +133.61 +/- 4.52 0 35 512 1450 39 +311.16 +/- 15.07
ncm-dbt-02 11:39:45 1052514 3968 1727 294 1947 +131.4 +/- 4.87 0 39 539 1340 66 +293.96 +/- 14.68
ncm-dbt-03 11:54:08 1100754 4066 1759 298 2009 +130.67 +/- 4.78 1 46 531 1401 54 +296.32 +/- 14.8
ncm-dbt-05 11:21:29 969996 3824 1730 291 1803 +137.5 +/- 4.73 0 25 480 1350 57 +317.38 +/- 15.55
ncm-dbt-06 11:53:49 1109567 4070 1766 323 1981 +128.77 +/- 4.73 0 45 553 1386 51 +290.68 +/- 14.5
20000 8772 1503 9725 +132.32 +/- 2.11 1 190 2615 6927 267 +301.54 +/- 6.66

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
367969 ncm-dbt-05 1198956 248 109 25 114 +122.52 +/- 16.75 0 1 38 85 0 +286.4 +/- 55.87
367968 ncm-dbt-02 1245202 392 171 21 200 +140.07 +/- 15.14 0 4 44 142 6 +326.19 +/- 52.33
367967 ncm-dbt-03 1227484 472 204 37 231 +128.48 +/- 14.47 0 8 59 163 6 +289.49 +/- 44.82
367966 ncm-dbt-01 1212306 480 212 37 231 +132.77 +/- 12.83 0 3 63 170 4 +310.0 +/- 43.36
367965 ncm-dbt-06 1225465 482 216 40 226 +133.0 +/- 13.98 0 5 63 165 8 +299.36 +/- 43.44
367964 ncm-dbt-05 1196051 500 232 35 233 +144.71 +/- 13.08 0 3 56 182 9 +339.63 +/- 46.2
367963 ncm-dbt-02 1217961 500 224 32 244 +140.62 +/- 12.64 0 2 61 180 7 +330.23 +/- 44.08
367962 ncm-dbt-01 1200504 500 223 38 239 +134.95 +/- 12.44 0 0 72 171 7 +309.64 +/- 40.0
367961 ncm-dbt-03 1232133 500 229 30 241 +146.36 +/- 13.41 0 1 62 174 13 +333.32 +/- 43.57
367960 ncm-dbt-06 1238884 500 228 40 232 +137.37 +/- 13.34 0 4 62 176 8 +315.35 +/- 43.81
367959 ncm-dbt-05 1196532 500 224 43 233 +131.74 +/- 12.93 0 2 72 169 7 +298.62 +/- 40.29
367958 ncm-dbt-02 1233373 500 212 37 251 +126.97 +/- 13.22 0 5 70 170 5 +288.06 +/- 41.11
367957 ncm-dbt-03 1237023 500 220 38 242 +132.54 +/- 13.47 0 6 62 176 6 +304.07 +/- 43.81
367956 ncm-dbt-01 1227972 500 219 38 243 +131.74 +/- 13.12 0 6 61 179 4 +306.84 +/- 44.17
367955 ncm-dbt-06 1217027 500 207 40 253 +120.67 +/- 14.01 0 8 73 163 6 +265.78 +/- 40.25
367954 ncm-dbt-05 1197950 500 224 43 233 +131.74 +/- 12.93 0 2 72 169 7 +298.62 +/- 40.29
367953 ncm-dbt-02 1229339 500 223 43 234 +130.94 +/- 13.14 0 3 71 169 7 +295.94 +/- 40.69
367952 ncm-dbt-03 1240377 500 217 28 255 +138.18 +/- 13.32 0 4 61 177 8 +318.25 +/- 44.18
367951 ncm-dbt-01 1246935 500 220 27 253 +141.44 +/- 12.41 0 4 53 189 4 +342.85 +/- 47.56
367950 ncm-dbt-06 1211334 500 215 31 254 +134.15 +/- 12.06 0 5 56 189 0 +327.18 +/- 46.19
367949 ncm-dbt-05 1193870 500 224 32 244 +140.62 +/- 12.44 0 1 63 179 7 +330.23 +/- 43.2
367948 ncm-dbt-02 1225367 500 207 34 259 +125.38 +/- 13.25 0 7 66 174 3 +288.06 +/- 42.4
367947 ncm-dbt-03 1236465 500 214 38 248 +127.76 +/- 14.1 0 9 62 173 6 +288.06 +/- 43.65
367946 ncm-dbt-01 1203286 500 218 29 253 +138.18 +/- 11.91 0 1 63 182 4 +330.23 +/- 43.2
367945 ncm-dbt-06 1212656 500 223 40 237 +133.34 +/- 13.81 0 4 69 167 10 +295.94 +/- 41.39
367944 ncm-dbt-05 1198374 500 228 40 232 +137.37 +/- 12.76 0 5 56 185 4 +327.18 +/- 46.19
367943 ncm-dbt-02 1224625 500 216 43 241 +125.38 +/- 14.47 0 5 79 154 12 +265.78 +/- 38.54
367942 ncm-dbt-03 1200880 500 212 38 250 +126.17 +/- 12.87 0 6 66 176 2 +293.29 +/- 42.41
367941 ncm-dbt-01 1238521 500 214 36 250 +129.35 +/- 13.36 0 9 56 183 2 +304.07 +/- 45.87
367940 ncm-dbt-06 1213461 500 203 35 262 +121.45 +/- 12.01 0 3 76 171 0 +282.94 +/- 39.21
367939 ncm-dbt-05 1195750 500 229 30 241 +146.36 +/- 12.81 0 2 56 183 9 +346.12 +/- 46.15
367938 ncm-dbt-02 1204784 500 219 36 245 +133.34 +/- 13.81 0 5 66 170 9 +298.62 +/- 42.41
367937 ncm-dbt-03 1198134 500 213 40 247 +125.38 +/- 12.89 0 3 76 166 5 +282.94 +/- 39.21
367936 ncm-dbt-01 1191790 500 227 41 232 +135.76 +/- 12.42 0 6 53 190 1 +330.23 +/- 47.44
367935 ncm-dbt-06 1195951 500 214 34 252 +130.94 +/- 13.69 0 6 65 172 7 +295.94 +/- 42.75
367934 ncm-dbt-05 872406 500 223 37 240 +135.76 +/- 14.98 0 9 58 171 12 +298.62 +/- 45.1
367933 ncm-dbt-05 895249 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367932 ncm-dbt-05 890009 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367931 ncm-dbt-05 838357 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367930 ncm-dbt-05 856857 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367929 ncm-dbt-05 871257 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367928 ncm-dbt-05 840799 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367927 ncm-dbt-05 833223 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367926 ncm-dbt-05 917861 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367925 ncm-dbt-05 849380 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367924 ncm-dbt-05 837035 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367923 ncm-dbt-02 835910 500 224 38 238 +135.76 +/- 15.47 0 8 64 162 16 +288.06 +/- 43.03
367922 ncm-dbt-05 855189 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367921 ncm-dbt-02 866132 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367920 ncm-dbt-05 889623 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367919 ncm-dbt-02 922912 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367918 ncm-dbt-05 860545 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367917 ncm-dbt-02 848663 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367916 ncm-dbt-05 863858 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367915 ncm-dbt-02 876628 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367914 ncm-dbt-03 557064 500 211 45 244 +119.89 +/- 14.99 1 9 71 161 8 +261.07 +/- 40.78
367913 ncm-dbt-06 549772 500 224 51 225 +125.38 +/- 15.12 0 9 71 158 12 +265.78 +/- 40.81
367912 ncm-dbt-05 885997 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367911 ncm-dbt-01 563065 500 222 46 232 +127.76 +/- 14.6 0 5 77 155 13 +270.57 +/- 39.07
367910 ncm-dbt-02 872473 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367909 ncm-dbt-02 754622 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367908 ncm-dbt-05 806072 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367907 ncm-dbt-03 680485 10 3 0 7 +107.43 +/- 84.35 0 0 2 3 0 +240.65 +/- 570.11
367906 ncm-dbt-01 727995 12 5 1 6 +120.31 +/- 75.55 0 0 2 4 0 +279.41 +/- 548.26
367905 ncm-dbt-06 843082 8 4 0 4 +190.56 +/- 13.88 0 0 0 4 0 +1199.83 +/- 250.99
367904 ncm-dbt-06 1188046 80 32 12 36 +88.73 +/- 31.56 0 1 18 21 0 +190.85 +/- 81.15
367903 ncm-dbt-02 1229732 76 31 10 35 +98.54 +/- 32.88 0 0 18 19 1 +203.24 +/- 78.7
367902 ncm-dbt-05 1208712 76 37 6 33 +150.44 +/- 33.67 0 0 9 27 2 +348.69 +/- 126.02
367901 ncm-dbt-01 1063835 80 30 4 46 +117.16 +/- 31.84 0 1 12 27 0 +269.37 +/- 105.06
367900 ncm-dbt-03 1197503 84 36 4 44 +139.37 +/- 26.27 0 0 10 32 0 +347.66 +/- 117.92

Commit

Commit ID 2694fce928e5eec867d56d853b416c9f389c284d
Author Linmiao Xu
Date 2024-05-18 16:08:39 UTC
Simplify away adjustEval lambda Now that only the shuffling constant differs between nets, a lambda for adjusting eval is no longer needed. Passed non-regression STC: https://tests.stockfishchess.org/tests/view/664806ca6dcff0d1d6b05f34 LLR: 2.99 (-2.94,2.94) <-1.75,0.25> Total: 31552 W: 8175 L: 7959 D: 15418 Ptnml(0-2): 76, 3180, 9065, 3362, 93 closes https://github.com/official-stockfish/Stockfish/pull/5260 No functional change
Copyright 2011–2024 Next Chess Move LLC