Dev Builds » 20240516-1217

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:45:02 1090170 4022 1735 334 1953 +126.31 ± 4.83 0 52 556 1353 50 +282.82 ± 14.46
ncm-dbt-02 11:43:46 1197572 3988 1774 310 1904 +133.79 ± 4.86 2 39 510 1379 64 +303.46 ± 15.1
ncm-dbt-03 11:46:27 1198478 4008 1752 274 1982 +134.45 ± 4.85 0 44 504 1390 66 +304.48 ± 15.19
ncm-dbt-05 11:41:45 1197053 4000 1780 283 1937 +136.67 ± 4.67 0 27 512 1398 63 +313.19 ± 15.05
ncm-dbt-06 11:36:08 1185953 3982 1747 319 1916 +130.39 ± 4.82 1 41 534 1359 56 +294.35 ± 14.75
20000 8788 1520 9692 +132.3 ± 2.15 3 203 2616 6879 299 +299.43 ± 6.66

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
367759 ncm-dbt-03 1197229 8 4 2 2 +88.62 ± 93.84 0 0 2 2 0 +190.67 ± 458.56
367758 ncm-dbt-01 1084816 22 10 1 11 +150.88 ± 72.53 0 0 3 7 1 +320.54 ± 376.65
367757 ncm-dbt-06 1185116 482 201 36 245 +123.94 ± 14.51 0 10 61 165 5 +277.86 ± 43.94
367756 ncm-dbt-02 1199452 488 206 35 247 +127.13 ± 14.34 0 6 70 159 9 +277.88 ± 41.12
367755 ncm-dbt-05 1195398 500 226 36 238 +138.99 ± 12.9 0 4 58 182 6 +327.18 ± 45.37
367754 ncm-dbt-03 1197894 500 216 38 246 +129.35 ± 13.54 0 6 66 172 6 +293.29 ± 42.41
367753 ncm-dbt-01 1089036 500 217 38 245 +130.14 ± 13.88 0 7 64 172 7 +293.29 ± 43.07
367752 ncm-dbt-06 1185105 500 217 45 238 +124.6 ± 13.09 0 4 75 166 5 +280.42 ± 39.57
367751 ncm-dbt-02 1197417 500 219 40 241 +130.15 ± 14.4 1 7 61 174 7 +295.94 ± 44.08
367750 ncm-dbt-05 1196417 500 208 31 261 +128.55 ± 12.63 0 3 71 172 4 +295.94 ± 40.69
367749 ncm-dbt-03 1199847 500 227 25 248 +148.85 ± 13.7 0 5 49 185 11 +349.43 ± 49.46
367748 ncm-dbt-01 1082273 500 215 46 239 +122.24 ± 14.17 0 9 69 166 6 +270.57 ± 41.4
367747 ncm-dbt-06 1186803 500 220 35 245 +134.95 ± 12.84 0 3 65 176 6 +312.48 ± 42.67
367746 ncm-dbt-02 1198614 500 235 35 230 +147.19 ± 13.18 0 5 48 189 8 +352.8 ± 49.98
367745 ncm-dbt-05 1197893 500 231 49 220 +132.54 ± 14.36 0 6 67 166 11 +290.66 ± 42.08
367744 ncm-dbt-03 1200472 500 221 45 234 +127.76 ± 13.75 0 6 69 168 7 +285.49 ± 41.44
367743 ncm-dbt-01 1107615 500 221 37 242 +134.15 ± 12.67 0 2 68 174 6 +309.64 ± 41.56
367742 ncm-dbt-06 1186628 500 218 39 243 +130.15 ± 13.7 1 3 69 170 7 +295.94 ± 41.39
367741 ncm-dbt-02 1198669 500 215 33 252 +132.54 ± 13.28 1 2 67 174 6 +306.84 ± 41.99
367740 ncm-dbt-05 1196396 500 238 30 232 +153.86 ± 13.28 0 2 51 184 13 +363.2 ± 48.51
367739 ncm-dbt-03 1200034 500 220 36 244 +134.15 ± 14.33 0 5 68 165 12 +293.29 ± 41.75
367738 ncm-dbt-01 1089033 500 219 31 250 +137.37 ± 13.15 0 4 61 178 7 +318.25 ± 44.18
367737 ncm-dbt-06 1182578 500 227 49 224 +129.35 ± 14.07 0 5 72 163 10 +282.94 ± 40.5
367736 ncm-dbt-02 1198671 500 230 42 228 +137.37 ± 14.25 0 5 64 169 12 +304.07 ± 43.1
367735 ncm-dbt-05 1196448 500 215 35 250 +130.94 ± 13.32 0 2 75 164 9 +290.66 ± 39.4
367734 ncm-dbt-03 1198340 500 200 35 265 +119.11 ± 13.52 0 8 72 167 3 +268.17 ± 40.54
367733 ncm-dbt-01 1090005 500 212 41 247 +123.81 ± 13.81 0 7 71 166 6 +275.45 ± 40.84
367732 ncm-dbt-06 1187633 500 226 34 240 +140.62 ± 13.62 0 5 57 179 9 +324.17 ± 45.77
367731 ncm-dbt-02 1197947 500 217 38 245 +130.14 ± 13.16 0 6 63 177 4 +301.33 ± 43.45
367730 ncm-dbt-05 1200600 500 218 37 245 +131.74 ± 13.3 0 4 68 171 7 +298.62 ± 41.71
367729 ncm-dbt-03 1195790 500 214 26 260 +137.37 ± 13.9 0 8 53 182 7 +318.25 ± 47.23
367728 ncm-dbt-01 1078639 500 220 48 232 +124.6 ± 14.14 0 8 69 166 7 +275.45 ± 41.43
367727 ncm-dbt-06 1184275 500 218 40 242 +129.35 ± 13.17 0 4 70 170 6 +293.29 ± 41.07
367726 ncm-dbt-02 1195254 500 225 46 229 +130.14 ± 13.34 0 3 73 166 8 +290.66 ± 40.08
367725 ncm-dbt-05 1194773 500 216 34 250 +132.54 ± 13.47 0 5 65 173 7 +301.33 ± 42.75
367724 ncm-dbt-01 1107896 500 211 51 238 +115.22 ± 14.37 0 10 76 158 6 +249.64 ± 39.41
367723 ncm-dbt-03 1195082 500 231 25 244 +152.18 ± 12.95 0 2 51 186 11 +363.2 ± 48.51
367722 ncm-dbt-06 1189486 500 220 41 239 +130.14 ± 14.06 0 7 65 170 8 +290.66 ± 42.73
367721 ncm-dbt-01 1082217 500 210 41 249 +122.24 ± 13.12 0 5 75 166 4 +275.45 ± 39.63
367720 ncm-dbt-05 1198502 500 228 31 241 +144.71 ± 12.05 0 1 57 186 6 +349.43 ± 45.6
367719 ncm-dbt-02 1194555 500 227 41 232 +135.76 ± 13.94 0 5 64 171 10 +304.07 ± 43.1
367718 ncm-dbt-03 1201614 500 219 42 239 +128.55 ± 13.73 0 4 74 163 9 +282.94 ± 39.86

Commit

Commit ID e3c9ed77aa62e096d52bb558193279b804f53a84
Author Muzhen Gaming
Date 2024-05-16 12:17:53 UTC
Revert "Reduce more when improving and ttvalue is lower than alpha" The patch regressed significantly at longer time controls. Passed VLTC: https://tests.stockfishchess.org/tests/view/6644c7a2bc537f5619453096 LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 43336 W: 11177 L: 10884 D: 21275 Ptnml(0-2): 3, 4432, 12507, 4721, 5 Passed VVLTC: https://tests.stockfishchess.org/tests/view/66450c974aa4fa9a83b6d0b0 LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 32394 W: 8350 L: 8072 D: 15972 Ptnml(0-2): 2, 2798, 10317, 3080, 0 closes https://github.com/official-stockfish/Stockfish/pull/5251 Bench: 1594188
Copyright 2011–2024 Next Chess Move LLC