Dev Builds » 20211019-2009

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:29:25 1215995 3154 999 544 1611 +50.47 +/- 6.1 1 195 752 606 23 +97.91 +/- 12.42
ncm-dbt-02 09:25:07 1238875 3158 985 560 1613 +47.04 +/- 5.97 1 195 777 590 16 +92.33 +/- 12.2
ncm-dbt-03 10:34:36 1349921 3514 1093 653 1768 +43.73 +/- 5.7 2 231 866 641 17 +85.74 +/- 11.56
ncm-dbt-04 10:37:58 1332344 3526 1109 618 1799 +48.7 +/- 5.68 3 205 877 654 24 +94.92 +/- 11.47
ncm-dbt-05 10:31:19 1345578 3486 1112 628 1746 +48.55 +/- 5.74 2 215 843 663 20 +95.2 +/- 11.72
ncm-dbt-06 09:28:36 1233692 3162 997 548 1617 +49.67 +/- 6.06 1 192 769 595 24 +95.99 +/- 12.27
20000 6295 3551 10154 +47.97 +/- 2.4 10 1233 4884 3749 124 +93.57 +/- 4.87

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
193061 ncm-dbt-01 1206386 154 52 31 71 +47.67 +/- 34.22 0 16 29 27 5 +73.26 +/- 62.53
193060 ncm-dbt-05 1241351 154 51 28 75 +52.28 +/- 25.69 0 7 41 28 1 +102.11 +/- 53.0
193059 ncm-dbt-02 1232013 158 53 35 70 +39.75 +/- 29.0 1 9 43 23 3 +71.35 +/- 51.88
193058 ncm-dbt-06 1241088 162 47 26 89 +45.29 +/- 24.81 0 9 42 30 0 +92.18 +/- 52.69
193057 ncm-dbt-03 1237216 182 65 35 82 +57.8 +/- 24.4 0 10 41 40 0 +118.98 +/- 53.73
193056 ncm-dbt-04 1220198 190 57 28 105 +53.45 +/- 21.47 0 7 52 36 0 +109.55 +/- 46.55
193055 ncm-dbt-01 1215361 500 167 93 240 +51.8 +/- 15.89 1 32 113 100 4 +101.46 +/- 32.14
193054 ncm-dbt-05 1243129 500 161 96 243 +45.42 +/- 14.94 0 32 123 93 2 +89.48 +/- 30.76
193053 ncm-dbt-02 1221216 500 159 81 260 +54.64 +/- 14.49 0 26 121 102 1 +110.6 +/- 30.98
193052 ncm-dbt-06 1241821 500 162 87 251 +52.51 +/- 15.43 0 28 126 89 7 +96.94 +/- 30.31
193051 ncm-dbt-03 1237160 500 146 104 250 +29.25 +/- 15.22 1 41 123 85 0 +60.36 +/- 30.78
193050 ncm-dbt-04 1209568 500 168 94 238 +51.8 +/- 15.01 0 29 121 97 3 +101.46 +/- 31.01
193049 ncm-dbt-01 1237981 500 169 96 235 +51.09 +/- 15.36 0 31 119 96 4 +98.44 +/- 31.3
193048 ncm-dbt-02 1256652 500 156 91 253 +45.42 +/- 15.19 0 33 122 92 3 +88.0 +/- 30.9
193047 ncm-dbt-05 1219352 500 152 87 261 +45.42 +/- 15.07 0 33 121 94 2 +89.48 +/- 31.03
193046 ncm-dbt-06 1250994 500 159 95 246 +44.72 +/- 14.9 0 34 118 98 0 +90.97 +/- 31.44
193045 ncm-dbt-03 1258291 500 143 84 273 +41.19 +/- 14.95 0 32 131 83 4 +77.71 +/- 29.68
193044 ncm-dbt-04 1213124 500 154 81 265 +51.09 +/- 15.23 0 30 121 95 4 +98.44 +/- 31.02
193043 ncm-dbt-02 1224327 500 156 89 255 +46.84 +/- 15.39 0 35 115 98 2 +92.46 +/- 31.85
193042 ncm-dbt-01 1194580 500 150 76 274 +51.8 +/- 15.01 0 29 121 97 3 +101.46 +/- 31.01
193041 ncm-dbt-05 1234481 500 160 89 251 +49.67 +/- 15.42 0 33 116 98 3 +96.94 +/- 31.72
193040 ncm-dbt-04 1258451 500 153 90 257 +44.01 +/- 14.73 1 27 133 86 3 +86.52 +/- 29.35
193039 ncm-dbt-03 1232279 500 166 96 238 +48.96 +/- 15.38 0 33 117 97 3 +95.44 +/- 31.58
193038 ncm-dbt-06 1226233 500 163 99 238 +44.72 +/- 15.9 1 32 126 84 7 +82.1 +/- 30.36
193025 ncm-dbt-02 1243737 500 158 89 253 +48.25 +/- 14.83 0 31 120 98 1 +96.94 +/- 31.16
193024 ncm-dbt-01 1191400 500 143 92 265 +35.56 +/- 15.25 0 37 129 80 4 +66.1 +/- 29.99
193022 ncm-dbt-05 1227671 500 160 78 262 +57.5 +/- 15.54 1 28 112 106 3 +115.23 +/- 32.29
193021 ncm-dbt-04 1209955 500 164 73 263 +63.94 +/- 14.91 0 22 120 103 5 +124.6 +/- 31.07
193020 ncm-dbt-06 1225338 500 162 73 265 +62.51 +/- 15.37 0 27 111 108 4 +123.02 +/- 32.44
193019 ncm-dbt-03 1248108 500 153 95 252 +40.48 +/- 14.78 1 29 134 83 3 +79.17 +/- 29.25
192839 ncm-dbt-01 1237280 500 160 81 259 +55.36 +/- 14.12 0 23 126 100 1 +112.14 +/- 30.22
192838 ncm-dbt-02 1223192 500 154 93 253 +42.6 +/- 15.04 0 33 126 88 3 +82.1 +/- 30.36
192837 ncm-dbt-05 1250558 500 166 99 235 +46.84 +/- 15.52 0 31 128 84 7 +85.04 +/- 30.07
192836 ncm-dbt-04 1218764 500 150 88 262 +43.3 +/- 15.82 0 36 122 86 6 +79.17 +/- 30.91
192835 ncm-dbt-06 1218166 500 156 78 266 +54.64 +/- 14.76 0 25 126 95 4 +106.01 +/- 30.26
192834 ncm-dbt-03 1239349 500 177 90 233 +61.07 +/- 15.57 0 29 109 108 4 +119.89 +/- 32.73
192833 ncm-dbt-05 1228089 500 153 94 253 +41.19 +/- 15.08 1 33 123 92 1 +83.57 +/- 30.77
192832 ncm-dbt-02 1270990 500 149 82 269 +46.84 +/- 14.62 0 28 130 89 3 +90.97 +/- 29.76
192831 ncm-dbt-04 1202978 500 165 105 230 +41.89 +/- 14.74 0 33 125 91 1 +83.57 +/- 30.49
192830 ncm-dbt-01 1228983 500 158 75 267 +58.21 +/- 14.93 0 27 115 106 2 +116.78 +/- 31.85
192829 ncm-dbt-03 1239382 500 145 94 261 +35.56 +/- 14.74 0 36 128 85 1 +70.44 +/- 30.11
192828 ncm-dbt-06 1232205 500 148 90 262 +40.48 +/- 15.29 0 37 120 91 2 +79.17 +/- 31.18
175044 ncm-dbt-05 1458555 32 10 4 18 +65.88 +/- 53.37 0 0 11 4 1 +112.3 +/- 90.0
175043 ncm-dbt-03 1456036 32 7 7 18 0.0 +/- 60.83 0 4 8 4 0 -0.0 +/- 125.57
175042 ncm-dbt-04 1443262 36 8 6 22 +19.32 +/- 59.94 0 4 8 6 0 +38.76 +/- 125.12
175041 ncm-dbt-05 1458407 50 15 9 26 +41.89 +/- 49.33 0 4 11 10 0 +85.04 +/- 106.19
175040 ncm-dbt-03 1456039 50 15 8 27 +48.96 +/- 42.0 0 2 14 9 0 +99.95 +/- 91.41
175039 ncm-dbt-04 1443700 50 16 10 24 +41.89 +/- 45.18 0 3 13 9 0 +85.04 +/- 96.78
175038 ncm-dbt-05 1455443 50 17 6 27 +77.7 +/- 45.94 0 2 10 13 0 +164.07 +/- 113.84
175037 ncm-dbt-03 1457962 50 16 10 24 +41.89 +/- 49.33 0 4 11 10 0 +85.04 +/- 106.19
175036 ncm-dbt-04 1447933 50 16 11 23 +34.86 +/- 43.75 0 3 14 8 0 +70.44 +/- 92.08
175035 ncm-dbt-05 1457516 50 18 12 20 +41.89 +/- 40.64 0 2 15 8 0 +85.04 +/- 86.62
175034 ncm-dbt-03 1458424 50 17 8 25 +63.21 +/- 52.66 0 3 11 10 1 +115.23 +/- 106.91
175033 ncm-dbt-04 1444571 50 11 8 31 +20.88 +/- 48.92 1 2 15 7 0 +56.07 +/- 87.47
175032 ncm-dbt-05 1458109 50 18 10 22 +56.07 +/- 51.66 0 4 9 12 0 +115.23 +/- 116.78
175031 ncm-dbt-04 1444425 50 15 9 26 +41.91 +/- 53.16 1 2 12 10 0 +99.95 +/- 101.68
175030 ncm-dbt-03 1458854 50 14 6 30 +56.05 +/- 47.6 0 2 14 8 1 +99.95 +/- 91.41
175029 ncm-dbt-05 1451912 50 14 6 30 +56.07 +/- 47.61 0 3 11 11 0 +115.23 +/- 106.91
175028 ncm-dbt-04 1446495 50 15 8 27 +48.96 +/- 50.55 0 4 10 11 0 +99.95 +/- 111.26
175027 ncm-dbt-03 1458858 50 17 8 25 +63.22 +/- 39.41 0 1 14 10 0 +130.94 +/- 89.9
175026 ncm-dbt-05 1453526 50 17 10 23 +48.96 +/- 46.46 0 3 12 10 0 +99.95 +/- 101.68
175025 ncm-dbt-03 1460942 50 12 8 30 +27.85 +/- 50.47 0 5 11 9 0 +56.07 +/- 105.56
175024 ncm-dbt-04 1449400 50 17 7 26 +70.42 +/- 57.33 0 3 11 9 2 +115.23 +/- 106.91

Commit

Commit ID b37054c310876850f6ff65b19f6cdb5f941c57dc
Author bmc4
Date 2021-10-19 20:09:47 UTC
Simplify evaluate condition on search Remove condition for MOVE_NULL on search. STC: LLR: 2.94 (-2.94,2.94) <-2.50,0.50> Total: 47544 W: 11968 L: 11864 D: 23712 Ptnml(0-2): 150, 5535, 12318, 5599, 170 https://tests.stockfishchess.org/tests/view/616e37143799eb91f1f071ee LTC: LLR: 2.93 (-2.94,2.94) <-2.50,0.50> Total: 67472 W: 16938 L: 16870 D: 33664 Ptnml(0-2): 49, 7119, 19331, 7189, 48 https://tests.stockfishchess.org/tests/view/616e3fab3799eb91f1f071f1 closes https://github.com/official-stockfish/Stockfish/pull/3746 bench: 5255771
Copyright 2011–2024 Next Chess Move LLC