Dev Builds » 20211014-0747

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:54:47 1234396 3982 1259 736 1987 +45.9 +/- 5.28 1 251 976 750 13 +91.21 +/- 10.89
ncm-dbt-02 11:50:49 1235445 3970 1243 744 1983 +43.9 +/- 5.35 4 257 975 734 15 +87.2 +/- 10.9
ncm-dbt-03 11:54:39 1260304 3968 1254 754 1960 +44.01 +/- 5.54 3 280 943 730 28 +84.83 +/- 11.09
ncm-dbt-04 00:30:59 1483077 164 56 25 83 +66.47 +/- 24.13 0 6 39 37 0 +138.2 +/- 54.84
ncm-dbt-05 11:50:53 1258105 3950 1245 717 1988 +46.72 +/- 5.51 3 271 916 765 20 +91.98 +/- 11.25
ncm-dbt-06 11:54:18 1261137 3966 1302 670 1994 +55.84 +/- 5.43 3 225 917 813 25 +110.45 +/- 11.25
20000 6359 3646 9995 +47.42 +/- 2.41 14 1290 4766 3829 101 +93.43 +/- 4.93

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
208966 ncm-dbt-05 1254207 280 83 44 153 +48.71 +/- 19.57 0 17 67 56 0 +99.41 +/- 41.81
208965 ncm-dbt-06 1234866 298 95 53 150 +49.29 +/- 19.27 0 19 69 61 0 +100.66 +/- 41.23
208964 ncm-dbt-02 1188200 304 89 47 168 +48.31 +/- 19.45 1 17 74 59 1 +98.56 +/- 39.73
208963 ncm-dbt-03 1224758 304 93 54 157 +44.82 +/- 20.01 0 24 65 63 0 +91.18 +/- 42.33
208962 ncm-dbt-01 1221405 314 102 63 149 +43.37 +/- 18.88 0 20 80 55 2 +83.45 +/- 38.13
208961 ncm-dbt-05 1230360 500 144 90 266 +37.67 +/- 15.0 1 34 126 88 1 +76.25 +/- 30.37
208960 ncm-dbt-02 1205418 500 164 100 236 +44.72 +/- 15.65 1 34 118 94 3 +88.0 +/- 31.44
208959 ncm-dbt-06 1248524 500 158 79 263 +55.36 +/- 15.69 1 28 117 99 5 +107.54 +/- 31.57
208958 ncm-dbt-01 1170445 500 163 95 242 +47.54 +/- 15.05 0 33 117 99 1 +95.44 +/- 31.58
208957 ncm-dbt-03 1232426 500 162 90 248 +50.38 +/- 16.78 0 40 105 98 7 +92.46 +/- 33.18
208956 ncm-dbt-02 1209669 500 154 98 248 +39.08 +/- 14.57 1 31 129 89 0 +80.63 +/- 29.95
208955 ncm-dbt-05 1228163 500 162 81 257 +56.78 +/- 15.51 0 31 110 106 3 +112.14 +/- 32.58
208954 ncm-dbt-06 1225050 500 169 88 243 +56.78 +/- 15.12 0 26 122 97 5 +109.07 +/- 30.84
208953 ncm-dbt-03 1230234 500 154 93 253 +42.6 +/- 15.66 1 36 116 95 2 +85.04 +/- 31.71
208952 ncm-dbt-01 1215216 500 158 83 259 +52.51 +/- 14.52 1 25 122 102 0 +109.07 +/- 30.84
208951 ncm-dbt-05 1225336 500 165 91 244 +51.8 +/- 16.14 1 35 106 105 3 +102.97 +/- 33.1
208950 ncm-dbt-03 1252318 500 156 103 241 +36.97 +/- 15.46 2 33 128 84 3 +73.34 +/- 30.1
208949 ncm-dbt-06 1244078 500 161 92 247 +48.25 +/- 15.09 0 31 122 94 3 +93.95 +/- 30.89
208948 ncm-dbt-02 1195130 500 157 90 253 +46.84 +/- 14.36 0 28 128 93 1 +93.95 +/- 30.03
208947 ncm-dbt-01 1193649 500 171 102 227 +48.25 +/- 14.96 0 33 115 102 0 +98.44 +/- 31.86
208946 ncm-dbt-05 1221131 500 157 96 247 +42.6 +/- 16.14 0 43 105 100 2 +83.57 +/- 33.14
208945 ncm-dbt-03 1226453 500 156 92 252 +44.72 +/- 15.15 0 31 129 85 5 +83.57 +/- 29.93
208944 ncm-dbt-02 1194228 500 157 85 258 +50.38 +/- 13.86 0 23 133 93 1 +101.46 +/- 29.24
208943 ncm-dbt-06 1222022 500 171 74 255 +68.27 +/- 16.11 1 28 98 119 4 +137.37 +/- 34.42
208942 ncm-dbt-01 1175523 500 155 89 256 +46.13 +/- 15.1 0 31 126 89 4 +88.0 +/- 30.34
208941 ncm-dbt-05 1217559 500 170 84 246 +60.36 +/- 15.15 0 26 116 104 4 +118.33 +/- 31.7
208940 ncm-dbt-06 1210706 500 155 89 256 +46.13 +/- 15.48 1 30 126 88 5 +88.0 +/- 30.34
208939 ncm-dbt-01 1215658 500 149 82 269 +46.84 +/- 14.09 0 26 132 91 1 +93.95 +/- 29.45
208938 ncm-dbt-03 1231004 500 159 99 242 +41.89 +/- 14.61 0 32 127 90 1 +83.57 +/- 30.21
208937 ncm-dbt-02 1237280 500 163 101 236 +43.3 +/- 15.45 1 33 122 91 3 +85.04 +/- 30.9
208936 ncm-dbt-05 1224331 500 142 113 245 +20.17 +/- 16.04 0 53 118 76 3 +36.26 +/- 31.4
208935 ncm-dbt-03 1217380 500 172 96 232 +53.22 +/- 15.96 0 34 111 100 5 +101.46 +/- 32.41
208934 ncm-dbt-02 1194922 500 163 103 234 +41.89 +/- 15.62 0 37 120 89 4 +79.17 +/- 31.18
208933 ncm-dbt-06 1231648 500 169 81 250 +61.79 +/- 15.08 0 28 107 114 1 +126.18 +/- 33.04
208932 ncm-dbt-01 1221556 500 160 90 250 +48.96 +/- 14.87 0 30 122 96 2 +96.94 +/- 30.88
208931 ncm-dbt-06 1243345 500 168 83 249 +59.64 +/- 14.04 0 21 124 104 1 +121.46 +/- 30.47
208930 ncm-dbt-03 1225354 500 148 95 257 +36.97 +/- 15.58 0 40 120 87 3 +70.44 +/- 31.17
208929 ncm-dbt-05 1222664 500 162 89 249 +51.09 +/- 14.45 0 26 127 95 2 +101.46 +/- 30.14
208928 ncm-dbt-02 1197927 500 142 87 271 +38.37 +/- 15.04 0 38 119 93 0 +77.71 +/- 31.31
208927 ncm-dbt-01 1201175 500 145 103 252 +29.25 +/- 14.97 0 42 124 84 0 +58.93 +/- 30.66
177877 ncm-dbt-02 1496233 166 54 33 79 +44.18 +/- 30.05 0 16 32 33 2 +80.97 +/- 59.81
177876 ncm-dbt-01 1494944 168 56 29 83 +56.32 +/- 28.39 0 11 38 32 3 +102.11 +/- 55.82
177875 ncm-dbt-06 1489994 168 56 31 81 +52.08 +/- 28.66 0 14 32 37 1 +102.11 +/- 60.05
177874 ncm-dbt-03 1502815 164 54 32 78 +46.88 +/- 26.83 0 10 42 28 2 +86.48 +/- 52.8
177873 ncm-dbt-05 1499194 170 60 29 81 +64.07 +/- 26.81 1 6 41 35 2 +128.13 +/- 53.47
177872 ncm-dbt-04 1483077 164 56 25 83 +66.47 +/- 24.13 0 6 39 37 0 +138.2 +/- 54.84

Commit

Commit ID 0bddd942b4d096ff31132a4c3e7aef016d0f2d41
Author bmc4
Date 2021-10-14 07:47:20 UTC
Simplify ttHitAverage away Simplify ttHitAverage away, which was introduced in the following commit: [here](https://github.com/BM123499/Stockfish/commit/fe124896b241b4791454fd151da10101ad48f6d7) A few tweaks with Elo gaining bounds have been tried to keep the code, but they all failed: https://tests.stockfishchess.org/tests/view/61656f7683dd501a05b0b292 https://tests.stockfishchess.org/tests/view/6165c0ca83dd501a05b0b2ca https://tests.stockfishchess.org/tests/view/6165bf9683dd501a05b0b2c8 https://tests.stockfishchess.org/tests/view/6165719483dd501a05b0b29b https://tests.stockfishchess.org/tests/view/6166c7fd83dd501a05b0b353 https://tests.stockfishchess.org/tests/view/6166c63b83dd501a05b0b350 STC: LLR: 2.94 (-2.94,2.94) <-2.50,0.50> Total: 58504 W: 14781 L: 14694 D: 29029 Ptnml(0-2): 175, 6718, 15426, 6711, 222 https://tests.stockfishchess.org/tests/view/6165112c83dd501a05b0b257 LTC: LLR: 2.96 (-2.94,2.94) <-2.50,0.50> Total: 33480 W: 8448 L: 8332 D: 16700 Ptnml(0-2): 21, 3569, 9447, 3679, 24 https://tests.stockfishchess.org/tests/view/61656fcf83dd501a05b0b294 change https://github.com/official-stockfish/Stockfish/pull/3739 bench: 4540339
Copyright 2011–2024 Next Chess Move LLC