Dev Builds » 20211105-2120

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 14:45:54 1225552 4930 1590 908 2432 +48.37 +/- 4.88 2 322 1159 956 26 +95.05 +/- 10.0
ncm-dbt-02 14:41:07 1222870 4936 1550 898 2488 +46.16 +/- 4.7 1 298 1237 912 20 +91.15 +/- 9.66
ncm-dbt-03 14:45:33 1258105 4934 1500 888 2546 +43.32 +/- 4.8 2 333 1201 913 18 +85.63 +/- 9.82
ncm-dbt-04 00:30:52 1489833 170 61 30 79 +64.07 +/- 24.8 0 8 38 39 0 +132.83 +/- 55.87
ncm-dbt-05 14:40:07 1256835 4860 1534 842 2484 +49.81 +/- 4.88 2 300 1160 940 28 +97.72 +/- 10.0
ncm-dbt-06 00:31:14 1498253 170 54 30 86 +49.37 +/- 25.65 0 9 45 29 2 +92.02 +/- 50.72
20000 6289 3596 10115 +47.07 +/- 2.39 7 1270 4840 3789 94 +92.68 +/- 4.89

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
208053 ncm-dbt-05 1226508 198 68 42 88 +45.88 +/- 25.08 0 15 44 39 1 +89.68 +/- 51.72
208052 ncm-dbt-01 1242856 262 85 56 121 +38.61 +/- 21.82 0 20 65 43 3 +69.88 +/- 42.44
208051 ncm-dbt-02 1196755 270 83 50 137 +42.67 +/- 19.34 0 15 73 46 1 +83.95 +/- 39.62
208050 ncm-dbt-03 1251543 270 70 57 143 +16.74 +/- 20.83 1 25 69 40 0 +36.16 +/- 41.16
208049 ncm-dbt-05 1226022 500 164 84 252 +56.07 +/- 14.7 0 24 126 96 4 +109.07 +/- 30.24
208048 ncm-dbt-01 1188017 500 156 83 261 +51.09 +/- 14.58 0 27 125 96 2 +101.46 +/- 30.43
208047 ncm-dbt-02 1194724 500 154 103 243 +35.56 +/- 15.74 0 41 121 84 4 +66.1 +/- 31.04
208046 ncm-dbt-03 1229984 500 142 97 261 +31.35 +/- 14.34 0 36 133 81 0 +63.23 +/- 29.45
208045 ncm-dbt-05 1239860 500 161 84 255 +53.93 +/- 14.73 0 28 118 103 1 +109.07 +/- 31.43
208044 ncm-dbt-01 1201327 500 158 103 239 +38.37 +/- 15.54 0 40 117 91 2 +74.79 +/- 31.57
208043 ncm-dbt-02 1194013 500 157 86 257 +49.67 +/- 14.77 0 30 120 99 1 +99.95 +/- 31.16
208042 ncm-dbt-03 1223959 500 151 83 266 +47.54 +/- 15.68 0 37 110 101 2 +93.95 +/- 32.53
208041 ncm-dbt-05 1218583 500 162 88 250 +51.8 +/- 15.89 0 34 113 98 5 +98.44 +/- 32.13
208040 ncm-dbt-01 1197012 500 162 89 249 +51.09 +/- 15.61 1 32 112 103 2 +102.97 +/- 32.28
208039 ncm-dbt-03 1228063 500 157 88 255 +48.25 +/- 15.59 1 32 117 97 3 +95.44 +/- 31.58
208038 ncm-dbt-02 1199933 500 156 87 257 +48.25 +/- 15.22 0 31 123 92 4 +92.46 +/- 30.75
208037 ncm-dbt-05 1243650 500 152 95 253 +39.78 +/- 15.25 0 37 121 90 2 +77.71 +/- 31.04
208036 ncm-dbt-01 1227048 500 168 86 246 +57.5 +/- 15.29 0 31 107 111 1 +116.78 +/- 33.01
208035 ncm-dbt-03 1246223 500 147 82 271 +45.42 +/- 15.19 0 33 122 92 3 +88.0 +/- 30.9
208034 ncm-dbt-02 1195503 500 164 84 252 +56.07 +/- 14.96 1 25 119 103 2 +113.68 +/- 31.27
208033 ncm-dbt-05 1224339 500 149 101 250 +33.46 +/- 15.97 0 46 112 90 2 +64.66 +/- 32.19
208032 ncm-dbt-03 1231365 500 169 101 230 +47.54 +/- 15.31 0 35 113 101 1 +95.44 +/- 32.13
208031 ncm-dbt-01 1202862 500 162 95 243 +46.84 +/- 14.75 0 30 125 93 2 +92.46 +/- 30.47
208030 ncm-dbt-02 1200091 500 170 87 243 +58.21 +/- 14.53 0 24 121 103 2 +116.78 +/- 30.96
208029 ncm-dbt-05 1235575 500 154 78 268 +53.22 +/- 13.87 0 19 140 87 4 +102.97 +/- 28.14
208028 ncm-dbt-03 1254789 500 147 89 264 +40.48 +/- 15.17 0 35 125 87 3 +77.71 +/- 30.5
208027 ncm-dbt-01 1207366 500 163 89 248 +51.8 +/- 16.02 0 35 111 99 5 +98.44 +/- 32.41
208026 ncm-dbt-02 1193168 500 141 91 268 +34.86 +/- 14.57 0 35 131 83 1 +68.99 +/- 29.71
208025 ncm-dbt-05 1239375 500 153 83 264 +48.96 +/- 15.75 1 31 120 93 5 +93.95 +/- 31.17
208024 ncm-dbt-03 1237169 500 158 74 268 +58.93 +/- 14.96 0 26 117 104 3 +116.78 +/- 31.56
208023 ncm-dbt-01 1181764 500 163 97 240 +46.13 +/- 15.61 0 34 121 90 5 +86.52 +/- 31.04
208022 ncm-dbt-02 1195611 500 149 95 256 +37.67 +/- 14.22 0 30 138 80 2 +73.34 +/- 28.71
208021 ncm-dbt-05 1231036 500 168 80 252 +61.79 +/- 15.34 0 28 109 110 3 +123.02 +/- 32.74
208020 ncm-dbt-01 1175971 500 166 82 252 +58.93 +/- 14.42 0 24 119 106 1 +119.89 +/- 31.25
208019 ncm-dbt-03 1224957 500 161 98 241 +44.01 +/- 14.2 0 28 132 89 1 +88.0 +/- 29.49
208018 ncm-dbt-02 1199645 500 166 93 241 +51.09 +/- 14.72 0 30 117 103 0 +104.49 +/- 31.58
208017 ncm-dbt-05 1240239 500 157 74 269 +58.21 +/- 15.06 1 26 113 109 1 +119.89 +/- 32.15
208016 ncm-dbt-02 1192451 500 163 93 244 +48.96 +/- 15.13 0 31 121 95 3 +95.44 +/- 31.02
208015 ncm-dbt-03 1212546 500 146 94 260 +36.26 +/- 15.17 0 39 121 89 1 +71.89 +/- 31.04
208014 ncm-dbt-01 1180848 500 160 99 241 +42.6 +/- 15.9 1 38 112 97 2 +85.04 +/- 32.24
177787 ncm-dbt-02 1489677 166 47 29 90 +37.82 +/- 21.24 0 6 53 24 0 +76.56 +/- 44.25
177786 ncm-dbt-03 1498567 164 52 25 87 +57.72 +/- 24.97 0 7 42 32 1 +114.09 +/- 52.55
177785 ncm-dbt-05 1500008 162 46 33 83 +27.94 +/- 25.04 0 12 44 25 0 +56.25 +/- 51.39
177784 ncm-dbt-06 1498253 170 54 30 86 +49.37 +/- 25.65 0 9 45 29 2 +92.02 +/- 50.72
177783 ncm-dbt-01 1476005 168 47 29 92 +37.36 +/- 25.37 0 11 45 27 1 +71.3 +/- 50.81
177782 ncm-dbt-04 1489833 170 61 30 79 +64.07 +/- 24.8 0 8 38 39 0 +132.83 +/- 55.87

Commit

Commit ID 45e5e65a28ce7e304c279fabf5f8a83cced73013
Author Joost VandeVondele
Date 2021-11-05 21:20:37 UTC
do not store qsearch positions in TT as exact. in qsearch don't store positions in TT with the exact flag. passed STC: https://tests.stockfishchess.org/tests/view/617f9a29af49befdeee40231 LLR: 2.95 (-2.94,2.94) <-2.25,0.25> Total: 155568 W: 39003 L: 39022 D: 77543 Ptnml(0-2): 403, 17854, 41305, 17803, 419 passed LTC: https://tests.stockfishchess.org/tests/view/6180d47259e71df00dcc42a5 LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 79640 W: 19993 L: 19910 D: 39737 Ptnml(0-2): 37, 8356, 22957, 8427, 43 closes https://github.com/official-stockfish/Stockfish/pull/3775 Bench: 7531210
Copyright 2011–2024 Next Chess Move LLC