Dev Builds » 20211013-2134

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:02:41 1291463 3350 1075 625 1650 +46.95 +/- 5.93 4 219 789 649 14 +93.46 +/- 12.13
ncm-dbt-02 09:57:30 1311306 3304 1028 563 1713 +49.22 +/- 5.88 1 208 781 649 13 +97.77 +/- 12.19
ncm-dbt-03 10:01:28 1316516 3334 1048 572 1714 +49.94 +/- 5.75 0 198 807 650 12 +99.33 +/- 11.98
ncm-dbt-04 09:52:56 1311738 3348 1021 584 1743 +45.61 +/- 5.89 2 220 808 627 17 +89.51 +/- 11.98
ncm-dbt-05 09:59:23 1315122 3310 1057 594 1659 +48.92 +/- 5.72 0 187 836 614 18 +95.77 +/- 11.73
ncm-dbt-06 10:02:28 1307837 3354 1041 580 1733 +48.06 +/- 5.81 5 195 828 632 17 +95.35 +/- 11.81
20000 6270 3518 10212 +48.11 +/- 2.38 12 1227 4849 3821 91 +95.18 +/- 4.89

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
184436 ncm-dbt-02 1233555 134 38 24 72 +36.43 +/- 29.62 0 11 31 25 0 +73.68 +/- 61.85 ↓
184435 ncm-dbt-05 1205324 144 51 19 74 +78.51 +/- 32.26 0 10 22 38 2 +154.14 +/- 71.6 ↓
184434 ncm-dbt-03 1228702 166 52 29 85 +48.45 +/- 25.36 0 9 43 30 1 +94.34 +/- 52.05 ↓
184433 ncm-dbt-01 1213388 180 66 36 78 +58.45 +/- 27.58 1 11 36 41 1 +120.41 +/- 57.14 ↓
184432 ncm-dbt-06 1230729 182 59 28 95 +59.76 +/- 25.15 0 10 41 39 1 +118.98 +/- 53.73 ↓
184431 ncm-dbt-04 1254529 194 61 29 104 +57.83 +/- 24.37 0 11 44 41 1 +115.07 +/- 51.82 ↓
184430 ncm-dbt-02 1227099 500 161 87 252 +51.8 +/- 15.89 0 36 107 104 3 +101.46 +/- 32.96 ↓
184429 ncm-dbt-05 1239914 500 173 87 240 +60.36 +/- 13.93 0 19 128 101 2 +121.46 +/- 29.83 ↓
184428 ncm-dbt-03 1213626 500 146 84 270 +43.3 +/- 13.6 0 24 141 84 1 +86.52 +/- 28.17 ↓
184427 ncm-dbt-01 1180935 500 155 89 256 +46.13 +/- 15.1 0 33 120 95 2 +90.97 +/- 31.17 ↓
184426 ncm-dbt-06 1221282 500 160 78 262 +57.5 +/- 14.36 1 22 121 106 0 +119.89 +/- 30.94 ↓
184425 ncm-dbt-04 1218380 500 157 82 261 +52.51 +/- 15.18 0 30 118 99 3 +102.97 +/- 31.44 ↓
184424 ncm-dbt-02 1234623 500 151 90 259 +42.6 +/- 15.04 0 36 117 97 0 +86.52 +/- 31.58 ↓
184423 ncm-dbt-05 1220675 500 165 103 232 +43.3 +/- 14.02 0 26 138 84 2 +85.04 +/- 28.63 ↓
184422 ncm-dbt-03 1253919 500 152 89 259 +44.01 +/- 15.49 0 37 115 96 2 +86.52 +/- 31.85 ↓
184421 ncm-dbt-01 1197903 500 161 80 259 +56.78 +/- 15.25 0 31 108 110 1 +115.23 +/- 32.87 ↓
184420 ncm-dbt-06 1195810 500 156 105 239 +35.56 +/- 15.12 0 38 125 85 2 +68.99 +/- 30.52 ↓
184419 ncm-dbt-04 1239480 500 156 93 251 +44.01 +/- 15.61 0 39 110 100 1 +88.0 +/- 32.51 ↓
184418 ncm-dbt-02 1230832 500 151 75 274 +53.22 +/- 15.21 0 29 120 97 4 +102.97 +/- 31.15 ↓
184417 ncm-dbt-05 1233544 500 162 92 246 +48.96 +/- 13.79 0 24 132 94 0 +99.95 +/- 29.4 ↓
184416 ncm-dbt-03 1235131 500 151 85 264 +46.13 +/- 15.73 0 38 110 100 2 +90.97 +/- 32.52 ↓
184415 ncm-dbt-01 1235470 500 167 100 233 +46.84 +/- 15.27 1 31 120 96 2 +93.95 +/- 31.17 ↓
184414 ncm-dbt-04 1234868 500 163 90 247 +51.09 +/- 14.98 0 28 125 93 4 +98.44 +/- 30.45 ↓
184413 ncm-dbt-06 1207582 500 167 73 260 +66.1 +/- 15.26 1 23 110 113 3 +134.15 +/- 32.59 ↓
184412 ncm-dbt-02 1222669 500 158 95 247 +44.01 +/- 15.61 0 39 110 100 1 +88.0 +/- 32.51 ↓
184411 ncm-dbt-05 1232094 500 152 97 251 +38.37 +/- 15.66 0 41 115 92 2 +74.79 +/- 31.83 ↓
184410 ncm-dbt-03 1242033 500 158 90 252 +47.54 +/- 14.26 0 27 129 93 1 +95.44 +/- 29.88 ↓
184409 ncm-dbt-06 1224932 500 146 80 274 +46.13 +/- 14.32 1 24 135 88 2 +92.46 +/- 29.02 ↓
184408 ncm-dbt-01 1215099 500 150 102 248 +33.46 +/- 15.12 1 38 123 88 0 +68.99 +/- 30.78 ↓
184407 ncm-dbt-04 1223789 500 138 91 271 +32.75 +/- 14.95 0 37 132 78 3 +61.79 +/- 29.59 ↓
184406 ncm-dbt-05 1246531 500 159 77 264 +57.5 +/- 15.67 0 29 116 99 6 +109.07 +/- 31.72 ↓
184405 ncm-dbt-02 1222933 500 155 73 272 +57.5 +/- 14.22 0 21 129 97 3 +113.68 +/- 29.75 ↓
184404 ncm-dbt-06 1246515 500 163 88 249 +52.51 +/- 15.3 2 22 131 89 6 +101.46 +/- 29.54 ↓
184403 ncm-dbt-03 1257962 500 167 89 244 +54.64 +/- 15.28 0 29 118 99 4 +106.01 +/- 31.43 ↓
184402 ncm-dbt-01 1188744 500 163 94 243 +48.25 +/- 15.72 1 34 112 101 2 +96.94 +/- 32.27 ↓
184401 ncm-dbt-04 1218517 500 145 82 273 +44.01 +/- 14.6 0 31 126 92 1 +88.0 +/- 30.34 ↓
184400 ncm-dbt-03 1225088 500 159 81 260 +54.65 +/- 14.63 0 28 116 106 0 +112.14 +/- 31.71 ↓
184399 ncm-dbt-02 1223270 500 156 89 255 +46.84 +/- 14.75 1 27 128 92 2 +93.95 +/- 30.03 ↓
184398 ncm-dbt-05 1262491 500 139 94 267 +31.35 +/- 14.34 0 32 145 69 4 +57.5 +/- 27.81 ↓
184397 ncm-dbt-06 1229733 500 134 94 272 +27.85 +/- 15.0 0 42 127 80 1 +54.65 +/- 30.27 ↓
184396 ncm-dbt-01 1174057 500 162 98 240 +44.72 +/- 15.41 0 32 128 84 6 +82.1 +/- 30.08 ↓
184395 ncm-dbt-04 1206722 500 150 83 267 +46.84 +/- 15.39 0 35 115 98 2 +92.46 +/- 31.85 ↓
172843 ncm-dbt-04 1343083 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83 ↓
172842 ncm-dbt-04 1362650 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83 ↓
172840 ncm-dbt-04 1350149 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83 ↓
172839 ncm-dbt-05 1456034 16 6 2 8 +88.68 +/- 65.24 0 0 4 4 0 +190.76 +/- 189.19 ↓
172838 ncm-dbt-02 1453540 20 7 5 8 +34.85 +/- 83.02 0 2 4 4 0 +70.44 +/- 185.84 ↓
172837 ncm-dbt-03 1456493 18 8 3 7 +99.06 +/- 106.24 0 1 3 4 1 +165.99 +/- 249.17 ↓
172836 ncm-dbt-01 1455155 20 5 1 14 +70.4 +/- 55.57 0 0 6 4 0 +147.13 +/- 135.14 ↓
172835 ncm-dbt-04 1372022 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83 ↓
172834 ncm-dbt-06 1456033 22 5 3 14 +31.67 +/- 60.18 0 1 7 3 0 +63.88 +/- 128.17 ↓
172833 ncm-dbt-04 1340033 2 2 0 0 +1041.08 +/- 395.59 0 0 0 0 1 +1129.65 +/- 376.02 ↓
172832 ncm-dbt-04 1330316 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83 ↓
172830 ncm-dbt-04 1344515 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83 ↓
172829 ncm-dbt-04 1331929 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83 ↓
172827 ncm-dbt-02 1456633 50 16 8 26 +56.07 +/- 47.61 0 3 11 11 0 +115.23 +/- 106.91 ↓
172826 ncm-dbt-03 1458110 50 21 9 20 +85.04 +/- 46.59 0 2 9 14 0 +181.7 +/- 121.14 ↓
172825 ncm-dbt-05 1458407 50 18 7 25 +77.7 +/- 41.12 0 1 12 12 0 +164.07 +/- 100.82 ↓
172824 ncm-dbt-01 1451779 50 14 6 30 +56.07 +/- 43.2 0 2 13 10 0 +115.23 +/- 96.38 ↓
172823 ncm-dbt-06 1455441 50 16 14 20 +13.89 +/- 61.4 0 8 8 8 1 +13.9 +/- 116.56 ↓
172822 ncm-dbt-04 1348419 50 16 11 23 +34.86 +/- 43.75 0 3 14 8 0 +70.44 +/- 92.08 ↓
172821 ncm-dbt-04 1329996 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83 ↓
172819 ncm-dbt-04 1348023 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83 ↓
172818 ncm-dbt-04 1333417 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83 ↓
172817 ncm-dbt-04 1343815 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83 ↓
172815 ncm-dbt-02 1461832 50 15 8 27 +48.96 +/- 42.0 0 2 14 9 0 +99.95 +/- 91.41 ↓
172814 ncm-dbt-03 1455595 50 18 6 26 +85.04 +/- 41.74 0 1 11 13 0 +181.7 +/- 107.11 ↓
172813 ncm-dbt-01 1449991 50 16 11 23 +34.86 +/- 58.95 0 7 6 12 0 +70.44 +/- 126.33 ↓
172812 ncm-dbt-06 1460640 50 17 10 23 +48.95 +/- 54.34 0 4 11 9 1 +85.04 +/- 106.19 ↓
172811 ncm-dbt-05 1456776 50 16 9 25 +48.96 +/- 42.0 0 2 14 9 0 +99.95 +/- 91.41 ↓
172810 ncm-dbt-04 1368385 50 17 11 22 +41.88 +/- 56.76 0 5 10 9 1 +70.44 +/- 110.15 ↓
172808 ncm-dbt-04 1339188 50 16 10 24 +41.91 +/- 49.32 1 1 14 9 0 +99.95 +/- 91.41 ↓
172807 ncm-dbt-04 1344853 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83 ↓
172806 ncm-dbt-02 1457384 50 20 9 21 +77.7 +/- 45.94 0 2 10 13 0 +164.07 +/- 113.84 ↓
172805 ncm-dbt-04 1354637 2 0 2 0 -1041.08 +/- 395.59 1 0 0 0 0 -1129.65 +/- 376.02 ↓
172804 ncm-dbt-01 1443574 50 16 8 26 +56.06 +/- 32.73 0 0 17 8 0 +115.21 +/- 72.12 ↓
172802 ncm-dbt-05 1454554 50 16 7 27 +63.22 +/- 48.63 0 3 10 12 0 +130.94 +/- 112.59 ↓
172801 ncm-dbt-06 1457519 50 18 7 25 +77.7 +/- 41.12 0 1 12 12 0 +164.07 +/- 100.82 ↓
172799 ncm-dbt-03 1455023 50 16 7 27 +63.22 +/- 44.25 0 2 12 11 0 +130.94 +/- 101.68 ↓

Commit

Commit ID 673841301b0cc6ed78c4db3e6ec2a0b9a010c8cb
Author Joseph Ellis
Date 2021-10-13 21:34:23 UTC
Simplify multi-cut condition Now that the multi-cut condition is safer, we can avoid the cost of the sub-search. STC: https://tests.stockfishchess.org/tests/view/6165fd9283dd501a05b0b2fe LLR: 2.93 (-2.94,2.94) <-2.50,0.50> Total: 18648 W: 4745 L: 4600 D: 9303 Ptnml(0-2): 47, 2111, 4887, 2208, 71 LTC: https://tests.stockfishchess.org/tests/view/616629ea83dd501a05b0b320 LLR: 2.96 (-2.94,2.94) <-2.50,0.50> Total: 41704 W: 10407 L: 10302 D: 20995 Ptnml(0-2): 35, 4425, 11823, 4538, 31 closes https://github.com/official-stockfish/Stockfish/pull/3738 Bench: 5905086
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy