Dev Builds » 20211115-1720

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:18:39 1308032 3390 1098 617 1675 +49.63 +/- 5.87 4 212 792 673 14 +99.15 +/- 12.1
ncm-dbt-02 10:10:40 1323065 3370 1078 614 1678 +48.14 +/- 5.81 1 212 808 650 14 +95.31 +/- 11.98
ncm-dbt-03 09:41:15 1261855 3240 1022 549 1669 +51.09 +/- 6.0 1 192 788 611 28 +98.18 +/- 12.12
ncm-dbt-04 09:40:36 1280205 3238 1034 591 1613 +47.83 +/- 6.05 4 203 780 610 22 +93.39 +/- 12.19
ncm-dbt-05 10:14:46 1322553 3360 1065 590 1705 +49.45 +/- 5.87 3 206 802 651 18 +97.62 +/- 12.02
ncm-dbt-06 10:17:42 1323887 3402 1090 618 1694 +48.52 +/- 5.66 0 201 840 647 13 +96.13 +/- 11.73
20000 6387 3579 10034 +49.1 +/- 2.4 13 1226 4810 3842 109 +96.64 +/- 4.91

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
184394 ncm-dbt-05 1250820 132 43 20 69 +61.16 +/- 29.7 0 8 27 31 0 +126.37 +/- 66.46
184393 ncm-dbt-02 1200502 144 59 25 60 +83.6 +/- 28.38 0 6 27 38 1 +172.05 +/- 66.76
184392 ncm-dbt-01 1190857 166 43 33 90 +20.96 +/- 30.56 2 17 33 31 0 +50.59 +/- 58.81
184391 ncm-dbt-06 1237722 180 55 44 81 +21.25 +/- 23.34 0 13 54 22 1 +38.76 +/- 45.52
184390 ncm-dbt-03 1257214 190 59 35 96 +44.12 +/- 26.3 0 15 43 35 2 +81.95 +/- 52.33
184389 ncm-dbt-04 1205692 188 57 25 106 +59.71 +/- 25.65 0 10 45 36 3 +110.8 +/- 51.14
184388 ncm-dbt-02 1220508 500 159 93 248 +46.13 +/- 14.05 0 26 133 90 1 +92.46 +/- 29.31
184387 ncm-dbt-05 1211022 500 152 86 262 +46.13 +/- 14.18 0 27 131 91 1 +92.46 +/- 29.6
184386 ncm-dbt-01 1191306 500 169 101 230 +47.54 +/- 15.18 0 33 118 97 2 +93.95 +/- 31.44
184385 ncm-dbt-06 1207926 500 173 92 235 +56.78 +/- 14.46 0 25 120 104 1 +115.23 +/- 31.11
184384 ncm-dbt-03 1231395 500 161 88 251 +51.09 +/- 15.61 1 29 121 94 5 +98.44 +/- 31.02
184383 ncm-dbt-04 1238561 500 153 97 250 +39.08 +/- 15.7 0 40 117 90 3 +74.79 +/- 31.57
184382 ncm-dbt-02 1237640 500 166 90 244 +53.22 +/- 16.08 0 37 103 107 3 +104.49 +/- 33.51
184381 ncm-dbt-05 1222758 500 160 101 239 +41.19 +/- 15.46 0 37 120 90 3 +79.17 +/- 31.18
184380 ncm-dbt-01 1196861 500 175 85 240 +63.23 +/- 14.88 0 25 112 111 2 +127.76 +/- 32.29
184379 ncm-dbt-06 1241926 500 145 86 269 +41.19 +/- 15.21 0 37 118 94 1 +82.1 +/- 31.44
184378 ncm-dbt-04 1231683 500 154 90 256 +44.72 +/- 14.64 0 32 122 96 0 +90.97 +/- 30.89
184377 ncm-dbt-03 1217214 500 156 80 264 +53.22 +/- 14.42 0 23 132 91 4 +102.97 +/- 29.38
184376 ncm-dbt-02 1230017 500 163 86 251 +53.93 +/- 14.19 0 24 126 99 1 +109.07 +/- 30.24
184375 ncm-dbt-05 1212899 500 173 85 242 +61.79 +/- 15.73 1 27 109 109 4 +123.02 +/- 32.74
184374 ncm-dbt-01 1235979 500 160 87 253 +51.09 +/- 14.85 0 29 121 98 2 +101.46 +/- 31.01
184373 ncm-dbt-03 1252325 500 164 78 258 +60.36 +/- 15.79 0 32 103 112 3 +119.89 +/- 33.6
184372 ncm-dbt-06 1230299 500 162 91 247 +49.67 +/- 14.24 0 24 134 89 3 +96.94 +/- 29.13
184371 ncm-dbt-04 1228448 500 169 95 236 +51.8 +/- 14.75 0 27 125 95 3 +101.46 +/- 30.43
184370 ncm-dbt-02 1231465 500 147 85 268 +43.3 +/- 15.33 1 32 124 90 3 +85.04 +/- 30.63
184369 ncm-dbt-05 1231371 500 160 86 254 +51.8 +/- 15.27 2 26 120 100 2 +106.01 +/- 31.14
184368 ncm-dbt-01 1196316 500 157 88 255 +48.25 +/- 15.09 1 28 125 93 3 +95.44 +/- 30.46
184367 ncm-dbt-03 1218036 500 167 95 238 +50.38 +/- 15.45 0 31 121 93 5 +95.44 +/- 31.02
184366 ncm-dbt-04 1226442 500 158 93 249 +45.42 +/- 15.19 2 27 128 90 3 +90.97 +/- 30.05
184365 ncm-dbt-06 1223155 500 161 89 250 +50.38 +/- 15.2 0 31 119 97 3 +98.44 +/- 31.3
184364 ncm-dbt-02 1235542 500 152 99 249 +36.97 +/- 15.08 0 38 122 89 1 +73.34 +/- 30.91
184363 ncm-dbt-05 1227983 500 154 87 259 +46.84 +/- 15.14 0 32 122 93 3 +90.97 +/- 30.89
184362 ncm-dbt-03 1226554 500 149 77 274 +50.38 +/- 14.68 0 25 133 87 5 +95.44 +/- 29.29
184361 ncm-dbt-01 1184503 500 157 88 255 +48.25 +/- 14.57 0 29 124 96 1 +96.94 +/- 30.59
184360 ncm-dbt-04 1232856 500 172 94 234 +54.64 +/- 15.15 0 30 114 104 2 +109.07 +/- 32.0
184359 ncm-dbt-06 1220825 500 163 82 255 +56.78 +/- 14.32 0 24 122 103 1 +115.23 +/- 30.81
184358 ncm-dbt-02 1224406 500 164 89 247 +52.51 +/- 15.05 0 29 120 98 3 +102.97 +/- 31.15
184357 ncm-dbt-03 1235182 500 147 85 268 +43.3 +/- 15.08 0 33 125 89 3 +83.57 +/- 30.49
184356 ncm-dbt-05 1223979 500 154 81 265 +51.09 +/- 15.61 0 33 115 98 4 +98.44 +/- 31.86
184355 ncm-dbt-04 1215477 500 154 93 253 +42.6 +/- 16.26 2 34 121 87 6 +80.63 +/- 31.04
184354 ncm-dbt-06 1236755 500 170 95 235 +52.51 +/- 14.92 0 28 122 97 3 +102.97 +/- 30.86
184353 ncm-dbt-01 1236195 500 168 93 239 +52.51 +/- 15.81 0 35 108 104 3 +102.97 +/- 32.83
172797 ncm-dbt-04 1350831 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
172794 ncm-dbt-04 1353704 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
172791 ncm-dbt-06 1460341 22 6 2 14 +63.87 +/- 69.29 0 1 5 5 0 +132.4 +/- 169.29
172790 ncm-dbt-01 1455601 24 10 4 10 +88.7 +/- 81.86 0 1 5 5 1 +154.14 +/- 171.6
172789 ncm-dbt-02 1459900 26 9 4 13 +67.65 +/- 73.58 0 2 4 7 0 +140.87 +/- 187.01
172787 ncm-dbt-05 1458111 28 11 4 13 +88.73 +/- 61.63 0 1 5 8 0 +190.85 +/- 175.35
172786 ncm-dbt-04 1363268 50 17 4 29 +92.44 +/- 59.57 0 3 8 12 2 +164.07 +/- 126.09
172785 ncm-dbt-04 1367037 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
172784 ncm-dbt-03 1456927 50 19 11 20 +56.05 +/- 55.43 0 4 10 10 1 +99.95 +/- 111.26
172782 ncm-dbt-04 1348466 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
172779 ncm-dbt-02 1456362 50 15 11 24 +27.85 +/- 46.49 0 4 13 8 0 +56.07 +/- 96.84
172778 ncm-dbt-05 1455589 50 15 11 24 +27.85 +/- 50.47 0 5 11 9 0 +56.07 +/- 105.56
172777 ncm-dbt-01 1452816 50 15 9 26 +41.91 +/- 60.15 1 4 8 12 0 +99.95 +/- 120.32
172776 ncm-dbt-06 1454999 50 15 5 30 +70.43 +/- 40.35 0 1 13 11 0 +147.19 +/- 95.14
172771 ncm-dbt-01 1453259 50 14 11 25 +20.87 +/- 44.85 0 4 14 7 0 +41.89 +/- 92.36
172770 ncm-dbt-05 1459151 50 13 11 26 +13.9 +/- 43.02 0 4 15 6 0 +27.85 +/- 87.86
172769 ncm-dbt-02 1460490 50 14 14 22 -0.01 +/- 51.33 0 6 14 4 1 -13.9 +/- 92.45
172768 ncm-dbt-06 1458557 50 15 11 24 +27.85 +/- 50.47 0 5 11 9 0 +56.07 +/- 105.56
172763 ncm-dbt-01 1449025 50 17 6 27 +77.7 +/- 41.12 0 1 12 12 0 +164.07 +/- 100.82
172762 ncm-dbt-06 1457813 50 14 10 26 +27.85 +/- 46.49 0 4 13 8 0 +56.07 +/- 96.84
172761 ncm-dbt-05 1459299 50 15 12 23 +20.87 +/- 44.85 0 4 14 7 0 +41.89 +/- 92.36
172760 ncm-dbt-02 1459461 50 15 8 27 +48.96 +/- 46.46 0 3 12 10 0 +99.95 +/- 101.68
172759 ncm-dbt-06 1456330 50 11 11 28 -0.0 +/- 54.94 0 8 9 8 0 -0.0 +/- 112.75
172758 ncm-dbt-02 1460491 50 15 10 25 +34.86 +/- 51.88 0 5 10 10 0 +70.44 +/- 110.15
172757 ncm-dbt-01 1453669 50 13 12 25 +6.95 +/- 49.39 0 6 12 7 0 +13.9 +/- 100.98
172756 ncm-dbt-05 1457664 50 15 6 29 +63.21 +/- 48.62 0 2 13 9 1 +115.23 +/- 96.38

Commit

Commit ID f5df517145890ecee3d855e98470241b68645b87
Author Michael Chaly
Date 2021-11-15 17:20:10 UTC
Simplify Pv nodes related logic in LMR Instead of having 2 separate conditions for Pv nodes reductions we can actually write them together. Despite it's not being strictly logically the same bench actually doesn't change up to depth 20, so them interacting is really rare and thus it's just a removal of extra PvNode check most of the time. passed STC: https://tests.stockfishchess.org/tests/view/618ce27cd7a085ad008ef4e9 LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 37488 W: 9424 L: 9279 D: 18785 Ptnml(0-2): 90, 3903, 10634, 4006, 111 passed LTC: https://tests.stockfishchess.org/tests/view/618d2585d7a085ad008ef527 LLR: 2.95 (-2.94,2.94) <-2.25,0.25> Total: 49968 W: 12449 L: 12331 D: 25188 Ptnml(0-2): 27, 4745, 15309, 4889, 14 closes https://github.com/official-stockfish/Stockfish/pull/3792 Bench: 6339548
Copyright 2011–2024 Next Chess Move LLC