Dev Builds » 20211105-2118

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:05:22 1279071 3360 1054 621 1685 +45.02 +/- 5.67 1 203 850 614 12 +89.18 +/- 11.65
ncm-dbt-02 09:59:20 1312707 3312 1056 585 1671 +49.75 +/- 5.82 4 185 822 626 19 +98.21 +/- 11.85
ncm-dbt-03 10:05:28 1317600 3352 1092 587 1673 +52.74 +/- 5.87 1 199 790 666 20 +103.72 +/- 12.11
ncm-dbt-04 10:01:58 1312619 3316 1067 601 1648 +49.15 +/- 5.88 2 203 797 639 17 +96.95 +/- 12.06
ncm-dbt-05 10:02:09 1311551 3330 1041 572 1717 +49.26 +/- 5.76 3 192 815 643 12 +98.55 +/- 11.91
ncm-dbt-06 10:06:27 1311588 3330 1055 569 1706 +51.07 +/- 5.87 1 206 777 668 13 +101.72 +/- 12.22
20000 6365 3535 10100 +49.49 +/- 2.37 12 1188 4851 3856 93 +98.03 +/- 4.88

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
186020 ncm-dbt-02 1223200 150 46 26 78 +46.6 +/- 25.65 0 8 39 28 0 +94.94 +/- 54.67
186019 ncm-dbt-04 1229925 152 46 27 79 +43.66 +/- 25.08 0 8 41 27 0 +88.74 +/- 53.05
186018 ncm-dbt-05 1218513 156 45 27 84 +40.27 +/- 27.28 0 12 36 30 0 +81.65 +/- 57.33
186017 ncm-dbt-06 1230359 164 52 25 87 +57.72 +/- 22.67 0 5 45 32 0 +118.83 +/- 49.83
186016 ncm-dbt-03 1261956 184 53 28 103 +47.5 +/- 23.95 0 11 45 36 0 +96.84 +/- 51.12
186015 ncm-dbt-01 1138854 194 61 40 93 +37.76 +/- 22.06 0 11 54 32 0 +76.43 +/- 45.98
186014 ncm-dbt-04 1246277 500 165 87 248 +54.65 +/- 14.36 0 26 120 104 0 +112.14 +/- 31.13
186013 ncm-dbt-02 1210385 500 157 85 258 +50.38 +/- 15.07 0 31 118 99 2 +99.95 +/- 31.44
186012 ncm-dbt-05 1250801 500 161 85 254 +53.22 +/- 14.56 1 25 121 103 0 +110.6 +/- 30.98
186011 ncm-dbt-06 1238031 500 155 83 262 +50.38 +/- 15.82 0 36 109 102 3 +98.44 +/- 32.68
186010 ncm-dbt-03 1230750 500 169 78 253 +63.94 +/- 14.5 0 21 120 106 3 +127.76 +/- 31.05
186009 ncm-dbt-01 1201058 500 164 83 253 +56.78 +/- 15.12 0 29 113 106 2 +113.68 +/- 32.15
186008 ncm-dbt-04 1223228 500 164 91 245 +51.09 +/- 14.04 0 22 136 89 3 +99.95 +/- 28.8
186007 ncm-dbt-02 1222491 500 163 110 227 +36.97 +/- 15.82 3 33 125 86 3 +74.79 +/- 30.51
186006 ncm-dbt-05 1218048 500 156 90 254 +46.13 +/- 15.61 1 34 115 98 2 +92.46 +/- 31.85
186005 ncm-dbt-06 1236665 500 163 91 246 +50.38 +/- 15.33 0 32 117 98 3 +98.44 +/- 31.58
186004 ncm-dbt-03 1218197 500 173 97 230 +53.22 +/- 15.59 0 32 114 100 4 +102.97 +/- 32.0
186003 ncm-dbt-01 1209814 500 146 107 247 +27.16 +/- 14.18 1 34 140 75 0 +56.07 +/- 28.52
186002 ncm-dbt-04 1217450 500 170 80 250 +63.23 +/- 16.52 1 30 104 108 7 +121.46 +/- 33.46
186001 ncm-dbt-02 1220621 500 160 77 263 +58.21 +/- 14.66 0 24 122 101 3 +115.23 +/- 30.81
186000 ncm-dbt-06 1213794 500 149 90 261 +41.19 +/- 15.94 0 42 109 97 2 +80.63 +/- 32.62
185999 ncm-dbt-05 1218498 500 146 91 263 +38.37 +/- 15.04 0 37 122 90 1 +76.25 +/- 30.91
185998 ncm-dbt-01 1222815 500 165 84 251 +56.78 +/- 14.19 0 22 127 99 2 +113.68 +/- 30.06
185997 ncm-dbt-03 1245217 500 150 86 264 +44.72 +/- 15.9 0 36 120 88 6 +82.1 +/- 31.18
185996 ncm-dbt-04 1232700 500 164 89 247 +52.51 +/- 14.79 0 28 121 99 2 +104.49 +/- 31.0
185995 ncm-dbt-02 1236249 500 170 92 238 +54.64 +/- 14.76 0 25 126 95 4 +106.01 +/- 30.26
185994 ncm-dbt-03 1243260 500 165 93 242 +50.38 +/- 15.2 1 29 119 99 2 +101.46 +/- 31.3
185993 ncm-dbt-05 1227036 500 162 82 256 +56.07 +/- 13.73 1 16 137 94 2 +113.68 +/- 28.47
185992 ncm-dbt-06 1244804 500 155 74 271 +56.78 +/- 14.6 1 23 121 104 1 +116.78 +/- 30.96
185991 ncm-dbt-01 1208037 500 161 94 245 +46.84 +/- 14.88 0 30 126 91 3 +90.97 +/- 30.33
185990 ncm-dbt-04 1246869 500 152 104 244 +33.46 +/- 15.85 0 44 117 86 3 +63.23 +/- 31.56
185989 ncm-dbt-02 1242008 500 148 85 267 +44.01 +/- 14.99 0 32 126 89 3 +85.04 +/- 30.35
185988 ncm-dbt-05 1219073 500 161 84 255 +53.93 +/- 15.25 0 31 113 104 2 +107.54 +/- 32.15
185987 ncm-dbt-03 1238571 500 166 84 250 +57.5 +/- 15.16 0 28 115 104 3 +113.68 +/- 31.86
185986 ncm-dbt-01 1152786 500 153 98 249 +38.37 +/- 15.17 0 36 126 85 3 +73.34 +/- 30.38
185985 ncm-dbt-06 1214111 500 169 90 241 +55.36 +/- 14.66 0 27 118 104 1 +112.14 +/- 31.42
185984 ncm-dbt-04 1243264 500 156 100 244 +39.08 +/- 15.46 1 37 118 93 1 +79.17 +/- 31.44
185983 ncm-dbt-02 1245814 500 158 86 256 +50.38 +/- 14.94 1 26 126 94 3 +99.95 +/- 30.29
185982 ncm-dbt-03 1240712 500 160 92 248 +47.54 +/- 14.92 0 32 119 98 1 +95.44 +/- 31.3
185981 ncm-dbt-05 1247099 500 157 83 260 +51.8 +/- 14.62 0 26 127 94 3 +101.46 +/- 30.14
185980 ncm-dbt-01 1163007 500 151 84 265 +46.84 +/- 15.01 0 32 121 95 2 +92.46 +/- 31.03
185979 ncm-dbt-06 1230440 500 150 81 269 +48.25 +/- 15.22 0 34 114 101 1 +96.94 +/- 32.0
173428 ncm-dbt-01 1442975 16 4 2 10 +43.65 +/- 82.55 0 1 4 3 0 +88.74 +/- 190.27
173427 ncm-dbt-02 1462280 12 4 3 5 +29.01 +/- 98.94 0 1 3 2 0 +58.45 +/- 226.57
173426 ncm-dbt-04 1447348 14 5 0 9 +129.72 +/- 68.06 0 0 2 5 0 +311.09 +/- 530.6
173425 ncm-dbt-03 1458259 18 7 1 10 +120.35 +/- 61.17 0 0 3 6 0 +279.47 +/- 313.13
173424 ncm-dbt-06 1456337 16 7 2 7 +112.27 +/- 142.04 0 1 3 2 2 +136.97 +/- 241.58
173423 ncm-dbt-05 1458556 24 8 3 13 +73.45 +/- 66.73 0 1 5 6 0 +154.14 +/- 171.6
173422 ncm-dbt-04 1453962 50 14 4 32 +70.42 +/- 49.53 0 2 12 10 1 +130.94 +/- 101.68
173421 ncm-dbt-02 1456043 50 15 6 29 +63.22 +/- 44.25 0 2 12 11 0 +130.94 +/- 101.68
173420 ncm-dbt-01 1447810 50 18 6 26 +85.04 +/- 41.74 0 1 11 13 0 +181.7 +/- 107.11
173419 ncm-dbt-03 1450022 50 15 10 25 +34.86 +/- 43.75 0 3 14 8 0 +70.44 +/- 92.08
173418 ncm-dbt-06 1454849 50 21 8 21 +92.44 +/- 36.68 0 0 12 13 0 +200.21 +/- 97.77
173417 ncm-dbt-05 1458112 50 13 9 28 +27.84 +/- 54.17 0 5 12 7 1 +41.89 +/- 101.14
173413 ncm-dbt-04 1448395 50 14 11 25 +20.87 +/- 44.85 0 4 14 7 0 +41.89 +/- 92.36
173412 ncm-dbt-01 1443994 50 16 12 22 +27.85 +/- 42.16 0 3 15 7 0 +56.07 +/- 87.47
173411 ncm-dbt-02 1461094 50 18 8 24 +70.42 +/- 53.56 0 3 10 11 1 +130.94 +/- 112.59
173410 ncm-dbt-03 1455159 50 17 9 24 +56.07 +/- 47.61 0 3 11 11 0 +115.23 +/- 106.91
173409 ncm-dbt-06 1453081 50 19 13 18 +41.89 +/- 45.18 0 3 13 9 0 +85.04 +/- 96.78
173408 ncm-dbt-05 1454998 50 16 9 25 +48.96 +/- 42.0 0 2 14 9 0 +99.95 +/- 91.41
173404 ncm-dbt-02 1459602 50 17 7 26 +70.42 +/- 34.91 0 0 15 10 0 +147.17 +/- 81.61
173403 ncm-dbt-01 1438634 50 15 11 24 +27.85 +/- 46.49 0 4 13 8 0 +56.07 +/- 96.84
173402 ncm-dbt-04 1449399 50 17 8 25 +63.22 +/- 44.25 0 2 12 11 0 +130.94 +/- 101.68
173401 ncm-dbt-03 1451501 50 17 9 24 +56.05 +/- 55.43 0 4 10 10 1 +99.95 +/- 111.26
173400 ncm-dbt-06 1455002 50 15 12 23 +20.87 +/- 40.37 0 3 16 6 0 +41.89 +/- 82.84
173399 ncm-dbt-05 1456329 50 16 9 25 +48.95 +/- 50.55 0 3 13 8 1 +85.04 +/- 96.78

Commit

Commit ID c2b9134c6e7637ea375b4755a6f96dc772c6bb17
Author Michael Chaly
Date 2021-11-05 21:18:59 UTC
Do more reductions at Pv nodes with low delta This patch increases reduction for PvNodes that have their delta (difference between beta and alpha) significantly reduced compared to what it was at root. passed STC https://tests.stockfishchess.org/tests/view/617f9063af49befdeee40226 LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 220840 W: 55752 L: 55150 D: 109938 Ptnml(0-2): 583, 24982, 58712, 25536, 607 passed LTC https://tests.stockfishchess.org/tests/view/61815de959e71df00dcc42ed LLR: 2.95 (-2.94,2.94) <0.50,3.00> Total: 79000 W: 19937 L: 19562 D: 39501 Ptnml(0-2): 36, 8190, 22674, 8563, 37 closes https://github.com/official-stockfish/Stockfish/pull/3774 bench: 6717808
Copyright 2011–2024 Next Chess Move LLC