Dev Builds » 20211018-1900

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:04:50 1281558 3354 1042 626 1686 +43.32 +/- 5.89 2 223 831 599 22 +83.62 +/- 11.8
ncm-dbt-02 10:00:48 1299577 3314 1011 605 1698 +42.78 +/- 5.96 1 236 792 612 16 +83.56 +/- 12.1
ncm-dbt-03 10:05:55 1330934 3338 1062 604 1672 +47.97 +/- 5.9 5 207 797 645 15 +95.6 +/- 12.06
ncm-dbt-04 10:04:59 1314584 3348 1099 610 1639 +51.11 +/- 5.97 4 203 791 652 24 +100.01 +/- 12.11
ncm-dbt-05 09:59:00 964667 3310 1061 599 1650 +48.81 +/- 5.85 1 208 785 650 11 +97.36 +/- 12.15
ncm-dbt-06 10:02:56 1326378 3336 1062 623 1651 +45.99 +/- 5.82 2 210 818 623 15 +90.74 +/- 11.9
20000 6337 3667 9996 +46.66 +/- 2.41 15 1287 4814 3781 103 +91.79 +/- 4.91

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
200338 ncm-dbt-02 1193314 146 46 31 69 +35.82 +/- 29.1 0 13 32 28 0 +72.42 +/- 60.66
200337 ncm-dbt-05 1215124 152 54 27 71 +62.38 +/- 25.14 0 6 37 33 0 +129.06 +/- 56.28
200336 ncm-dbt-06 1226983 158 50 26 82 +53.18 +/- 26.79 0 9 38 31 1 +104.16 +/- 55.76
200335 ncm-dbt-03 1243403 170 51 34 85 +34.86 +/- 25.51 0 13 42 30 0 +70.44 +/- 52.97
200334 ncm-dbt-01 1155586 186 63 33 90 +56.53 +/- 25.07 0 11 42 39 1 +112.07 +/- 53.07
200333 ncm-dbt-04 1246234 188 62 34 92 +52.13 +/- 24.52 0 12 42 40 0 +106.73 +/- 53.05
200332 ncm-dbt-02 1195906 500 152 92 256 +41.89 +/- 16.1 0 42 109 96 3 +80.63 +/- 32.62
200331 ncm-dbt-05 1230975 500 167 91 242 +53.22 +/- 14.42 0 26 123 100 1 +107.54 +/- 30.7
200330 ncm-dbt-06 1223002 500 157 90 253 +46.84 +/- 15.89 1 36 110 101 2 +93.95 +/- 32.53
200329 ncm-dbt-03 1225781 500 161 99 240 +43.3 +/- 16.06 1 37 115 93 4 +83.57 +/- 31.84
200328 ncm-dbt-01 1149326 500 148 87 265 +42.6 +/- 15.66 0 38 116 93 3 +82.1 +/- 31.71
200327 ncm-dbt-04 1227328 500 166 105 229 +42.6 +/- 16.02 1 37 116 92 4 +82.1 +/- 31.71
200326 ncm-dbt-06 1253431 500 153 83 264 +48.96 +/- 14.2 0 22 141 82 5 +92.46 +/- 28.11
200325 ncm-dbt-02 1195127 500 147 81 272 +46.13 +/- 15.23 0 31 127 87 5 +86.52 +/- 30.2
200324 ncm-dbt-05 1232129 500 150 89 261 +42.6 +/- 15.03 1 32 123 93 1 +86.52 +/- 30.76
200323 ncm-dbt-03 1242194 500 162 85 253 +53.93 +/- 15.63 2 28 113 105 2 +110.6 +/- 32.15
200322 ncm-dbt-01 1200855 500 159 97 244 +43.3 +/- 16.06 2 34 118 92 4 +85.04 +/- 31.44
200321 ncm-dbt-04 1233108 500 160 83 257 +53.93 +/- 16.0 1 31 113 100 5 +104.49 +/- 32.14
200320 ncm-dbt-06 1231084 500 163 95 242 +47.54 +/- 15.56 0 36 112 100 2 +93.95 +/- 32.26
200319 ncm-dbt-02 1194064 500 148 90 262 +40.48 +/- 14.12 0 28 138 82 2 +79.17 +/- 28.67
200318 ncm-dbt-05 1233239 500 152 87 261 +45.42 +/- 15.07 0 34 118 97 1 +90.97 +/- 31.44
200317 ncm-dbt-03 1239035 500 147 86 267 +42.6 +/- 15.16 1 33 121 94 1 +86.52 +/- 31.04
200316 ncm-dbt-04 1232108 500 167 90 243 +53.93 +/- 14.86 0 29 116 104 1 +109.07 +/- 31.72
200315 ncm-dbt-01 1143502 500 154 84 262 +48.96 +/- 14.2 0 24 135 88 3 +95.44 +/- 28.99
200314 ncm-dbt-06 1243537 500 161 91 248 +48.96 +/- 14.61 0 30 120 100 0 +99.95 +/- 31.16
200313 ncm-dbt-02 1196100 500 158 97 245 +42.6 +/- 15.29 0 37 116 96 1 +85.04 +/- 31.71
200312 ncm-dbt-05 1223540 500 164 94 242 +48.96 +/- 15.25 0 31 122 93 4 +93.95 +/- 30.89
200311 ncm-dbt-03 1258455 500 175 96 229 +55.36 +/- 14.93 1 24 123 99 3 +110.6 +/- 30.69
200310 ncm-dbt-04 1200319 500 160 80 260 +56.07 +/- 15.97 1 30 112 102 5 +109.07 +/- 32.29
200309 ncm-dbt-01 1194526 500 156 96 248 +41.89 +/- 15.37 0 35 124 87 4 +79.17 +/- 30.64
200308 ncm-dbt-06 1241857 500 153 111 236 +29.25 +/- 14.32 0 37 134 79 0 +58.93 +/- 29.33
200307 ncm-dbt-05 1234549 500 162 94 244 +47.54 +/- 14.53 0 29 125 95 1 +95.44 +/- 30.46
200306 ncm-dbt-02 1192980 500 158 88 254 +48.96 +/- 15.75 0 36 111 100 3 +95.44 +/- 32.4
200305 ncm-dbt-01 1165610 500 160 95 245 +45.42 +/- 14.55 0 30 126 93 1 +90.97 +/- 30.33
200304 ncm-dbt-03 1230437 500 157 88 255 +48.25 +/- 15.59 0 36 111 101 2 +95.44 +/- 32.4
200303 ncm-dbt-04 1215077 500 166 96 238 +48.96 +/- 15.0 1 27 126 93 3 +96.94 +/- 30.31
200302 ncm-dbt-06 1246190 500 161 92 247 +48.25 +/- 15.72 0 35 115 96 4 +92.46 +/- 31.85
200301 ncm-dbt-05 1226377 500 162 96 242 +46.13 +/- 16.21 0 42 102 104 2 +90.97 +/- 33.57
200300 ncm-dbt-02 1193954 500 158 95 247 +44.01 +/- 15.74 1 36 114 97 2 +88.0 +/- 31.98
200299 ncm-dbt-01 1190199 500 153 100 247 +36.97 +/- 15.7 0 38 127 79 6 +66.1 +/- 30.25
200298 ncm-dbt-03 1249585 500 159 86 255 +51.09 +/- 14.18 0 23 134 90 3 +99.95 +/- 29.1
200297 ncm-dbt-04 1217799 500 160 87 253 +51.09 +/- 14.72 0 27 126 94 3 +99.95 +/- 30.29
176811 ncm-dbt-05 503865 8 3 1 4 +88.62 +/- 93.84 0 0 2 2 0 +190.67 +/- 458.56
176810 ncm-dbt-04 1476188 10 6 1 3 +190.62 +/- 141.35 0 0 1 3 1 +381.35 +/- 516.06
176809 ncm-dbt-03 1490307 18 4 2 12 +38.73 +/- 48.22 0 0 7 2 0 +78.47 +/- 102.62
176808 ncm-dbt-01 1476626 18 4 3 11 +19.32 +/- 65.34 0 1 6 2 0 +38.76 +/- 137.18
176807 ncm-dbt-02 1480589 18 6 5 7 +19.32 +/- 85.67 0 2 4 3 0 +38.76 +/- 185.98
176806 ncm-dbt-06 1481083 28 10 7 11 +37.39 +/- 80.65 1 1 6 6 0 +102.11 +/- 149.46
176805 ncm-dbt-05 504131 50 18 7 25 +77.7 +/- 41.12 0 1 12 12 0 +164.07 +/- 100.82
176804 ncm-dbt-04 1470264 50 12 11 27 +6.95 +/- 49.39 0 6 12 7 0 +13.9 +/- 100.98
176803 ncm-dbt-03 1482582 50 17 7 26 +70.43 +/- 49.53 0 3 9 13 0 +147.19 +/- 118.91
176802 ncm-dbt-01 1476772 50 18 11 21 +48.96 +/- 46.46 0 3 12 10 0 +99.95 +/- 101.68
176801 ncm-dbt-02 1482291 50 15 9 26 +41.89 +/- 49.33 0 4 11 10 0 +85.04 +/- 106.19
176800 ncm-dbt-06 1479378 50 21 11 18 +70.42 +/- 34.91 0 0 15 10 0 +147.17 +/- 81.61
176799 ncm-dbt-05 503510 50 14 6 30 +56.07 +/- 51.66 0 4 9 12 0 +115.23 +/- 116.78
176798 ncm-dbt-01 1472075 50 13 11 26 +13.9 +/- 47.24 0 5 13 7 0 +27.85 +/- 96.81
176797 ncm-dbt-02 1485359 50 12 8 30 +27.85 +/- 42.16 0 3 15 7 0 +56.07 +/- 87.47
176796 ncm-dbt-03 1490035 50 11 10 29 +6.95 +/- 53.12 0 7 10 8 0 +13.9 +/- 108.98
176795 ncm-dbt-04 1472359 50 19 11 20 +56.05 +/- 55.43 0 3 13 7 2 +85.04 +/- 96.78
176794 ncm-dbt-06 1482578 50 17 9 24 +56.07 +/- 43.2 0 2 13 10 0 +115.23 +/- 96.38
176793 ncm-dbt-05 503901 50 15 7 28 +56.05 +/- 51.65 0 3 12 9 1 +99.95 +/- 101.68
176792 ncm-dbt-01 1472065 50 14 9 27 +34.86 +/- 47.98 0 4 12 9 0 +70.44 +/- 101.42
176791 ncm-dbt-04 1469643 50 21 12 17 +63.22 +/- 39.41 0 1 14 10 0 +130.94 +/- 89.9
176790 ncm-dbt-03 1488462 50 18 11 21 +48.96 +/- 46.46 0 3 12 10 0 +99.95 +/- 101.68
176789 ncm-dbt-02 1485665 50 11 9 30 +13.9 +/- 43.02 0 4 15 6 0 +27.85 +/- 87.86
176788 ncm-dbt-06 1481045 50 16 8 26 +56.05 +/- 47.6 0 2 14 8 1 +99.95 +/- 91.41

Commit

Commit ID 67d06164833857d3497010e952fd0d2c5f00c095
Author bmc4
Date 2021-10-18 19:00:08 UTC
Simplify probCutCount away Simplify away the limitation in number of moves in probCut. STC: LLR: 2.96 (-2.94,2.94) <-2.50,0.50> Total: 286768 W: 71888 L: 72133 D: 142747 Ptnml(0-2): 983, 33084, 75471, 32887, 959 https://tests.stockfishchess.org/tests/view/616c9b9b90e1312a3cd0ef0a LTC: LLR: 2.95 (-2.94,2.94) <-2.50,0.50> Total: 69312 W: 17243 L: 17176 D: 34893 Ptnml(0-2): 42, 7452, 19614, 7493, 55 https://tests.stockfishchess.org/tests/view/616cebbf4f95b438f7a85f93 closes https://github.com/official-stockfish/Stockfish/pull/3745 bench: 5005810
Copyright 2011–2024 Next Chess Move LLC