Dev Builds » 20230305-1506

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:05:10 1300764 3342 1377 321 1644 +113.67 +/- 5.3 1 47 548 1045 30 +248.86 +/- 14.54
ncm-dbt-02 10:00:05 1312830 3314 1350 337 1627 +109.71 +/- 5.47 2 58 552 1015 30 +237.83 +/- 14.5
ncm-dbt-03 10:04:01 1311056 3350 1358 316 1676 +111.77 +/- 5.33 0 51 564 1027 33 +242.12 +/- 14.33
ncm-dbt-04 10:04:03 1302842 3338 1391 349 1598 +112.2 +/- 5.53 0 59 554 1011 45 +239.4 +/- 14.48
ncm-dbt-05 10:03:48 1302798 3332 1400 298 1634 +119.4 +/- 5.36 2 46 500 1084 34 +264.75 +/- 15.25
ncm-dbt-06 10:02:07 1311331 3324 1396 322 1606 +116.43 +/- 5.47 3 56 498 1074 31 +257.23 +/- 15.28
20000 8272 1943 9785 +113.85 +/- 2.21 8 317 3216 6256 203 +248.19 +/- 6.0

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
181161 ncm-dbt-02 1218536 146 64 13 69 +126.69 +/- 28.88 0 4 17 49 3 +273.94 +/- 84.98
181160 ncm-dbt-05 1207712 164 68 15 81 +116.45 +/- 23.11 0 2 26 53 1 +259.99 +/- 68.57
181159 ncm-dbt-06 1232064 166 70 14 82 +121.98 +/- 22.83 0 2 24 56 1 +277.09 +/- 71.77
181158 ncm-dbt-01 1238852 174 77 14 83 +131.76 +/- 22.74 0 1 25 58 3 +294.38 +/- 70.02
181157 ncm-dbt-04 1242434 170 67 14 89 +112.04 +/- 23.51 0 3 27 54 1 +247.28 +/- 67.26
181156 ncm-dbt-03 1216947 180 73 23 84 +99.11 +/- 24.03 0 5 31 53 1 +212.09 +/- 62.39
181155 ncm-dbt-02 1226594 500 195 39 266 +112.14 +/- 13.22 0 5 88 153 4 +245.2 +/- 36.32
181154 ncm-dbt-05 1189783 500 214 57 229 +112.91 +/- 14.38 1 9 76 160 4 +249.64 +/- 39.41
181153 ncm-dbt-01 1211429 500 211 53 236 +113.68 +/- 13.55 0 8 79 160 3 +251.89 +/- 38.63
181152 ncm-dbt-04 1223476 500 214 56 230 +113.68 +/- 14.22 0 8 83 152 7 +243.0 +/- 37.64
181151 ncm-dbt-06 1231706 500 210 52 238 +113.68 +/- 13.55 0 8 79 160 3 +251.89 +/- 38.63
181150 ncm-dbt-03 1212259 500 195 42 263 +109.83 +/- 13.23 0 6 88 153 3 +240.82 +/- 36.39
181149 ncm-dbt-02 1231379 500 208 60 232 +106.01 +/- 14.67 0 13 81 151 5 +226.0 +/- 38.11
181148 ncm-dbt-05 1203749 500 207 48 245 +114.45 +/- 13.89 0 8 80 157 5 +249.64 +/- 38.38
181147 ncm-dbt-06 1206063 500 207 54 239 +109.83 +/- 14.22 0 11 79 156 4 +238.66 +/- 38.63
181146 ncm-dbt-04 1243198 500 210 62 228 +106.01 +/- 14.67 0 12 84 148 6 +223.94 +/- 37.43
181145 ncm-dbt-01 1204486 500 198 44 258 +110.6 +/- 13.56 0 5 92 147 6 +236.51 +/- 35.43
181144 ncm-dbt-03 1243091 500 202 41 257 +116.0 +/- 13.88 0 7 81 156 6 +251.89 +/- 38.11
181143 ncm-dbt-02 1222958 500 203 51 246 +109.07 +/- 15.14 1 10 83 148 8 +230.16 +/- 37.67
181142 ncm-dbt-06 1247518 500 208 47 245 +116.0 +/- 13.71 1 5 80 160 4 +258.75 +/- 38.32
181141 ncm-dbt-04 1217556 500 209 50 241 +114.45 +/- 13.38 0 3 92 148 7 +245.2 +/- 35.25
181140 ncm-dbt-01 1204596 500 204 55 241 +106.77 +/- 14.05 0 10 85 151 4 +230.16 +/- 37.2
181139 ncm-dbt-05 1222477 500 207 41 252 +119.89 +/- 14.68 0 10 72 160 8 +258.75 +/- 40.49
181138 ncm-dbt-03 1236809 500 196 56 248 +99.95 +/- 13.36 0 9 93 147 1 +217.85 +/- 35.44
181137 ncm-dbt-06 1209269 500 209 48 243 +116.0 +/- 13.88 1 7 75 164 3 +261.07 +/- 39.69
181136 ncm-dbt-02 1224718 500 215 45 240 +123.02 +/- 12.74 0 6 69 174 1 +285.49 +/- 41.44
181135 ncm-dbt-04 1194014 500 213 51 236 +116.77 +/- 14.04 0 10 72 164 4 +258.75 +/- 40.49
181134 ncm-dbt-03 1232107 500 214 48 238 +119.89 +/- 14.51 0 11 68 165 6 +263.42 +/- 41.6
181133 ncm-dbt-01 1216090 500 203 44 253 +114.45 +/- 13.89 0 9 77 160 4 +251.89 +/- 39.16
181132 ncm-dbt-05 1237541 500 199 38 263 +116.0 +/- 13.37 1 3 84 158 4 +258.75 +/- 37.2
181131 ncm-dbt-06 1256197 500 207 48 245 +114.45 +/- 14.05 0 9 78 158 5 +249.64 +/- 38.9
181130 ncm-dbt-02 1254419 500 200 57 243 +102.22 +/- 14.78 0 14 84 147 5 +215.85 +/- 37.4
181129 ncm-dbt-03 1237254 500 202 43 255 +114.45 +/- 13.21 0 1 97 144 8 +243.0 +/- 33.94
181128 ncm-dbt-05 1250391 500 217 40 243 +128.55 +/- 13.38 0 5 69 170 6 +290.66 +/- 41.43
181127 ncm-dbt-04 1211804 500 204 50 246 +110.6 +/- 14.69 0 10 84 148 8 +232.26 +/- 37.43
181126 ncm-dbt-01 1217431 500 202 51 247 +108.3 +/- 13.23 1 4 90 153 2 +240.82 +/- 35.87
181125 ncm-dbt-06 1221979 500 214 44 242 +123.02 +/- 14.82 0 11 66 165 8 +268.17 +/- 42.21
181124 ncm-dbt-02 1234494 500 199 57 244 +101.46 +/- 13.53 1 6 95 146 2 +221.9 +/- 34.93
181123 ncm-dbt-03 1222071 500 204 44 252 +115.22 +/- 14.37 0 10 76 158 6 +249.64 +/- 39.41
181122 ncm-dbt-05 1196470 500 213 40 247 +125.38 +/- 13.43 0 6 70 169 5 +282.94 +/- 41.13
181121 ncm-dbt-04 1209391 500 198 48 254 +107.54 +/- 14.05 0 10 84 152 4 +232.26 +/- 37.43
181120 ncm-dbt-01 1217487 500 212 46 242 +119.89 +/- 14.02 0 7 77 159 7 +261.07 +/- 39.14
173221 ncm-dbt-06 1454111 8 4 0 4 +190.56 +/- 13.88 0 0 0 4 0 +1199.83 +/- 250.99
173220 ncm-dbt-02 1455907 18 7 1 10 +120.32 +/- 87.61 0 0 4 4 1 +217.54 +/- 198.33
173219 ncm-dbt-04 1447200 18 9 1 8 +165.87 +/- 82.68 0 0 2 6 1 +361.06 +/- 503.16
173218 ncm-dbt-01 1448225 18 9 2 7 +142.54 +/- 56.5 0 0 2 7 0 +361.06 +/- 503.16
173217 ncm-dbt-05 1457071 18 10 2 6 +165.87 +/- 82.68 0 0 2 6 1 +361.06 +/- 503.16
173216 ncm-dbt-03 1457961 20 9 2 9 +126.91 +/- 57.06 0 0 3 7 0 +301.22 +/- 341.95
173211 ncm-dbt-06 1456333 50 22 4 24 +130.91 +/- 41.82 0 0 8 16 1 +288.02 +/- 131.84
173210 ncm-dbt-04 1444133 50 30 8 12 +164.04 +/- 70.4 0 1 7 11 6 +263.42 +/- 145.5
173209 ncm-dbt-02 1455014 50 21 4 25 +123.0 +/- 36.12 0 0 8 17 0 +288.02 +/- 131.84
173208 ncm-dbt-01 1450138 50 19 2 29 +123.01 +/- 42.3 0 1 6 18 0 +288.06 +/- 162.53
173207 ncm-dbt-03 1457526 50 20 6 24 +99.92 +/- 42.49 0 0 12 12 1 +200.21 +/- 97.77
173206 ncm-dbt-05 1455293 50 23 4 23 +138.98 +/- 41.07 0 1 4 20 0 +346.12 +/- 230.09
173205 ncm-dbt-06 1453374 50 22 5 23 +123.0 +/- 52.64 0 2 5 17 1 +263.42 +/- 170.28
173204 ncm-dbt-04 1449544 50 16 6 28 +70.43 +/- 45.16 0 2 11 12 0 +147.19 +/- 107.43
173203 ncm-dbt-02 1459598 50 20 7 23 +92.43 +/- 42.19 0 0 13 11 1 +181.68 +/- 91.94
173202 ncm-dbt-03 1450435 50 22 7 21 +107.52 +/- 52.35 0 2 7 15 1 +219.87 +/- 140.03
173201 ncm-dbt-01 1449399 50 19 4 27 +107.53 +/- 42.62 0 1 8 16 0 +240.82 +/- 132.75
173200 ncm-dbt-05 1454258 50 22 3 25 +138.97 +/- 34.19 0 0 6 19 0 +346.06 +/- 166.42
173199 ncm-dbt-01 1450281 50 23 6 21 +123.0 +/- 47.73 0 1 7 16 1 +263.42 +/- 145.5
173198 ncm-dbt-06 1456037 50 23 6 21 +123.02 +/- 61.36 1 1 4 18 1 +288.06 +/- 195.19
173197 ncm-dbt-03 1455156 50 21 4 25 +123.0 +/- 36.12 0 0 8 17 0 +288.02 +/- 131.84
173196 ncm-dbt-02 1457516 50 18 3 29 +107.52 +/- 36.86 0 0 10 15 0 +240.79 +/- 111.83
173195 ncm-dbt-05 1456036 50 20 10 20 +70.43 +/- 45.16 0 2 11 12 0 +147.19 +/- 107.43
173194 ncm-dbt-04 1448517 50 21 3 26 +130.91 +/- 41.82 0 0 8 16 1 +288.02 +/- 131.84

Commit

Commit ID 5c75c1c2fbb7bb4f0bf7c44fb855c415b788cbf7
Author Michael Chaly
Date 2023-03-05 15:06:03 UTC
Fix duplicated moves generation in movepicker in a some of cases movepicker returned some moves more than once which lead to them being searched more than once. This bug was possible because of how we use queen promotions - they are generated as a captures but are not included in position function which checks if move is a capture. Thus if any refutation (killer or countermove) was a queen promotion it was searched twice - once as a capture and one as a refutation. This patch affects various things, namely stats assignments for queen promotions and other moves if best move is queen promotion, also some heuristics in search and qsearch. With this patch every queen promotion is now considered a capture. After this patch number of found duplicated moves is 0 during normal 13 depth bench run. Passed STC: https://tests.stockfishchess.org/tests/view/63f77e01e74a12625bcd87d7 LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 80920 W: 21455 L: 21289 D: 38176 Ptnml(0-2): 198, 8839, 22241, 8963, 219 Passed LTC: https://tests.stockfishchess.org/tests/view/63f7e020e74a12625bcd9a76 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 89712 W: 23674 L: 23533 D: 42505 Ptnml(0-2): 24, 8737, 27202, 8860, 33 closes https://github.com/official-stockfish/Stockfish/pull/4405 bench 4681731
Copyright 2011–2024 Next Chess Move LLC