Dev Builds » 20230218-1301

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 05:00:48 1199379 1670 662 153 855 +109.37 +/- 7.29 0 21 295 508 11 +238.88 +/- 19.77
ncm-dbt-02 04:57:53 1218883 1636 674 166 796 +111.57 +/- 8.04 0 34 264 498 22 +237.66 +/- 21.01
ncm-dbt-03 04:59:59 1248136 1678 708 163 807 +117.08 +/- 7.47 0 24 262 537 16 +257.89 +/- 21.08
ncm-dbt-04 05:00:37 1229590 1676 670 173 833 +106.22 +/- 7.75 0 34 289 499 16 +227.03 +/- 20.06
ncm-dbt-05 04:58:21 1237158 1648 671 166 811 +110.0 +/- 7.65 1 26 278 505 14 +239.25 +/- 20.45
ncm-dbt-06 05:00:16 1233124 1692 702 175 815 +111.93 +/- 7.63 0 23 297 502 24 +237.89 +/- 19.73
ncm-et-3 06:25:31 1304128 1662 678 200 784 +102.82 +/- 7.67 0 29 312 473 17 +217.22 +/- 19.24
ncm-et-4 06:26:09 1305096 1650 661 160 829 +108.93 +/- 7.86 0 33 276 498 18 +233.03 +/- 20.54
ncm-et-9 06:26:09 1296795 1670 668 175 827 +105.71 +/- 7.74 1 30 295 493 16 +226.24 +/- 19.84
ncm-et-10 06:27:07 1284896 1676 701 175 800 +112.85 +/- 7.65 0 23 289 503 23 +240.95 +/- 20.01
ncm-et-13 06:28:36 1309999 1674 678 186 810 +105.22 +/- 8.03 0 41 283 493 20 +221.86 +/- 20.28
ncm-et-15 06:26:47 1304704 1668 663 156 849 +109.05 +/- 7.57 0 25 294 498 17 +234.13 +/- 19.84
20000 8136 2048 9816 +109.22 +/- 2.22 2 343 3434 6007 214 +234.17 +/- 5.8

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
194710 ncm-dbt-02 1218722 136 54 14 68 +105.29 +/- 29.34 0 4 22 40 2 +219.27 +/- 74.64
194709 ncm-dbt-05 1230402 148 56 7 85 +119.53 +/- 23.48 0 1 24 48 1 +268.55 +/- 71.19
194708 ncm-dbt-01 1208666 170 72 19 79 +112.04 +/- 24.34 0 2 31 49 3 +234.51 +/- 62.07
194707 ncm-dbt-04 1241242 176 72 15 89 +116.72 +/- 25.29 0 6 20 61 1 +261.29 +/- 76.65
194706 ncm-dbt-03 1242951 178 79 19 80 +121.87 +/- 22.7 0 2 27 58 2 +270.38 +/- 67.3
194705 ncm-dbt-06 1231820 192 86 17 89 +130.69 +/- 22.13 0 1 29 62 4 +286.19 +/- 64.52
194704 ncm-dbt-02 1221633 500 208 43 249 +119.11 +/- 14.68 0 8 79 153 10 +251.89 +/- 38.63
194703 ncm-dbt-05 1248479 500 198 46 256 +109.07 +/- 14.68 1 9 83 151 6 +234.38 +/- 37.67
194702 ncm-dbt-01 1176496 500 189 41 270 +106.01 +/- 12.35 0 2 100 146 2 +232.26 +/- 33.47
194701 ncm-dbt-03 1246706 500 210 49 241 +116.0 +/- 13.88 0 6 84 153 7 +249.64 +/- 37.33
194700 ncm-dbt-04 1224245 500 204 48 248 +112.14 +/- 13.89 0 8 83 154 5 +243.0 +/- 37.64
194699 ncm-dbt-06 1222374 500 200 52 248 +106.01 +/- 14.2 0 11 84 151 4 +228.08 +/- 37.44
194698 ncm-dbt-02 1222530 500 201 50 249 +108.3 +/- 14.83 0 13 79 152 6 +230.16 +/- 38.58
194697 ncm-dbt-05 1237502 500 205 53 242 +109.07 +/- 13.4 0 8 84 156 2 +240.82 +/- 37.4
194696 ncm-dbt-01 1215766 500 205 50 245 +111.37 +/- 13.73 0 8 83 155 4 +243.0 +/- 37.64
194695 ncm-dbt-03 1239528 500 210 43 247 +120.67 +/- 13.67 0 8 71 167 4 +270.57 +/- 40.83
194694 ncm-dbt-04 1222101 500 192 59 249 +94.69 +/- 14.09 0 11 99 136 4 +198.34 +/- 34.31
194693 ncm-dbt-06 1229761 500 202 54 244 +106.01 +/- 13.88 0 5 100 137 8 +219.87 +/- 33.78
194692 ncm-dbt-02 1212649 500 211 59 230 +109.07 +/- 13.89 0 9 84 153 4 +236.51 +/- 37.42
194691 ncm-dbt-03 1263361 500 209 52 239 +112.91 +/- 13.56 0 8 80 159 3 +249.64 +/- 38.38
194690 ncm-dbt-05 1232250 500 212 60 228 +109.07 +/- 13.89 0 8 87 150 5 +234.38 +/- 36.71
194689 ncm-dbt-06 1248543 500 214 52 234 +116.77 +/- 14.04 0 6 84 152 8 +249.64 +/- 37.33
194688 ncm-dbt-04 1230775 500 202 51 247 +108.3 +/- 14.21 0 9 87 148 6 +230.16 +/- 36.73
194687 ncm-dbt-01 1196590 500 196 43 261 +109.83 +/- 13.56 0 9 81 158 2 +243.0 +/- 38.14
166556 ncm-et-4 1294814 150 59 15 76 +105.0 +/- 25.48 0 4 23 48 0 +233.67 +/- 72.98
166555 ncm-et-3 1298813 162 60 23 79 +80.78 +/- 23.55 0 4 36 41 0 +171.37 +/- 57.14
166554 ncm-et-15 1298696 168 59 13 96 +97.62 +/- 23.57 0 3 33 47 1 +207.81 +/- 60.06
166553 ncm-et-13 1306491 174 69 16 89 +109.29 +/- 23.16 0 4 26 57 0 +245.86 +/- 68.53
166552 ncm-et-10 1290262 176 71 16 89 +112.32 +/- 21.31 0 1 32 54 1 +248.32 +/- 60.64
166551 ncm-et-9 1297750 170 74 16 80 +123.48 +/- 24.22 0 1 29 51 4 +260.66 +/- 64.14
166550 ncm-et-4 1307236 500 197 53 250 +102.97 +/- 14.49 0 11 90 143 6 +215.85 +/- 36.11
166549 ncm-et-15 1304650 500 198 48 254 +107.54 +/- 14.52 0 11 84 149 6 +228.08 +/- 37.44
166548 ncm-et-10 1293883 500 215 51 234 +118.33 +/- 14.36 0 7 81 153 9 +251.89 +/- 38.11
166547 ncm-et-13 1314943 500 201 66 233 +96.19 +/- 16.25 0 20 85 135 10 +190.85 +/- 37.01
166546 ncm-et-9 1304377 500 207 54 239 +109.83 +/- 14.53 1 10 78 157 4 +240.82 +/- 38.87
166545 ncm-et-3 1309861 500 203 57 240 +104.49 +/- 14.04 0 8 94 142 6 +219.87 +/- 35.19
166544 ncm-et-15 1309980 500 211 55 234 +112.14 +/- 13.39 0 4 92 148 6 +240.82 +/- 35.35
166543 ncm-et-9 1287077 500 192 48 260 +102.97 +/- 13.71 0 9 91 147 3 +221.9 +/- 35.86
166542 ncm-et-4 1321469 500 197 45 258 +109.07 +/- 14.21 0 8 89 146 7 +230.16 +/- 36.26
166541 ncm-et-3 1305249 500 204 62 234 +101.46 +/- 14.63 0 11 93 139 7 +209.91 +/- 35.49
166540 ncm-et-10 1276935 500 207 52 241 +111.37 +/- 13.73 0 7 86 152 5 +240.82 +/- 36.9
166539 ncm-et-13 1307970 500 202 49 249 +109.83 +/- 14.22 0 9 85 150 6 +234.38 +/- 37.19
166538 ncm-et-3 1302590 500 211 58 231 +109.83 +/- 13.4 0 6 89 151 4 +238.66 +/- 36.16
166537 ncm-et-9 1297977 500 195 57 248 +98.44 +/- 14.14 0 10 97 138 5 +206.01 +/- 34.66
166536 ncm-et-4 1296868 500 208 47 245 +116.0 +/- 14.21 0 10 74 161 5 +254.16 +/- 39.94
166535 ncm-et-10 1278507 500 208 56 236 +109.07 +/- 14.37 0 8 90 144 8 +228.08 +/- 36.04
166534 ncm-et-15 1305491 500 195 40 265 +111.37 +/- 13.56 0 7 85 154 4 +243.0 +/- 37.13
166533 ncm-et-13 1310593 500 206 55 239 +108.3 +/- 13.73 0 8 87 151 4 +234.38 +/- 36.71

Commit

Commit ID 037ef3e18dc7f5455cc671995ae38d5b4d1fce4a
Author Dubslow
Date 2023-02-18 13:01:08 UTC
Remove one `reduction` call even though bench is unchanged to depth 28, due to adjusting depth in singular extensions this might be functional. STC: https://tests.stockfishchess.org/tests/view/63ec21affe833123fef34153 LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 195712 W: 51625 L: 51581 D: 92506 Ptnml(0-2): 504, 20527, 55779, 20513, 533 LTC: https://tests.stockfishchess.org/tests/view/63ed3487fe833123fef375ed LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 32176 W: 8631 L: 8442 D: 15103 Ptnml(0-2): 5, 2794, 10309, 2967, 13 closes https://github.com/official-stockfish/Stockfish/pull/4395 Bench 4283297
Copyright 2011–2024 Next Chess Move LLC