Dev Builds » 20220602-0547

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:12:55 1232566 3394 1336 393 1665 +99.14 +/- 5.65 1 82 630 941 43 +205.49 +/- 13.57
ncm-dbt-02 10:07:45 1262423 3344 1333 347 1664 +105.58 +/- 5.68 1 80 562 990 39 +223.43 +/- 14.38
ncm-dbt-03 10:13:14 1268948 3376 1306 392 1678 +96.47 +/- 5.61 0 88 632 934 34 +200.87 +/- 13.55
ncm-dbt-04 10:09:17 1260827 3356 1328 404 1624 +98.19 +/- 5.54 0 81 622 945 30 +206.38 +/- 13.66
ncm-dbt-05 10:08:55 1137004 3352 1300 395 1657 +96.19 +/- 5.84 1 102 606 925 42 +198.11 +/- 13.84
ncm-dbt-06 09:35:37 1227076 3178 1220 390 1568 +92.89 +/- 5.8 1 83 624 847 34 +191.58 +/- 13.63
20000 7823 2321 9856 +98.11 +/- 2.32 4 516 3676 5582 222 +204.27 +/- 5.62

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
185642 ncm-dbt-02 1224918 140 55 20 65 +88.73 +/- 26.26 0 3 30 36 1 +184.29 +/- 62.85
185641 ncm-dbt-04 1223159 154 61 18 75 +99.65 +/- 23.04 0 1 33 42 1 +212.59 +/- 58.87
185640 ncm-dbt-05 1218307 160 62 18 80 +98.07 +/- 24.33 0 4 28 48 0 +214.85 +/- 65.82
185639 ncm-dbt-03 1237765 172 62 24 86 +78.04 +/- 26.12 0 8 33 44 1 +159.88 +/- 60.09
185638 ncm-dbt-06 1224999 178 66 27 85 +77.37 +/- 24.79 0 5 43 38 3 +149.05 +/- 51.86
185637 ncm-dbt-01 1207474 196 77 18 101 +107.92 +/- 24.06 0 5 32 58 3 +225.71 +/- 61.41
185636 ncm-dbt-02 1221890 500 198 58 244 +99.95 +/- 16.04 0 20 78 144 8 +204.07 +/- 38.49
185635 ncm-dbt-04 1211810 500 207 64 229 +102.22 +/- 14.63 0 11 92 140 7 +211.87 +/- 35.7
185634 ncm-dbt-05 1237715 500 190 55 255 +96.19 +/- 14.56 0 16 85 147 2 +206.01 +/- 37.14
185633 ncm-dbt-03 1232473 500 195 67 238 +90.96 +/- 14.32 0 13 100 133 4 +189.0 +/- 34.18
185632 ncm-dbt-06 1215266 500 188 53 259 +96.19 +/- 13.95 1 10 93 145 1 +209.91 +/- 35.49
185631 ncm-dbt-01 1222319 500 195 58 247 +97.69 +/- 15.45 0 13 98 128 11 +192.71 +/- 34.55
185630 ncm-dbt-04 1232729 500 200 50 250 +107.54 +/- 14.05 0 9 87 149 5 +230.16 +/- 36.73
185629 ncm-dbt-02 1232167 500 209 43 248 +119.89 +/- 15.3 0 9 79 149 13 +247.41 +/- 38.64
185628 ncm-dbt-05 1224776 500 193 62 245 +93.2 +/- 14.36 0 13 97 136 4 +194.57 +/- 34.74
185627 ncm-dbt-06 1218979 500 190 57 253 +94.69 +/- 14.39 0 12 98 135 5 +196.45 +/- 34.53
185626 ncm-dbt-03 1235253 500 197 59 244 +98.44 +/- 14.44 0 12 93 140 5 +206.01 +/- 35.51
185625 ncm-dbt-01 1149025 500 204 54 242 +107.54 +/- 14.21 0 9 88 147 6 +228.08 +/- 36.51
185624 ncm-dbt-04 1227627 500 195 75 230 +85.04 +/- 14.35 0 17 97 135 1 +179.9 +/- 34.76
185623 ncm-dbt-02 1249327 500 191 40 269 +108.3 +/- 13.73 0 10 81 157 2 +238.66 +/- 38.15
185622 ncm-dbt-05 1240278 500 197 63 240 +95.44 +/- 15.41 0 18 86 140 6 +196.45 +/- 36.88
185621 ncm-dbt-06 1226913 500 186 61 253 +88.74 +/- 15.0 0 16 99 129 6 +179.9 +/- 34.4
185620 ncm-dbt-01 1192020 500 194 52 254 +101.46 +/- 14.32 1 8 94 142 5 +215.85 +/- 35.23
185619 ncm-dbt-03 1241257 500 188 56 256 +93.95 +/- 14.53 0 13 97 135 5 +194.57 +/- 34.74
185618 ncm-dbt-04 1205640 500 202 54 244 +106.01 +/- 14.2 0 10 87 148 5 +226.0 +/- 36.75
185617 ncm-dbt-02 1230226 500 204 49 247 +111.37 +/- 14.38 1 7 84 152 6 +240.82 +/- 37.4
185616 ncm-dbt-06 1234704 500 199 69 232 +92.45 +/- 14.94 0 13 102 127 8 +185.33 +/- 33.81
185615 ncm-dbt-05 1228121 500 185 61 254 +88.0 +/- 16.07 1 20 90 132 7 +178.11 +/- 36.01
185614 ncm-dbt-01 1210795 500 194 76 230 +83.57 +/- 15.02 0 18 101 126 5 +169.27 +/- 34.05
185613 ncm-dbt-03 1250381 500 188 45 267 +102.22 +/- 13.7 0 7 98 140 5 +215.85 +/- 34.33
185612 ncm-dbt-04 1252550 500 192 66 242 +89.48 +/- 14.59 0 13 104 127 6 +181.7 +/- 33.45
185611 ncm-dbt-02 1212997 500 206 57 237 +106.77 +/- 14.05 0 10 85 151 4 +230.16 +/- 37.2
185610 ncm-dbt-05 1209146 500 199 55 246 +102.97 +/- 15.38 0 12 93 134 11 +206.01 +/- 35.51
185609 ncm-dbt-03 1250926 500 202 66 232 +96.94 +/- 15.44 0 17 87 139 7 +198.34 +/- 36.7
185608 ncm-dbt-01 1197880 500 201 68 231 +94.69 +/- 15.4 0 16 93 133 8 +190.85 +/- 35.52
185607 ncm-dbt-06 1233546 500 195 48 257 +105.25 +/- 14.66 0 13 82 150 5 +223.94 +/- 37.87
185606 ncm-dbt-04 1260435 500 191 55 254 +96.94 +/- 14.87 0 16 86 144 4 +204.07 +/- 36.93
185605 ncm-dbt-05 1234150 500 204 62 234 +101.46 +/- 14.78 0 12 91 140 7 +209.91 +/- 35.92
185604 ncm-dbt-02 1246512 500 190 54 256 +96.94 +/- 14.42 0 14 89 144 3 +206.01 +/- 36.33
185603 ncm-dbt-06 1235127 500 196 75 229 +85.78 +/- 14.65 0 14 107 123 6 +172.78 +/- 32.96
185602 ncm-dbt-03 1215714 500 196 53 251 +102.22 +/- 14.78 0 13 87 144 6 +213.85 +/- 36.76
185601 ncm-dbt-01 1206062 500 191 52 257 +99.2 +/- 13.51 0 9 95 144 2 +213.85 +/- 35.03
177373 ncm-dbt-05 503546 192 70 19 103 +94.55 +/- 26.47 0 7 36 48 5 +181.33 +/- 57.61
177372 ncm-dbt-02 1481351 204 80 26 98 +94.21 +/- 23.7 0 7 36 57 2 +195.42 +/- 57.61
177371 ncm-dbt-01 1474957 198 80 15 103 +118.44 +/- 23.28 0 4 29 63 3 +255.45 +/- 64.78
177370 ncm-dbt-03 1487819 204 78 22 104 +97.88 +/- 22.07 0 5 37 59 1 +209.52 +/- 56.9
177369 ncm-dbt-04 1472666 202 80 22 100 +102.64 +/- 21.68 0 4 36 60 1 +222.08 +/- 57.71

Commit

Commit ID 7f1333ccf89c715933ead72e31233510c6f4d146
Author xoto10
Date 2022-06-02 05:47:23 UTC
Blend nnue complexity with classical. Following mstembera's test of the complexity value derived from nnue values, this change blends that idea with the old complexity calculation. STC 10+0.1: LLR: 2.95 (-2.94,2.94) <0.00,2.50> Total: 42320 W: 11436 L: 11148 D: 19736 Ptnml(0-2): 209, 4585, 11263, 4915, 188 https://tests.stockfishchess.org/tests/live_elo/6295c9239c8c2fcb2bad7fd9 LTC 60+0.6: LLR: 2.98 (-2.94,2.94) <0.50,3.00> Total: 34600 W: 9393 L: 9125 D: 16082 Ptnml(0-2): 32, 3323, 10319, 3597, 29 https://tests.stockfishchess.org/tests/view/6295fd5d9c8c2fcb2bad88cf closes https://github.com/official-stockfish/Stockfish/pull/4046 Bench 6078140
Copyright 2011–2024 Next Chess Move LLC