Dev Builds » 20211230-1059

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:25:54 1195941 3178 1094 527 1557 +62.66 +/- 6.05 2 165 706 696 20 +125.19 +/- 12.82
ncm-dbt-02 09:21:30 1213328 3144 1125 463 1556 +74.27 +/- 6.03 0 133 673 737 29 +148.3 +/- 13.13
ncm-dbt-03 11:05:29 1357167 3682 1305 544 1833 +72.86 +/- 5.65 1 169 772 866 33 +145.53 +/- 12.26
ncm-dbt-04 09:25:24 1233831 3156 1096 457 1603 +71.33 +/- 6.0 1 137 687 728 25 +142.96 +/- 12.99
ncm-dbt-05 11:01:00 1348940 3650 1267 533 1850 +70.83 +/- 5.6 2 160 795 838 30 +141.78 +/- 12.08
ncm-dbt-06 09:25:48 1234749 3190 1115 476 1599 +70.55 +/- 5.96 0 135 718 710 32 +139.22 +/- 12.7
20000 7002 3000 9998 +70.47 +/- 2.4 6 899 4351 4575 169 +140.58 +/- 5.16

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
198867 ncm-dbt-02 1211777 144 57 22 65 +86.16 +/- 30.24 0 6 28 35 3 +165.99 +/- 65.53
198866 ncm-dbt-04 1230722 156 53 33 70 +44.78 +/- 26.26 0 9 41 27 1 +86.37 +/- 53.29
198865 ncm-dbt-05 1240562 156 47 29 80 +40.26 +/- 26.54 0 10 41 26 1 +76.96 +/- 53.36
198864 ncm-dbt-03 1221926 176 60 31 85 +57.77 +/- 25.65 0 10 40 37 1 +114.52 +/- 54.41
198863 ncm-dbt-01 1224699 178 63 30 85 +65.16 +/- 25.35 0 8 42 37 2 +126.3 +/- 52.95
198862 ncm-dbt-06 1212893 190 64 28 98 +66.63 +/- 23.06 0 7 46 41 1 +134.32 +/- 50.33
198861 ncm-dbt-02 1192473 500 179 75 246 +73.33 +/- 14.3 0 18 112 118 2 +150.51 +/- 32.22
198860 ncm-dbt-04 1226994 500 175 74 251 +71.16 +/- 15.05 0 24 103 121 2 +145.54 +/- 33.69
198859 ncm-dbt-05 1221949 500 163 71 266 +64.66 +/- 14.39 0 20 121 106 3 +129.35 +/- 30.88
198858 ncm-dbt-03 1243494 500 186 79 235 +75.52 +/- 15.2 1 19 106 120 4 +153.86 +/- 33.21
198857 ncm-dbt-01 1201777 500 170 65 265 +74.06 +/- 14.74 0 23 99 128 0 +155.54 +/- 34.37
198856 ncm-dbt-06 1254462 500 168 74 258 +66.1 +/- 15.52 0 24 115 104 7 +126.18 +/- 31.84
198855 ncm-dbt-05 1227675 500 171 71 258 +70.44 +/- 14.89 1 19 112 115 3 +143.89 +/- 32.25
198854 ncm-dbt-02 1212901 500 168 74 258 +66.1 +/- 15.65 0 24 116 102 8 +124.6 +/- 31.69
198853 ncm-dbt-04 1245665 500 167 68 265 +69.71 +/- 14.17 0 18 117 113 2 +142.26 +/- 31.44
198852 ncm-dbt-03 1236319 500 192 69 239 +87.26 +/- 15.25 0 19 94 132 5 +178.11 +/- 35.3
198851 ncm-dbt-01 1216783 500 158 92 250 +46.13 +/- 15.48 1 31 123 91 4 +89.48 +/- 30.76
198850 ncm-dbt-06 1215125 500 172 77 251 +66.82 +/- 14.89 0 22 115 109 4 +132.54 +/- 31.82
198849 ncm-dbt-02 1197131 500 172 76 252 +67.54 +/- 16.21 0 30 100 114 6 +130.94 +/- 34.09
198848 ncm-dbt-04 1247556 500 181 67 252 +80.63 +/- 15.22 1 17 104 123 5 +164.07 +/- 33.53
198847 ncm-dbt-05 1223762 500 191 76 233 +81.36 +/- 15.1 0 18 105 121 6 +162.35 +/- 33.37
198846 ncm-dbt-03 1236885 500 166 78 256 +61.79 +/- 15.47 0 29 107 111 3 +123.02 +/- 33.03
198845 ncm-dbt-01 1165947 500 171 75 254 +67.54 +/- 15.32 0 27 102 119 2 +137.37 +/- 33.82
198844 ncm-dbt-06 1242404 500 174 76 250 +68.99 +/- 14.14 0 16 124 106 4 +137.37 +/- 30.31
198843 ncm-dbt-05 1223586 500 175 77 248 +68.99 +/- 15.63 0 26 105 114 5 +135.76 +/- 33.36
198842 ncm-dbt-04 1227670 500 166 59 275 +75.52 +/- 15.2 0 22 103 121 4 +152.18 +/- 33.71
198841 ncm-dbt-02 1197447 500 185 68 247 +82.83 +/- 15.14 0 20 97 129 4 +169.27 +/- 34.75
198840 ncm-dbt-03 1217100 500 182 72 246 +77.7 +/- 15.4 0 22 101 122 5 +155.54 +/- 34.04
198839 ncm-dbt-01 1200152 500 178 87 235 +63.95 +/- 15.17 1 23 113 110 3 +129.35 +/- 32.14
198838 ncm-dbt-06 1244928 500 179 72 249 +75.52 +/- 15.46 0 23 102 120 5 +150.51 +/- 33.87
198837 ncm-dbt-04 1216329 500 177 87 236 +63.23 +/- 15.66 0 27 112 105 6 +121.46 +/- 32.29
198836 ncm-dbt-02 1235695 500 175 81 244 +66.1 +/- 14.45 0 20 119 108 3 +132.54 +/- 31.18
198835 ncm-dbt-03 1227517 500 168 79 253 +62.51 +/- 15.37 0 28 108 111 3 +124.6 +/- 32.89
198834 ncm-dbt-05 1238822 500 172 65 263 +75.52 +/- 14.37 0 18 109 121 2 +155.54 +/- 32.7
198833 ncm-dbt-01 1203451 500 168 89 243 +55.36 +/- 14.79 0 26 122 99 3 +109.07 +/- 30.84
198832 ncm-dbt-06 1235137 500 181 84 235 +68.27 +/- 15.21 0 23 112 110 5 +134.15 +/- 32.28
198831 ncm-dbt-03 1248153 500 186 69 245 +82.83 +/- 15.41 0 20 99 125 6 +165.8 +/- 34.39
198830 ncm-dbt-02 1245873 500 189 67 244 +86.52 +/- 14.38 0 15 101 131 3 +179.9 +/- 34.03
198829 ncm-dbt-04 1241885 500 177 69 254 +76.25 +/- 15.09 0 20 107 118 5 +152.18 +/- 33.05
198828 ncm-dbt-05 1219092 500 181 72 247 +76.97 +/- 16.16 0 26 96 121 7 +150.51 +/- 34.82
198827 ncm-dbt-01 1158784 500 186 89 225 +68.27 +/- 15.86 0 27 105 112 6 +132.54 +/- 33.35
198826 ncm-dbt-06 1238300 500 177 65 258 +79.17 +/- 15.31 0 20 104 120 6 +157.24 +/- 33.54
176345 ncm-dbt-03 1438762 6 3 1 2 +120.22 +/- 109.7 0 0 1 2 0 +279.24 +/- 576.89
176339 ncm-dbt-05 1430723 44 17 5 22 +97.21 +/- 57.23 0 3 4 15 0 +212.59 +/- 173.09
176338 ncm-dbt-03 1441239 50 19 3 28 +115.2 +/- 36.62 0 0 9 16 0 +263.38 +/- 120.78
176337 ncm-dbt-05 1429168 50 12 5 33 +48.96 +/- 42.0 0 2 14 9 0 +99.95 +/- 91.41
176336 ncm-dbt-03 1432435 50 17 6 27 +77.69 +/- 50.32 0 1 14 8 2 +130.94 +/- 89.9
176335 ncm-dbt-05 1433727 50 16 6 28 +70.45 +/- 57.33 1 2 8 14 0 +164.07 +/- 126.09
176334 ncm-dbt-03 1438909 50 13 5 32 +56.05 +/- 51.65 0 3 12 9 1 +99.95 +/- 101.68
176333 ncm-dbt-05 1431022 50 17 10 23 +48.95 +/- 54.34 0 4 11 9 1 +85.04 +/- 106.19
176332 ncm-dbt-03 1442831 50 17 10 23 +48.96 +/- 46.46 0 3 12 10 0 +99.95 +/- 101.68
176331 ncm-dbt-05 1433432 50 18 8 24 +70.43 +/- 49.53 0 3 9 13 0 +147.19 +/- 118.91
176330 ncm-dbt-03 1429280 50 17 7 26 +70.43 +/- 45.16 0 2 11 12 0 +147.19 +/- 107.43
176329 ncm-dbt-05 1436170 50 18 10 22 +56.07 +/- 38.31 0 1 15 9 0 +115.23 +/- 84.94
176328 ncm-dbt-03 1427020 50 9 5 36 +27.85 +/- 46.49 0 4 13 8 0 +56.07 +/- 96.84
176327 ncm-dbt-05 1437045 50 13 3 34 +70.43 +/- 40.35 0 1 13 11 0 +147.19 +/- 95.14
176326 ncm-dbt-03 1435876 50 18 10 22 +56.05 +/- 51.65 0 3 12 9 1 +99.95 +/- 101.68
176325 ncm-dbt-05 1437472 50 15 11 24 +27.85 +/- 46.49 0 4 13 8 0 +56.07 +/- 96.84
176324 ncm-dbt-03 1432285 50 19 9 22 +70.42 +/- 57.33 0 4 8 12 1 +130.94 +/- 122.89
176317 ncm-dbt-05 1437912 50 22 4 24 +130.92 +/- 52.55 0 1 7 15 2 +263.42 +/- 145.5
176316 ncm-dbt-03 1440650 50 16 5 29 +77.68 +/- 41.12 0 0 15 9 1 +147.17 +/- 81.61
176315 ncm-dbt-05 1429862 50 19 10 21 +63.22 +/- 44.25 0 2 12 11 0 +130.94 +/- 101.68
176314 ncm-dbt-03 1438342 50 17 6 27 +77.7 +/- 45.94 0 2 10 13 0 +164.07 +/- 113.84

Commit

Commit ID 1066119083ffc8a697becbeb75a48f95add1a92d
Author Stéphane Nicolet
Date 2021-12-30 10:59:23 UTC
Tweak optimism with complexity This patch increases the optimism bonus for "complex positions", where the complexity is measured as the absolute value of the difference between material and the sophisticated NNUE evaluation (idea by Joost VandeVondele). Also rename some variables in evaluate() while there. passed STC: LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 88392 W: 23150 L: 22781 D: 42461 Ptnml(0-2): 318, 9961, 23257, 10354, 306 https://tests.stockfishchess.org/tests/view/61cbbedee68b2a714b6eb110 passed LTC: LLR: 2.93 (-2.94,2.94) <0.50,3.00> Total: 37848 W: 10043 L: 9766 D: 18039 Ptnml(0-2): 26, 3815, 10961, 4100, 22 https://tests.stockfishchess.org/tests/view/61cc0cc3e68b2a714b6ec28c Closes https://github.com/official-stockfish/Stockfish/pull/3875 Follow-up from https://github.com/official-stockfish/Stockfish/commit/a5a89b27c8e3225fb453d603bc4515d32bb351c3 Bench: 4125221
Copyright 2011–2024 Next Chess Move LLC