Dev Builds » 20230903-0728

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:55:07 574909 4004 1390 661 1953 +63.97 ± 5.05 3 162 950 877 10 +131.2 ± 11.01
ncm-dbt-02 06:54:53 575994 3998 1349 677 1972 +58.96 ± 5.12 3 186 954 848 8 +120.54 ± 11.0
ncm-dbt-03 06:52:58 587236 4000 1376 711 1913 +58.3 ± 4.92 1 161 1019 810 9 +118.53 ± 10.56
ncm-dbt-04 06:53:15 570921 4000 1352 711 1937 +56.16 ± 5.01 1 182 1000 809 8 +114.07 ± 10.7
ncm-dbt-05 06:55:07 583878 3998 1360 711 1927 +56.9 ± 5.06 1 186 985 817 10 +115.29 ± 10.8
20000 6827 3471 9702 +58.86 ± 2.25 9 877 4908 4161 45 +119.89 ± 4.83

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
403678 ncm-dbt-02 586012 312 106 46 160 +67.65 ± 17.41 0 10 77 68 1 +138.27 ± 38.58 ↓
403677 ncm-dbt-01 584076 318 107 54 157 +58.45 ± 16.98 0 12 82 65 0 +120.41 ± 37.3 ↓
403676 ncm-dbt-03 587452 500 176 96 228 +56.07 ± 14.15 0 22 128 98 2 +112.14 ± 29.92 ↓
403675 ncm-dbt-05 578959 498 174 96 228 +54.87 ± 15.08 0 28 118 100 3 +108.0 ± 31.42 ↓
403674 ncm-dbt-04 572155 500 162 84 254 +54.64 ± 14.49 0 25 124 99 2 +109.07 ± 30.54 ↓
403673 ncm-dbt-01 583614 500 177 82 241 +66.82 ± 14.06 0 19 118 112 1 +137.37 ± 31.31 ↓
403672 ncm-dbt-02 585928 500 173 79 248 +66.1 ± 14.45 0 22 113 114 1 +135.76 ± 32.12 ↓
403671 ncm-dbt-05 582193 500 186 91 223 +66.82 ± 13.33 0 15 125 110 0 +138.99 ± 30.12 ↓
403670 ncm-dbt-03 587240 500 170 84 246 +60.36 ± 13.64 0 17 132 99 2 +121.46 ± 29.18 ↓
403669 ncm-dbt-04 572034 500 176 92 232 +58.93 ± 14.29 0 23 121 105 1 +119.89 ± 30.94 ↓
403668 ncm-dbt-01 585126 500 171 80 249 +63.95 ± 14.5 1 21 114 114 0 +134.15 ± 31.97 ↓
403667 ncm-dbt-02 582819 500 169 80 251 +62.51 ± 13.88 0 18 127 103 2 +126.18 ± 29.94 ↓
403666 ncm-dbt-05 581111 500 169 84 247 +59.64 ± 13.32 0 16 134 99 1 +121.46 ± 28.86 ↓
403665 ncm-dbt-03 590825 500 173 80 247 +65.38 ± 13.42 0 14 131 103 2 +132.54 ± 29.19 ↓
403664 ncm-dbt-04 571310 500 168 84 248 +58.93 ± 13.72 0 18 132 98 2 +118.33 ± 29.22 ↓
403663 ncm-dbt-01 584076 500 178 86 236 +64.66 ± 14.53 0 21 119 107 3 +129.35 ± 31.2 ↓
403662 ncm-dbt-02 587155 500 161 85 254 +53.22 ± 15.21 1 30 111 108 0 +110.6 ± 32.43 ↓
403661 ncm-dbt-03 586393 500 183 83 234 +70.43 ± 13.62 0 15 121 113 1 +145.54 ± 30.73 ↓
403660 ncm-dbt-05 585042 500 158 91 251 +46.84 ± 14.75 0 32 119 99 0 +95.44 ± 31.3 ↓
403659 ncm-dbt-04 571431 500 165 101 234 +44.72 ± 14.51 0 29 130 89 2 +88.0 ± 29.77 ↓
403658 ncm-dbt-01 584453 500 171 85 244 +60.36 ± 14.49 0 23 120 105 2 +121.46 ± 31.09 ↓
403657 ncm-dbt-02 585590 500 162 90 248 +50.38 ± 14.28 0 27 124 99 0 +102.97 ± 30.57 ↓
403656 ncm-dbt-03 585548 500 164 93 243 +49.67 ± 14.24 0 26 128 95 1 +99.95 ± 30.0 ↓
403655 ncm-dbt-04 568275 500 167 88 245 +55.36 ± 13.84 1 18 133 97 1 +113.68 ± 29.12 ↓
403654 ncm-dbt-05 586181 500 180 86 234 +66.1 ± 14.73 1 18 121 106 4 +132.54 ± 30.86 ↓
403653 ncm-dbt-02 586689 500 166 94 240 +50.38 ± 13.44 1 18 139 92 0 +104.49 ± 28.28 ↓
403652 ncm-dbt-01 582945 500 171 83 246 +61.79 ± 13.71 1 15 130 103 1 +127.76 ± 29.43 ↓
403651 ncm-dbt-03 588856 500 179 98 223 +56.79 ± 13.77 1 18 130 101 0 +118.33 ± 29.54 ↓
403650 ncm-dbt-05 587834 500 169 86 245 +58.21 ± 13.83 0 21 125 104 0 +119.89 ± 30.32 ↓
403649 ncm-dbt-04 571592 500 167 85 248 +57.5 ± 13.94 0 22 124 104 0 +118.33 ± 30.49 ↓
403648 ncm-dbt-02 585506 500 173 87 240 +60.36 ± 14.35 0 24 116 110 0 +124.6 ± 31.69 ↓
403647 ncm-dbt-01 583782 500 170 82 248 +61.79 ± 14.55 1 22 115 112 0 +129.35 ± 31.83 ↓
403646 ncm-dbt-03 583447 500 169 94 237 +52.51 ± 14.39 0 27 121 102 0 +107.54 ± 30.99 ↓
403645 ncm-dbt-04 569749 500 176 88 236 +61.79 ± 14.27 0 23 116 111 0 +127.76 ± 31.68 ↓
403644 ncm-dbt-05 584034 500 161 88 251 +51.09 ± 14.98 0 30 119 99 2 +101.46 ± 31.3 ↓
403643 ncm-dbt-02 495052 500 181 85 234 +67.55 ± 15.7 1 25 105 115 4 +135.76 ± 33.36 ↓
403642 ncm-dbt-01 500015 500 180 81 239 +69.71 ± 14.59 0 20 114 113 3 +140.62 ± 31.94 ↓
403641 ncm-dbt-03 588132 500 162 83 255 +55.36 ± 13.98 0 22 128 99 1 +112.14 ± 29.92 ↓
403640 ncm-dbt-05 585674 500 163 89 248 +51.8 ± 14.22 0 26 124 100 0 +106.01 ± 30.56 ↓
403639 ncm-dbt-02 589197 186 58 31 97 +50.79 ± 24.62 0 12 42 39 0 +103.85 ± 53.04 ↓
403638 ncm-dbt-04 570829 500 171 89 240 +57.5 ± 14.22 0 24 120 106 0 +118.33 ± 31.1 ↓
403637 ncm-dbt-01 586097 186 65 28 93 +70.05 ± 24.24 0 9 38 46 0 +146.3 ± 55.91 ↓

Commit

Commit ID b25d68f6ee2d016cc0c14b076e79e6c44fdaea2a
Author Stéphane Nicolet
Date 2023-09-03 07:28:16 UTC
Introduce simple_eval() for lazy evaluations This patch implements the pure materialistic evaluation called simple_eval() to gain a speed-up during Stockfish search. We use the so-called lazy evaluation trick: replace the accurate but slow NNUE network evaluation by the super-fast simple_eval() if the position seems to be already won (high material advantage). To guard against some of the most obvious blunders introduced by this idea, this patch uses the following features which will raise the lazy evaluation threshold in some situations: - avoid lazy evals on shuffling branches in the search tree - avoid lazy evals if the position at root already has a material imbalance - avoid lazy evals if the search value at root is already winning/losing. Moreover, we add a small random noise to the simple_eval() term. This idea (stochastic mobility in the minimax tree) was worth about 200 Elo in the pure simple_eval() player on Lichess. Overall, the current implementation in this patch evaluates about 2% of the leaves in the search tree lazily. -------------------------------------------- STC: LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 60352 W: 15585 L: 15234 D: 29533 Ptnml(0-2): 216, 6906, 15578, 7263, 213 https://tests.stockfishchess.org/tests/view/64f1d9bcbd9967ffae366209 LTC: LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 35106 W: 8990 L: 8678 D: 17438 Ptnml(0-2): 14, 3668, 9887, 3960, 24 https://tests.stockfishchess.org/tests/view/64f25204f5b0c54e3f04c0e7 verification run at VLTC: LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 74362 W: 19088 L: 18716 D: 36558 Ptnml(0-2): 6, 7226, 22348, 7592, 9 https://tests.stockfishchess.org/tests/view/64f2ecdbf5b0c54e3f04d3ae All three tests above were run with adjudication off, we also verified that there was no regression on matetracker (thanks Disservin!). ---------------------------------------------- closes https://github.com/official-stockfish/Stockfish/pull/4771 Bench: 1393714
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy