Dev Builds » 20220418-2003

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:30:43 584864 6672 1632 1706 3334 -3.85 ± 3.95 5 767 1864 697 3 -7.5 ± 7.83
ncm-dbt-02 11:31:05 586162 6672 1696 1684 3292 +0.62 ± 3.93 3 720 1881 726 6 +0.94 ± 7.79
ncm-dbt-03 11:31:09 587361 6656 1667 1715 3274 -2.51 ± 3.91 2 745 1884 693 4 -5.22 ± 7.78
20000 4995 5105 9900 -1.91 ± 2.27 10 2232 5629 2116 13 -3.93 ± 4.5

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
370505 ncm-dbt-03 582694 156 39 45 72 -13.36 ± 27.55 1 20 41 16 0 -22.3 ± 53.52 ↓
370504 ncm-dbt-01 583824 172 49 51 72 -4.04 ± 26.9 0 24 40 22 0 -8.08 ± 54.14 ↓
370503 ncm-dbt-02 586012 172 46 41 85 +10.1 ± 24.7 0 17 47 22 0 +20.22 ± 49.77 ↓
370502 ncm-dbt-03 586774 500 138 123 239 +10.43 ± 14.05 0 46 143 61 0 +20.87 ± 28.22 ↓
370501 ncm-dbt-01 586350 500 124 123 253 +0.69 ± 14.36 0 55 139 56 0 +1.39 ± 28.76 ↓
370500 ncm-dbt-02 588004 500 134 142 224 -5.56 ± 14.92 0 62 136 50 2 -13.9 ± 29.15 ↓
370499 ncm-dbt-03 587749 500 117 111 272 +4.17 ± 13.89 0 49 146 55 0 +8.34 ± 27.83 ↓
370498 ncm-dbt-01 586604 500 132 112 256 +13.9 ± 14.21 0 45 140 65 0 +27.85 ± 28.61 ↓
370497 ncm-dbt-02 585169 500 128 121 251 +4.87 ± 14.09 1 47 146 56 0 +11.12 ± 27.83 ↓
370496 ncm-dbt-03 587028 500 113 135 252 -15.3 ± 13.93 0 64 144 42 0 -30.65 ± 28.07 ↓
370495 ncm-dbt-01 580904 500 121 126 253 -3.47 ± 14.35 0 58 139 53 0 -6.95 ± 28.76 ↓
370494 ncm-dbt-02 583028 500 117 123 260 -4.17 ± 13.75 0 54 148 48 0 -8.34 ± 27.56 ↓
370493 ncm-dbt-03 588132 500 113 134 253 -14.6 ± 14.0 0 64 143 43 0 -29.25 ± 28.2 ↓
370492 ncm-dbt-01 584537 500 124 125 251 -0.7 ± 13.0 0 45 162 42 1 -2.78 ± 25.6 ↓
370491 ncm-dbt-02 580862 500 112 124 264 -8.34 ± 14.65 1 61 137 51 0 -15.3 ± 29.02 ↓
370490 ncm-dbt-03 588174 500 128 140 232 -8.34 ± 15.03 0 67 128 55 0 -16.69 ± 30.16 ↓
370489 ncm-dbt-01 585548 500 107 133 260 -18.08 ± 15.17 0 76 124 50 0 -36.26 ± 30.66 ↓
370488 ncm-dbt-02 588089 500 125 143 232 -12.51 ± 14.74 0 67 135 47 1 -26.46 ± 29.26 ↓
370487 ncm-dbt-03 588686 500 132 125 243 +4.86 ± 14.6 0 53 138 58 1 +8.34 ± 28.89 ↓
370486 ncm-dbt-01 585506 500 113 122 265 -6.25 ± 13.4 0 53 153 44 0 -12.51 ± 26.87 ↓
370485 ncm-dbt-02 587113 500 129 120 251 +6.25 ± 14.34 0 51 139 60 0 +12.51 ± 28.76 ↓
370484 ncm-dbt-01 583070 500 128 128 244 0.0 ± 14.16 3 45 151 51 0 +4.17 ± 27.16 ↓
370483 ncm-dbt-03 587028 500 127 125 248 +1.39 ± 14.03 0 51 147 51 1 +1.39 ± 27.7 ↓
370482 ncm-dbt-02 588984 500 128 132 240 -2.78 ± 14.29 0 57 140 53 0 -5.56 ± 28.63 ↓
370481 ncm-dbt-01 584622 500 124 135 241 -7.64 ± 14.72 2 58 139 51 0 -12.51 ± 28.76 ↓
370480 ncm-dbt-03 587962 500 132 139 229 -4.86 ± 14.6 0 61 135 54 0 -9.73 ± 29.28 ↓
370479 ncm-dbt-02 586266 500 125 124 251 +0.7 ± 14.61 1 54 138 57 0 +2.78 ± 28.89 ↓
370478 ncm-dbt-01 583279 500 132 131 237 +0.69 ± 14.87 0 59 131 60 0 +1.39 ± 29.79 ↓
370477 ncm-dbt-03 586139 500 120 120 260 0.0 ± 14.29 0 54 143 52 1 -1.39 ± 28.24 ↓
370476 ncm-dbt-02 588217 500 135 120 245 +10.42 ± 14.57 0 49 138 62 1 +19.48 ± 28.88 ↓
370475 ncm-dbt-01 585674 500 117 127 256 -6.95 ± 14.4 0 61 138 51 0 -13.9 ± 28.89 ↓
370474 ncm-dbt-03 587962 500 127 129 244 -1.39 ± 14.42 0 56 141 52 1 -4.17 ± 28.5 ↓
370473 ncm-dbt-02 586435 500 139 120 241 +13.21 ± 14.92 0 49 135 64 2 +23.66 ± 29.27 ↓
370472 ncm-dbt-01 586393 500 117 138 245 -14.6 ± 14.78 0 70 131 49 0 -29.25 ± 29.78 ↓
370471 ncm-dbt-03 588260 500 125 131 244 -4.17 ± 13.48 0 52 152 46 0 -8.34 ± 27.01 ↓
370470 ncm-dbt-02 584076 500 117 125 258 -5.56 ± 13.61 0 54 150 46 0 -11.12 ± 27.29 ↓
370469 ncm-dbt-03 588132 500 126 134 240 -5.56 ± 14.41 1 57 141 51 0 -9.73 ± 28.5 ↓
370468 ncm-dbt-01 583866 500 126 129 245 -2.09 ± 15.36 0 64 126 59 1 -5.56 ± 30.41 ↓
370467 ncm-dbt-02 588643 500 127 127 246 -0.0 ± 13.49 0 49 152 49 0 -0.0 ± 27.02 ↓
370466 ncm-dbt-01 587919 500 118 126 256 -5.56 ± 13.75 0 54 151 44 1 -12.51 ± 27.15 ↓
370465 ncm-dbt-02 585379 500 134 122 244 +8.34 ± 14.26 0 49 140 61 0 +16.69 ± 28.62 ↓
370464 ncm-dbt-03 588345 500 130 124 246 +4.17 ± 14.15 0 51 142 57 0 +8.34 ± 28.37 ↓

Commit

Commit ID e6e324eb28fd49c1fc44b3b65784f85a773ec61c
Author Joost VandeVondele
Date 2022-04-18 20:03:20 UTC
Stockfish 15 Official release version of Stockfish 15 Bench: 8129754 --- A new major release of Stockfish is now available at https://stockfishchess.org Stockfish 15 continues to push the boundaries of chess, providing unrivalled analysis and playing strength. In our testing, Stockfish 15 is ahead of Stockfish 14 by 36 Elo points and wins nine times more game pairs than it loses[1]. Improvements to the engine have made it possible for Stockfish to end up victorious in tournaments at all sorts of time controls ranging from bullet to classical and even at Fischer random chess[2]. At CCC, Stockfish won all of the latest tournaments: CCC 16 Bullet, Blitz and Rapid, CCC 960 championship, and the CCC 17 Rapid. At TCEC, Stockfish won the Season 21, Cup 9, FRC 4 and in the current Season 22 superfinal, at the time of writing, has won 16 game pairs and not yet lost a single one. This progress is the result of a dedicated team of developers that comes up with new ideas and improvements. For Stockfish 15, we tested nearly 13000 different changes and retained the best 200. These include the fourth generation of our NNUE network architecture, as well as various search improvements. To perform these tests, contributors provide CPU time for testing, and in the last year, they have collectively played roughly a billion chess games. In the last few years, our distributed testing framework, Fishtest, has been operated superbly and has been developed and improved extensively. This work by Pasquale Pigazzini, Tom Vijlbrief, Michel Van den Bergh, and various other developers[3] is an essential part of the success of the Stockfish project. Indeed, the Stockfish project builds on a thriving community of enthusiasts to offer a free and open-source chess engine that is robust, widely available, and very strong. We invite our chess fans to join the Fishtest testing framework and programmers to contribute to the project[4]. The Stockfish team [1] https://tests.stockfishchess.org/tests/view/625d156dff677a888877d1be [2] https://en.wikipedia.org/wiki/Stockfish_(chess)#Competition_results [3] https://github.com/glinscott/fishtest/blob/master/AUTHORS [4] https://stockfishchess.org/get-involved/
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy