Dev Builds » 20230629-0600

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:32:17 465340 6674 2288 1198 3188 +57.26 ± 3.85 1 297 1659 1371 9 +116.87 ± 8.31
ncm-dbt-02 11:30:40 468309 6680 2296 1198 3186 +57.63 ± 3.83 2 283 1679 1367 9 +117.8 ± 8.25
ncm-dbt-03 11:29:07 474900 6646 2269 1149 3228 +59.11 ± 3.92 2 303 1601 1407 10 +120.92 ± 8.48
20000 6853 3545 9602 +58.0 ± 2.23 5 883 4939 4145 28 +118.53 ± 4.82

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
370418 ncm-dbt-03 478763 146 54 22 70 +77.4 ± 25.02 0 3 36 33 1 +157.51 ± 56.31
370417 ncm-dbt-01 446688 174 64 30 80 +68.77 ± 24.02 0 6 42 38 1 +138.71 ± 52.68
370416 ncm-dbt-02 463327 180 69 33 78 +70.43 ± 22.88 0 5 45 39 1 +142.62 ± 50.46
370415 ncm-dbt-03 482678 500 167 92 241 +52.51 ± 13.55 0 20 136 93 1 +106.01 ± 28.73
370414 ncm-dbt-01 462208 500 175 91 234 +58.93 ± 14.15 0 23 120 107 0 +121.46 ± 31.09
370413 ncm-dbt-02 472747 500 167 76 257 +63.95 ± 14.23 0 22 115 113 0 +132.54 ± 31.82
370412 ncm-dbt-03 461527 500 159 87 254 +50.38 ± 15.58 0 36 107 106 1 +101.46 ± 32.96
370411 ncm-dbt-02 467462 500 169 95 236 +51.8 ± 13.08 0 18 140 92 0 +106.01 ± 28.1
370410 ncm-dbt-01 468764 500 159 86 255 +51.09 ± 13.9 0 24 129 97 0 +104.49 ± 29.82
370409 ncm-dbt-03 451166 500 174 95 231 +55.36 ± 14.93 0 30 111 109 0 +113.68 ± 32.44
370408 ncm-dbt-02 459874 500 172 105 223 +46.84 ± 13.53 0 23 137 90 0 +95.44 ± 28.69
370407 ncm-dbt-01 480245 500 179 96 225 +58.21 ± 15.32 0 29 112 106 3 +115.23 ± 32.29
370406 ncm-dbt-03 469189 500 172 84 244 +61.79 ± 14.14 0 22 118 110 0 +127.76 ± 31.37
370405 ncm-dbt-02 469962 500 187 82 231 +74.06 ± 13.44 0 12 123 113 2 +152.18 ± 30.28
370404 ncm-dbt-01 445267 500 171 94 235 +53.93 ± 14.19 0 24 126 99 1 +109.07 ± 30.24
370403 ncm-dbt-03 470215 500 170 80 250 +63.23 ± 13.33 0 16 128 106 0 +130.94 ± 29.72
370402 ncm-dbt-01 459274 500 168 90 242 +54.64 ± 14.08 0 23 127 99 1 +110.6 ± 30.08
370401 ncm-dbt-02 466305 500 176 82 242 +66.1 ± 14.17 0 21 114 115 0 +137.37 ± 31.96
370400 ncm-dbt-03 473226 500 168 86 246 +57.5 ± 14.63 1 23 120 105 1 +118.33 ± 31.1
370399 ncm-dbt-01 448399 500 160 90 250 +48.96 ± 13.65 0 23 134 93 0 +99.95 ± 29.1
370398 ncm-dbt-02 476822 500 172 99 229 +51.09 ± 14.31 0 27 123 100 0 +104.49 ± 30.71
370397 ncm-dbt-03 499131 500 162 96 242 +46.13 ± 14.45 0 30 124 96 0 +93.95 ± 30.6
370396 ncm-dbt-01 493573 500 170 94 236 +53.22 ± 14.29 0 26 122 102 0 +109.07 ± 30.84
370395 ncm-dbt-02 496939 500 168 77 255 +63.95 ± 13.66 1 15 126 108 0 +134.15 ± 30.02
370394 ncm-dbt-01 479764 500 169 78 253 +63.95 ± 13.94 0 20 119 111 0 +132.54 ± 31.18
370393 ncm-dbt-02 459136 500 174 86 240 +61.79 ± 14.14 0 22 118 110 0 +127.76 ± 31.37
370392 ncm-dbt-03 479866 500 179 92 229 +61.07 ± 14.24 0 23 117 110 0 +126.18 ± 31.53
370391 ncm-dbt-01 457781 500 173 94 233 +55.36 ± 14.26 1 22 124 103 0 +115.23 ± 30.51
370390 ncm-dbt-02 457974 500 172 78 250 +66.1 ± 14.31 0 20 118 110 2 +134.15 ± 31.33
370389 ncm-dbt-03 476739 500 164 84 252 +56.07 ± 14.15 0 23 125 101 1 +113.68 ± 30.37
370388 ncm-dbt-01 479883 500 182 96 222 +60.36 ± 13.79 0 19 127 103 1 +123.02 ± 29.98
370387 ncm-dbt-02 455638 500 167 99 234 +47.55 ± 13.42 1 19 141 89 0 +98.44 ± 28.04
370386 ncm-dbt-03 494368 500 169 79 252 +63.23 ± 14.2 0 21 119 109 1 +129.35 ± 31.2
370385 ncm-dbt-01 453573 500 171 98 231 +51.09 ± 14.31 0 27 123 100 0 +104.49 ± 30.71
370384 ncm-dbt-02 481343 500 166 101 233 +45.42 ± 14.55 0 29 129 90 2 +89.48 ± 29.91
370383 ncm-dbt-03 477834 500 182 83 235 +69.71 ± 13.44 0 15 121 114 0 +145.54 ± 30.73
370382 ncm-dbt-01 467168 500 172 82 246 +63.23 ± 13.03 0 13 135 101 1 +129.35 ± 28.56
370381 ncm-dbt-02 470148 500 172 96 232 +53.22 ± 14.01 0 23 129 97 1 +107.54 ± 29.8
370380 ncm-dbt-03 464174 500 170 93 237 +53.93 ± 14.59 1 23 126 98 2 +109.07 ± 30.24
370379 ncm-dbt-01 472177 500 175 79 246 +67.54 ± 13.95 0 18 119 112 1 +138.99 ± 31.13
370378 ncm-dbt-02 458655 500 165 89 246 +53.22 ± 14.56 0 27 121 101 1 +107.54 ± 30.99
370377 ncm-dbt-03 469730 500 179 76 245 +72.61 ± 14.27 0 18 113 117 2 +148.85 ± 32.06

Commit

Commit ID 68e1e9b3811e16cad014b590d7443b9063b3eb52
Author Joost VandeVondele
Date 2023-06-29 06:00:10 UTC
Stockfish 16 Official release version of Stockfish 16 Bench: 2593605 --- Stockfish 16 A new major release of Stockfish is now available at https://stockfishchess.org/download/ *Quality of chess play* Stockfish continues to demonstrate its ability to discover superior moves with remarkable speed. In self-play against Stockfish 15, this new release gains up to 50 Elo[1] and wins up to 12 times more game pairs[2] than it loses. In major chess engine tournaments, Stockfish reliably tops the rankings[3] winning the TCEC season 24 Superfinal, Swiss, Fischer Random, and Double Random Chess tournaments and the CCC 19 Bullet, 20 Blitz, and 20 Rapid competitions. Leela Chess Zero[4] was the challenger in most finals, putting top-engine chess now firmly in the hands of teams embracing free and open-source software. *Progress made* This updated version of Stockfish introduces several enhancements, including an upgraded neural net architecture (SFNNv6)[5], improved implementation, and refined parameterization. The ongoing utilization of Leela’s data combined with a novel inference approach exploiting sparsity[6], and network compression[7] ensure a speedy evaluation and modest binary sizes while allowing for more weights and higher accuracy. The search has undergone more optimization, leading to improved performance, particularly in longer analyses[8]. Additionally, the Fishtest framework has been improved and is now able to run the tests needed to validate new ideas with 10000s of CPU cores. *Usability improvements* Stockfish now comes with documentation, found in the wiki folder when downloading it or on GitHub[9]. Additionally, Stockfish now includes a clear and consistent forced tablebase win score, displaying a value of 200 minus the number of plies required to reach a tablebase win[10]. Furthermore, the UCI_Elo option, to reduce its strength, has been calibrated[11]. It is worth noting that the evaluation system remains consistent with Stockfish 15.1[12], maintaining the choice that 100cp means a 50% chance of winning the game against an equal opponent[13]. Finally, binaries of our latest development version are now provided continuously as pre-releases on GitHub making it easier for enthusiasts to download the latest and strongest version of the program[14], we thank Roman Korba for having provided a similar service for a long time. *Thank you* The success of the Stockfish project relies on the vibrant community of passionate enthusiasts (we appreciate each and every one of you!) who generously contribute their knowledge, time, and resources. Together, this dedicated community works towards the common goal of developing a powerful, freely accessible, and open-source chess engine. We invite all chess enthusiasts to join the Fishtest testing framework and contribute to the project[15]. The Stockfish team [1] https://tests.stockfishchess.org/tests/view/649409f0dc7002ce609c99cc [2] https://tests.stockfishchess.org/tests/view/649409d7dc7002ce609c99c6 [3] https://en.wikipedia.org/wiki/Stockfish_(chess)#Competition_results [4] https://lczero.org/ [5] https://github.com/official-stockfish/Stockfish/commit/c1fff71 [6] https://github.com/official-stockfish/Stockfish/commit/38e6166 [7] https://github.com/official-stockfish/Stockfish/commit/a46087e [8] https://github.com/official-stockfish/Stockfish/commit/472e726 [9] https://github.com/official-stockfish/Stockfish/wiki/ [10] https://github.com/official-stockfish/Stockfish/commit/def2966 [11] https://github.com/official-stockfish/Stockfish/commit/a08b8d4 [12] https://github.com/official-stockfish/Stockfish/commit/52e84e4 [13] https://github.com/official-stockfish/Stockfish/wiki/Stockfish-FAQ#interpretation-of-the-stockfish-evaluation [14] https://github.com/official-stockfish/Stockfish/releases?q=prerelease%3Atrue [15] https://stockfishchess.org/get-involved/
Copyright 2011–2024 Next Chess Move LLC