Dev Builds » 20240113-1840

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:54:54 583966 4000 1423 592 1985 +73.25 ± 4.95 1 126 929 929 15 +150.72 ± 11.1
ncm-dbt-02 06:55:57 587259 4008 1483 630 1895 +75.09 ± 4.93 0 132 893 973 6 +156.67 ± 11.36
ncm-dbt-03 06:55:21 587559 3998 1459 645 1894 +71.74 ± 5.03 2 139 915 929 14 +147.69 ± 11.21
ncm-dbt-04 06:55:09 570904 3994 1395 620 1979 +68.28 ± 4.92 2 141 936 916 2 +142.29 ± 11.07
ncm-dbt-05 06:54:13 584562 4000 1458 665 1877 +69.8 ± 5.06 3 150 908 929 10 +144.3 ± 11.27
20000 7218 3152 9630 +71.63 ± 2.23 8 688 4581 4676 47 +148.31 ± 5.01

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
402027 ncm-dbt-02 587494 8 2 2 4 -0.0 ± 125.78 0 1 2 1 0 -0.0 ± 296.58 ↓
402026 ncm-dbt-04 569310 494 174 71 249 +73.52 ± 14.28 1 16 109 121 0 +155.99 ± 32.67 ↓
402025 ncm-dbt-03 588004 498 185 80 233 +74.37 ± 13.94 0 16 113 119 1 +154.56 ± 32.01 ↓
402024 ncm-dbt-01 582903 500 183 67 250 +82.1 ± 14.13 0 15 106 127 2 +171.02 ± 33.15 ↓
402023 ncm-dbt-02 589497 500 190 74 236 +82.1 ± 13.06 0 10 114 126 0 +174.55 ± 31.61 ↓
402022 ncm-dbt-05 587494 500 172 77 251 +66.82 ± 14.89 0 24 109 115 2 +135.76 ± 32.75 ↓
402021 ncm-dbt-04 570989 500 179 76 245 +72.61 ± 14.41 1 18 108 123 0 +153.86 ± 32.88 ↓
402020 ncm-dbt-03 586054 500 174 72 254 +71.88 ± 13.67 0 13 125 109 3 +145.54 ± 30.03 ↓
402019 ncm-dbt-01 584832 500 194 82 224 +79.17 ± 13.75 0 14 111 124 1 +165.8 ± 32.28 ↓
402018 ncm-dbt-02 588004 500 184 85 231 +69.71 ± 13.59 0 16 119 115 0 +145.54 ± 31.07 ↓
402017 ncm-dbt-05 585717 500 193 94 213 +69.71 ± 14.73 1 20 109 119 1 +145.54 ± 32.74 ↓
402016 ncm-dbt-04 570348 500 166 82 252 +58.93 ± 13.43 0 18 130 102 0 +121.46 ± 29.51 ↓
402015 ncm-dbt-03 588686 500 196 84 220 +79.17 ± 13.9 0 14 112 122 2 +164.07 ± 32.12 ↓
402014 ncm-dbt-01 585253 500 179 68 253 +78.43 ± 13.88 0 14 113 121 2 +162.35 ± 31.95 ↓
402013 ncm-dbt-02 585379 500 192 80 228 +79.17 ± 13.6 0 14 110 126 0 +167.53 ± 32.45 ↓
402012 ncm-dbt-05 587749 500 171 70 259 +71.16 ± 14.5 0 21 108 120 1 +147.19 ± 32.89 ↓
402011 ncm-dbt-03 587877 500 188 80 232 +76.25 ± 14.81 0 20 105 122 3 +155.54 ± 33.38 ↓
402010 ncm-dbt-04 571029 500 168 86 246 +57.5 ± 14.63 0 26 117 106 1 +116.78 ± 31.56 ↓
402009 ncm-dbt-01 582861 500 182 82 236 +70.43 ± 14.2 0 17 119 111 3 +142.26 ± 31.1 ↓
402008 ncm-dbt-02 586223 500 182 71 247 +78.43 ± 13.42 0 12 116 121 1 +164.07 ± 31.39 ↓
402007 ncm-dbt-05 579951 500 192 87 221 +74.06 ± 14.32 0 19 108 122 1 +153.86 ± 32.88 ↓
402006 ncm-dbt-04 571029 500 178 77 245 +71.16 ± 13.04 0 12 125 113 0 +148.85 ± 29.98 ↓
402005 ncm-dbt-03 587452 500 183 96 221 +61.08 ± 14.24 1 20 120 109 0 +127.76 ± 31.05 ↓
402004 ncm-dbt-01 583908 500 173 75 252 +68.99 ± 13.41 0 14 125 110 1 +142.26 ± 30.08 ↓
402003 ncm-dbt-02 590010 500 174 87 239 +61.07 ± 14.79 0 26 112 111 1 +124.6 ± 32.29 ↓
402002 ncm-dbt-05 583866 500 176 79 245 +68.27 ± 13.68 0 14 128 105 3 +137.37 ± 29.63 ↓
402001 ncm-dbt-03 586604 500 171 81 248 +63.23 ± 13.77 0 18 125 106 1 +129.35 ± 30.24 ↓
402000 ncm-dbt-01 584790 500 170 75 255 +66.82 ± 14.06 0 18 121 109 2 +135.76 ± 30.83 ↓
401999 ncm-dbt-04 571471 500 176 80 244 +67.55 ± 13.65 0 17 120 113 0 +140.62 ± 30.95 ↓
401998 ncm-dbt-02 587919 500 191 80 229 +78.43 ± 14.46 0 19 102 128 1 +164.07 ± 33.88 ↓
401997 ncm-dbt-05 581319 500 185 84 231 +71.16 ± 13.49 0 15 119 116 0 +148.85 ± 31.04 ↓
401996 ncm-dbt-03 587962 500 188 70 242 +83.57 ± 14.74 1 17 96 135 1 +178.11 ± 34.94 ↓
401995 ncm-dbt-04 571551 500 183 77 240 +74.79 ± 13.91 0 16 113 120 1 +155.54 ± 32.01 ↓
401994 ncm-dbt-01 584285 500 172 73 255 +69.71 ± 14.17 0 18 117 113 2 +142.26 ± 31.44 ↓
401993 ncm-dbt-02 584201 500 181 72 247 +76.97 ± 13.98 0 15 113 120 2 +158.93 ± 31.99 ↓
401992 ncm-dbt-05 582485 500 188 89 223 +69.71 ± 14.17 2 14 117 117 0 +148.85 ± 31.38 ↓
401991 ncm-dbt-04 571511 500 171 71 258 +70.44 ± 13.91 0 18 114 118 0 +147.19 ± 31.9 ↓
401990 ncm-dbt-03 587834 500 174 82 244 +64.66 ± 14.53 0 21 119 107 3 +129.35 ± 31.2 ↓
401989 ncm-dbt-01 582903 500 170 70 260 +70.44 ± 14.34 1 16 117 114 2 +145.54 ± 31.41 ↓
401988 ncm-dbt-05 587919 500 181 85 234 +67.54 ± 14.78 0 23 110 115 2 +137.37 ± 32.59 ↓
401987 ncm-dbt-02 586604 500 187 79 234 +76.25 ± 14.39 0 19 105 125 1 +158.93 ± 33.37 ↓

Commit

Commit ID a10791095150bf7c020b92be0f55566fe34e9bf2
Author Disservin
Date 2024-01-13 18:40:53 UTC
Refactor global variables This aims to remove some of the annoying global structure which Stockfish has. Overall there is no major elo regression to be expected. Non regression SMP STC (paused, early version): https://tests.stockfishchess.org/tests/view/65983d7979aa8af82b9608f1 LLR: 0.23 (-2.94,2.94) <-1.75,0.25> Total: 76232 W: 19035 L: 19096 D: 38101 Ptnml(0-2): 92, 8735, 20515, 8690, 84 Non regression STC (early version): https://tests.stockfishchess.org/tests/view/6595b3a479aa8af82b95da7f LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 185344 W: 47027 L: 46972 D: 91345 Ptnml(0-2): 571, 21285, 48943, 21264, 609 Non regression SMP STC: https://tests.stockfishchess.org/tests/view/65a0715c79aa8af82b96b7e4 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 142936 W: 35761 L: 35662 D: 71513 Ptnml(0-2): 209, 16400, 38135, 16531, 193 These global structures/variables add hidden dependencies and allow data to be mutable from where it shouldn't it be (i.e. options). They also prevent Stockfish from internal selfplay, which would be a nice thing to be able to do, i.e. instantiate two Stockfish instances and let them play against each other. It will also allow us to make Stockfish a library, which can be easier used on other platforms. For consistency with the old search code, `thisThread` has been kept, even though it is not strictly necessary anymore. This the first major refactor of this kind (in recent time), and future changes are required, to achieve the previously described goals. This includes cleaning up the dependencies, transforming the network to be self contained and coming up with a plan to deal with proper tablebase memory management (see comments for more information on this). The removal of these global structures has been discussed in parts with Vondele and Sopel. closes https://github.com/official-stockfish/Stockfish/pull/4968 No functional change
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy