Dev Builds » 20211214-1241

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:51:53 584168 4000 870 1169 1961 -26.02 ± 5.21 8 609 1059 322 2 -51.27 ± 10.43
ncm-dbt-02 06:51:01 586413 3982 863 1145 1974 -24.65 ± 5.21 7 597 1061 323 3 -48.83 ± 10.42
ncm-dbt-03 06:49:24 587192 4000 865 1209 1926 -29.95 ± 5.22 7 641 1043 307 2 -59.46 ± 10.52
ncm-dbt-04 06:51:44 570702 4018 878 1202 1938 -28.08 ± 5.16 10 611 1085 299 4 -55.46 ± 10.28
ncm-dbt-05 06:51:44 583871 4000 878 1158 1964 -24.36 ± 5.19 8 594 1070 326 2 -47.9 ± 10.37
20000 4354 5883 9763 -26.61 ± 2.32 40 3052 5318 1577 13 -52.58 ± 4.65

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
399734 ncm-dbt-04 571994 18 5 8 5 -58.44 ± 79.35 0 4 4 1 0 -120.41 ± 194.59
399733 ncm-dbt-02 587707 482 87 139 256 -37.63 ± 14.92 1 83 124 33 0 -74.65 ± 30.57
399732 ncm-dbt-05 585000 500 118 152 230 -23.66 ± 16.05 3 79 117 51 0 -43.3 ± 31.53
399731 ncm-dbt-03 587367 500 112 148 240 -25.06 ± 14.93 0 80 126 44 0 -50.38 ± 30.4
399730 ncm-dbt-01 581194 500 107 144 249 -25.76 ± 15.47 1 81 123 44 1 -51.8 ± 30.79
399729 ncm-dbt-04 569509 500 107 138 255 -21.57 ± 14.81 3 67 138 42 0 -39.08 ± 28.85
399728 ncm-dbt-02 587113 500 115 140 245 -17.38 ± 14.23 2 62 145 41 0 -32.05 ± 27.93
399727 ncm-dbt-05 583447 500 102 139 259 -25.76 ± 14.47 2 70 142 35 1 -50.38 ± 28.27
399726 ncm-dbt-01 583614 500 119 158 223 -27.15 ± 14.57 1 76 134 39 0 -53.22 ± 29.35
399725 ncm-dbt-03 581444 500 111 135 254 -16.69 ± 14.04 0 66 142 42 0 -33.46 ± 28.33
399724 ncm-dbt-04 572759 500 101 143 256 -29.25 ± 15.34 1 83 124 41 1 -58.93 ± 30.66
399723 ncm-dbt-02 585169 500 113 135 252 -15.3 ± 14.84 0 71 130 49 0 -30.65 ± 29.9
399722 ncm-dbt-03 589411 500 111 157 232 -32.05 ± 15.03 3 78 131 38 0 -60.36 ± 29.73
399721 ncm-dbt-05 583824 500 118 160 222 -29.25 ± 14.46 0 79 135 35 1 -60.36 ± 29.19
399720 ncm-dbt-01 584453 500 107 161 232 -37.67 ± 14.74 0 90 124 36 0 -76.25 ± 30.64
399719 ncm-dbt-04 569390 500 112 156 232 -30.65 ± 14.29 1 77 137 35 0 -60.36 ± 28.92
399718 ncm-dbt-02 586604 500 118 144 238 -18.08 ± 14.29 0 69 138 43 0 -36.26 ± 28.86
399717 ncm-dbt-01 583028 500 112 142 246 -20.87 ± 13.97 1 66 145 38 0 -40.48 ± 27.9
399716 ncm-dbt-03 588260 500 103 143 254 -27.85 ± 15.13 0 84 122 44 0 -56.07 ± 30.91
399715 ncm-dbt-05 579496 500 101 143 256 -29.25 ± 14.46 0 80 132 38 0 -58.93 ± 29.6
399714 ncm-dbt-04 569031 500 104 151 245 -32.75 ± 13.76 1 75 144 30 0 -64.66 ± 27.91
399713 ncm-dbt-02 588728 500 108 154 238 -32.05 ± 15.15 1 85 123 41 0 -63.23 ± 30.78
399712 ncm-dbt-01 584916 500 122 152 226 -20.87 ± 14.5 1 70 137 42 0 -40.48 ± 28.98
399711 ncm-dbt-03 590610 500 112 166 222 -37.67 ± 15.38 3 85 126 35 1 -73.34 ± 30.38
399710 ncm-dbt-05 584411 500 116 132 252 -11.12 ± 15.13 2 64 132 52 0 -19.48 ± 29.66
399709 ncm-dbt-04 570428 500 115 148 237 -22.96 ± 14.53 1 72 136 41 0 -44.72 ± 29.1
399708 ncm-dbt-02 584958 500 103 149 248 -32.05 ± 15.28 1 84 127 36 2 -66.1 ± 30.25
399707 ncm-dbt-03 587877 500 100 150 250 -34.86 ± 14.83 1 85 127 37 0 -68.99 ± 30.25
399706 ncm-dbt-01 585548 500 92 144 264 -36.26 ± 15.04 3 82 129 36 0 -68.99 ± 29.98
399705 ncm-dbt-05 583866 500 110 145 245 -24.36 ± 13.28 0 67 151 32 0 -48.96 ± 27.01
399704 ncm-dbt-04 571471 500 124 159 217 -24.36 ± 14.76 1 74 135 39 1 -48.96 ± 29.23
399703 ncm-dbt-02 587622 500 101 147 252 -32.05 ± 15.15 2 81 129 37 1 -63.23 ± 29.99
399702 ncm-dbt-03 586731 500 104 148 248 -30.65 ± 14.16 0 78 139 32 1 -63.23 ± 28.63
399701 ncm-dbt-01 586139 500 110 132 258 -15.3 ± 14.96 0 71 131 47 1 -32.05 ± 29.77
399700 ncm-dbt-05 586435 500 115 141 244 -18.08 ± 15.05 0 75 126 49 0 -36.26 ± 30.41
399699 ncm-dbt-04 569869 500 110 148 242 -26.46 ± 14.78 1 75 137 35 2 -54.65 ± 28.94
399698 ncm-dbt-02 583405 500 118 137 245 -13.21 ± 13.89 0 62 145 43 0 -26.46 ± 27.94
399697 ncm-dbt-03 585843 500 112 162 226 -34.86 ± 14.44 0 85 130 35 0 -70.44 ± 29.84
399696 ncm-dbt-05 584495 500 98 146 256 -33.46 ± 14.35 1 80 135 34 0 -66.1 ± 29.17
399695 ncm-dbt-04 571873 500 100 151 249 -35.56 ± 14.61 1 84 130 35 0 -70.44 ± 29.84
399694 ncm-dbt-01 584453 500 101 136 263 -24.36 ± 14.5 1 73 136 40 0 -47.55 ± 29.1

Commit

Commit ID c6edf33f539f160d4a7009f3aac25e7ec5668eda
Author Joost VandeVondele
Date 2021-12-14 12:41:12 UTC
Remove NNUE scaling term remove pawns scaling, probably correlated with piece scaling, and might be less useful with the recent improved nets. Might allow for another tune of the scaling params. passed STC https://tests.stockfishchess.org/tests/view/61afdb2e56fcf33bce7df31a LLR: 2.95 (-2.94,2.94) <-2.25,0.25> Total: 280864 W: 72198 L: 72399 D: 136267 Ptnml(0-2): 854, 32356, 74346, 31889, 987 passed LTC https://tests.stockfishchess.org/tests/view/61b233a606b4c2dcb1b16140 LLR: 2.95 (-2.94,2.94) <-2.25,0.25> Total: 400136 W: 102669 L: 103012 D: 194455 Ptnml(0-2): 212, 42005, 116047, 41522, 282 closes https://github.com/official-stockfish/Stockfish/pull/3851 Bench: 4735679
Copyright 2011–2025 Next Chess Move LLC