Dev Builds » 20211211-1456

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:50:04 584847 4000 831 1210 1959 -33.02 ± 5.24 14 645 1050 288 3 -64.66 ± 10.47
ncm-dbt-02 06:50:29 586278 4000 827 1202 1971 -32.67 ± 5.23 9 660 1028 303 0 -64.31 ± 10.6
ncm-dbt-03 06:50:37 587153 4012 836 1224 1952 -33.71 ± 5.35 17 666 1013 308 2 -65.36 ± 10.69
ncm-dbt-04 06:50:26 570853 4000 870 1189 1941 -27.77 ± 5.21 6 627 1050 314 3 -55.36 ± 10.48
ncm-dbt-05 06:51:28 585617 3988 854 1194 1940 -29.69 ± 5.16 9 620 1069 294 2 -58.57 ± 10.36
20000 4218 6019 9763 -31.37 ± 2.34 55 3218 5210 1507 10 -61.65 ± 4.7

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
404923 ncm-dbt-03 586901 12 3 6 3 -88.66 ± 75.75 0 3 3 0 0 -190.73 ± 238.47
404922 ncm-dbt-05 585126 488 107 153 228 -32.85 ± 14.73 0 81 129 33 1 -67.77 ± 29.91
404921 ncm-dbt-04 568434 500 103 158 239 -38.37 ± 14.26 1 84 134 31 0 -76.25 ± 29.26
404920 ncm-dbt-02 583070 500 92 151 257 -41.19 ± 14.7 0 93 123 34 0 -83.57 ± 30.77
404919 ncm-dbt-01 584369 500 108 153 239 -31.35 ± 15.36 3 78 132 35 2 -61.79 ± 29.59
404918 ncm-dbt-03 586477 500 98 152 250 -37.67 ± 15.13 1 90 121 38 0 -74.79 ± 31.04
404917 ncm-dbt-05 589411 500 98 146 256 -33.46 ± 13.94 1 77 141 31 0 -66.1 ± 28.33
404916 ncm-dbt-02 587494 500 109 161 230 -36.26 ± 13.99 0 83 136 31 0 -73.34 ± 29.0
404915 ncm-dbt-04 570909 500 98 144 258 -32.05 ± 14.25 3 72 143 32 0 -60.36 ± 28.08
404914 ncm-dbt-01 583572 500 107 145 248 -26.46 ± 14.39 0 77 134 39 0 -53.22 ± 29.35
404913 ncm-dbt-03 584874 500 102 143 255 -28.55 ± 14.28 4 66 147 33 0 -51.8 ± 27.56
404912 ncm-dbt-05 586858 500 95 146 259 -35.56 ± 15.62 2 89 117 42 0 -68.99 ± 31.56
404911 ncm-dbt-02 584916 500 104 148 248 -30.65 ± 14.55 0 82 130 38 0 -61.79 ± 29.86
404910 ncm-dbt-04 570029 500 112 147 241 -24.36 ± 14.37 0 74 138 37 1 -50.38 ± 28.82
404909 ncm-dbt-01 586393 500 98 147 255 -34.16 ± 14.52 3 76 138 33 0 -64.66 ± 28.76
404908 ncm-dbt-03 588217 500 103 157 240 -37.67 ± 15.0 2 86 126 36 0 -73.34 ± 30.38
404907 ncm-dbt-05 586393 500 108 167 225 -41.19 ± 14.17 2 83 137 28 0 -80.63 ± 28.81
404906 ncm-dbt-02 588813 500 106 145 249 -27.15 ± 14.57 2 73 137 38 0 -51.8 ± 28.95
404905 ncm-dbt-03 585970 500 109 162 229 -36.97 ± 14.7 1 86 128 35 0 -73.34 ± 30.1
404904 ncm-dbt-04 572719 500 105 140 255 -24.36 ± 14.37 0 75 135 40 0 -48.96 ± 29.23
404903 ncm-dbt-01 585928 500 113 160 227 -32.75 ± 14.69 1 82 130 37 0 -64.66 ± 29.86
404902 ncm-dbt-05 583531 500 108 143 249 -24.36 ± 14.5 0 76 133 41 0 -48.96 ± 29.49
404901 ncm-dbt-01 583908 500 119 147 234 -19.48 ± 14.78 2 68 136 44 0 -36.26 ± 29.12
404900 ncm-dbt-02 586266 500 87 153 260 -46.13 ± 15.23 3 93 121 33 0 -89.48 ± 31.03
404899 ncm-dbt-04 568673 500 114 148 238 -23.66 ± 15.21 1 78 125 46 0 -46.13 ± 30.53
404898 ncm-dbt-03 586308 500 100 152 248 -36.26 ± 15.29 2 87 122 39 0 -70.44 ± 30.91
404897 ncm-dbt-04 572719 500 115 155 230 -27.86 ± 15.0 0 82 127 40 1 -57.5 ± 30.27
404896 ncm-dbt-01 584285 500 99 154 247 -38.37 ± 15.54 3 88 120 39 0 -73.34 ± 31.18
404895 ncm-dbt-03 588856 500 112 156 232 -30.65 ± 15.8 3 81 125 39 2 -60.36 ± 30.52
404894 ncm-dbt-02 584916 500 108 150 242 -29.25 ± 14.32 0 79 134 37 0 -58.93 ± 29.33
404893 ncm-dbt-05 585885 500 121 146 233 -17.38 ± 15.12 1 72 128 49 0 -33.46 ± 30.16
404892 ncm-dbt-02 585295 500 108 154 238 -32.05 ± 15.88 2 88 114 46 0 -61.79 ± 31.93
404891 ncm-dbt-04 572437 500 111 138 251 -18.78 ± 15.23 1 74 126 49 0 -36.26 ± 30.41
404890 ncm-dbt-03 588558 500 104 151 245 -32.75 ± 15.57 3 83 122 42 0 -61.79 ± 30.91
404889 ncm-dbt-01 588217 500 97 150 253 -36.97 ± 14.17 1 82 136 31 0 -73.34 ± 29.0
404888 ncm-dbt-05 584832 500 108 155 237 -32.75 ± 14.43 2 77 137 34 0 -63.23 ± 28.9
404887 ncm-dbt-05 582903 500 109 138 253 -20.17 ± 14.05 1 65 147 36 1 -40.48 ± 27.62
404886 ncm-dbt-03 588217 500 105 145 250 -27.85 ± 15.49 1 84 119 46 0 -54.65 ± 31.29
404885 ncm-dbt-01 582110 500 90 154 256 -44.72 ± 14.9 1 94 124 30 1 -90.97 ± 30.61
404884 ncm-dbt-04 570909 500 112 159 229 -32.76 ± 15.2 0 88 122 39 1 -67.55 ± 30.91
404883 ncm-dbt-02 589454 500 113 140 247 -18.78 ± 14.98 2 69 133 46 0 -34.86 ± 29.51

Commit

Commit ID d579db34a3f7a26cd5502e79dafde2a80614d645
Author Stefan Geschwentner
Date 2021-12-11 14:56:38 UTC
Simplify falling eval time factor. Remove the difference to previous best score in falling eval calculation. As compensation double the effect of the difference to previous best average score. STC: LLR: 2.95 (-2.94,2.94) <-2.25,0.25> Total: 86944 W: 22363 L: 22285 D: 42296 Ptnml(0-2): 273, 9227, 24396, 9301, 275 https://tests.stockfishchess.org/tests/view/61b111ce06b4c2dcb1b11546 LTC: LLR: 2.96 (-2.94,2.94) <-2.25,0.25> Total: 134944 W: 34606 L: 34596 D: 65742 Ptnml(0-2): 66, 12941, 41456, 12935, 74 https://tests.stockfishchess.org/tests/view/61b19ca206b4c2dcb1b13a8b closes https://github.com/official-stockfish/Stockfish/pull/3841 Bench: 4729473
Copyright 2011–2025 Next Chess Move LLC