Dev Builds » 20201214-0648

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 14:29:38 1132135 4920 827 1714 2379 -63.33 +/- 4.93 43 1065 1091 258 3 -124.72 +/- 10.31
ncm-dbt-02 14:24:07 1259647 4912 814 1677 2421 -61.68 +/- 4.92 33 1075 1071 276 1 -122.38 +/- 10.41
ncm-dbt-03 14:30:33 1258473 4936 822 1697 2417 -62.25 +/- 4.85 39 1054 1120 253 2 -122.85 +/- 10.17
ncm-dbt-04 00:30:12 1491183 168 29 69 70 -84.34 +/- 28.89 3 42 32 6 1 -169.44 +/- 61.14
ncm-dbt-05 14:24:49 1257442 4896 826 1689 2381 -61.89 +/- 4.96 45 1039 1104 254 6 -121.69 +/- 10.25
ncm-dbt-06 00:29:54 1503131 168 25 65 78 -84.34 +/- 28.23 4 38 37 4 1 -164.28 +/- 56.51
20000 3343 6911 9746 -62.65 +/- 2.44 167 4313 4455 1051 14 -123.61 +/- 5.1

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
211943 ncm-dbt-05 1238705 232 36 78 118 -63.6 +/- 21.23 0 53 52 11 0 -131.77 +/- 47.6
211942 ncm-dbt-02 1235676 246 45 88 113 -61.36 +/- 22.51 4 48 58 13 0 -114.09 +/- 44.98
211941 ncm-dbt-01 1081092 252 42 83 127 -57.03 +/- 20.36 2 48 65 11 0 -111.19 +/- 42.07
211940 ncm-dbt-03 1218488 270 39 89 142 -65.09 +/- 19.48 2 56 67 10 0 -129.17 +/- 41.48
211939 ncm-dbt-05 1238162 500 90 172 238 -57.5 +/- 16.16 5 104 111 28 2 -113.68 +/- 32.44
211938 ncm-dbt-02 1245117 500 76 169 255 -65.38 +/- 16.49 5 117 94 34 0 -127.76 +/- 34.92
211937 ncm-dbt-01 1083870 500 91 187 222 -67.55 +/- 16.33 5 117 98 29 1 -134.15 +/- 34.4
211936 ncm-dbt-03 1235497 500 80 169 251 -62.51 +/- 15.11 4 106 115 25 0 -123.02 +/- 31.84
211935 ncm-dbt-05 1227805 500 90 174 236 -58.93 +/- 15.48 4 105 112 29 0 -115.23 +/- 32.29
211934 ncm-dbt-02 1221806 500 84 163 253 -55.36 +/- 15.44 1 110 106 33 0 -112.14 +/- 33.14
211933 ncm-dbt-01 1109657 500 81 163 256 -57.5 +/- 15.29 4 102 116 28 0 -112.14 +/- 31.71
211932 ncm-dbt-03 1225561 500 90 162 248 -50.38 +/- 15.82 5 95 118 31 1 -96.94 +/- 31.44
211931 ncm-dbt-01 1092684 500 90 180 230 -63.23 +/- 15.79 6 105 113 25 1 -123.02 +/- 32.15
211930 ncm-dbt-02 1259969 500 93 171 236 -54.65 +/- 14.76 1 103 120 25 1 -112.14 +/- 31.13
211929 ncm-dbt-05 1229217 500 88 169 243 -56.78 +/- 15.38 4 101 118 26 1 -112.14 +/- 31.42
211928 ncm-dbt-03 1227383 500 71 178 251 -75.52 +/- 15.6 3 127 94 26 0 -153.86 +/- 35.15
211927 ncm-dbt-02 1229886 500 83 175 242 -64.66 +/- 14.8 3 109 115 23 0 -129.35 +/- 31.83
211926 ncm-dbt-05 1238930 500 85 168 247 -58.21 +/- 15.19 5 99 120 26 0 -112.14 +/- 31.13
211925 ncm-dbt-01 1100051 500 69 177 254 -76.25 +/- 15.09 3 124 101 22 0 -155.54 +/- 34.04
211924 ncm-dbt-03 1237125 500 79 160 261 -56.78 +/- 14.99 2 105 115 28 0 -113.68 +/- 31.86
211923 ncm-dbt-02 1247292 500 79 176 245 -68.27 +/- 16.11 6 114 101 29 0 -132.54 +/- 33.95
211922 ncm-dbt-01 1090274 500 89 180 231 -63.94 +/- 14.91 5 103 120 22 0 -124.6 +/- 31.07
211921 ncm-dbt-05 1236147 500 84 170 246 -60.36 +/- 14.62 3 103 121 23 0 -119.89 +/- 30.94
211920 ncm-dbt-03 1236758 500 77 179 244 -71.88 +/- 15.86 5 119 99 27 0 -142.26 +/- 34.3
211919 ncm-dbt-05 1236139 500 91 175 234 -58.93 +/- 16.58 7 104 106 32 1 -112.14 +/- 33.14
211918 ncm-dbt-01 1110612 500 86 164 250 -54.65 +/- 15.15 3 100 120 26 1 -109.07 +/- 31.14
211917 ncm-dbt-02 1222248 500 80 172 248 -64.66 +/- 15.46 2 117 102 29 0 -130.94 +/- 33.79
211916 ncm-dbt-03 1242165 500 84 174 242 -63.23 +/- 14.61 3 106 119 22 0 -126.18 +/- 31.22
211915 ncm-dbt-01 1085920 500 93 174 233 -56.78 +/- 15.88 5 103 110 32 0 -109.07 +/- 32.57
211914 ncm-dbt-05 1238505 500 73 176 251 -72.61 +/- 15.63 5 118 102 25 0 -143.89 +/- 33.85
211913 ncm-dbt-02 1253881 500 88 173 239 -59.64 +/- 15.25 2 110 109 29 0 -119.89 +/- 32.73
211912 ncm-dbt-03 1251728 500 101 172 227 -49.67 +/- 14.51 2 94 127 27 0 -98.44 +/- 30.15
211911 ncm-dbt-01 1102527 500 85 173 242 -61.79 +/- 15.47 4 108 110 28 0 -121.46 +/- 32.59
211910 ncm-dbt-05 1229001 500 82 173 245 -63.94 +/- 15.04 4 107 115 24 0 -126.18 +/- 31.84
211909 ncm-dbt-02 1226238 500 81 165 254 -58.93 +/- 14.56 1 107 117 25 0 -119.89 +/- 31.55
211908 ncm-dbt-03 1230956 500 92 170 238 -54.64 +/- 15.02 5 94 125 26 0 -104.49 +/- 30.42
211907 ncm-dbt-02 1227118 500 82 167 251 -59.64 +/- 15.76 6 102 113 29 0 -113.68 +/- 32.15
211906 ncm-dbt-05 1226150 500 76 170 254 -66.1 +/- 16.03 7 106 113 22 2 -129.35 +/- 32.14
211905 ncm-dbt-03 1239761 500 81 180 239 -69.71 +/- 15.66 5 114 107 23 1 -138.99 +/- 33.06
211904 ncm-dbt-01 1113921 500 72 176 252 -73.33 +/- 15.65 5 119 101 25 0 -145.54 +/- 34.01
178270 ncm-dbt-02 1486891 166 23 58 85 -74.36 +/- 26.61 2 38 36 7 0 -146.2 +/- 57.49
178269 ncm-dbt-06 1503131 168 25 65 78 -84.34 +/- 28.23 4 38 37 4 1 -164.28 +/- 56.51
178268 ncm-dbt-04 1491183 168 29 69 70 -84.34 +/- 28.89 3 42 32 6 1 -169.44 +/- 61.14
178267 ncm-dbt-01 1482886 168 29 57 82 -58.45 +/- 26.64 1 36 37 10 0 -115.78 +/- 56.62
178266 ncm-dbt-05 1493105 164 31 64 69 -70.87 +/- 26.64 1 39 34 8 0 -143.17 +/- 59.2
178265 ncm-dbt-03 1497783 166 28 64 74 -76.56 +/- 28.1 3 38 34 8 0 -146.2 +/- 59.21

Commit

Commit ID 16adcb5374a6847b52dd901e183d78c0c8c6cf8a
Author pb00067
Date 2020-12-14 06:48:48 UTC
Merge static history into main history, thus simplifying and reducing the memory footprint. I believe using static diff for better move ordering is more suited for low depths, so restrict writing to low depths. Todo: probably the condition for writing can be simplified LTC: LLR: 2.95 (-2.94,2.94) {-0.75,0.25} Total: 18752 W: 768 L: 705 D: 17279 Ptnml(0-2): 7, 635, 8034, 688, 12 https://tests.stockfishchess.org/tests/view/5fd631791ac169120188859e STC: LLR: 2.95 (-2.94,2.94) {-1.25,0.25} Total: 36504 W: 3380 L: 3313 D: 29811 Ptnml(0-2): 116, 2667, 12645, 2682, 142 https://tests.stockfishchess.org/tests/view/5fd5ed861ac1691201888569 closes https://github.com/official-stockfish/Stockfish/pull/3262 bench: 4018036
Copyright 2011–2024 Next Chess Move LLC