Dev Builds » 20211024-2008

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:53:59 1228788 3972 1270 651 2051 +54.59 +/- 5.34 0 221 953 784 28 +106.62 +/- 11.02
ncm-dbt-02 11:49:14 1229492 3944 1246 666 2032 +51.47 +/- 5.37 6 226 937 788 15 +103.56 +/- 11.12
ncm-dbt-03 11:53:07 1270036 3974 1275 688 2011 +51.7 +/- 5.17 0 211 996 762 18 +102.35 +/- 10.75
ncm-dbt-04 00:30:21 1489832 168 47 29 92 +37.36 +/- 26.67 0 13 41 29 1 +71.3 +/- 53.64
ncm-dbt-05 11:50:17 1261357 3962 1256 707 1999 +48.45 +/- 5.29 1 227 1003 722 28 +93.76 +/- 10.71
ncm-dbt-06 11:55:19 1264326 3980 1258 741 1981 +45.39 +/- 5.26 0 250 988 737 15 +89.58 +/- 10.82
20000 6352 3482 10166 +50.2 +/- 2.36 7 1148 4918 3822 105 +98.9 +/- 4.85

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
208683 ncm-dbt-02 1192572 276 95 51 130 +55.86 +/- 20.9 0 19 56 63 0 +114.78 +/- 45.63
208682 ncm-dbt-05 1216512 298 107 54 137 +62.45 +/- 18.62 0 12 74 61 2 +123.92 +/- 39.5
208681 ncm-dbt-01 1181142 298 90 40 168 +58.85 +/- 20.96 0 18 68 58 5 +108.31 +/- 41.54
208680 ncm-dbt-03 1242786 310 99 54 157 +50.79 +/- 17.39 0 12 88 53 2 +98.98 +/- 35.47
208679 ncm-dbt-06 1238693 318 95 53 170 +46.15 +/- 18.88 0 21 76 61 1 +91.66 +/- 39.24
208678 ncm-dbt-02 1198318 500 161 77 262 +58.93 +/- 14.83 1 23 119 105 2 +119.89 +/- 31.25
208677 ncm-dbt-05 1238236 500 160 88 252 +50.38 +/- 15.2 0 30 122 94 4 +96.94 +/- 30.88
208676 ncm-dbt-01 1176841 500 162 76 262 +60.36 +/- 15.67 0 29 111 105 5 +116.78 +/- 32.44
208675 ncm-dbt-03 1236152 500 154 82 264 +50.38 +/- 14.28 0 24 133 90 3 +98.44 +/- 29.27
208674 ncm-dbt-06 1215290 500 160 83 257 +53.93 +/- 16.0 0 35 107 104 4 +104.49 +/- 32.97
208673 ncm-dbt-02 1193609 500 154 75 271 +55.36 +/- 15.44 2 27 112 108 1 +115.23 +/- 32.29
208672 ncm-dbt-05 1238748 500 143 97 260 +32.05 +/- 15.03 1 36 131 80 2 +63.23 +/- 29.72
208671 ncm-dbt-01 1172652 500 159 73 268 +60.36 +/- 14.89 0 25 117 105 3 +119.89 +/- 31.55
208670 ncm-dbt-03 1242418 500 147 92 261 +38.37 +/- 14.92 0 36 124 89 1 +76.25 +/- 30.64
208669 ncm-dbt-06 1225756 500 165 98 237 +46.84 +/- 13.81 0 25 133 92 0 +95.44 +/- 29.29
208668 ncm-dbt-02 1193948 500 158 96 246 +43.3 +/- 15.82 0 39 113 95 3 +83.57 +/- 32.11
208667 ncm-dbt-05 1232560 500 164 88 248 +53.22 +/- 15.21 0 28 123 94 5 +101.46 +/- 30.72
208666 ncm-dbt-01 1217269 500 165 86 249 +55.36 +/- 15.06 0 25 127 92 6 +104.49 +/- 30.12
208665 ncm-dbt-03 1249484 500 161 73 266 +61.79 +/- 14.95 0 28 106 116 0 +127.76 +/- 33.19
208664 ncm-dbt-06 1243942 500 147 88 265 +41.19 +/- 14.57 0 31 131 86 2 +80.63 +/- 29.67
208663 ncm-dbt-02 1203232 500 148 87 265 +42.6 +/- 14.38 1 24 142 79 4 +82.1 +/- 28.06
208662 ncm-dbt-05 1242083 500 164 95 241 +48.25 +/- 14.3 0 26 131 91 2 +95.44 +/- 29.59
208661 ncm-dbt-01 1204104 500 162 88 250 +51.8 +/- 15.14 0 33 110 107 0 +106.01 +/- 32.56
208660 ncm-dbt-03 1265069 500 166 82 252 +58.93 +/- 14.42 0 23 122 103 2 +118.33 +/- 30.8
208659 ncm-dbt-06 1239759 500 170 103 227 +46.84 +/- 14.88 0 30 126 91 3 +90.97 +/- 30.33
208658 ncm-dbt-02 1204437 500 156 82 262 +51.8 +/- 15.14 1 27 122 97 3 +102.97 +/- 30.86
208657 ncm-dbt-01 1223810 500 166 98 236 +47.54 +/- 14.4 0 28 127 94 1 +95.44 +/- 30.17
208656 ncm-dbt-03 1225223 500 165 94 241 +49.67 +/- 15.16 0 30 123 93 4 +95.44 +/- 30.74
208655 ncm-dbt-05 1230316 500 161 80 259 +56.78 +/- 14.05 0 20 132 95 3 +112.14 +/- 29.29
208654 ncm-dbt-06 1236304 500 162 109 229 +36.97 +/- 14.57 0 34 130 85 1 +73.34 +/- 29.83
208653 ncm-dbt-02 1194422 500 164 79 257 +59.64 +/- 14.86 1 24 115 109 1 +123.02 +/- 31.84
208652 ncm-dbt-01 1193148 500 158 86 256 +50.38 +/- 15.2 0 31 119 97 3 +98.44 +/- 31.3
208651 ncm-dbt-03 1228866 500 156 94 250 +43.3 +/- 14.95 0 32 127 88 3 +83.57 +/- 30.21
208650 ncm-dbt-05 1229460 500 150 96 254 +37.67 +/- 14.61 0 32 135 80 3 +71.89 +/- 29.14
208649 ncm-dbt-06 1252423 500 160 82 258 +54.64 +/- 14.89 0 28 118 102 2 +109.07 +/- 31.43
208648 ncm-dbt-03 1237990 500 168 86 246 +57.5 +/- 14.36 0 22 127 98 3 +113.68 +/- 30.06
208647 ncm-dbt-02 1194127 500 161 83 256 +54.64 +/- 15.02 0 30 113 106 1 +110.6 +/- 32.15
208646 ncm-dbt-05 1225831 500 160 78 262 +57.5 +/- 15.54 0 28 118 98 6 +109.07 +/- 31.43
208645 ncm-dbt-01 1190331 500 143 73 284 +48.96 +/- 14.2 0 25 132 91 2 +96.94 +/- 29.43
208644 ncm-dbt-06 1226159 500 151 93 256 +40.48 +/- 14.65 0 33 127 89 1 +80.63 +/- 30.22
177829 ncm-dbt-03 1502343 164 59 31 74 +59.9 +/- 22.03 0 4 46 32 0 +123.6 +/- 48.77
177828 ncm-dbt-04 1489832 168 47 29 92 +37.36 +/- 26.67 0 13 41 29 1 +71.3 +/- 53.64
177827 ncm-dbt-06 1500611 162 48 32 82 +34.42 +/- 27.19 0 13 40 27 1 +65.09 +/- 54.3
177826 ncm-dbt-02 1490765 168 49 36 83 +26.94 +/- 24.85 0 13 45 26 0 +54.21 +/- 50.9
177825 ncm-dbt-05 1498469 164 47 31 86 +34.0 +/- 28.15 0 15 37 29 1 +64.28 +/- 56.39
177824 ncm-dbt-01 1499796 174 65 31 78 +68.77 +/- 26.02 0 7 42 35 3 +129.48 +/- 52.8

Commit

Commit ID 1163d972a9a1e480d9130c5fabbf869cdb7f7ecb
Author bmc4
Date 2021-10-24 20:08:28 UTC
Simplify LMR multiThread condition STC (8 threads): LLR: 2.95 (-2.94,2.94) <-2.50,0.50> Total: 110584 W: 27818 L: 27807 D: 54959 Ptnml(0-2): 156, 12089, 30791, 12100, 156 https://tests.stockfishchess.org/tests/view/6172ef436ce927be325583a9 LTC (8 threads): LLR: 2.94 (-2.94,2.94) <-2.50,0.50> Total: 23632 W: 6025 L: 5903 D: 11704 Ptnml(0-2): 5, 2292, 7100, 2414, 5 https://tests.stockfishchess.org/tests/view/6173cf096ce927be32558412 closes https://github.com/official-stockfish/Stockfish/pull/3757 No functional change (in the single-threaded case) Bench: 6689428
Copyright 2011–2024 Next Chess Move LLC