Dev Builds » 20210713-1535

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:11:54 1291537 3338 828 779 1731 +5.1 +/- 5.81 2 375 864 428 0 +10.62 +/- 11.58
ncm-dbt-02 10:03:21 1327111 3284 819 743 1722 +8.04 +/- 5.77 4 337 882 417 2 +16.52 +/- 11.43
ncm-dbt-03 10:12:44 1312203 3340 839 779 1722 +6.24 +/- 5.9 2 383 839 445 1 +12.7 +/- 11.76
ncm-dbt-04 10:13:27 1307741 3352 860 753 1739 +11.09 +/- 5.68 5 324 907 439 1 +23.04 +/- 11.27
ncm-dbt-05 10:08:21 1310951 3330 864 775 1691 +9.29 +/- 5.85 5 349 866 442 3 +19.01 +/- 11.56
ncm-dbt-06 10:12:56 1308080 3356 877 798 1681 +8.18 +/- 5.75 3 350 894 427 4 +16.16 +/- 11.37
20000 5087 4627 10286 +7.99 +/- 2.37 21 2118 5252 2598 11 +16.34 +/- 4.69

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
186188 ncm-dbt-02 1240682 128 27 33 68 -16.29 +/- 29.97 1 16 35 12 0 -27.2 +/- 57.8 ↓
186187 ncm-dbt-05 1233401 158 51 31 76 +44.22 +/- 25.94 0 10 39 30 0 +89.91 +/- 54.98 ↓
186186 ncm-dbt-03 1236587 168 36 38 94 -4.13 +/- 21.46 1 12 59 12 0 -4.14 +/- 40.71 ↓
186185 ncm-dbt-01 1206831 170 47 33 90 +28.68 +/- 25.46 0 14 43 28 0 +57.75 +/- 52.31 ↓
186184 ncm-dbt-04 1210947 186 52 39 95 +24.32 +/- 24.22 0 16 48 29 0 +48.89 +/- 49.43 ↓
186183 ncm-dbt-06 1211352 190 52 37 101 +27.49 +/- 25.2 0 18 44 33 0 +55.32 +/- 51.67 ↓
186182 ncm-dbt-02 1219026 500 117 111 272 +4.17 +/- 14.8 2 50 138 60 0 +11.12 +/- 28.89 ↓
186181 ncm-dbt-05 1229703 500 125 118 257 +4.87 +/- 14.98 1 54 132 63 0 +11.12 +/- 29.66 ↓
186180 ncm-dbt-03 1224873 500 119 129 252 -6.95 +/- 15.52 1 67 123 59 0 -12.51 +/- 30.78 ↓
186179 ncm-dbt-01 1213596 500 127 120 253 +4.86 +/- 15.35 0 60 123 67 0 +9.73 +/- 30.78 ↓
186178 ncm-dbt-04 1230398 500 113 113 274 0.0 +/- 14.55 1 54 139 56 0 +1.39 +/- 28.76 ↓
186177 ncm-dbt-06 1231096 500 133 125 242 +5.56 +/- 14.79 1 52 135 62 0 +12.51 +/- 29.28 ↓
186176 ncm-dbt-02 1223303 500 135 114 251 +14.6 +/- 14.65 0 48 133 69 0 +29.25 +/- 29.52 ↓
186175 ncm-dbt-05 1225764 500 129 117 254 +8.34 +/- 14.65 0 52 134 64 0 +16.69 +/- 29.4 ↓
186174 ncm-dbt-03 1225098 500 124 116 260 +5.56 +/- 15.29 0 59 124 67 0 +11.12 +/- 30.65 ↓
186173 ncm-dbt-01 1195870 500 129 118 253 +7.64 +/- 14.72 0 53 133 64 0 +15.3 +/- 29.53 ↓
186172 ncm-dbt-06 1212158 500 129 130 241 -0.7 +/- 15.11 0 61 130 58 1 -2.78 +/- 29.91 ↓
186171 ncm-dbt-04 1237740 500 140 107 253 +22.96 +/- 13.59 0 35 147 68 0 +46.13 +/- 27.59 ↓
186170 ncm-dbt-02 1240056 500 128 112 260 +11.12 +/- 14.37 0 48 138 64 0 +22.27 +/- 28.88 ↓
186169 ncm-dbt-05 1213449 500 110 113 277 -2.08 +/- 15.36 1 61 129 58 1 -4.17 +/- 30.04 ↓
186168 ncm-dbt-03 1247778 500 127 106 267 +14.6 +/- 14.78 0 49 131 70 0 +29.25 +/- 29.78 ↓
186167 ncm-dbt-01 1206536 500 138 113 249 +17.39 +/- 15.37 2 46 127 75 0 +37.67 +/- 30.28 ↓
186166 ncm-dbt-04 1207087 500 133 106 261 +18.78 +/- 15.47 0 52 119 79 0 +37.67 +/- 31.28 ↓
186165 ncm-dbt-06 1217417 500 116 125 259 -6.26 +/- 15.58 0 69 122 58 1 -13.9 +/- 30.9 ↓
186164 ncm-dbt-02 1221021 500 127 118 255 +6.25 +/- 14.47 0 51 140 58 1 +11.12 +/- 28.63 ↓
186163 ncm-dbt-05 1226507 500 129 108 263 +14.6 +/- 15.16 0 51 128 70 1 +27.85 +/- 30.16 ↓
186162 ncm-dbt-03 1229286 500 135 119 246 +11.12 +/- 15.85 0 60 114 76 0 +22.27 +/- 31.87 ↓
186161 ncm-dbt-06 1241756 500 138 109 253 +20.17 +/- 13.92 0 38 146 65 1 +39.08 +/- 27.76 ↓
186160 ncm-dbt-01 1213670 500 108 122 270 -9.73 +/- 14.38 0 63 138 49 0 -19.48 +/- 28.88 ↓
186159 ncm-dbt-04 1231001 500 133 118 249 +10.43 +/- 15.07 2 48 133 67 0 +23.66 +/- 29.53 ↓
186158 ncm-dbt-02 1229344 500 113 113 274 0.0 +/- 15.3 1 60 127 62 0 +1.39 +/- 30.29 ↓
186157 ncm-dbt-05 1225001 500 138 124 238 +9.73 +/- 14.89 1 50 133 66 0 +20.87 +/- 29.53 ↓
186156 ncm-dbt-06 1227013 500 128 112 260 +11.12 +/- 15.13 1 50 132 66 1 +22.27 +/- 29.65 ↓
186155 ncm-dbt-03 1242527 500 124 122 254 +1.39 +/- 15.66 0 65 118 67 0 +2.78 +/- 31.38 ↓
186154 ncm-dbt-01 1183803 500 114 120 266 -4.17 +/- 14.67 0 61 134 55 0 -8.34 +/- 29.41 ↓
186153 ncm-dbt-04 1236347 500 109 114 277 -3.47 +/- 14.74 1 57 139 52 1 -6.95 +/- 28.76 ↓
186152 ncm-dbt-02 1259385 500 132 111 257 +14.6 +/- 15.52 0 54 122 73 1 +27.85 +/- 30.9 ↓
186151 ncm-dbt-05 1240724 500 135 118 247 +11.82 +/- 15.67 0 57 120 72 1 +22.27 +/- 31.15 ↓
186150 ncm-dbt-01 1188367 500 124 119 257 +3.47 +/- 15.35 0 61 123 66 0 +6.95 +/- 30.78 ↓
186149 ncm-dbt-03 1209677 500 126 116 258 +6.95 +/- 15.03 0 55 131 63 1 +12.51 +/- 29.78 ↓
186148 ncm-dbt-06 1228987 500 130 119 251 +7.65 +/- 14.46 1 48 140 61 0 +16.69 +/- 28.62 ↓
186147 ncm-dbt-04 1230501 500 139 115 246 +16.69 +/- 14.82 1 45 133 71 0 +34.86 +/- 29.51 ↓
173531 ncm-dbt-02 1460939 6 1 2 3 -58.33 +/- 98.71 0 1 2 0 0 -120.24 +/- 264.77 ↓
173530 ncm-dbt-06 1456332 16 4 5 7 -21.74 +/- 96.86 0 3 3 2 0 -43.66 +/- 216.48 ↓
173529 ncm-dbt-04 1448082 16 2 3 11 -21.74 +/- 96.86 0 3 3 2 0 -43.66 +/- 216.48 ↓
173528 ncm-dbt-01 1443697 18 5 6 7 -19.32 +/- 85.67 0 3 4 2 0 -38.76 +/- 185.98 ↓
173527 ncm-dbt-03 1453521 22 5 3 14 +31.67 +/- 75.32 0 2 5 4 0 +63.88 +/- 164.47 ↓
173526 ncm-dbt-05 1456478 22 4 6 12 -31.65 +/- 40.21 0 2 9 0 0 -63.84 +/- 83.66 ↓
173525 ncm-dbt-02 1459156 50 12 14 24 -13.9 +/- 38.37 0 5 17 3 0 -27.85 +/- 78.07 ↓
173524 ncm-dbt-02 1455309 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83 ↓
173523 ncm-dbt-04 1449692 50 12 11 27 +6.95 +/- 40.99 0 4 16 5 0 +13.9 +/- 83.23 ↓
173522 ncm-dbt-05 1455441 50 8 13 29 -34.84 +/- 47.97 2 3 18 2 0 -41.89 +/- 72.28 ↓
173521 ncm-dbt-01 1451903 50 13 9 28 +27.85 +/- 46.49 0 4 13 8 0 +56.07 +/- 96.84 ↓
173520 ncm-dbt-03 1455890 50 17 10 23 +48.96 +/- 50.55 0 4 10 11 0 +99.95 +/- 111.26 ↓
173519 ncm-dbt-06 1452783 50 15 8 27 +48.96 +/- 46.46 0 3 12 10 0 +99.95 +/- 101.68 ↓
173518 ncm-dbt-04 1453672 50 15 17 18 -13.9 +/- 38.37 0 5 17 3 0 -27.85 +/- 78.07 ↓
173517 ncm-dbt-05 1458705 50 16 12 22 +27.85 +/- 50.47 0 5 11 9 0 +56.07 +/- 105.56 ↓
173516 ncm-dbt-02 1457368 50 13 8 29 +34.86 +/- 39.1 0 2 16 7 0 +70.44 +/- 81.92 ↓
173515 ncm-dbt-06 1454849 50 15 11 24 +27.85 +/- 46.49 0 4 13 8 0 +56.07 +/- 96.84 ↓
173514 ncm-dbt-01 1454258 50 9 10 31 -6.95 +/- 49.39 0 7 12 6 0 -13.9 +/- 100.98 ↓
173513 ncm-dbt-03 1459001 50 12 8 30 +27.85 +/- 42.16 0 3 15 7 0 +56.07 +/- 87.47 ↓
173512 ncm-dbt-05 1455295 50 19 15 16 +27.85 +/- 46.49 0 4 13 8 0 +56.07 +/- 96.84 ↓
173511 ncm-dbt-01 1448379 50 14 9 27 +34.86 +/- 43.75 0 3 14 8 0 +70.44 +/- 92.08 ↓
173510 ncm-dbt-04 1449692 50 12 10 28 +13.9 +/- 47.24 0 5 13 7 0 +27.85 +/- 96.81 ↓
173509 ncm-dbt-03 1450001 50 14 12 24 +13.9 +/- 54.75 0 7 9 9 0 +27.85 +/- 113.01 ↓
173508 ncm-dbt-02 1459748 50 14 7 29 +48.96 +/- 42.0 0 2 14 9 0 +99.95 +/- 91.41 ↓
173507 ncm-dbt-06 1455145 50 17 17 16 0.0 +/- 38.7 0 4 17 4 0 -0.0 +/- 78.34 ↓

Commit

Commit ID 36f8d3806bb1c6e498ac8fd1a746c1714d1485a3
Author VoyagerOne
Date 2021-07-13 15:35:20 UTC
Don't save excluded move eval in TT STC: LLR: 2.93 (-2.94,2.94) <-0.50,2.50> Total: 17544 W: 1384 L: 1236 D: 14924 Ptnml(0-2): 37, 1031, 6499, 1157, 48 https://tests.stockfishchess.org/tests/view/60ec8d9bd1189bed71812999 LTC: LLR: 2.95 (-2.94,2.94) <0.50,3.50> Total: 26136 W: 823 L: 707 D: 24606 Ptnml(0-2): 6, 643, 11656, 755, 8 https://tests.stockfishchess.org/tests/view/60ecb11ed1189bed718129ba closes https://github.com/official-stockfish/Stockfish/pull/3614 Bench: 5505251
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy