Dev Builds » 20230520-0805

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:56:36 1137262 3334 1397 314 1623 +117.1 +/- 5.3 1 43 529 1060 34 +257.52 +/- 14.8
ncm-dbt-02 09:53:03 1228855 3318 1386 271 1661 +121.47 +/- 5.25 0 33 520 1064 42 +267.43 +/- 14.91
ncm-dbt-03 09:57:49 1234674 3356 1421 267 1668 +124.54 +/- 5.23 0 36 494 1106 42 +277.12 +/- 15.32
ncm-dbt-04 09:58:04 1232805 3340 1415 284 1641 +122.48 +/- 5.44 0 48 491 1083 48 +268.47 +/- 15.39
ncm-dbt-05 09:53:46 1225138 3322 1401 261 1660 +124.27 +/- 5.27 0 40 479 1104 38 +277.59 +/- 15.57
ncm-dbt-06 09:57:57 1230268 3330 1406 271 1653 +123.35 +/- 5.25 0 43 478 1110 34 +276.23 +/- 15.59
20000 8426 1668 9906 +122.2 +/- 2.16 1 243 2991 6527 238 +270.63 +/- 6.22

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
188472 ncm-dbt-02 1234763 318 129 23 166 +120.41 +/- 16.94 0 2 54 98 5 +260.62 +/- 46.49
188471 ncm-dbt-05 1220597 322 141 28 153 +127.33 +/- 17.02 0 4 44 109 4 +286.14 +/- 52.25
188470 ncm-dbt-01 1131958 334 144 32 158 +121.19 +/- 17.04 0 2 58 100 7 +256.87 +/- 44.75
188469 ncm-dbt-06 1211563 330 135 30 165 +114.52 +/- 16.6 0 6 49 109 1 +257.77 +/- 49.35
188468 ncm-dbt-04 1255154 340 137 18 185 +126.97 +/- 15.44 0 2 50 115 3 +289.59 +/- 48.66
188467 ncm-dbt-03 1240259 356 151 24 181 +129.64 +/- 16.48 0 4 49 119 6 +287.92 +/- 49.41
188460 ncm-dbt-02 1253375 500 213 36 251 +128.55 +/- 13.01 0 3 73 168 6 +290.66 +/- 40.08
188459 ncm-dbt-05 1231602 500 219 41 240 +129.35 +/- 13.9 0 6 68 168 8 +288.06 +/- 41.76
188458 ncm-dbt-06 1225983 500 211 42 247 +122.24 +/- 13.12 0 7 69 172 2 +280.42 +/- 41.44
188457 ncm-dbt-01 1142205 500 213 49 238 +118.33 +/- 13.7 0 9 71 167 3 +265.78 +/- 40.81
188456 ncm-dbt-04 1230925 500 202 35 263 +120.67 +/- 13.84 0 7 75 162 6 +265.78 +/- 39.69
188455 ncm-dbt-03 1239687 500 220 41 239 +130.14 +/- 13.7 0 6 66 171 7 +293.29 +/- 42.41
188442 ncm-dbt-02 1212783 500 199 39 262 +115.22 +/- 13.38 0 5 85 155 5 +251.89 +/- 37.03
188441 ncm-dbt-05 1232501 500 209 41 250 +121.45 +/- 13.49 0 6 75 164 5 +270.57 +/- 39.67
188440 ncm-dbt-06 1262042 500 216 36 248 +130.94 +/- 13.51 0 6 64 174 6 +298.62 +/- 43.1
188439 ncm-dbt-01 1134635 500 204 49 247 +111.37 +/- 13.73 0 7 86 152 5 +240.82 +/- 36.9
188438 ncm-dbt-04 1222001 500 217 47 236 +123.02 +/- 14.33 0 8 72 162 8 +268.17 +/- 40.54
188437 ncm-dbt-03 1229855 500 193 36 271 +112.91 +/- 13.39 0 6 85 155 4 +247.41 +/- 37.09
188430 ncm-dbt-02 1227487 500 208 41 251 +120.67 +/- 13.84 0 7 75 162 6 +265.78 +/- 39.69
188429 ncm-dbt-05 1222948 500 207 37 256 +123.02 +/- 13.29 0 4 78 162 6 +273.0 +/- 38.74
188428 ncm-dbt-06 1235186 500 215 40 245 +126.97 +/- 12.85 0 3 74 168 5 +288.06 +/- 39.79
188427 ncm-dbt-04 1243314 500 218 45 237 +125.38 +/- 13.43 0 5 73 166 6 +280.42 +/- 40.21
188426 ncm-dbt-01 1132503 500 209 46 245 +117.55 +/- 13.87 1 6 76 163 4 +263.42 +/- 39.41
188425 ncm-dbt-03 1243010 500 214 39 247 +126.97 +/- 13.04 0 3 75 166 6 +285.49 +/- 39.5
188418 ncm-dbt-02 1206419 500 213 50 237 +117.55 +/- 14.37 0 10 73 161 6 +256.44 +/- 40.21
188417 ncm-dbt-01 1137778 500 206 40 254 +119.89 +/- 13.68 0 6 78 160 6 +263.42 +/- 38.85
188416 ncm-dbt-05 1211606 500 205 33 262 +124.6 +/- 13.8 0 6 73 164 7 +275.45 +/- 40.24
188415 ncm-dbt-06 1240694 500 202 46 252 +112.14 +/- 14.06 0 10 78 158 4 +245.2 +/- 38.89
188414 ncm-dbt-04 1233176 500 205 47 248 +113.68 +/- 14.05 0 11 73 163 3 +251.89 +/- 40.18
188413 ncm-dbt-03 1223032 500 209 43 248 +119.89 +/- 13.68 0 6 78 160 6 +263.42 +/- 38.85
188406 ncm-dbt-02 1248680 500 208 41 251 +120.67 +/- 13.15 0 3 83 158 6 +265.78 +/- 37.35
188405 ncm-dbt-05 1227272 500 221 35 244 +135.76 +/- 13.01 0 4 62 178 6 +315.35 +/- 43.81
188404 ncm-dbt-01 1142621 500 215 43 242 +124.6 +/- 13.45 0 5 74 165 6 +277.93 +/- 39.92
188403 ncm-dbt-03 1241988 500 219 44 237 +126.97 +/- 13.22 0 5 70 170 5 +288.06 +/- 41.11
188402 ncm-dbt-04 1210165 500 217 51 232 +119.89 +/- 14.51 0 9 74 159 8 +258.75 +/- 39.96
188401 ncm-dbt-06 1213315 500 218 38 244 +130.94 +/- 13.69 0 6 65 172 7 +295.94 +/- 42.75
188394 ncm-dbt-01 1139138 500 206 55 239 +108.3 +/- 13.56 0 8 86 153 3 +236.51 +/- 36.93
188393 ncm-dbt-05 1229446 500 199 46 255 +109.83 +/- 13.73 0 10 79 159 2 +243.0 +/- 38.64
188392 ncm-dbt-02 1218482 500 216 41 243 +126.97 +/- 13.41 0 3 77 162 8 +280.42 +/- 38.93
188391 ncm-dbt-03 1224890 500 215 40 245 +126.97 +/- 13.94 0 6 71 165 8 +280.42 +/- 40.83
188390 ncm-dbt-04 1234905 500 219 41 240 +129.35 +/- 14.91 0 6 74 156 14 +273.0 +/- 39.95
188389 ncm-dbt-06 1223097 500 209 39 252 +123.02 +/- 13.99 0 5 79 157 9 +265.78 +/- 38.54

Commit

Commit ID 4b085c4777c36939bd0a598f4bc3e0c04606e31b
Author xoto10
Date 2023-05-20 08:05:19 UTC
Simplify optimism calculation This change removes one of the constants in the calculation of optimism. It also changes the 2 constants used with the scale value so that they are independent, instead of applying a constant to the scale and then adjusting it again when it is applied to the optimism. This might make the tuning of these constants cleaner and more reliable in the future. STC 10+0.1 (accidentally run as an Elo gainer: LLR: 2.93 (-2.94,2.94) <0.00,2.00> Total: 154080 W: 41119 L: 40651 D: 72310 Ptnml(0-2): 375, 16840, 42190, 17212, 423 https://tests.stockfishchess.org/tests/live_elo/64653eabf3b1a4e86c317f77 LTC 60+0.6: LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 217434 W: 58382 L: 58363 D: 100689 Ptnml(0-2): 66, 21075, 66419, 21088, 69 https://tests.stockfishchess.org/tests/live_elo/6465d077f3b1a4e86c318d6c closes https://github.com/official-stockfish/Stockfish/pull/4576 bench: 3190961
Copyright 2011–2024 Next Chess Move LLC