Dev Builds » 20240518-0729

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:35:58 1215641 4020 1758 305 1957 +131.52 +/- 4.65 0 39 524 1402 45 +301.67 +/- 14.89
ncm-dbt-02 11:35:28 1231130 3966 1722 285 1959 +131.87 +/- 4.78 1 33 535 1356 58 +298.56 +/- 14.73
ncm-dbt-03 11:38:53 1239683 4014 1760 290 1964 +133.43 +/- 4.79 0 39 522 1383 63 +302.04 +/- 14.92
ncm-dbt-05 11:34:27 1198712 3996 1770 290 1936 +135.1 +/- 4.86 1 48 479 1410 60 +309.09 +/- 15.58
ncm-dbt-06 11:37:06 1227271 4004 1745 309 1950 +130.4 +/- 4.82 0 50 518 1382 52 +295.48 +/- 14.98
20000 8755 1479 9766 +132.46 +/- 2.14 2 209 2578 6933 278 +301.33 +/- 6.71

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
368067 ncm-dbt-06 1246481 4 2 0 2 +190.27 +/- 27.79 0 0 0 2 0 +1199.83 +/- 312.71
368066 ncm-dbt-03 1226720 14 5 0 9 +129.72 +/- 68.06 0 0 2 5 0 +311.09 +/- 530.6
368065 ncm-dbt-01 1234189 20 10 4 6 +107.48 +/- 58.78 0 0 4 6 0 +240.74 +/- 206.09
368064 ncm-dbt-02 1210775 466 209 31 226 +139.79 +/- 13.04 0 2 57 168 6 +328.85 +/- 45.65
368063 ncm-dbt-05 1195616 496 218 29 249 +139.42 +/- 14.1 0 9 48 184 7 +325.57 +/- 49.36
368062 ncm-dbt-06 1236863 500 227 45 228 +132.54 +/- 13.47 0 7 59 179 5 +306.84 +/- 44.88
368061 ncm-dbt-03 1251106 500 223 25 252 +145.54 +/- 13.25 0 3 56 181 10 +339.63 +/- 46.2
368060 ncm-dbt-01 1207214 500 219 33 248 +135.76 +/- 14.29 0 8 57 176 9 +306.84 +/- 45.58
368059 ncm-dbt-02 1256632 500 223 35 242 +137.37 +/- 12.96 0 2 66 174 8 +315.35 +/- 42.24
368058 ncm-dbt-05 1194089 500 208 31 261 +128.55 +/- 13.38 0 6 66 173 5 +293.29 +/- 42.41
368057 ncm-dbt-06 1217316 500 227 40 233 +136.56 +/- 13.36 0 5 60 178 7 +315.35 +/- 44.57
368056 ncm-dbt-03 1248614 500 224 43 233 +131.74 +/- 14.2 0 6 67 167 10 +290.66 +/- 42.08
368055 ncm-dbt-01 1197369 500 218 43 239 +126.97 +/- 13.22 0 6 67 173 4 +290.66 +/- 42.08
368054 ncm-dbt-02 1226490 500 212 36 252 +127.76 +/- 13.57 0 5 71 167 7 +285.49 +/- 40.81
368053 ncm-dbt-06 1243218 500 212 34 254 +129.35 +/- 13.36 0 5 68 171 6 +293.29 +/- 41.75
368052 ncm-dbt-05 1197299 500 220 43 237 +128.55 +/- 13.73 0 8 62 175 5 +293.29 +/- 43.72
368051 ncm-dbt-01 1245403 500 223 45 232 +129.35 +/- 13.36 0 3 74 165 8 +288.06 +/- 39.79
368050 ncm-dbt-03 1240703 500 217 45 238 +124.6 +/- 13.8 0 9 64 173 4 +282.94 +/- 42.98
368049 ncm-dbt-02 1232428 500 214 39 247 +126.97 +/- 14.11 0 7 69 166 8 +280.42 +/- 41.44
368048 ncm-dbt-05 1196034 500 221 37 242 +134.15 +/- 15.33 0 10 59 168 13 +290.66 +/- 44.63
368047 ncm-dbt-06 1204514 500 220 29 251 +139.81 +/- 13.07 0 8 46 193 3 +339.63 +/- 50.55
368046 ncm-dbt-01 1193040 500 220 30 250 +138.99 +/- 12.9 0 4 58 182 6 +327.18 +/- 45.37
368045 ncm-dbt-03 1232829 500 220 37 243 +133.34 +/- 13.63 0 6 62 175 7 +304.07 +/- 43.81
368044 ncm-dbt-02 1242285 500 203 32 265 +123.81 +/- 13.63 1 3 76 164 6 +277.93 +/- 39.29
368043 ncm-dbt-05 1200186 500 219 33 248 +135.76 +/- 13.76 1 5 57 181 6 +318.25 +/- 45.73
368042 ncm-dbt-06 1227720 500 215 42 243 +125.38 +/- 14.96 0 11 64 166 9 +273.0 +/- 42.83
368041 ncm-dbt-01 1199024 500 214 27 259 +136.56 +/- 12.59 0 3 62 180 5 +321.19 +/- 43.77
368040 ncm-dbt-03 1232243 500 226 29 245 +144.71 +/- 13.67 0 3 59 176 12 +330.23 +/- 44.94
368039 ncm-dbt-02 1209200 500 226 31 243 +143.07 +/- 13.34 0 5 53 184 8 +336.46 +/- 47.52
368038 ncm-dbt-06 1209187 500 217 46 237 +123.81 +/- 13.46 0 3 81 158 8 +270.57 +/- 37.86
368037 ncm-dbt-01 1199676 500 222 34 244 +137.37 +/- 12.56 0 3 61 181 5 +324.17 +/- 44.15
368036 ncm-dbt-05 1196198 500 226 43 231 +133.34 +/- 13.26 0 5 63 176 6 +306.84 +/- 43.45
368035 ncm-dbt-03 1246839 500 215 43 242 +124.6 +/- 13.62 0 6 72 166 6 +277.93 +/- 40.53
367992 ncm-dbt-06 1227767 500 213 34 253 +130.14 +/- 12.78 0 5 64 178 3 +304.07 +/- 43.1
367991 ncm-dbt-02 1237335 500 220 42 238 +129.35 +/- 14.07 0 7 66 169 8 +288.06 +/- 42.4
367990 ncm-dbt-05 1190786 500 225 46 229 +130.14 +/- 12.97 0 4 68 173 5 +298.62 +/- 41.71
367989 ncm-dbt-03 1241770 500 216 28 256 +137.37 +/- 13.34 0 3 65 173 9 +312.48 +/- 42.67
367988 ncm-dbt-01 1230079 500 214 49 237 +119.11 +/- 12.62 0 4 79 165 2 +270.57 +/- 38.47
367987 ncm-dbt-05 1219494 500 233 28 239 +151.34 +/- 13.2 0 1 56 180 13 +352.8 +/- 46.04
367986 ncm-dbt-06 1232381 500 212 39 249 +125.38 +/- 14.47 0 6 76 157 11 +268.17 +/- 39.39
367985 ncm-dbt-02 1233900 500 215 39 246 +127.76 +/- 13.02 0 2 77 164 7 +285.49 +/- 38.83
367984 ncm-dbt-03 1236324 500 214 40 246 +126.17 +/- 12.87 0 3 75 167 5 +285.49 +/- 39.5
367983 ncm-dbt-01 1234781 500 218 40 242 +129.35 +/- 13.9 0 8 62 174 6 +293.29 +/- 43.72

Commit

Commit ID 99dfc63e0321cb8544ce5455993df00a6c817ba3
Author Linmiao Xu
Date 2024-05-18 07:29:26 UTC
Use one nnue pawn count multiplier Switch to the value used by the main net. Passed non-regression STC: https://tests.stockfishchess.org/tests/view/6647e8096dcff0d1d6b05e96 LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 51040 W: 13249 L: 13044 D: 24747 Ptnml(0-2): 139, 6029, 13016, 6160, 176 Passed non-regression LTC: https://tests.stockfishchess.org/tests/view/6647f4a46dcff0d1d6b05eea LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 20460 W: 5195 L: 4972 D: 10293 Ptnml(0-2): 8, 2178, 5637, 2397, 10 https://github.com/official-stockfish/Stockfish/pull/5258 bench 1887462
Copyright 2011–2024 Next Chess Move LLC