Dev Builds » 20230622-0826

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:01:32 1081549 3336 1414 279 1643 +123.11 +/- 5.42 0 49 480 1094 45 +271.47 +/- 15.56
ncm-dbt-02 09:56:21 1115028 3328 1412 275 1641 +123.67 +/- 5.37 0 43 487 1088 46 +272.79 +/- 15.45
ncm-dbt-03 10:01:53 1115211 3340 1398 299 1643 +118.74 +/- 5.27 0 46 511 1081 32 +262.78 +/- 15.07
ncm-dbt-04 10:01:39 1099215 3332 1406 311 1615 +118.58 +/- 5.52 2 44 529 1039 52 +256.02 +/- 14.81
ncm-dbt-05 09:57:27 1129660 3322 1381 308 1633 +116.39 +/- 5.4 0 45 541 1032 43 +251.95 +/- 14.63
ncm-dbt-06 10:00:44 1112342 3342 1424 298 1620 +121.82 +/- 5.49 0 51 494 1075 51 +265.38 +/- 15.34
20000 8435 1770 9795 +120.38 +/- 2.21 2 278 3042 6409 269 +263.3 +/- 6.17

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
194158 ncm-dbt-05 1221781 102 43 13 46 +105.29 +/- 29.65 0 1 20 29 1 +224.27 +/- 77.64
194157 ncm-dbt-03 1212850 114 48 10 56 +120.41 +/- 27.52 0 2 15 40 0 +279.59 +/- 92.68
194156 ncm-dbt-01 1176293 110 48 10 52 +125.16 +/- 27.98 0 1 16 37 1 +283.41 +/- 89.4
194155 ncm-dbt-02 1250358 116 46 8 62 +118.16 +/- 28.83 0 1 20 35 2 +252.28 +/- 78.34
194154 ncm-dbt-04 1208169 116 49 5 62 +138.71 +/- 24.42 0 1 12 45 0 +344.99 +/- 106.69
194153 ncm-dbt-06 1240979 122 53 10 59 +127.93 +/- 26.11 0 1 17 42 1 +293.63 +/- 86.58
194140 ncm-dbt-05 1245817 500 209 47 244 +116.77 +/- 14.21 0 8 79 156 7 +251.89 +/- 38.63
194139 ncm-dbt-01 1199616 500 220 42 238 +129.35 +/- 14.58 0 10 60 172 8 +288.06 +/- 44.27
194138 ncm-dbt-02 1231954 500 206 41 253 +119.11 +/- 13.17 0 4 82 159 5 +263.42 +/- 37.69
194137 ncm-dbt-04 1226717 500 209 45 246 +118.33 +/- 13.7 0 7 77 161 5 +261.07 +/- 39.14
194136 ncm-dbt-03 1237155 500 202 46 252 +112.14 +/- 13.39 0 7 83 157 3 +247.41 +/- 37.61
194135 ncm-dbt-06 1239625 500 216 42 242 +126.17 +/- 14.12 0 8 67 168 7 +280.42 +/- 42.05
194128 ncm-dbt-05 1249095 500 214 45 241 +122.24 +/- 14.17 0 7 75 160 8 +265.78 +/- 39.69
194127 ncm-dbt-01 1179968 500 195 36 269 +114.45 +/- 13.89 0 8 80 157 5 +249.64 +/- 38.38
194126 ncm-dbt-02 1235397 500 203 36 261 +120.67 +/- 14.18 0 9 71 164 6 +265.78 +/- 40.81
194125 ncm-dbt-04 1219751 500 217 48 235 +122.24 +/- 14.98 0 8 77 153 12 +256.44 +/- 39.15
194124 ncm-dbt-03 1258876 500 212 45 243 +120.67 +/- 13.32 0 4 81 159 6 +265.78 +/- 37.95
194123 ncm-dbt-06 1231742 500 216 39 245 +128.55 +/- 14.08 0 7 67 168 8 +285.49 +/- 42.08
194116 ncm-dbt-05 1233030 500 221 44 235 +128.55 +/- 13.91 0 6 69 167 8 +285.49 +/- 41.44
194115 ncm-dbt-02 1210260 500 226 37 237 +138.18 +/- 13.32 0 3 64 174 9 +315.35 +/- 43.03
194114 ncm-dbt-01 1190548 500 212 40 248 +124.6 +/- 13.27 0 4 76 164 6 +277.93 +/- 39.29
194113 ncm-dbt-04 1203863 500 218 39 243 +130.14 +/- 13.88 0 4 73 163 10 +285.49 +/- 40.16
194112 ncm-dbt-03 1239194 500 216 43 241 +125.38 +/- 13.96 0 7 70 166 7 +277.93 +/- 41.14
194111 ncm-dbt-06 1241953 500 211 38 251 +125.38 +/- 13.25 0 5 72 168 5 +282.94 +/- 40.5
194104 ncm-dbt-05 1231321 500 207 45 248 +116.77 +/- 13.54 0 6 81 158 5 +256.44 +/- 38.07
194103 ncm-dbt-01 1210798 500 214 40 246 +126.17 +/- 13.42 0 5 72 167 6 +282.94 +/- 40.5
194102 ncm-dbt-02 1237891 500 215 37 248 +129.35 +/- 14.07 0 6 69 166 9 +285.49 +/- 41.44
194101 ncm-dbt-03 1243978 500 213 52 235 +116.0 +/- 13.54 0 8 76 163 3 +258.75 +/- 39.42
194100 ncm-dbt-06 1231600 500 207 44 249 +117.55 +/- 13.7 0 8 75 163 4 +261.07 +/- 39.69
194099 ncm-dbt-04 1207741 500 203 56 241 +105.25 +/- 13.72 1 5 94 146 4 +228.08 +/- 35.08
194092 ncm-dbt-05 1254459 500 199 50 251 +106.77 +/- 13.56 0 7 91 148 4 +230.16 +/- 35.78
194091 ncm-dbt-02 1225003 500 210 42 248 +121.45 +/- 13.31 0 7 71 169 3 +275.45 +/- 40.84
194090 ncm-dbt-01 1205135 500 219 40 241 +130.14 +/- 13.52 0 4 71 167 8 +290.66 +/- 40.76
194089 ncm-dbt-06 1234153 500 222 49 229 +125.38 +/- 14.13 0 6 74 161 9 +273.0 +/- 39.95
194088 ncm-dbt-03 1221964 500 207 41 252 +119.89 +/- 12.98 0 4 80 162 4 +268.17 +/- 38.21
194087 ncm-dbt-04 1198517 500 208 40 252 +121.45 +/- 14.01 0 6 78 158 8 +263.42 +/- 38.85
194080 ncm-dbt-02 598987 500 210 54 236 +112.14 +/- 14.85 0 11 80 151 8 +236.51 +/- 38.38
194079 ncm-dbt-05 648938 500 197 49 254 +106.01 +/- 14.82 0 10 91 140 9 +217.85 +/- 35.89
194078 ncm-dbt-01 587860 500 204 48 248 +112.14 +/- 15.15 0 12 79 150 9 +234.38 +/- 38.61
194077 ncm-dbt-04 631760 500 212 57 231 +111.37 +/- 15.74 1 10 84 143 12 +228.08 +/- 37.44
194076 ncm-dbt-03 629839 500 205 43 252 +116.77 +/- 14.53 0 11 72 161 6 +254.16 +/- 40.45
194075 ncm-dbt-06 596262 500 204 51 245 +109.83 +/- 15.73 0 12 86 139 13 +219.87 +/- 36.98
194074 ncm-dbt-02 822832 6 3 0 3 +190.46 +/- 18.51 0 0 0 3 0 +1199.83 +/- 276.48
194073 ncm-dbt-05 845974 8 4 0 4 +190.56 +/- 13.88 0 0 0 4 0 +1199.83 +/- 250.99
194072 ncm-dbt-06 772688 8 3 2 3 +43.58 +/- 76.58 0 0 3 1 0 +88.62 +/- 172.94
194071 ncm-dbt-04 790721 8 5 1 2 +190.56 +/- 189.63 0 0 1 2 1 +337.69 +/- 541.44
194070 ncm-dbt-01 788303 10 5 2 3 +107.43 +/- 84.35 0 0 2 3 0 +240.65 +/- 570.11
194069 ncm-dbt-03 782852 10 4 1 5 +107.43 +/- 84.35 0 0 2 3 0 +240.65 +/- 570.11
194062 ncm-dbt-06 1222084 212 92 23 97 +117.34 +/- 22.79 0 4 33 65 4 +248.08 +/- 60.55
194061 ncm-dbt-02 1222575 206 93 20 93 +128.7 +/- 21.84 0 2 30 67 4 +281.62 +/- 63.7
194060 ncm-dbt-05 1236527 212 87 15 110 +122.87 +/- 18.21 0 0 35 70 1 +281.55 +/- 57.63
194059 ncm-dbt-01 1195421 216 97 21 98 +127.7 +/- 21.78 0 5 24 77 2 +291.44 +/- 70.88
194058 ncm-dbt-04 1205702 208 85 20 103 +112.33 +/- 20.03 0 3 33 68 0 +254.73 +/- 60.52
194057 ncm-dbt-03 1210191 216 91 18 107 +122.22 +/- 21.29 0 3 32 70 3 +268.25 +/- 61.6

Commit

Commit ID 48f7c74f15f4cae4b77596cd468802054314d701
Author peregrineshahin
Date 2023-06-22 08:26:17 UTC
Fix Potential in TB cutoffs for NMP. Removes the second dependency on beta and caps the return value to VALUE_TB_WIN_IN_MAX_PLY - 1 Earlier tests: STC: LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 193632 W: 51372 L: 51326 D: 90934 Ptnml(0-2): 447, 20111, 55687, 20091, 480 https://tests.stockfishchess.org/tests/view/6486ee4465ffe077ca125bc1 LTC: LLR: 2.97 (-2.94,2.94) <-1.75,0.25> Total: 331758 W: 89538 L: 89624 D: 152596 Ptnml(0-2): 114, 30121, 105516, 29993, 135 https://tests.stockfishchess.org/tests/view/6489401af42a44347ed7be42 updated constant: LTC: LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 100260 W: 27143 L: 27017 D: 46100 Ptnml(0-2): 34, 8842, 32248, 8976, 30 https://tests.stockfishchess.org/tests/view/6492fcafdc7002ce609c818c closes: https://github.com/official-stockfish/Stockfish/pull/4632 fixes: https://github.com/official-stockfish/Stockfish/issues/4598 bench: 2370027
Copyright 2011–2024 Next Chess Move LLC