Dev Builds » 20240513-0522

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:47:24 1093321 4012 1709 353 1950 +122.23 +/- 4.84 0 50 599 1308 49 +270.3 +/- 13.92
ncm-dbt-02 11:43:13 1198860 4004 1781 297 1926 +135.21 +/- 4.67 0 32 510 1404 56 +310.55 +/- 15.09
ncm-dbt-03 11:48:42 1199511 4000 1746 301 1953 +131.44 +/- 4.7 0 42 516 1397 45 +301.33 +/- 15.01
ncm-dbt-05 11:46:18 1195761 4000 1764 305 1931 +132.84 +/- 4.75 0 40 516 1389 55 +302.7 +/- 15.01
ncm-dbt-06 11:48:25 1191598 3984 1749 345 1890 +127.92 +/- 4.8 1 41 554 1345 51 +287.88 +/- 14.48
20000 8749 1601 9650 +129.91 +/- 2.13 1 205 2695 6843 256 +294.15 +/- 6.56

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
367574 ncm-dbt-05 1189319 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367573 ncm-dbt-03 1201266 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
367572 ncm-dbt-02 1193934 4 1 0 3 +88.51 +/- 137.63 0 0 1 1 0 +190.5 +/- 634.21
367571 ncm-dbt-01 1089978 12 6 1 5 +153.98 +/- 123.22 0 0 2 3 1 +279.41 +/- 548.26
367570 ncm-dbt-06 1190610 484 215 43 226 +129.1 +/- 14.03 0 4 71 158 9 +283.93 +/- 40.73
367569 ncm-dbt-05 1197246 500 216 33 251 +133.34 +/- 12.49 0 4 62 181 3 +315.35 +/- 43.81
367568 ncm-dbt-03 1202255 500 231 38 231 +141.44 +/- 13.59 0 6 53 183 8 +330.23 +/- 47.44
367567 ncm-dbt-02 1198250 500 222 42 236 +130.94 +/- 13.32 0 4 69 170 7 +295.94 +/- 41.39
367566 ncm-dbt-01 1094242 500 215 49 236 +119.89 +/- 13.51 0 6 77 162 5 +265.78 +/- 39.12
367565 ncm-dbt-06 1194125 500 217 50 233 +120.67 +/- 13.15 0 7 71 170 2 +275.45 +/- 40.84
367564 ncm-dbt-05 1197236 500 218 44 238 +126.17 +/- 12.87 0 4 72 170 4 +288.06 +/- 40.46
367563 ncm-dbt-03 1193163 500 219 33 248 +135.76 +/- 12.62 0 4 60 182 4 +321.19 +/- 44.57
367562 ncm-dbt-02 1196289 500 229 44 227 +134.95 +/- 13.96 0 6 62 173 9 +304.07 +/- 43.81
367561 ncm-dbt-01 1090352 500 213 46 241 +120.67 +/- 14.51 0 9 73 160 8 +261.07 +/- 40.24
367560 ncm-dbt-06 1193562 500 216 40 244 +127.76 +/- 13.21 0 4 72 168 6 +288.06 +/- 40.46
367559 ncm-dbt-05 1196405 500 215 43 242 +124.6 +/- 14.31 0 10 64 170 6 +277.93 +/- 42.91
367558 ncm-dbt-02 1200358 500 227 34 239 +141.44 +/- 13.01 0 3 59 180 8 +330.23 +/- 44.94
367557 ncm-dbt-03 1194121 500 221 34 245 +136.56 +/- 12.59 0 5 56 186 3 +327.18 +/- 46.19
367556 ncm-dbt-01 1086131 500 198 41 261 +112.91 +/- 13.04 0 6 83 159 2 +251.89 +/- 37.57
367555 ncm-dbt-06 1193271 500 224 40 236 +134.15 +/- 13.24 0 3 68 171 8 +304.07 +/- 41.65
367554 ncm-dbt-05 1193935 500 218 41 241 +128.55 +/- 13.56 0 5 70 168 7 +288.06 +/- 41.11
367553 ncm-dbt-02 1196403 500 214 49 237 +119.11 +/- 12.62 0 4 79 165 2 +270.57 +/- 38.47
367552 ncm-dbt-03 1201399 500 217 40 243 +128.55 +/- 14.08 0 7 67 168 8 +285.49 +/- 42.08
367551 ncm-dbt-01 1090602 500 195 54 251 +100.7 +/- 13.85 0 10 92 145 3 +215.85 +/- 35.68
367550 ncm-dbt-06 1189076 500 218 43 239 +126.97 +/- 14.11 1 4 72 165 8 +282.94 +/- 40.5
367549 ncm-dbt-01 1102105 500 226 41 233 +134.95 +/- 13.78 0 4 67 169 10 +301.33 +/- 42.04
367548 ncm-dbt-05 1198910 500 221 37 242 +134.15 +/- 13.61 0 5 64 173 8 +304.07 +/- 43.1
367547 ncm-dbt-02 1197950 500 224 36 240 +137.37 +/- 13.15 0 4 61 178 7 +318.25 +/- 44.18
367546 ncm-dbt-03 1199731 500 214 36 250 +129.35 +/- 12.8 0 4 68 174 4 +298.62 +/- 41.71
367545 ncm-dbt-06 1190485 500 217 48 235 +122.24 +/- 13.83 0 7 73 164 6 +270.57 +/- 40.25
367544 ncm-dbt-01 1085346 500 226 45 229 +131.74 +/- 12.93 0 4 66 175 5 +304.07 +/- 42.38
367543 ncm-dbt-05 1196459 500 224 32 244 +140.62 +/- 12.64 0 2 61 180 7 +330.23 +/- 44.08
367542 ncm-dbt-03 1198006 500 217 30 253 +136.56 +/- 12.39 0 2 64 179 5 +321.19 +/- 42.95
367541 ncm-dbt-02 1198851 500 215 26 259 +138.18 +/- 13.5 0 6 56 181 7 +321.19 +/- 46.14
367540 ncm-dbt-06 1194031 500 225 40 235 +134.95 +/- 13.03 0 3 66 174 7 +309.64 +/- 42.33
367539 ncm-dbt-05 1196481 500 225 42 233 +133.34 +/- 14.34 0 8 60 173 9 +298.62 +/- 44.44
367538 ncm-dbt-03 1201635 500 221 47 232 +126.17 +/- 13.95 0 6 72 164 8 +277.93 +/- 40.53
367537 ncm-dbt-01 1109259 500 214 36 250 +129.35 +/- 13.36 0 4 71 168 7 +290.66 +/- 40.76
367536 ncm-dbt-02 1197735 500 226 34 240 +140.62 +/- 12.64 0 2 61 180 7 +330.23 +/- 44.08
367535 ncm-dbt-06 1187624 500 217 41 242 +127.76 +/- 13.92 0 9 61 175 5 +290.66 +/- 44.0
367534 ncm-dbt-02 1209971 500 223 32 245 +139.81 +/- 13.26 0 3 62 176 9 +321.19 +/- 43.77
367533 ncm-dbt-05 1195864 500 227 33 240 +142.25 +/- 13.37 0 2 63 174 11 +324.17 +/- 43.32
367532 ncm-dbt-03 1204023 500 206 43 251 +117.55 +/- 13.87 0 8 76 161 5 +258.75 +/- 39.42
367531 ncm-dbt-01 1091877 500 216 40 244 +127.76 +/- 14.1 0 7 68 167 8 +282.94 +/- 41.76

Commit

Commit ID d3f081ed8ad749cc7e07c0d85b4e8818678f952f
Author Michael Chaly
Date 2024-05-13 05:22:11 UTC
Adjust standpat return value in qsearch Instead of returning value itself return value between it and beta for non pv nodes - analogous to what we do after actual search there. Passed STC: https://tests.stockfishchess.org/tests/view/663cb1b4c0b75d7f7b98188e LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 131552 W: 34131 L: 33673 D: 63748 Ptnml(0-2): 420, 15446, 33600, 15876, 434 Passed LTC: https://tests.stockfishchess.org/tests/view/663cda5dc0b75d7f7b981c6f LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 282798 W: 71658 L: 70833 D: 140307 Ptnml(0-2): 112, 31187, 77979, 32006, 115 closes https://github.com/official-stockfish/Stockfish/pull/5233 Bench: 1606672
Copyright 2011–2024 Next Chess Move LLC