Dev Builds » 20240411-2023

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:48:17 1199172 4008 1734 319 1955 +128.17 +/- 4.92 0 57 531 1360 56 +286.87 +/- 14.79
ncm-dbt-02 11:46:29 1229159 3984 1718 332 1934 +126.13 +/- 4.89 0 51 558 1329 54 +280.85 +/- 14.43
ncm-dbt-03 11:49:23 1235164 4018 1753 298 1967 +131.79 +/- 4.74 2 40 516 1403 48 +302.25 +/- 15.01
ncm-dbt-05 11:47:07 1234514 4000 1730 321 1949 +127.86 +/- 4.79 1 41 557 1350 51 +287.74 +/- 14.44
ncm-dbt-06 11:49:33 1232505 3990 1728 312 1950 +128.91 +/- 4.79 1 35 563 1339 57 +289.17 +/- 14.35
20000 8663 1582 9755 +128.57 +/- 2.16 4 224 2725 6781 266 +289.29 +/- 6.52

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
340631 ncm-dbt-01 1197855 8 4 0 4 +190.56 +/- 13.88 0 0 0 4 0 +1199.83 +/- 250.99
340630 ncm-dbt-03 1238065 18 8 2 8 +120.35 +/- 61.17 0 0 3 6 0 +279.47 +/- 313.13
340629 ncm-dbt-02 1226380 484 213 35 236 +134.05 +/- 13.53 0 4 63 168 7 +305.88 +/- 43.42
340628 ncm-dbt-06 1248319 490 214 34 242 +133.88 +/- 13.43 0 3 67 167 8 +302.73 +/- 41.97
340627 ncm-dbt-05 1221178 500 220 37 243 +133.34 +/- 13.63 0 3 71 166 10 +295.94 +/- 40.69
340626 ncm-dbt-01 1219359 500 218 55 227 +117.55 +/- 14.53 0 11 71 162 6 +256.44 +/- 40.73
340625 ncm-dbt-03 1229795 500 223 39 238 +134.15 +/- 13.24 0 6 59 180 5 +312.48 +/- 44.93
340624 ncm-dbt-02 1226726 500 214 51 235 +117.55 +/- 14.69 0 10 75 157 8 +251.89 +/- 39.67
340623 ncm-dbt-06 1243446 500 202 31 267 +123.81 +/- 13.81 0 6 74 163 7 +273.0 +/- 39.95
340622 ncm-dbt-05 1256505 500 212 39 249 +125.38 +/- 13.79 0 8 66 171 5 +282.94 +/- 42.37
340621 ncm-dbt-01 1202715 500 218 36 246 +132.54 +/- 13.47 0 6 62 176 6 +304.07 +/- 43.81
340620 ncm-dbt-03 1236267 500 214 25 261 +138.18 +/- 14.06 0 6 59 175 10 +312.48 +/- 44.93
340619 ncm-dbt-06 1222915 500 226 44 230 +132.54 +/- 13.83 0 7 61 175 7 +301.33 +/- 44.13
340618 ncm-dbt-02 1229027 500 222 40 238 +132.54 +/- 13.47 0 5 65 173 7 +301.33 +/- 42.75
340617 ncm-dbt-05 1235960 500 215 39 246 +127.76 +/- 14.27 0 6 72 162 10 +277.93 +/- 40.53
340616 ncm-dbt-01 1198487 500 224 43 233 +131.74 +/- 14.71 0 7 67 164 12 +285.49 +/- 42.08
340615 ncm-dbt-03 1254790 500 222 37 241 +134.95 +/- 12.64 0 1 70 172 7 +309.64 +/- 40.79
340614 ncm-dbt-06 1226217 500 216 31 253 +134.95 +/- 12.84 0 3 65 176 6 +312.48 +/- 42.67
340613 ncm-dbt-02 1231986 500 224 34 242 +138.99 +/- 13.1 0 3 62 177 8 +321.19 +/- 43.77
340612 ncm-dbt-05 1229460 500 212 39 249 +125.39 +/- 14.13 1 7 65 172 5 +285.49 +/- 42.7
340611 ncm-dbt-01 1169479 500 204 38 258 +119.89 +/- 13.16 0 7 72 169 2 +273.0 +/- 40.54
340610 ncm-dbt-03 1218325 500 217 30 253 +136.56 +/- 12.59 0 3 62 180 5 +321.19 +/- 43.77
340609 ncm-dbt-06 1217310 500 212 35 253 +128.55 +/- 13.38 0 3 75 164 8 +285.49 +/- 39.5
340608 ncm-dbt-02 1219854 500 203 38 259 +119.11 +/- 13.34 0 7 74 166 3 +268.17 +/- 39.97
340607 ncm-dbt-01 1199615 500 217 37 246 +130.94 +/- 13.14 0 4 68 172 6 +298.62 +/- 41.71
340606 ncm-dbt-05 1233064 500 217 42 241 +126.97 +/- 12.66 0 2 76 167 5 +288.06 +/- 39.11
340605 ncm-dbt-03 1230389 500 220 50 230 +123.02 +/- 14.65 2 7 65 171 5 +280.42 +/- 42.65
340604 ncm-dbt-06 1242430 500 207 43 250 +118.33 +/- 12.44 0 2 85 160 3 +265.78 +/- 36.75
340603 ncm-dbt-02 1218240 500 218 51 231 +120.67 +/- 14.35 0 10 69 165 6 +265.78 +/- 41.36
340602 ncm-dbt-03 1244247 500 216 28 256 +137.37 +/- 12.76 0 4 59 182 5 +324.17 +/- 44.97
340601 ncm-dbt-05 1227151 500 216 44 240 +124.6 +/- 13.27 0 4 76 164 6 +277.93 +/- 39.29
340600 ncm-dbt-01 1220771 500 212 30 258 +132.54 +/- 13.65 0 7 60 177 6 +304.07 +/- 44.5
340599 ncm-dbt-06 1223084 500 218 43 239 +126.97 +/- 14.45 1 7 65 170 7 +285.49 +/- 42.7
340598 ncm-dbt-02 1244820 500 210 39 251 +123.81 +/- 13.28 0 4 77 163 6 +275.45 +/- 39.01
340597 ncm-dbt-03 1227700 500 222 43 235 +130.14 +/- 13.88 0 7 64 172 7 +293.29 +/- 43.07
340596 ncm-dbt-05 1232161 500 222 33 245 +138.18 +/- 12.93 0 4 59 181 6 +324.17 +/- 44.97
340595 ncm-dbt-01 1205288 500 219 38 243 +131.74 +/- 13.3 0 6 62 177 5 +304.07 +/- 43.81
340594 ncm-dbt-01 1178980 500 218 42 240 +127.76 +/- 15.25 0 9 69 159 13 +270.57 +/- 41.4
340593 ncm-dbt-06 1236321 500 233 51 216 +132.54 +/- 14.01 0 4 71 164 11 +290.66 +/- 40.76
340592 ncm-dbt-02 1236245 500 214 44 242 +123.02 +/- 14.49 0 8 73 160 9 +265.78 +/- 40.25
340591 ncm-dbt-03 1236898 500 211 44 245 +120.67 +/- 13.32 0 6 75 165 4 +270.57 +/- 39.67
340590 ncm-dbt-05 1240636 500 216 48 236 +121.45 +/- 13.49 0 7 72 167 4 +273.0 +/- 40.54

Commit

Commit ID 1adf8e1ae662f2eecc5d652ece7b9f53014cf057
Author Muzhen Gaming
Date 2024-04-11 20:23:52 UTC
VVLTC search tune Parameters were tuned in 3 stages: * Using an earlier L1-3072 net, and with triple extension margin manually set to 0: https://tests.stockfishchess.org/tests/view/65ffdf5d0ec64f0526c544f2 (~30k games) * Continue tuning, but with the previous master net (L1-2560). https://tests.stockfishchess.org/tests/view/660663f00ec64f0526c59c41 (~27k games) * Starting with the parameters from step 2, use the current L1-3072 net, and allow the triple extension margin to be tuned starting from 0: https://tests.stockfishchess.org/tests/view/660c16b8216a13d9498e7536 (40k games) Passed VVLTC 1st sprt: https://tests.stockfishchess.org/tests/view/66115eacbfeb43334bf7eddd LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 27138 W: 7045 L: 6789 D: 13304 Ptnml(0-2): 1, 2421, 8471, 2673, 3 Passed VVLTC 2nd sprt: https://tests.stockfishchess.org/tests/view/661483623eb00c8ccc0049c1 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 26242 W: 6807 L: 6535 D: 12900 Ptnml(0-2): 0, 2353, 8143, 2625, 0 STC Elo estimate: https://tests.stockfishchess.org/tests/view/66175ca55a4693796d96608c Elo: -10.53 ± 2.4 (95%) LOS: 0.0% Total: 21584 W: 5294 L: 5948 D: 10342 Ptnml(0-2): 102, 2937, 5363, 2293, 97 nElo: -19.99 ± 4.7 (95%) PairsRatio: 0.79 closes https://github.com/official-stockfish/Stockfish/pull/5162 Bench: 1381387
Copyright 2011–2024 Next Chess Move LLC