Dev Builds » 20240117-1712

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo
ncm-dbt-01	09:48:19	1180007	3332	1461 230 1641	+134.73 +/- 5.13	0 28 425 1167 46	+309.14 +/- 16.54
ncm-dbt-02	09:45:37	1232261	3322	1444 246 1632	+131.19 +/- 5.19	1 26 455 1132 47	+296.98 +/- 15.96
ncm-dbt-03	09:49:10	1237149	3354	1468 291 1595	+127.33 +/- 5.43	2 41 464 1118 52	+282.97 +/- 15.83
ncm-dbt-04	09:49:20	1227439	3344	1452 247 1645	+131.08 +/- 5.16	0 28 458 1139 47	+296.33 +/- 15.91
ncm-dbt-05	09:44:23	1238023	3296	1433 251 1612	+130.39 +/- 5.22	0 36 433 1140 39	+296.99 +/- 16.39
ncm-dbt-06	09:48:53	1230485	3352	1475 241 1636	+134.2 +/- 5.07	0 27 431 1175 43	+308.67 +/- 16.42
			20000	8733 1506 9761	+131.48 +/- 2.12	3 186 2666 6871 274	+298.35 +/- 6.59

Test Detail

ID	Host	Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo	PGN
257524	ncm-dbt-05	1234664	296	120 17 159	+126.16 +/- 16.01	0 3 39 106 0	+298.58 +/- 55.65	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 389288359 \ -pgnout ncm-dbt-20240117-1712-042.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257523	ncm-dbt-02	1220667	322	142 24 156	+133.53 +/- 18.22	1 2 43 108 7	+298.39 +/- 52.87	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2668438304 \ -pgnout ncm-dbt-20240117-1712-041.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257522	ncm-dbt-01	1179239	332	143 26 163	+127.92 +/- 16.33	0 4 44 115 3	+292.46 +/- 52.27	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 4274090757 \ -pgnout ncm-dbt-20240117-1712-040.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257521	ncm-dbt-04	1255291	344	148 31 165	+123.07 +/- 15.75	0 3 52 114 3	+277.18 +/- 47.76	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1781381586 \ -pgnout ncm-dbt-20240117-1712-039.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257520	ncm-dbt-06	1214317	352	158 28 166	+134.67 +/- 14.87	0 2 45 126 3	+316.5 +/- 51.6	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 389774151 \ -pgnout ncm-dbt-20240117-1712-038.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257519	ncm-dbt-03	1221400	354	158 30 166	+131.57 +/- 16.79	0 5 45 121 6	+294.12 +/- 51.64	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2653931053 \ -pgnout ncm-dbt-20240117-1712-037.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257518	ncm-dbt-05	1227758	500	218 42 240	+127.76 +/- 13.21	0 5 69 171 5	+290.66 +/- 41.43	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2125359126 \ -pgnout ncm-dbt-20240117-1712-036.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257517	ncm-dbt-02	1234254	500	225 40 235	+134.95 +/- 12.84	0 3 65 176 6	+312.48 +/- 42.67	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 340423908 \ -pgnout ncm-dbt-20240117-1712-035.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257516	ncm-dbt-01	1158907	500	221 36 243	+134.95 +/- 13.41	0 1 74 164 11	+298.62 +/- 39.56	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1458974329 \ -pgnout ncm-dbt-20240117-1712-034.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257515	ncm-dbt-04	1211345	500	220 40 240	+130.94 +/- 13.32	0 4 69 170 7	+295.94 +/- 41.39	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1400050106 \ -pgnout ncm-dbt-20240117-1712-033.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257514	ncm-dbt-03	1256966	500	226 45 229	+131.74 +/- 13.49	0 5 66 172 7	+298.62 +/- 42.41	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 518444334 \ -pgnout ncm-dbt-20240117-1712-032.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257513	ncm-dbt-06	1261887	500	219 27 254	+140.62 +/- 12.64	0 3 58 183 6	+333.32 +/- 45.35	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1766609602 \ -pgnout ncm-dbt-20240117-1712-031.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257512	ncm-dbt-02	1244312	500	206 40 254	+119.89 +/- 13.51	0 6 77 162 5	+265.78 +/- 39.12	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2370581147 \ -pgnout ncm-dbt-20240117-1712-030.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257511	ncm-dbt-05	1252394	500	224 27 249	+144.71 +/- 12.68	0 4 51 189 6	+349.43 +/- 48.52	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 287155363 \ -pgnout ncm-dbt-20240117-1712-029.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257510	ncm-dbt-01	1189219	500	216 38 246	+129.35 +/- 12.8	0 1 77 165 7	+290.66 +/- 38.7	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 145932065 \ -pgnout ncm-dbt-20240117-1712-028.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257509	ncm-dbt-06	1231197	500	214 37 249	+128.55 +/- 13.56	0 5 70 168 7	+288.06 +/- 41.11	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2278671314 \ -pgnout ncm-dbt-20240117-1712-027.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257508	ncm-dbt-03	1235136	500	228 42 230	+135.76 +/- 14.64	1 4 65 168 12	+301.33 +/- 42.75	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1919270552 \ -pgnout ncm-dbt-20240117-1712-026.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257507	ncm-dbt-04	1227972	500	212 35 253	+128.55 +/- 13.01	0 5 67 174 4	+295.94 +/- 42.08	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3283592345 \ -pgnout ncm-dbt-20240117-1712-025.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257506	ncm-dbt-05	1243571	500	217 45 238	+124.6 +/- 14.8	0 11 64 167 8	+273.0 +/- 42.83	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2772522951 \ -pgnout ncm-dbt-20240117-1712-024.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257505	ncm-dbt-02	1218949	500	217 44 239	+125.38 +/- 14.13	0 6 74 161 9	+273.0 +/- 39.95	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1039204427 \ -pgnout ncm-dbt-20240117-1712-023.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257504	ncm-dbt-01	1211378	500	212 28 260	+134.15 +/- 12.86	0 4 63 178 5	+312.48 +/- 43.44	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2876700977 \ -pgnout ncm-dbt-20240117-1712-022.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257503	ncm-dbt-06	1214290	500	223 39 238	+134.15 +/- 13.97	0 3 72 163 12	+293.29 +/- 40.39	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3717626527 \ -pgnout ncm-dbt-20240117-1712-021.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257502	ncm-dbt-04	1249260	500	225 35 240	+138.99 +/- 13.1	0 3 62 177 8	+321.19 +/- 43.77	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3977695737 \ -pgnout ncm-dbt-20240117-1712-020.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257501	ncm-dbt-03	1230744	500	223 45 232	+129.35 +/- 14.24	0 6 70 164 10	+282.94 +/- 41.13	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 890411116 \ -pgnout ncm-dbt-20240117-1712-019.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257500	ncm-dbt-05	1220764	500	217 37 246	+130.94 +/- 13.51	0 5 67 171 7	+295.94 +/- 42.08	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2832877920 \ -pgnout ncm-dbt-20240117-1712-018.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257499	ncm-dbt-02	1240252	500	220 32 248	+137.37 +/- 12.36	0 0 69 174 7	+318.25 +/- 40.94	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2272227008 \ -pgnout ncm-dbt-20240117-1712-017.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257498	ncm-dbt-06	1234002	500	216 41 243	+126.97 +/- 13.76	0 7 67 170 6	+285.49 +/- 42.08	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 192288734 \ -pgnout ncm-dbt-20240117-1712-016.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257497	ncm-dbt-01	1166992	500	221 32 247	+138.18 +/- 13.12	0 6 54 185 5	+327.18 +/- 47.0	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3897785554 \ -pgnout ncm-dbt-20240117-1712-015.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257496	ncm-dbt-04	1208771	500	206 32 262	+126.17 +/- 13.42	0 4 75 164 7	+280.42 +/- 39.57	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 760449607 \ -pgnout ncm-dbt-20240117-1712-014.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257495	ncm-dbt-03	1232712	500	207 31 262	+127.76 +/- 13.21	0 7 63 177 3	+295.94 +/- 43.42	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3294751210 \ -pgnout ncm-dbt-20240117-1712-013.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257494	ncm-dbt-05	1229451	500	220 37 243	+133.34 +/- 13.45	0 6 61 177 6	+306.84 +/- 44.17	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2556361123 \ -pgnout ncm-dbt-20240117-1712-012.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257493	ncm-dbt-06	1230961	500	224 35 241	+138.18 +/- 12.53	0 3 60 182 5	+327.18 +/- 44.54	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1383416409 \ -pgnout ncm-dbt-20240117-1712-011.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257492	ncm-dbt-01	1183814	500	226 35 239	+139.81 +/- 13.64	0 6 55 181 8	+324.17 +/- 46.56	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3446589756 \ -pgnout ncm-dbt-20240117-1712-010.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257491	ncm-dbt-02	1233514	500	217 30 253	+136.56 +/- 13.92	0 5 63 172 10	+306.84 +/- 43.45	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2386598851 \ -pgnout ncm-dbt-20240117-1712-009.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257490	ncm-dbt-04	1214048	500	221 41 238	+130.94 +/- 13.69	0 5 68 169 8	+293.29 +/- 41.75	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3054250862 \ -pgnout ncm-dbt-20240117-1712-008.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257489	ncm-dbt-03	1250891	500	217 44 239	+125.39 +/- 14.63	1 6 71 163 9	+275.45 +/- 40.84	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2039213302 \ -pgnout ncm-dbt-20240117-1712-007.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257488	ncm-dbt-05	1257559	500	217 46 237	+123.81 +/- 13.1	0 2 82 159 7	+273.0 +/- 37.5	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 182141881 \ -pgnout ncm-dbt-20240117-1712-006.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257487	ncm-dbt-01	1170505	500	222 35 243	+136.56 +/- 13.55	0 6 58 179 7	+315.35 +/- 45.33	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1270760170 \ -pgnout ncm-dbt-20240117-1712-005.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257486	ncm-dbt-02	1233884	500	217 36 247	+131.74 +/- 12.54	0 4 64 179 3	+309.64 +/- 43.08	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2918669843 \ -pgnout ncm-dbt-20240117-1712-004.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257485	ncm-dbt-06	1226746	500	221 34 245	+136.56 +/- 12.59	0 4 59 183 4	+324.17 +/- 44.97	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3515738518 \ -pgnout ncm-dbt-20240117-1712-003.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257484	ncm-dbt-03	1232198	500	209 54 237	+111.37 +/- 13.89	0 8 84 153 5	+240.82 +/- 37.4	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2312425629 \ -pgnout ncm-dbt-20240117-1712-002.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
257483	ncm-dbt-04	1225391	500	220 33 247	+136.56 +/- 13.73	0 4 65 171 10	+306.84 +/- 42.73	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2252686768 \ -pgnout ncm-dbt-20240117-1712-001.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240117-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:0c7f56dea6ee9a46a4be8481b2316711cb356f02 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14

Commit

Commit ID	0c7f56dea6ee9a46a4be8481b2316711cb356f02
Author	Shahin M. Shahin
Date	2024-01-17 17:12:16 UTC
Fix mated-in behaviour This addresses the issue where Stockfish may output non-proven checkmate scores if the search is prematurely halted, either due to a time control or node limit, before it explores other possibilities where the checkmate score could have been delayed or refuted. The fix also replaces staving off from proven mated scores in a multithread environment making use of the threads instead of a negative effect with multithreads (1t was better in proving mated in scores than more threads). Issue reported on mate tracker repo by and this PR is co-authored with @robertnurnberg Special thanks to @AndyGrant for outlining that a fix is eventually possible. Passed Adj off SMP STC: https://tests.stockfishchess.org/tests/view/65a125d779aa8af82b96c3eb LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 303256 W: 75823 L: 75892 D: 151541 Ptnml(0-2): 406, 35269, 80395, 35104, 454 Passed Adj off SMP LTC: https://tests.stockfishchess.org/tests/view/65a37add79aa8af82b96f0f7 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 56056 W: 13951 L: 13770 D: 28335 Ptnml(0-2): 11, 5910, 16002, 6097, 8 Passed all tests in matetrack without any better mate for opponent found in 1t and multithreads. Fixed bugs in https://github.com/official-stockfish/Stockfish/pull/4976 closes https://github.com/official-stockfish/Stockfish/pull/4990 Bench: 1308279 Co-Authored-By: Robert Nürnberg <28635489+robertnurnberg@users.noreply.github.com>