Dev Builds » 20240421-1246

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo
ncm-dbt-01	11:47:32	1218815	4000	1723 328 1949	+126.47 +/- 4.91	1 53 550 1342 54	+282.31 +/- 14.54
ncm-dbt-02	11:45:57	1233581	3992	1731 316 1945	+128.74 +/- 4.9	0 51 537 1350 58	+287.97 +/- 14.71
ncm-dbt-03	11:47:38	1234950	4000	1768 307 1925	+133.04 +/- 4.82	1 40 517 1381 61	+301.67 +/- 15.0
ncm-dbt-05	11:45:14	1238310	4000	1718 303 1979	+128.46 +/- 4.82	1 45 544 1358 52	+289.36 +/- 14.62
ncm-dbt-06	11:49:02	1227471	4008	1722 324 1962	+126.49 +/- 4.69	1 30 592 1332 49	+283.99 +/- 13.96
			20000	8662 1578 9760	+128.63 +/- 2.16	4 219 2740 6763 274	+288.97 +/- 6.5

Test Detail

ID	Host	Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo	PGN
346939	ncm-dbt-06	1238745	8	4 1 3	+136.8 +/- 89.09	0 0 1 3 0	+337.69 +/- 541.44	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3609244606 \ -pgnout ncm-dbt-20240421-1246-041.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346938	ncm-dbt-02	1240402	492	205 38 249	+122.8 +/- 14.14	0 9 66 166 5	+274.55 +/- 42.33	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1592916916 \ -pgnout ncm-dbt-20240421-1246-040.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346937	ncm-dbt-05	1241038	500	207 46 247	+116.0 +/- 13.2	0 6 80 161 3	+258.75 +/- 38.32	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 10988126 \ -pgnout ncm-dbt-20240421-1246-039.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346936	ncm-dbt-01	1186870	500	222 47 231	+126.97 +/- 14.61	1 8 63 171 7	+285.49 +/- 43.31	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3979466536 \ -pgnout ncm-dbt-20240421-1246-038.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346935	ncm-dbt-03	1229533	500	214 32 254	+132.54 +/- 13.47	0 7 59 179 5	+306.84 +/- 44.88	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2009624131 \ -pgnout ncm-dbt-20240421-1246-037.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346934	ncm-dbt-06	1226110	500	214 32 254	+132.54 +/- 13.83	0 4 70 166 10	+293.29 +/- 41.07	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2791806199 \ -pgnout ncm-dbt-20240421-1246-036.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346933	ncm-dbt-02	1230156	500	223 41 236	+132.54 +/- 12.91	0 3 68 173 6	+304.07 +/- 41.65	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 618267717 \ -pgnout ncm-dbt-20240421-1246-035.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346932	ncm-dbt-05	1227133	500	207 37 256	+123.02 +/- 13.47	0 6 73 166 5	+275.45 +/- 40.24	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 184673104 \ -pgnout ncm-dbt-20240421-1246-034.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346931	ncm-dbt-01	1182194	500	206 26 268	+130.94 +/- 13.14	0 4 68 172 6	+298.62 +/- 41.71	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2351489860 \ -pgnout ncm-dbt-20240421-1246-033.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346930	ncm-dbt-06	1224281	500	231 40 229	+139.81 +/- 12.47	0 1 64 178 7	+327.18 +/- 42.83	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3256618742 \ -pgnout ncm-dbt-20240421-1246-032.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346929	ncm-dbt-03	1232268	500	229 33 238	+143.89 +/- 12.92	0 2 59 180 9	+336.46 +/- 44.87	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 752528145 \ -pgnout ncm-dbt-20240421-1246-031.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346928	ncm-dbt-02	1228883	500	202 38 260	+118.33 +/- 14.03	0 8 76 160 6	+258.75 +/- 39.42	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3199242773 \ -pgnout ncm-dbt-20240421-1246-030.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346927	ncm-dbt-05	1254018	500	212 30 258	+132.54 +/- 13.28	0 5 64 175 6	+304.07 +/- 43.1	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2781916120 \ -pgnout ncm-dbt-20240421-1246-029.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346926	ncm-dbt-06	1231539	500	212 53 235	+114.45 +/- 14.05	0 8 81 155 6	+247.41 +/- 38.13	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2264129285 \ -pgnout ncm-dbt-20240421-1246-028.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346925	ncm-dbt-03	1227615	500	222 36 242	+135.76 +/- 13.57	0 6 59 178 7	+312.48 +/- 44.93	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2607956853 \ -pgnout ncm-dbt-20240421-1246-027.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346924	ncm-dbt-01	1241928	500	218 50 232	+121.45 +/- 14.17	0 8 73 162 7	+265.78 +/- 40.25	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3251395290 \ -pgnout ncm-dbt-20240421-1246-026.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346923	ncm-dbt-02	1239435	500	223 40 237	+133.34 +/- 14.34	0 9 57 176 8	+301.33 +/- 45.48	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2364719418 \ -pgnout ncm-dbt-20240421-1246-025.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346922	ncm-dbt-05	1220512	500	215 40 245	+126.97 +/- 14.11	0 6 72 163 9	+277.93 +/- 40.53	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 283639301 \ -pgnout ncm-dbt-20240421-1246-024.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346921	ncm-dbt-06	1225588	500	205 45 250	+115.23 +/- 13.72	1 5 81 159 4	+256.44 +/- 38.07	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 600901240 \ -pgnout ncm-dbt-20240421-1246-023.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346920	ncm-dbt-03	1240631	500	223 42 235	+131.74 +/- 14.2	0 7 64 170 9	+293.29 +/- 43.07	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1794169166 \ -pgnout ncm-dbt-20240421-1246-022.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346919	ncm-dbt-01	1195248	500	222 37 241	+134.95 +/- 13.22	0 5 61 178 6	+312.48 +/- 44.19	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 666935317 \ -pgnout ncm-dbt-20240421-1246-021.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346918	ncm-dbt-02	1220244	500	213 48 239	+119.11 +/- 14.68	0 10 73 159 8	+256.44 +/- 40.21	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2394857252 \ -pgnout ncm-dbt-20240421-1246-020.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346917	ncm-dbt-05	1251776	500	228 40 232	+137.37 +/- 14.78	1 7 55 177 10	+312.48 +/- 46.38	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 253833720 \ -pgnout ncm-dbt-20240421-1246-019.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346916	ncm-dbt-06	1233069	500	208 36 256	+124.6 +/- 12.53	0 2 78 166 4	+282.94 +/- 38.55	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3372611424 \ -pgnout ncm-dbt-20240421-1246-018.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346915	ncm-dbt-03	1220434	500	220 46 234	+126.17 +/- 14.46	0 6 75 158 11	+270.57 +/- 39.67	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2845003479 \ -pgnout ncm-dbt-20240421-1246-017.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346914	ncm-dbt-01	1241145	500	218 49 233	+122.24 +/- 14.0	0 6 77 159 8	+265.78 +/- 39.12	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1721353230 \ -pgnout ncm-dbt-20240421-1246-016.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346913	ncm-dbt-02	1235089	500	235 34 231	+148.02 +/- 13.35	0 4 51 185 10	+349.43 +/- 48.52	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3629229876 \ -pgnout ncm-dbt-20240421-1246-015.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346912	ncm-dbt-06	1235357	500	216 40 244	+127.76 +/- 12.65	0 4 69 174 3	+295.94 +/- 41.39	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3582054197 \ -pgnout ncm-dbt-20240421-1246-014.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346911	ncm-dbt-05	1244820	500	217 32 251	+134.95 +/- 14.13	0 6 63 171 10	+301.33 +/- 43.45	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1085786985 \ -pgnout ncm-dbt-20240421-1246-013.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346910	ncm-dbt-01	1240260	500	211 42 247	+122.24 +/- 14.5	0 10 68 165 7	+268.17 +/- 41.66	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 333145631 \ -pgnout ncm-dbt-20240421-1246-012.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346909	ncm-dbt-03	1248864	500	227 37 236	+138.99 +/- 12.7	0 1 66 175 8	+321.19 +/- 42.12	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 371085958 \ -pgnout ncm-dbt-20240421-1246-011.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346908	ncm-dbt-02	1227148	500	218 36 246	+132.54 +/- 13.1	0 2 72 168 8	+298.62 +/- 40.29	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2620291230 \ -pgnout ncm-dbt-20240421-1246-010.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346907	ncm-dbt-06	1211433	500	223 35 242	+137.37 +/- 12.96	0 1 69 171 9	+312.48 +/- 41.11	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 468504819 \ -pgnout ncm-dbt-20240421-1246-009.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346906	ncm-dbt-01	1238082	500	217 34 249	+133.34 +/- 13.26	0 4 66 173 7	+304.07 +/- 42.38	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3858074836 \ -pgnout ncm-dbt-20240421-1246-008.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346905	ncm-dbt-05	1220927	500	216 34 250	+132.54 +/- 12.91	0 6 59 182 3	+312.48 +/- 44.93	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 606543672 \ -pgnout ncm-dbt-20240421-1246-007.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346904	ncm-dbt-03	1242077	500	219 48 233	+123.81 +/- 13.81	0 8 68 169 5	+277.93 +/- 41.74	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3684121556 \ -pgnout ncm-dbt-20240421-1246-006.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346903	ncm-dbt-06	1221118	500	209 42 249	+120.67 +/- 13.5	0 5 79 160 6	+265.78 +/- 38.54	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3539742156 \ -pgnout ncm-dbt-20240421-1246-005.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346902	ncm-dbt-05	1246257	500	216 44 240	+124.6 +/- 13.09	0 3 78 163 6	+277.93 +/- 38.66	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 387036666 \ -pgnout ncm-dbt-20240421-1246-004.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346901	ncm-dbt-02	1247292	500	212 41 247	+123.81 +/- 13.81	0 6 74 163 7	+273.0 +/- 39.95	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 4081610952 \ -pgnout ncm-dbt-20240421-1246-003.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346900	ncm-dbt-01	1224794	500	209 43 248	+119.89 +/- 14.02	0 8 74 162 6	+263.42 +/- 39.97	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3308738680 \ -pgnout ncm-dbt-20240421-1246-002.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
346899	ncm-dbt-03	1238178	500	214 33 253	+131.74 +/- 13.67	1 3 67 172 7	+301.33 +/- 42.04	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1397387497 \ -pgnout ncm-dbt-20240421-1246-001.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240421-1246 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a8de45b8c2887e8d5efe61498f3acccf5f36116 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14

Commit

Commit ID	1a8de45b8c2887e8d5efe61498f3acccf5f36116
Author	Joost VandeVondele
Date	2024-04-21 12:46:01 UTC
Improve CI the recent refactoring has shown some limitations of our testing, hence we add a couple of more tests including: * expected mate score * expected mated score * expected in TB win score * expected in TB loss score * expected info line output * expected info line output (wdl) closes https://github.com/official-stockfish/Stockfish/pull/5181 No functional change