Dev Builds » 20240113-1840

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo
ncm-dbt-01	09:51:21	1216404	3330	1479 232 1619	+136.76 +/- 5.24	0 35 399 1180 51	+314.14 +/- 17.08
ncm-dbt-02	09:46:14	1235540	3334	1485 237 1612	+136.7 +/- 5.13	1 29 402 1191 44	+317.42 +/- 17.02
ncm-dbt-03	09:49:17	1232459	3332	1458 241 1633	+133.04 +/- 5.11	0 32 424 1171 39	+306.2 +/- 16.56
ncm-dbt-04	09:49:00	1227654	3338	1467 258 1613	+131.82 +/- 5.22	0 37 429 1160 43	+300.39 +/- 16.47
ncm-dbt-05	09:48:08	1232849	3328	1462 259 1607	+131.53 +/- 5.17	0 25 461 1128 50	+296.55 +/- 15.85
ncm-dbt-06	09:50:37	1225586	3338	1442 228 1668	+132.42 +/- 5.21	0 33 436 1153 47	+300.8 +/- 16.33
			20000	8793 1455 9752	+133.71 +/- 2.11	1 191 2551 6983 274	+305.8 +/- 6.74

Test Detail

ID	Host	Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo	PGN
246863	ncm-dbt-01	1208297	330	146 24 160	+134.83 +/- 15.83	0 4 37 122 2	+320.65 +/- 57.22	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2313567893 \ -pgnout ncm-dbt-20240113-1840-042.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246862	ncm-dbt-02	1228872	334	149 28 157	+131.85 +/- 15.1	0 2 44 119 2	+310.05 +/- 52.17	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 424604643 \ -pgnout ncm-dbt-20240113-1840-041.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246861	ncm-dbt-03	1232446	332	148 29 155	+130.32 +/- 17.27	0 3 48 108 7	+284.66 +/- 49.85	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3430231782 \ -pgnout ncm-dbt-20240113-1840-040.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246860	ncm-dbt-05	1231805	328	148 23 157	+139.44 +/- 16.44	0 2 41 115 6	+319.43 +/- 54.2	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2626069904 \ -pgnout ncm-dbt-20240113-1840-039.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246859	ncm-dbt-06	1220091	338	145 28 165	+125.44 +/- 16.84	0 5 46 114 4	+280.82 +/- 51.04	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2940562356 \ -pgnout ncm-dbt-20240113-1840-038.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246858	ncm-dbt-04	1238190	338	148 27 163	+130.14 +/- 16.42	0 4 44 117 4	+296.15 +/- 52.28	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 4124637720 \ -pgnout ncm-dbt-20240113-1840-037.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246689	ncm-dbt-05	1233611	500	209 46 245	+117.55 +/- 13.53	0 7 77 162 4	+261.07 +/- 39.14	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3159028466 \ -pgnout ncm-dbt-20240113-1840-036.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246688	ncm-dbt-01	1231058	500	226 27 247	+146.36 +/- 13.22	0 5 49 188 8	+349.43 +/- 49.46	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2256830276 \ -pgnout ncm-dbt-20240113-1840-035.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246687	ncm-dbt-03	1223261	500	219 28 253	+139.81 +/- 12.47	0 4 55 187 4	+336.46 +/- 46.65	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1406707457 \ -pgnout ncm-dbt-20240113-1840-034.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246686	ncm-dbt-02	1227102	500	227 35 238	+140.62 +/- 13.62	0 6 54 182 8	+327.18 +/- 47.0	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3288768886 \ -pgnout ncm-dbt-20240113-1840-033.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246685	ncm-dbt-04	1218586	500	211 34 255	+128.55 +/- 12.43	0 4 67 177 2	+301.33 +/- 42.04	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3236621611 \ -pgnout ncm-dbt-20240113-1840-032.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246684	ncm-dbt-06	1229414	500	213 27 260	+135.76 +/- 13.2	0 2 69 170 9	+306.84 +/- 41.23	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 199219896 \ -pgnout ncm-dbt-20240113-1840-031.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246683	ncm-dbt-05	1242573	500	219 44 237	+126.97 +/- 12.08	0 3 70 176 1	+298.62 +/- 41.01	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2199960935 \ -pgnout ncm-dbt-20240113-1840-030.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246682	ncm-dbt-03	1232390	500	214 37 249	+128.55 +/- 13.91	0 8 63 173 6	+290.66 +/- 43.37	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1108468392 \ -pgnout ncm-dbt-20240113-1840-029.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246681	ncm-dbt-02	1243602	500	221 40 239	+131.74 +/- 13.3	1 2 68 173 6	+304.07 +/- 41.65	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3826841745 \ -pgnout ncm-dbt-20240113-1840-028.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246680	ncm-dbt-06	1243359	500	213 33 254	+130.94 +/- 13.69	0 6 65 172 7	+295.94 +/- 42.75	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1668337521 \ -pgnout ncm-dbt-20240113-1840-027.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246679	ncm-dbt-01	1225530	500	226 27 247	+146.36 +/- 13.02	0 3 54 184 9	+346.12 +/- 47.1	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 451565698 \ -pgnout ncm-dbt-20240113-1840-026.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246678	ncm-dbt-04	1233607	500	223 41 236	+132.54 +/- 12.91	0 3 68 173 6	+304.07 +/- 41.65	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2984497418 \ -pgnout ncm-dbt-20240113-1840-025.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246677	ncm-dbt-05	1211561	500	221 33 246	+137.37 +/- 12.96	0 3 63 177 7	+318.25 +/- 43.39	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1101345820 \ -pgnout ncm-dbt-20240113-1840-024.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246676	ncm-dbt-03	1236653	500	218 33 249	+134.95 +/- 12.44	0 3 63 180 4	+318.25 +/- 43.39	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1039371943 \ -pgnout ncm-dbt-20240113-1840-023.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246675	ncm-dbt-06	1234784	500	208 32 260	+127.76 +/- 14.6	0 8 68 164 10	+277.93 +/- 41.74	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 453701027 \ -pgnout ncm-dbt-20240113-1840-022.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246674	ncm-dbt-02	1234761	500	217 35 248	+132.54 +/- 13.65	0 7 60 177 6	+304.07 +/- 44.5	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1915610164 \ -pgnout ncm-dbt-20240113-1840-021.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246673	ncm-dbt-04	1231833	500	224 33 243	+139.81 +/- 13.26	0 4 59 179 8	+324.17 +/- 44.97	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1354189219 \ -pgnout ncm-dbt-20240113-1840-020.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246672	ncm-dbt-01	1244554	500	222 39 239	+133.34 +/- 13.81	0 5 66 170 9	+298.62 +/- 42.41	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 971532439 \ -pgnout ncm-dbt-20240113-1840-019.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246671	ncm-dbt-03	1250408	500	214 41 245	+125.38 +/- 12.51	0 4 71 173 2	+290.66 +/- 40.76	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 477826576 \ -pgnout ncm-dbt-20240113-1840-018.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246670	ncm-dbt-05	1239400	500	228 31 241	+144.71 +/- 13.08	0 2 59 179 10	+336.46 +/- 44.87	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2287194500 \ -pgnout ncm-dbt-20240113-1840-017.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246669	ncm-dbt-06	1205843	500	219 36 245	+133.34 +/- 12.29	0 4 61 183 2	+318.25 +/- 44.18	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1558590324 \ -pgnout ncm-dbt-20240113-1840-016.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246668	ncm-dbt-02	1240284	500	222 25 253	+144.71 +/- 13.08	0 4 53 185 8	+342.85 +/- 47.56	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 143300261 \ -pgnout ncm-dbt-20240113-1840-015.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246667	ncm-dbt-04	1227523	500	220 34 246	+135.76 +/- 13.2	0 6 57 182 5	+318.25 +/- 45.73	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3662922937 \ -pgnout ncm-dbt-20240113-1840-014.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246666	ncm-dbt-01	1183987	500	221 34 245	+136.56 +/- 14.62	0 8 58 173 11	+304.07 +/- 45.19	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1806305513 \ -pgnout ncm-dbt-20240113-1840-013.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246665	ncm-dbt-03	1208127	500	227 36 237	+139.81 +/- 12.87	0 3 60 180 7	+327.18 +/- 44.54	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 4183573766 \ -pgnout ncm-dbt-20240113-1840-012.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246664	ncm-dbt-05	1231322	500	219 40 241	+130.14 +/- 15.06	0 4 80 149 17	+268.17 +/- 38.21	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 841465765 \ -pgnout ncm-dbt-20240113-1840-011.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246663	ncm-dbt-04	1225053	500	222 39 239	+133.34 +/- 14.17	0 8 59 175 8	+301.33 +/- 44.81	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1790302012 \ -pgnout ncm-dbt-20240113-1840-010.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246662	ncm-dbt-02	1243810	500	223 48 229	+126.97 +/- 13.58	0 5 72 166 7	+282.94 +/- 40.5	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 935600014 \ -pgnout ncm-dbt-20240113-1840-009.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246661	ncm-dbt-06	1225716	500	219 38 243	+131.74 +/- 13.12	0 3 70 170 7	+298.62 +/- 41.01	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2097065409 \ -pgnout ncm-dbt-20240113-1840-008.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246660	ncm-dbt-01	1217502	500	215 40 245	+126.97 +/- 13.04	0 3 75 166 6	+285.49 +/- 39.5	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2708165219 \ -pgnout ncm-dbt-20240113-1840-007.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246659	ncm-dbt-03	1243934	500	218 37 245	+131.74 +/- 14.2	0 7 64 170 9	+293.29 +/- 43.07	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3959559585 \ -pgnout ncm-dbt-20240113-1840-006.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246658	ncm-dbt-02	1230353	500	226 26 248	+147.19 +/- 12.57	0 3 51 189 7	+356.21 +/- 48.54	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2191904411 \ -pgnout ncm-dbt-20240113-1840-005.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246657	ncm-dbt-05	1239671	500	218 42 240	+127.76 +/- 13.02	0 4 71 170 5	+290.66 +/- 40.76	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1127047178 \ -pgnout ncm-dbt-20240113-1840-004.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246656	ncm-dbt-04	1218788	500	219 50 231	+122.24 +/- 14.66	0 8 75 157 10	+261.07 +/- 39.69	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2366841345 \ -pgnout ncm-dbt-20240113-1840-003.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246655	ncm-dbt-01	1203902	500	223 41 236	+132.54 +/- 13.65	0 7 60 177 6	+304.07 +/- 44.5	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 4199301887 \ -pgnout ncm-dbt-20240113-1840-002.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
246654	ncm-dbt-06	1219900	500	225 34 241	+139.81 +/- 13.45	0 5 57 180 8	+324.17 +/- 45.77	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 638759180 \ -pgnout ncm-dbt-20240113-1840-001.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240113-1840 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:eec361f64c7d28ff3a5add64bddc5a96800f7fba \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14

Commit

Commit ID	eec361f64c7d28ff3a5add64bddc5a96800f7fba
Author	mstembera
Date	2024-01-13 18:40:53 UTC
Simplify bad quiets The main difference is that instead of returning the first bad quiet as a good one we fall through. This is actually more correct and simpler to implement. Non regression STC: https://tests.stockfishchess.org/tests/view/659bbb3479aa8af82b964ec7 LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 150944 W: 38399 L: 38305 D: 74240 Ptnml(0-2): 485, 18042, 38298, 18188, 459 Non regression LTC: https://tests.stockfishchess.org/tests/view/659c6e6279aa8af82b9660eb LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 192060 W: 47871 L: 47823 D: 96366 Ptnml(0-2): 144, 21912, 51845, 22010, 119 The cutoff is now -8K instead of -7.5K. -7.5K failed. https://tests.stockfishchess.org/tests/view/659a1f4b79aa8af82b962a0e This was likely a false negative. closes https://github.com/official-stockfish/Stockfish/pull/4975 Bench: 1308279