Dev Builds » 20230123-0601

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	Wins	Losses	Draws	Elo
ncm-et-3	11:13:09	1954590	3327	2833	8	486	+435.33 +/- 15.46
ncm-et-4	11:13:13	1962328	3370	2905	2	463	+451.26 +/- 15.82
ncm-et-9	11:13:00	1956456	3334	2885	6	443	+454.12 +/- 16.2
ncm-et-10	11:13:07	1942870	3304	2844	2	458	+449.58 +/- 15.91
ncm-et-13	11:12:54	1956547	3323	2891	4	428	+461.44 +/- 16.48
ncm-et-15	11:13:16	1957245	3342	2883	4	455	+451.31 +/- 15.97
			20000	17241	26	2733	+450.36 +/- 6.51

Test Detail

ID	Host	Started (UTC)	Duration	Base NPS	Games	Wins	Losses	Draws	Elo	PGN
164166	ncm-et-10	2023-01-23 21:13	01:02:38	1941057	304	257	0	47	+430.74 +/- 50.59	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2647702583 \ -pgnout /tmp/ncm-dbt-20230123-0601-042.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.73+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164165	ncm-et-13	2023-01-23 21:10	01:05:30	1957096	323	283	0	40	+472.16 +/- 55.21	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1402064922 \ -pgnout /tmp/ncm-dbt-20230123-0601-041.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.53+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164164	ncm-et-3	2023-01-23 21:09	01:07:08	1936107	327	274	0	53	+421.83 +/- 47.49	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2113828284 \ -pgnout /tmp/ncm-dbt-20230123-0601-040.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.79+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164163	ncm-et-9	2023-01-23 21:08	01:08:05	1954527	334	300	0	34	+508.23 +/- 60.3	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2502624357 \ -pgnout /tmp/ncm-dbt-20230123-0601-039.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164162	ncm-et-15	2023-01-23 21:06	01:09:34	1952672	342	287	0	55	+423.31 +/- 46.59	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3484594862 \ -pgnout /tmp/ncm-dbt-20230123-0601-038.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.58+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164161	ncm-et-4	2023-01-23 21:03	01:12:44	1968949	370	319	0	51	+452.25 +/- 48.54	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3284617590 \ -pgnout /tmp/ncm-dbt-20230123-0601-037.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.38+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164160	ncm-et-10	2023-01-23 19:30	01:42:16	1956635	500	439	0	61	+474.93 +/- 44.28	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 456215647 \ -pgnout /tmp/ncm-dbt-20230123-0601-036.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.53+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164159	ncm-et-13	2023-01-23 19:29	01:40:25	1970061	500	431	1	68	+449.35 +/- 41.89	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2092209303 \ -pgnout /tmp/ncm-dbt-20230123-0601-035.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.36+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164158	ncm-et-3	2023-01-23 19:28	01:40:18	1965228	500	426	1	73	+436.43 +/- 40.36	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3918000641 \ -pgnout /tmp/ncm-dbt-20230123-0601-034.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.42+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164157	ncm-et-9	2023-01-23 19:25	01:42:18	1947961	500	427	1	72	+438.95 +/- 40.66	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 4180188551 \ -pgnout /tmp/ncm-dbt-20230123-0601-033.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.64+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164156	ncm-et-15	2023-01-23 19:24	01:41:57	1953281	500	436	0	64	+466.03 +/- 43.18	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3391789500 \ -pgnout /tmp/ncm-dbt-20230123-0601-032.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.57+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164155	ncm-et-4	2023-01-23 19:23	01:39:23	1967148	500	424	0	76	+433.94 +/- 39.45	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3259476161 \ -pgnout /tmp/ncm-dbt-20230123-0601-031.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.40+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164154	ncm-et-13	2023-01-23 17:47	01:41:43	1950361	500	429	0	71	+446.7 +/- 40.89	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3659697266 \ -pgnout /tmp/ncm-dbt-20230123-0601-030.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.61+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164153	ncm-et-10	2023-01-23 17:47	01:42:46	1937341	500	420	1	79	+421.93 +/- 38.73	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 625842066 \ -pgnout /tmp/ncm-dbt-20230123-0601-029.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.78+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164152	ncm-et-3	2023-01-23 17:45	01:42:20	1952064	500	421	1	78	+424.28 +/- 38.99	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 948911534 \ -pgnout /tmp/ncm-dbt-20230123-0601-028.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.59+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164151	ncm-et-15	2023-01-23 17:44	01:39:14	1962611	500	421	1	78	+424.28 +/- 38.99	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 449133880 \ -pgnout /tmp/ncm-dbt-20230123-0601-027.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.46+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164150	ncm-et-4	2023-01-23 17:43	01:39:54	1964933	500	432	1	67	+452.04 +/- 42.22	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 72111458 \ -pgnout /tmp/ncm-dbt-20230123-0601-026.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.43+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164149	ncm-et-9	2023-01-23 17:41	01:42:35	1954555	500	442	2	56	+477.99 +/- 46.39	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2807452824 \ -pgnout /tmp/ncm-dbt-20230123-0601-025.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164148	ncm-et-13	2023-01-23 16:05	01:40:52	1957216	500	436	1	63	+463.16 +/- 43.6	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3528072852 \ -pgnout /tmp/ncm-dbt-20230123-0601-024.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164147	ncm-et-10	2023-01-23 16:04	01:42:31	1939832	500	421	0	79	+426.65 +/- 38.66	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1037753107 \ -pgnout /tmp/ncm-dbt-20230123-0601-023.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.74+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164146	ncm-et-15	2023-01-23 16:04	01:39:32	1961151	500	438	0	62	+471.92 +/- 43.9	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3705179769 \ -pgnout /tmp/ncm-dbt-20230123-0601-022.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164145	ncm-et-4	2023-01-23 16:03	01:39:10	1961735	500	421	0	79	+426.65 +/- 38.66	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1187948035 \ -pgnout /tmp/ncm-dbt-20230123-0601-021.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.47+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164144	ncm-et-3	2023-01-23 16:02	01:41:36	1958799	500	428	2	70	+438.95 +/- 41.29	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3521990829 \ -pgnout /tmp/ncm-dbt-20230123-0601-020.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.50+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164143	ncm-et-9	2023-01-23 16:01	01:39:14	1971414	500	430	0	70	+449.35 +/- 41.19	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2150957896 \ -pgnout /tmp/ncm-dbt-20230123-0601-019.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.35+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164142	ncm-et-13	2023-01-23 14:23	01:41:46	1953756	500	440	0	60	+477.98 +/- 44.67	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3138773373 \ -pgnout /tmp/ncm-dbt-20230123-0601-018.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.57+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164141	ncm-et-15	2023-01-23 14:22	01:40:43	1956485	500	425	1	74	+433.94 +/- 40.08	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1773473737 \ -pgnout /tmp/ncm-dbt-20230123-0601-017.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.53+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164140	ncm-et-10	2023-01-23 14:21	01:41:35	1941798	500	433	1	66	+454.76 +/- 42.55	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1376325909 \ -pgnout /tmp/ncm-dbt-20230123-0601-016.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.72+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164139	ncm-et-3	2023-01-23 14:21	01:40:24	1955732	500	426	1	73	+436.43 +/- 40.36	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 833179091 \ -pgnout /tmp/ncm-dbt-20230123-0601-015.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164138	ncm-et-4	2023-01-23 14:21	01:41:13	1948593	500	431	0	69	+452.04 +/- 41.5	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3537708559 \ -pgnout /tmp/ncm-dbt-20230123-0601-014.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.63+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164137	ncm-et-9	2023-01-23 14:19	01:41:34	1952069	500	419	3	78	+415.05 +/- 39.05	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 348445049 \ -pgnout /tmp/ncm-dbt-20230123-0601-013.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.59+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164136	ncm-et-9	2023-01-23 12:41	01:37:28	1960318	500	434	0	66	+460.32 +/- 42.48	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 728579641 \ -pgnout /tmp/ncm-dbt-20230123-0601-012.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164135	ncm-et-4	2023-01-23 12:41	01:39:04	1966017	500	443	1	56	+484.25 +/- 46.39	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1197478222 \ -pgnout /tmp/ncm-dbt-20230123-0601-011.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.41+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164134	ncm-et-3	2023-01-23 12:41	01:39:42	1959244	500	426	2	72	+433.94 +/- 40.69	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2721602930 \ -pgnout /tmp/ncm-dbt-20230123-0601-010.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.50+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164133	ncm-et-15	2023-01-23 12:41	01:40:35	1956350	500	433	0	67	+457.52 +/- 42.15	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1851115675 \ -pgnout /tmp/ncm-dbt-20230123-0601-009.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164132	ncm-et-13	2023-01-23 12:40	01:41:59	1956335	500	435	2	63	+457.52 +/- 43.63	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3997556409 \ -pgnout /tmp/ncm-dbt-20230123-0601-008.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164131	ncm-et-10	2023-01-23 12:38	01:42:20	1923105	500	434	0	66	+460.32 +/- 42.48	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2564020654 \ -pgnout /tmp/ncm-dbt-20230123-0601-007.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.96+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164130	ncm-et-13	2023-01-23 10:59	01:40:39	1951006	500	437	0	63	+468.95 +/- 43.54	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2718524328 \ -pgnout /tmp/ncm-dbt-20230123-0601-006.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.60+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164129	ncm-et-9	2023-01-23 10:59	01:41:46	1954353	500	433	0	67	+457.52 +/- 42.15	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 640260670 \ -pgnout /tmp/ncm-dbt-20230123-0601-005.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164128	ncm-et-4	2023-01-23 10:59	01:41:45	1958927	500	435	0	65	+463.15 +/- 42.83	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2001755125 \ -pgnout /tmp/ncm-dbt-20230123-0601-004.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.50+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164127	ncm-et-10	2023-01-23 10:59	01:39:01	1960323	500	440	0	60	+477.98 +/- 44.67	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1188267406 \ -pgnout /tmp/ncm-dbt-20230123-0601-003.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164126	ncm-et-3	2023-01-23 10:59	01:41:41	1954960	500	432	1	67	+452.04 +/- 42.22	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 630166169 \ -pgnout /tmp/ncm-dbt-20230123-0601-002.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.55+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
164125	ncm-et-15	2023-01-23 10:59	01:41:41	1958167	500	443	2	55	+481.1 +/- 46.83	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 444649961 \ -pgnout /tmp/ncm-dbt-20230123-0601-001.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230123-0601 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:596a528c6a9ace6fb1a8407c86d972d96653418d \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7

Commit

Commit ID	596a528c6a9ace6fb1a8407c86d972d96653418d
Author	Linmiao Xu
Date	2023-01-23 06:01:32 UTC
Update default net to nn-bc24c101ada0.nnue Created by retraining the master net with Leela T78 data from Aug+Sep 2022 added to the previous best dataset. Trained with end lambda 0.7 and started with max epoch 800. All positions with ply <= 28 were skipped: ``` python easy_train.py \ --experiment-name leela95-dfrc96-filt-only-T80octnov-T60novdecT78augsepT79aprmay-12tb7p-sk28-lambda7 \ --training-dataset /data/leela95-dfrc96-filt-only-T80octnov-T60novdecT78augsepT79aprmay-12tb7p.binpack \ --nnue-pytorch-branch linrock/nnue-pytorch/misc-fixes-skip-ply-lteq-28 \ --start-from-engine-test-net True \ --gpus "0," \ --start-lambda 1.0 \ --end-lambda 0.7 \ --gamma 0.995 \ --lr 4.375e-4 \ --tui False \ --seed $RANDOM \ --max_epoch 800 ``` Around epoch 750, training was manually paused and max epoch increased to 950 before resuming. The additional Leela training data from T78 was prepared in the same way as the previous best dataset. The exact training data used can be found at: https://robotmoon.com/nnue-training-data/ While the local elo ratings during this experiment were much lower than in recent master nets, several later epochs had a consistent elo above zero, and this was hypothesized to represent potential strength at slower time controls. Local elo at 25k nodes per move leela95-dfrc96-filt-only-T80octnov-T60novdecT78augsepT79aprmay-12tb7p-sk28-lambda7 nn-epoch819.nnue : 0.4 +/- 1.1 (nn-bc24c101ada0.nnue) nn-epoch799.nnue : 0.3 +/- 1.2 nn-epoch759.nnue : 0.3 +/- 1.1 nn-epoch839.nnue : 0.2 +/- 1.4 Passed STC https://tests.stockfishchess.org/tests/view/63cabf6f0eefe8694a0c6013 LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 41608 W: 11161 L: 10848 D: 19599 Ptnml(0-2): 116, 4496, 11281, 4781, 130 Passed LTC https://tests.stockfishchess.org/tests/view/63cb1856344bb01c191af263 LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 76760 W: 20517 L: 20137 D: 36106 Ptnml(0-2): 34, 7435, 23070, 7799, 42 closes https://github.com/official-stockfish/Stockfish/pull/4351 bench 3941848