Dev Builds » 20210618-1929

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	Wins	Losses	Draws	Elo
ncm-et-3	08:27:41	1969662	3369	2824	10	535	+418.76 +/- 14.73
ncm-et-4	08:28:01	1965955	3344	2773	11	560	+408.33 +/- 14.39
ncm-et-9	08:27:46	1959282	3325	2755	12	558	+407.25 +/- 14.42
ncm-et-10	08:27:57	1955710	3293	2766	10	517	+420.68 +/- 14.99
ncm-et-13	08:27:50	1962953	3345	2772	8	565	+408.72 +/- 14.32
ncm-et-15	08:27:52	1959022	3324	2764	12	548	+410.49 +/- 14.55
			20000	16654	63	3283	+412.3 +/- 5.94

Test Detail

ID	Host	Started (UTC)	Duration	Base NPS	Games	Wins	Losses	Draws	Elo	PGN
149167	ncm-et-10	2021-06-20 22:41	00:57:23	1955264	375	322	3	50	+437.27 +/- 49.14	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1428876170 \ -pgnout /tmp/ncm-dbt-20210618-1929-042.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.55+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
149166	ncm-et-9	2021-06-20 22:41	00:57:13	1965709	380	314	0	66	+408.72 +/- 42.35	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2201002803 \ -pgnout /tmp/ncm-dbt-20210618-1929-041.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.42+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
149165	ncm-et-4	2021-06-20 22:40	00:57:24	1966459	381	313	1	67	+400.75 +/- 42.11	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 537214436 \ -pgnout /tmp/ncm-dbt-20210618-1929-040.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.41+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
149164	ncm-et-3	2021-06-20 22:39	00:58:20	1970651	391	331	0	60	+432.15 +/- 44.56	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1129133613 \ -pgnout /tmp/ncm-dbt-20210618-1929-039.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.36+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
149163	ncm-et-15	2021-06-20 22:39	00:58:56	1956189	379	306	0	73	+388.94 +/- 40.14	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4230163866 \ -pgnout /tmp/ncm-dbt-20210618-1929-038.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
149162	ncm-et-13	2021-06-20 22:38	01:00:08	1967080	399	341	2	56	+435.96 +/- 46.35	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2451940804 \ -pgnout /tmp/ncm-dbt-20210618-1929-037.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.40+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
149161	ncm-et-13	2021-06-20 21:23	01:14:16	1960013	500	396	2	102	+370.41 +/- 33.92	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4169931790 \ -pgnout /tmp/ncm-dbt-20210618-1929-036.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
149160	ncm-et-9	2021-06-20 21:23	01:16:47	1955882	500	411	1	88	+401.92 +/- 36.6	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2017511925 \ -pgnout /tmp/ncm-dbt-20210618-1929-035.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
149159	ncm-et-3	2021-06-20 21:23	01:15:47	1967695	500	418	2	80	+415.05 +/- 38.52	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1677069953 \ -pgnout /tmp/ncm-dbt-20210618-1929-034.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.39+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
149158	ncm-et-10	2021-06-20 21:23	01:17:06	1956030	500	434	1	65	+457.52 +/- 42.89	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3845644368 \ -pgnout /tmp/ncm-dbt-20210618-1929-033.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
149157	ncm-et-4	2021-06-20 21:23	01:16:49	1963395	500	417	1	82	+415.05 +/- 37.98	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4218817626 \ -pgnout /tmp/ncm-dbt-20210618-1929-032.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.45+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
149156	ncm-et-15	2021-06-20 21:23	01:15:14	1973430	500	418	1	81	+417.32 +/- 38.22	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 441917576 \ -pgnout /tmp/ncm-dbt-20210618-1929-031.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.32+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148981	ncm-et-10	2021-06-19 10:36	01:05:04	1957400	418	342	0	76	+400.0 +/- 39.36	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3376278770 \ -pgnout /tmp/ncm-dbt-20210618-1929-030.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148980	ncm-et-13	2021-06-19 10:34	01:07:31	1968160	446	373	0	73	+419.98 +/- 40.24	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4150765437 \ -pgnout /tmp/ncm-dbt-20210618-1929-029.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.39+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148979	ncm-et-15	2021-06-19 10:33	01:08:27	1953309	445	364	1	80	+397.44 +/- 38.42	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1268630005 \ -pgnout /tmp/ncm-dbt-20210618-1929-028.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.57+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148978	ncm-et-9	2021-06-19 10:33	01:09:14	1958014	445	368	0	77	+409.44 +/- 39.13	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1193032111 \ -pgnout /tmp/ncm-dbt-20210618-1929-027.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148977	ncm-et-4	2021-06-19 10:30	01:12:12	1958011	463	396	1	66	+440.39 +/- 42.53	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2512280971 \ -pgnout /tmp/ncm-dbt-20210618-1929-026.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148976	ncm-et-3	2021-06-19 10:29	01:12:27	1968469	478	395	3	80	+402.01 +/- 38.53	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2025733403 \ -pgnout /tmp/ncm-dbt-20210618-1929-025.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.38+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148975	ncm-et-10	2021-06-19 09:19	01:16:42	1947974	500	419	1	80	+419.61 +/- 38.47	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1908019886 \ -pgnout /tmp/ncm-dbt-20210618-1929-024.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.64+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148974	ncm-et-13	2021-06-19 09:17	01:16:06	1957554	500	409	1	90	+397.72 +/- 36.17	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1351051926 \ -pgnout /tmp/ncm-dbt-20210618-1929-023.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148973	ncm-et-15	2021-06-19 09:17	01:16:04	1959853	500	422	1	77	+426.65 +/- 39.25	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2681666286 \ -pgnout /tmp/ncm-dbt-20210618-1929-022.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148972	ncm-et-9	2021-06-19 09:16	01:16:07	1947161	500	413	1	86	+406.2 +/- 37.04	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3460668502 \ -pgnout /tmp/ncm-dbt-20210618-1929-021.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.65+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148971	ncm-et-4	2021-06-19 09:14	01:15:08	1963415	500	399	3	98	+374.11 +/- 34.68	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 528346580 \ -pgnout /tmp/ncm-dbt-20210618-1929-020.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.45+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148970	ncm-et-3	2021-06-19 09:14	01:14:56	1979666	500	424	0	76	+433.94 +/- 39.45	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3773550607 \ -pgnout /tmp/ncm-dbt-20210618-1929-019.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.25+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148969	ncm-et-10	2021-06-19 08:01	01:17:54	1957860	500	432	0	68	+454.76 +/- 41.82	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3411368848 \ -pgnout /tmp/ncm-dbt-20210618-1929-018.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148968	ncm-et-13	2021-06-19 08:00	01:17:00	1960616	500	414	1	85	+408.38 +/- 37.27	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2761513608 \ -pgnout /tmp/ncm-dbt-20210618-1929-017.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148967	ncm-et-15	2021-06-19 07:59	01:16:38	1955230	500	424	2	74	+429.05 +/- 40.11	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2012570583 \ -pgnout /tmp/ncm-dbt-20210618-1929-016.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.55+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148966	ncm-et-9	2021-06-19 07:59	01:16:35	1963534	500	424	3	73	+426.65 +/- 40.41	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2503118765 \ -pgnout /tmp/ncm-dbt-20210618-1929-015.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.45+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148965	ncm-et-3	2021-06-19 07:57	01:15:38	1969714	500	431	3	66	+444.09 +/- 42.58	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2252022832 \ -pgnout /tmp/ncm-dbt-20210618-1929-014.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.37+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148964	ncm-et-4	2021-06-19 07:57	01:15:49	1966020	500	416	1	83	+412.8 +/- 37.74	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2788175205 \ -pgnout /tmp/ncm-dbt-20210618-1929-013.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.41+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148963	ncm-et-10	2021-06-19 06:43	01:16:57	1958633	500	416	2	82	+410.58 +/- 38.02	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3761944023 \ -pgnout /tmp/ncm-dbt-20210618-1929-012.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148962	ncm-et-13	2021-06-19 06:43	01:16:19	1966936	500	414	0	86	+410.58 +/- 36.97	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1410764186 \ -pgnout /tmp/ncm-dbt-20210618-1929-011.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.40+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148961	ncm-et-15	2021-06-19 06:42	01:16:18	1953604	500	414	2	84	+406.2 +/- 37.55	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1117423959 \ -pgnout /tmp/ncm-dbt-20210618-1929-010.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.57+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148960	ncm-et-9	2021-06-19 06:42	01:16:18	1955266	500	406	4	90	+385.59 +/- 36.27	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1200313833 \ -pgnout /tmp/ncm-dbt-20210618-1929-009.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.55+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148959	ncm-et-3	2021-06-19 06:41	01:15:35	1970970	500	419	1	80	+419.61 +/- 38.47	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3356638191 \ -pgnout /tmp/ncm-dbt-20210618-1929-008.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.35+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148958	ncm-et-4	2021-06-19 06:41	01:15:51	1968621	500	419	1	80	+419.61 +/- 38.47	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2907850146 \ -pgnout /tmp/ncm-dbt-20210618-1929-007.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.38+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148957	ncm-et-13	2021-06-19 05:26	01:16:30	1960314	500	425	2	73	+431.48 +/- 40.4	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4082294141 \ -pgnout /tmp/ncm-dbt-20210618-1929-006.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148956	ncm-et-10	2021-06-19 05:26	01:16:51	1956811	500	401	3	96	+377.87 +/- 35.05	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1857906668 \ -pgnout /tmp/ncm-dbt-20210618-1929-005.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.53+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148955	ncm-et-3	2021-06-19 05:26	01:14:58	1960469	500	406	1	93	+391.57 +/- 35.55	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2855384542 \ -pgnout /tmp/ncm-dbt-20210618-1929-004.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148954	ncm-et-9	2021-06-19 05:26	01:15:32	1969413	500	419	3	78	+415.05 +/- 39.05	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3073610232 \ -pgnout /tmp/ncm-dbt-20210618-1929-003.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.37+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148953	ncm-et-15	2021-06-19 05:25	01:16:15	1961542	500	416	5	79	+404.05 +/- 38.78	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 649174542 \ -pgnout /tmp/ncm-dbt-20210618-1929-002.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.47+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148952	ncm-et-4	2021-06-19 05:25	01:14:48	1975769	500	413	3	84	+401.92 +/- 37.57	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1211996165 \ -pgnout /tmp/ncm-dbt-20210618-1929-001.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.29+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210618-1929 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:86afb6a7cf33640a4d7bb7dbb2a8203450e34938 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7

Commit

Commit ID	86afb6a7cf33640a4d7bb7dbb2a8203450e34938
Author	SFisGOD
Date	2021-06-18 19:29:14 UTC
Update default net to nn-aa9d7eeb397e.nnue Optimization of vondele's nn-33c9d39e5eb6.nnue using SPSA https://tests.stockfishchess.org/tests/view/60ca68be457376eb8bcab28b Setting: ck values are default based on how large the parameters are The new values for this net are the raw values at the end of the tuning (80k games) The significant changes are in buckets 1 and 2 (5-12 pieces) so the main difference is in playing endgames if we compare it to nn-33c9. There is also change in bucket 7 (29-32 pieces) but not as substantial as the changes in buckets 1 and 2. If we interpret the changes based on an experiment a few months ago, this new net plays more optimistically during endgames and less optimistically during openings. STC: LLR: 2.93 (-2.94,2.94) <-0.50,2.50> Total: 49504 W: 4246 L: 4053 D: 41205 Ptnml(0-2): 140, 3282, 17749, 3407, 174 https://tests.stockfishchess.org/tests/view/60cbd752457376eb8bcab478 LTC: LLR: 2.95 (-2.94,2.94) <0.50,3.50> Total: 88720 W: 4926 L: 4651 D: 79143 Ptnml(0-2): 105, 4048, 35793, 4295, 119 https://tests.stockfishchess.org/tests/view/60cc7828457376eb8bcab4fa closes https://github.com/official-stockfish/Stockfish/pull/3566 Bench: 4758885