Dev Builds » 20210518-1606

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	Wins	Losses	Draws	Elo
ncm-et-3	08:12:10	1969795	3351	2750	14	587	+398.21 +/- 14.06
ncm-et-4	08:12:20	1965393	3360	2706	15	639	+382.56 +/- 13.46
ncm-et-9	08:12:27	1956054	3301	2679	15	607	+388.59 +/- 13.82
ncm-et-10	08:12:40	1956450	3314	2668	21	625	+380.48 +/- 13.63
ncm-et-13	08:12:14	1964713	3362	2739	16	607	+391.5 +/- 13.82
ncm-et-15	08:12:07	1957692	3313	2708	14	591	+394.79 +/- 14.01
			20001	16250	95	3656	+389.27 +/- 5.62

Test Detail

ID	Host	Started (UTC)	Duration	Base NPS	Games	Wins	Losses	Draws	Elo	PGN
146961	ncm-et-9	2021-05-19 08:11	00:45:13	1958013	301	253	1	47	+421.01 +/- 50.71	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 123061564 \ -pgnout /tmp/ncm-dbt-20210518-1606-042.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146960	ncm-et-10	2021-05-19 08:09	00:47:15	1954349	314	254	2	58	+384.17 +/- 45.42	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1752813002 \ -pgnout /tmp/ncm-dbt-20210518-1606-041.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146959	ncm-et-15	2021-05-19 08:08	00:47:41	1946320	313	253	1	59	+386.69 +/- 44.94	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 587220056 \ -pgnout /tmp/ncm-dbt-20210518-1606-040.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.66+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146958	ncm-et-3	2021-05-19 08:04	00:51:41	1974383	351	291	3	57	+402.46 +/- 45.89	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3707424129 \ -pgnout /tmp/ncm-dbt-20210518-1606-039.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.31+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146957	ncm-et-4	2021-05-19 08:04	00:52:14	1962008	360	292	3	65	+384.39 +/- 42.85	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1522045269 \ -pgnout /tmp/ncm-dbt-20210518-1606-038.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.46+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146956	ncm-et-13	2021-05-19 08:02	00:53:17	1964152	362	286	0	76	+372.3 +/- 39.26	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1731927944 \ -pgnout /tmp/ncm-dbt-20210518-1606-037.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.44+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146955	ncm-et-9	2021-05-19 06:56	01:13:54	1962615	500	399	2	99	+375.98 +/- 34.46	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2716047141 \ -pgnout /tmp/ncm-dbt-20210518-1606-036.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.46+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146954	ncm-et-10	2021-05-19 06:54	01:14:17	1950554	500	411	4	85	+395.65 +/- 37.35	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1103301539 \ -pgnout /tmp/ncm-dbt-20210518-1606-035.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.61+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146953	ncm-et-15	2021-05-19 06:54	01:13:31	1967590	500	407	2	91	+391.57 +/- 36.01	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4062074598 \ -pgnout /tmp/ncm-dbt-20210518-1606-034.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.40+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146952	ncm-et-4	2021-05-19 06:50	01:12:53	1972655	500	401	2	97	+379.78 +/- 34.83	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4186173127 \ -pgnout /tmp/ncm-dbt-20210518-1606-033.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.33+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146951	ncm-et-3	2021-05-19 06:50	01:13:36	1960320	500	403	3	94	+381.7 +/- 35.44	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4251867903 \ -pgnout /tmp/ncm-dbt-20210518-1606-032.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146950	ncm-et-13	2021-05-19 06:48	01:13:26	1960928	500	407	0	93	+395.65 +/- 35.48	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 750825621 \ -pgnout /tmp/ncm-dbt-20210518-1606-031.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146949	ncm-et-9	2021-05-19 05:41	01:14:26	1948435	500	409	1	90	+397.72 +/- 36.17	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 727432797 \ -pgnout /tmp/ncm-dbt-20210518-1606-030.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.64+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146948	ncm-et-10	2021-05-19 05:40	01:13:20	1962617	500	411	4	85	+395.65 +/- 37.35	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1068745255 \ -pgnout /tmp/ncm-dbt-20210518-1606-029.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.46+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146947	ncm-et-15	2021-05-19 05:39	01:14:16	1957263	500	408	3	89	+391.57 +/- 36.46	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2514701774 \ -pgnout /tmp/ncm-dbt-20210518-1606-028.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146946	ncm-et-3	2021-05-19 05:37	01:12:17	1969710	500	404	1	95	+387.57 +/- 35.16	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 559422025 \ -pgnout /tmp/ncm-dbt-20210518-1606-027.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.37+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146945	ncm-et-13	2021-05-19 05:34	01:13:15	1961537	500	407	4	89	+387.57 +/- 36.48	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1952520121 \ -pgnout /tmp/ncm-dbt-20210518-1606-026.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.47+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146944	ncm-et-4	2021-05-19 05:34	01:15:37	1956027	500	410	1	89	+399.81 +/- 36.38	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3289504364 \ -pgnout /tmp/ncm-dbt-20210518-1606-025.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146943	ncm-et-9	2021-05-19 04:26	01:14:24	1962173	500	393	0	107	+368.58 +/- 32.96	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2078781207 \ -pgnout /tmp/ncm-dbt-20210518-1606-024.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.46+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146942	ncm-et-10	2021-05-19 04:25	01:14:30	1954961	500	399	2	99	+375.98 +/- 34.46	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1967842896 \ -pgnout /tmp/ncm-dbt-20210518-1606-023.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.55+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146941	ncm-et-15	2021-05-19 04:24	01:13:50	1958016	500	404	7	89	+375.98 +/- 36.45	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3887312333 \ -pgnout /tmp/ncm-dbt-20210518-1606-022.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146940	ncm-et-3	2021-05-19 04:23	01:13:13	1972344	500	407	4	89	+387.57 +/- 36.48	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2413618616 \ -pgnout /tmp/ncm-dbt-20210518-1606-021.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.34+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146939	ncm-et-4	2021-05-19 04:21	01:12:08	1971269	500	396	2	102	+370.41 +/- 33.92	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2094376232 \ -pgnout /tmp/ncm-dbt-20210518-1606-020.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.35+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146938	ncm-et-13	2021-05-19 04:20	01:13:30	1961538	500	396	5	99	+364.98 +/- 34.53	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3445800309 \ -pgnout /tmp/ncm-dbt-20210518-1606-019.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.47+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146937	ncm-et-9	2021-05-19 03:11	01:14:18	1953642	500	409	4	87	+391.57 +/- 36.91	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4016765337 \ -pgnout /tmp/ncm-dbt-20210518-1606-018.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.57+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146936	ncm-et-10	2021-05-19 03:10	01:14:10	1961235	500	408	0	92	+397.72 +/- 35.69	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 242095900 \ -pgnout /tmp/ncm-dbt-20210518-1606-017.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.47+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146935	ncm-et-15	2021-05-19 03:09	01:14:42	1955422	500	422	0	78	+429.05 +/- 38.92	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1080981931 \ -pgnout /tmp/ncm-dbt-20210518-1606-016.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.55+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146934	ncm-et-3	2021-05-19 03:09	01:13:27	1973276	500	417	1	82	+415.05 +/- 37.98	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3999612711 \ -pgnout /tmp/ncm-dbt-20210518-1606-015.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.33+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146933	ncm-et-13	2021-05-19 03:07	01:12:25	1975452	500	418	1	81	+417.32 +/- 38.22	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3502437606 \ -pgnout /tmp/ncm-dbt-20210518-1606-014.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.30+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146932	ncm-et-4	2021-05-19 03:07	01:13:36	1960071	500	392	1	107	+364.98 +/- 33.02	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1081950214 \ -pgnout /tmp/ncm-dbt-20210518-1606-013.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146931	ncm-et-10	2021-05-19 01:55	01:14:06	1955567	500	393	2	105	+364.98 +/- 33.41	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 146708873 \ -pgnout /tmp/ncm-dbt-20210518-1606-012.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.55+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146930	ncm-et-9	2021-05-19 01:55	01:15:13	1957257	500	411	3	86	+397.72 +/- 37.12	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3647546554 \ -pgnout /tmp/ncm-dbt-20210518-1606-011.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146929	ncm-et-3	2021-05-19 01:55	01:13:21	1967586	500	413	1	86	+406.2 +/- 37.04	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3916069472 \ -pgnout /tmp/ncm-dbt-20210518-1606-010.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.40+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146928	ncm-et-4	2021-05-19 01:54	01:12:26	1971571	500	405	4	91	+383.64 +/- 36.06	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2397726323 \ -pgnout /tmp/ncm-dbt-20210518-1606-009.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.35+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146927	ncm-et-15	2021-05-19 01:53	01:15:05	1958930	500	394	0	106	+370.41 +/- 33.12	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1477324225 \ -pgnout /tmp/ncm-dbt-20210518-1606-008.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.50+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146926	ncm-et-13	2021-05-19 01:53	01:13:10	1965541	500	408	4	88	+389.56 +/- 36.69	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2118659795 \ -pgnout /tmp/ncm-dbt-20210518-1606-007.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.42+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146925	ncm-et-3	2021-05-19 00:40	01:14:35	1970949	500	415	1	84	+410.58 +/- 37.5	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2272947946 \ -pgnout /tmp/ncm-dbt-20210518-1606-006.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.35+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146924	ncm-et-15	2021-05-19 00:40	01:13:02	1960309	500	420	1	79	+421.93 +/- 38.73	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2025318769 \ -pgnout /tmp/ncm-dbt-20210518-1606-005.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146923	ncm-et-10	2021-05-19 00:40	01:15:02	1955873	500	392	7	101	+354.5 +/- 34.18	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2803682061 \ -pgnout /tmp/ncm-dbt-20210518-1606-004.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146922	ncm-et-4	2021-05-19 00:40	01:13:26	1964152	500	410	2	88	+397.72 +/- 36.65	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2078020623 \ -pgnout /tmp/ncm-dbt-20210518-1606-003.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.44+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146921	ncm-et-9	2021-05-19 00:40	01:14:59	1950245	500	405	4	91	+383.64 +/- 36.06	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2831783567 \ -pgnout /tmp/ncm-dbt-20210518-1606-002.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.61+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
146920	ncm-et-13	2021-05-19 00:40	01:13:11	1963847	500	417	2	81	+412.8 +/- 38.27	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 940635446 \ -pgnout /tmp/ncm-dbt-20210518-1606-001.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.44+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210518-1606 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e8d64af1230fdac65bb0da246df3e7abe82e0838 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7

Commit

Commit ID	e8d64af1230fdac65bb0da246df3e7abe82e0838
Author	Tomasz Sobczyk
Date	2021-05-18 16:06:23 UTC
New NNUE architecture and net Introduces a new NNUE network architecture and associated network parameters, as obtained by a new pytorch trainer. The network is already very strong at short TC, without regression at longer TC, and has potential for further improvements. https://tests.stockfishchess.org/tests/view/60a159c65085663412d0921d TC: 10s+0.1s, 1 thread ELO: 21.74 +-3.4 (95%) LOS: 100.0% Total: 10000 W: 1559 L: 934 D: 7507 Ptnml(0-2): 38, 701, 2972, 1176, 113 https://tests.stockfishchess.org/tests/view/60a187005085663412d0925b TC: 60s+0.6s, 1 thread ELO: 5.85 +-1.7 (95%) LOS: 100.0% Total: 20000 W: 1381 L: 1044 D: 17575 Ptnml(0-2): 27, 885, 7864, 1172, 52 https://tests.stockfishchess.org/tests/view/60a2beede229097940a03806 TC: 20s+0.2s, 8 threads LLR: 2.93 (-2.94,2.94) <0.50,3.50> Total: 34272 W: 1610 L: 1452 D: 31210 Ptnml(0-2): 30, 1285, 14350, 1439, 32 https://tests.stockfishchess.org/tests/view/60a2d687e229097940a03c72 TC: 60s+0.6s, 8 threads LLR: 2.94 (-2.94,2.94) <-2.50,0.50> Total: 45544 W: 1262 L: 1214 D: 43068 Ptnml(0-2): 12, 1129, 20442, 1177, 12 The network has been trained (by vondele) using the https://github.com/glinscott/nnue-pytorch/ trainer (started by glinscott), specifically the branch https://github.com/Sopel97/nnue-pytorch/tree/experiment_56. The data used are in 64 billion positions (193GB total) generated and scored with the current master net d8: https://drive.google.com/file/d/1hOOYSDKgOOp38ZmD0N4DV82TOLHzjUiF/view?usp=sharing d9: https://drive.google.com/file/d/1VlhnHL8f-20AXhGkILujnNXHwy9T-MQw/view?usp=sharing d10: https://drive.google.com/file/d/1ZC5upzBYMmMj1gMYCkt6rCxQG0GnO3Kk/view?usp=sharing fishtest_d9: https://drive.google.com/file/d/1GQHt0oNgKaHazwJFTRbXhlCN3FbUedFq/view?usp=sharing This network also contains a few architectural changes with respect to the current master: Size changed from 256x2-32-32-1 to 512x2-16-32-1 ~15-20% slower ~2x larger adds a special path for 16 valued ClippedReLU fixes affine transform code for 16 inputs/outputs, buy using InputDimensions instead of PaddedInputDimensions this is safe now because the inputs are processed in groups of 4 in the current affine transform code The feature set changed from HalfKP to HalfKAv2 Includes information about the kings like HalfKA Packs king features better, resulting in 8% size reduction compared to HalfKA The board is flipped for the black's perspective, instead of rotated like in the current master PSQT values for each feature the feature transformer now outputs a part that is fowarded directly to the output and allows learning piece values more directly than the previous network architecture. The effect is visible for high imbalance positions, where the current master network outputs evaluations skewed towards zero. 8 PSQT values per feature, chosen based on (popcount(pos.pieces()) - 1) / 4 initialized to classical material values on the start of the training 8 subnetworks (512x2->16->32->1), chosen based on (popcount(pos.pieces()) - 1) / 4 only one subnetwork is evaluated for any position, no or marginal speed loss A diagram of the network is available: https://user-images.githubusercontent.com/8037982/118656988-553a1700-b7eb-11eb-82ef-56a11cbebbf2.png A more complete description: https://github.com/glinscott/nnue-pytorch/blob/master/docs/nnue.md closes https://github.com/official-stockfish/Stockfish/pull/3474 Bench: 3806488