Dev Builds » 20221016-0949

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	Wins	Losses	Draws	Elo
ncm-et-3	11:16:07	1948660	3320	2834	5	481	+439.09 +/- 15.53
ncm-et-4	11:16:02	1960746	3354	2895	5	454	+451.58 +/- 16.0
ncm-et-9	11:16:13	1957389	3335	2850	8	477	+439.17 +/- 15.61
ncm-et-10	11:16:21	1957235	3334	2840	14	480	+433.49 +/- 15.57
ncm-et-13	11:16:23	1959097	3334	2839	5	490	+436.47 +/- 15.39
ncm-et-15	11:16:19	1950986	3323	2886	4	433	+459.32 +/- 16.38
			20000	17144	41	2815	+442.98 +/- 6.41

Test Detail

ID	Host	Started (UTC)	Duration	Base NPS	Games	Wins	Losses	Draws	Elo	PGN
161277	ncm-et-3	2022-10-18 00:50	01:06:25	1952853	320	273	0	47	+440.38 +/- 50.62	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3817034961 \ -pgnout /tmp/ncm-dbt-20221016-0949-042.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.58+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161276	ncm-et-15	2022-10-18 00:50	01:07:03	1932733	323	264	0	59	+399.11 +/- 44.84	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1969145972 \ -pgnout /tmp/ncm-dbt-20221016-0949-041.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.84+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161275	ncm-et-13	2022-10-18 00:50	01:07:01	1970963	334	281	1	52	+422.31 +/- 48.1	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2435882929 \ -pgnout /tmp/ncm-dbt-20221016-0949-040.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.35+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161274	ncm-et-9	2022-10-18 00:49	01:07:04	1960166	335	293	2	40	+461.25 +/- 55.29	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3949945704 \ -pgnout /tmp/ncm-dbt-20221016-0949-039.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161273	ncm-et-10	2022-10-18 00:49	01:07:31	1964157	334	294	2	38	+469.33 +/- 56.82	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1586468515 \ -pgnout /tmp/ncm-dbt-20221016-0949-038.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.44+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161272	ncm-et-4	2022-10-18 00:44	01:12:36	1955305	354	309	0	45	+467.31 +/- 51.87	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 4231968297 \ -pgnout /tmp/ncm-dbt-20221016-0949-037.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.55+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161271	ncm-et-3	2022-10-17 23:09	01:40:32	1958814	500	428	0	72	+444.08 +/- 40.59	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2256361963 \ -pgnout /tmp/ncm-dbt-20221016-0949-036.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.50+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161270	ncm-et-9	2022-10-17 23:09	01:40:06	1960927	500	428	2	70	+438.95 +/- 41.29	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 836683380 \ -pgnout /tmp/ncm-dbt-20221016-0949-035.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161269	ncm-et-10	2022-10-17 23:07	01:41:10	1957917	500	432	0	68	+454.76 +/- 41.82	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1601986013 \ -pgnout /tmp/ncm-dbt-20221016-0949-034.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161268	ncm-et-13	2022-10-17 23:07	01:42:09	1954672	500	418	1	81	+417.32 +/- 38.22	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2627518147 \ -pgnout /tmp/ncm-dbt-20221016-0949-033.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161267	ncm-et-15	2022-10-17 23:07	01:42:32	1956524	500	439	0	61	+474.93 +/- 44.28	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3049168844 \ -pgnout /tmp/ncm-dbt-20221016-0949-032.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.53+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161266	ncm-et-4	2022-10-17 23:03	01:39:58	1960024	500	421	0	79	+426.65 +/- 38.66	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 926283521 \ -pgnout /tmp/ncm-dbt-20221016-0949-031.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161265	ncm-et-9	2022-10-17 21:27	01:40:50	1960013	500	426	1	73	+436.43 +/- 40.36	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2128287853 \ -pgnout /tmp/ncm-dbt-20221016-0949-030.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161264	ncm-et-13	2022-10-17 21:26	01:39:54	1957876	500	426	0	74	+438.95 +/- 40.01	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1362338061 \ -pgnout /tmp/ncm-dbt-20221016-0949-029.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161263	ncm-et-3	2022-10-17 21:26	01:42:12	1945082	500	429	1	70	+444.09 +/- 41.26	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 259088675 \ -pgnout /tmp/ncm-dbt-20221016-0949-028.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.68+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161262	ncm-et-10	2022-10-17 21:24	01:42:46	1948298	500	415	2	83	+408.38 +/- 37.78	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3561824997 \ -pgnout /tmp/ncm-dbt-20221016-0949-027.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.64+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161261	ncm-et-15	2022-10-17 21:24	01:42:26	1954684	500	435	0	65	+463.15 +/- 42.83	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3020239981 \ -pgnout /tmp/ncm-dbt-20221016-0949-026.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161260	ncm-et-4	2022-10-17 21:23	01:40:12	1961103	500	439	3	58	+466.04 +/- 45.52	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2150392814 \ -pgnout /tmp/ncm-dbt-20221016-0949-025.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161259	ncm-et-9	2022-10-17 19:45	01:41:52	1954350	500	426	0	74	+438.95 +/- 40.01	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2355826614 \ -pgnout /tmp/ncm-dbt-20221016-0949-024.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161258	ncm-et-3	2022-10-17 19:45	01:40:50	1937464	500	415	1	84	+410.58 +/- 37.5	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2955553426 \ -pgnout /tmp/ncm-dbt-20221016-0949-023.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.77+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161257	ncm-et-13	2022-10-17 19:45	01:41:07	1958340	500	438	2	60	+466.04 +/- 44.75	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2207959204 \ -pgnout /tmp/ncm-dbt-20221016-0949-022.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161256	ncm-et-15	2022-10-17 19:43	01:40:33	1954664	500	431	2	67	+446.7 +/- 42.25	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 643878843 \ -pgnout /tmp/ncm-dbt-20221016-0949-021.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161255	ncm-et-4	2022-10-17 19:41	01:40:43	1963849	500	431	0	69	+452.04 +/- 41.5	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 756350621 \ -pgnout /tmp/ncm-dbt-20221016-0949-020.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.44+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161254	ncm-et-10	2022-10-17 19:41	01:42:17	1955855	500	418	2	80	+415.05 +/- 38.52	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1020361590 \ -pgnout /tmp/ncm-dbt-20221016-0949-019.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161253	ncm-et-3	2022-10-17 18:02	01:42:19	1952994	500	441	1	58	+477.99 +/- 45.54	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1575437882 \ -pgnout /tmp/ncm-dbt-20221016-0949-018.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.58+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161252	ncm-et-9	2022-10-17 18:01	01:42:47	1948187	500	420	1	79	+421.93 +/- 38.73	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1817514227 \ -pgnout /tmp/ncm-dbt-20221016-0949-017.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.64+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161251	ncm-et-13	2022-10-17 18:01	01:42:55	1958184	500	433	0	67	+457.52 +/- 42.15	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2079341299 \ -pgnout /tmp/ncm-dbt-20221016-0949-016.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161250	ncm-et-15	2022-10-17 18:01	01:41:23	1950870	500	439	0	61	+474.93 +/- 44.28	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 4130132780 \ -pgnout /tmp/ncm-dbt-20221016-0949-015.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.60+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161249	ncm-et-10	2022-10-17 18:00	01:40:29	1960320	500	426	2	72	+433.94 +/- 40.69	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1233885485 \ -pgnout /tmp/ncm-dbt-20221016-0949-014.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161248	ncm-et-4	2022-10-17 18:00	01:41:00	1965996	500	431	1	68	+449.35 +/- 41.89	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1582547821 \ -pgnout /tmp/ncm-dbt-20221016-0949-013.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.42+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161247	ncm-et-9	2022-10-17 16:20	01:41:09	1962925	500	426	2	72	+433.94 +/- 40.69	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 382088648 \ -pgnout /tmp/ncm-dbt-20221016-0949-012.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.45+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161246	ncm-et-10	2022-10-17 16:19	01:40:00	1964000	500	429	3	68	+438.95 +/- 41.92	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3816731610 \ -pgnout /tmp/ncm-dbt-20221016-0949-011.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.44+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161245	ncm-et-3	2022-10-17 16:19	01:42:26	1939680	500	421	1	78	+424.28 +/- 38.99	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3987951077 \ -pgnout /tmp/ncm-dbt-20221016-0949-010.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.75+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161244	ncm-et-15	2022-10-17 16:18	01:42:23	1948620	500	449	1	50	+504.32 +/- 49.24	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2116305476 \ -pgnout /tmp/ncm-dbt-20221016-0949-009.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.63+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161243	ncm-et-4	2022-10-17 16:17	01:41:56	1956947	500	430	0	70	+449.35 +/- 41.19	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 937725661 \ -pgnout /tmp/ncm-dbt-20221016-0949-008.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.53+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161242	ncm-et-13	2022-10-17 16:17	01:43:34	1950412	500	425	1	74	+433.94 +/- 40.08	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 169867876 \ -pgnout /tmp/ncm-dbt-20221016-0949-007.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.61+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161241	ncm-et-15	2022-10-17 14:37	01:39:59	1958810	500	429	1	70	+444.09 +/- 41.26	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1615893743 \ -pgnout /tmp/ncm-dbt-20221016-0949-006.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.50+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161240	ncm-et-4	2022-10-17 14:37	01:39:37	1961998	500	434	1	65	+457.52 +/- 42.89	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3686653857 \ -pgnout /tmp/ncm-dbt-20221016-0949-005.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.46+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161239	ncm-et-10	2022-10-17 14:37	01:42:08	1950100	500	426	3	71	+431.48 +/- 41.0	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3361658704 \ -pgnout /tmp/ncm-dbt-20221016-0949-004.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.61+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161238	ncm-et-3	2022-10-17 14:37	01:41:23	1953738	500	427	1	72	+438.95 +/- 40.66	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3197676748 \ -pgnout /tmp/ncm-dbt-20221016-0949-003.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.57+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161237	ncm-et-9	2022-10-17 14:36	01:42:25	1955159	500	431	0	69	+452.04 +/- 41.5	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 255175112 \ -pgnout /tmp/ncm-dbt-20221016-0949-002.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.55+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
161236	ncm-et-13	2022-10-17 14:36	01:39:43	1963233	500	418	0	82	+419.61 +/- 37.91	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2547183605 \ -pgnout /tmp/ncm-dbt-20221016-0949-001.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.45+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221016-0949 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:d6b6360ff5dcdffa141f50d0a81d0be7c6324c71 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7

Commit

Commit ID	d6b6360ff5dcdffa141f50d0a81d0be7c6324c71
Author	Stéphane Nicolet
Date	2022-10-16 09:49:07 UTC
Tweak the formula for NNUE complexity Joint work by Ofek Shochat and Stéphane Nicolet. passed STC: LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 93288 W: 24996 L: 24601 D: 43691 Ptnml(0-2): 371, 10263, 24989, 10642, 379 https://tests.stockfishchess.org/tests/view/63448f4f4bc7650f07541987 passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 84168 W: 22771 L: 22377 D: 39020 Ptnml(0-2): 47, 8181, 25234, 8575, 47 https://tests.stockfishchess.org/tests/view/6345186d4bc7650f07542fbd ================ It seems there are two effects with this patch: effect A : If Stockfish is winning at root, we have optimism > 0 for all leaves in the search tree where Stockfish is to move. There, if (psq - nnue) > 0 (ie if the advantage is more materialistic than positional), then the product D = optimism * (psq - nnue) will be positive, nnueComplexity will increase, and the eval will increase from SF point of view. So the effect A is that if Stockfish is winning at root, she will slightly favor in the search tree (in other words, search more) the positions where she can convert her advantage via materialist means. effect B : If Stockfish is losing at root, we have optimism > 0 for all leaves in the search tree where the opponent is to move. There, if (psq - nnue) < 0 (ie if the opponent advantage is more positional than materialistic), then the product D = optimism * (psq-nnue) will be negative, nnueComplexity will decrease, and the eval will decrease from the opponent point of view. So the effect B is that Stockfish will slightly favor in the search tree (search more) the branches where she can defend by slowly reducing the opponent positional advantage. ================= closes https://github.com/official-stockfish/Stockfish/pull/4195 bench: 4673898