Dev Builds » 20210519-1834

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	Wins	Losses	Draws	Elo
ncm-et-3	08:12:37	1965906	3337	2757	8	572	+405.98 +/- 14.23
ncm-et-4	08:12:33	1962160	3352	2694	14	644	+381.24 +/- 13.41
ncm-et-9	08:12:10	1962361	3325	2675	21	629	+379.96 +/- 13.58
ncm-et-10	08:12:16	1954779	3310	2660	15	635	+380.82 +/- 13.51
ncm-et-13	08:12:31	1961121	3348	2722	12	614	+391.0 +/- 13.73
ncm-et-15	08:12:23	1960953	3328	2683	17	628	+382.74 +/- 13.59
			20000	16191	87	3722	+386.77 +/- 5.57

Test Detail

ID	Host	Started (UTC)	Duration	Base NPS	Games	Wins	Losses	Draws	Elo	PGN
147123	ncm-et-10	2021-05-21 02:35	00:46:52	1953308	310	255	2	53	+397.85 +/- 47.63	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4165337222 \ -pgnout /tmp/ncm-dbt-20210519-1834-042.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.57+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147122	ncm-et-9	2021-05-21 02:34	00:48:13	1961076	325	259	3	63	+370.13 +/- 43.53	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 704702926 \ -pgnout /tmp/ncm-dbt-20210519-1834-041.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147121	ncm-et-15	2021-05-21 02:33	00:48:58	1959083	328	259	4	65	+360.94 +/- 42.83	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 18543446 \ -pgnout /tmp/ncm-dbt-20210519-1834-040.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.50+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147120	ncm-et-3	2021-05-21 02:32	00:50:18	1965689	337	282	1	54	+417.12 +/- 47.15	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3564915850 \ -pgnout /tmp/ncm-dbt-20210519-1834-039.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.42+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147119	ncm-et-13	2021-05-21 02:30	00:51:31	1960780	348	280	1	67	+383.37 +/- 42.06	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1023555925 \ -pgnout /tmp/ncm-dbt-20210519-1834-038.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147118	ncm-et-4	2021-05-21 02:29	00:52:51	1957401	352	280	2	70	+372.04 +/- 41.18	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 790109219 \ -pgnout /tmp/ncm-dbt-20210519-1834-037.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147117	ncm-et-10	2021-05-21 01:21	01:13:21	1962150	500	410	2	88	+397.72 +/- 36.65	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1550815953 \ -pgnout /tmp/ncm-dbt-20210519-1834-036.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.46+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147116	ncm-et-15	2021-05-21 01:19	01:12:58	1970018	500	401	4	95	+375.98 +/- 35.27	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 591803635 \ -pgnout /tmp/ncm-dbt-20210519-1834-035.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.37+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147115	ncm-et-9	2021-05-21 01:19	01:13:40	1962465	500	398	3	99	+372.25 +/- 34.49	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1198277344 \ -pgnout /tmp/ncm-dbt-20210519-1834-034.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.46+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147114	ncm-et-3	2021-05-21 01:18	01:12:59	1960039	500	413	0	87	+408.38 +/- 36.75	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2068133054 \ -pgnout /tmp/ncm-dbt-20210519-1834-033.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147113	ncm-et-13	2021-05-21 01:16	01:13:20	1955625	500	408	2	90	+393.6 +/- 36.22	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2997424466 \ -pgnout /tmp/ncm-dbt-20210519-1834-032.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147112	ncm-et-4	2021-05-21 01:15	01:13:14	1961074	500	409	1	90	+397.72 +/- 36.17	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 394693612 \ -pgnout /tmp/ncm-dbt-20210519-1834-031.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147111	ncm-et-15	2021-05-21 00:06	01:12:44	1964558	500	405	2	93	+387.57 +/- 35.6	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3471613166 \ -pgnout /tmp/ncm-dbt-20210519-1834-030.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.43+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147110	ncm-et-10	2021-05-21 00:05	01:14:52	1954200	500	389	2	109	+357.94 +/- 32.76	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3371854566 \ -pgnout /tmp/ncm-dbt-20210519-1834-029.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147109	ncm-et-9	2021-05-21 00:05	01:13:43	1961552	500	401	2	97	+379.78 +/- 34.83	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 930034986 \ -pgnout /tmp/ncm-dbt-20210519-1834-028.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.47+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147108	ncm-et-3	2021-05-21 00:04	01:14:00	1972033	500	409	2	89	+395.65 +/- 36.43	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1489939081 \ -pgnout /tmp/ncm-dbt-20210519-1834-027.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.34+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147107	ncm-et-4	2021-05-21 00:02	01:12:14	1970336	500	408	1	91	+395.65 +/- 35.96	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2665465646 \ -pgnout /tmp/ncm-dbt-20210519-1834-026.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.36+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147106	ncm-et-13	2021-05-21 00:02	01:13:45	1962461	500	393	1	106	+366.78 +/- 33.19	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4191012488 \ -pgnout /tmp/ncm-dbt-20210519-1834-025.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.46+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147105	ncm-et-15	2021-05-20 22:52	01:13:46	1976537	500	402	1	97	+383.64 +/- 34.77	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3593727483 \ -pgnout /tmp/ncm-dbt-20210519-1834-024.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.28+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147104	ncm-et-10	2021-05-20 22:50	01:14:23	1947065	500	395	4	101	+364.98 +/- 34.16	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4203808107 \ -pgnout /tmp/ncm-dbt-20210519-1834-023.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.65+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147103	ncm-et-3	2021-05-20 22:49	01:13:45	1973585	500	411	1	88	+401.92 +/- 36.6	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2971200562 \ -pgnout /tmp/ncm-dbt-20210519-1834-022.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.32+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147102	ncm-et-9	2021-05-20 22:48	01:16:08	1942441	500	408	5	87	+387.57 +/- 36.91	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1829125254 \ -pgnout /tmp/ncm-dbt-20210519-1834-021.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.71+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147101	ncm-et-13	2021-05-20 22:48	01:13:51	1956964	500	414	1	85	+408.38 +/- 37.27	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4083716626 \ -pgnout /tmp/ncm-dbt-20210519-1834-020.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.53+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147100	ncm-et-4	2021-05-20 22:47	01:14:45	1946826	500	395	1	104	+370.41 +/- 33.52	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3000633195 \ -pgnout /tmp/ncm-dbt-20210519-1834-019.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.66+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147099	ncm-et-15	2021-05-20 21:36	01:14:58	1947303	500	400	0	100	+381.69 +/- 34.16	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3690970169 \ -pgnout /tmp/ncm-dbt-20210519-1834-018.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.65+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147098	ncm-et-10	2021-05-20 21:36	01:14:14	1955437	500	391	1	108	+363.2 +/- 32.86	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3369232092 \ -pgnout /tmp/ncm-dbt-20210519-1834-017.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.55+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147097	ncm-et-4	2021-05-20 21:35	01:11:34	1961269	500	393	3	104	+363.2 +/- 33.62	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1075496857 \ -pgnout /tmp/ncm-dbt-20210519-1834-016.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.47+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147096	ncm-et-9	2021-05-20 21:34	01:13:36	1967853	500	411	0	89	+404.05 +/- 36.31	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 415097187 \ -pgnout /tmp/ncm-dbt-20210519-1834-015.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.39+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147095	ncm-et-13	2021-05-20 21:34	01:13:20	1960622	500	419	1	80	+419.61 +/- 38.47	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2123694787 \ -pgnout /tmp/ncm-dbt-20210519-1834-014.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147094	ncm-et-3	2021-05-20 21:34	01:14:58	1955671	500	396	1	103	+372.25 +/- 33.69	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3082013834 \ -pgnout /tmp/ncm-dbt-20210519-1834-013.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147093	ncm-et-10	2021-05-20 20:22	01:13:03	1953891	500	409	3	88	+393.6 +/- 36.68	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2621829123 \ -pgnout /tmp/ncm-dbt-20210519-1834-012.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.57+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147092	ncm-et-13	2021-05-20 20:20	01:12:47	1967553	500	397	4	99	+368.59 +/- 34.52	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1222840450 \ -pgnout /tmp/ncm-dbt-20210519-1834-011.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.40+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147091	ncm-et-9	2021-05-20 20:20	01:13:35	1971748	500	398	3	99	+372.25 +/- 34.49	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2002605189 \ -pgnout /tmp/ncm-dbt-20210519-1834-010.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.34+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147090	ncm-et-4	2021-05-20 20:20	01:14:31	1965867	500	408	3	89	+391.57 +/- 36.46	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3617655499 \ -pgnout /tmp/ncm-dbt-20210519-1834-009.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.42+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147089	ncm-et-15	2021-05-20 20:20	01:15:46	1939926	500	393	3	104	+363.2 +/- 33.62	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4170490174 \ -pgnout /tmp/ncm-dbt-20210519-1834-008.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.74+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147088	ncm-et-3	2021-05-20 20:19	01:13:30	1971873	500	426	2	72	+433.94 +/- 40.69	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2884299636 \ -pgnout /tmp/ncm-dbt-20210519-1834-007.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.34+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147087	ncm-et-9	2021-05-20 19:06	01:13:15	1969398	500	400	5	95	+372.25 +/- 35.28	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 234045888 \ -pgnout /tmp/ncm-dbt-20210519-1834-006.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.37+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147086	ncm-et-10	2021-05-20 19:06	01:15:31	1957405	500	411	1	88	+401.92 +/- 36.6	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 358315359 \ -pgnout /tmp/ncm-dbt-20210519-1834-005.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147085	ncm-et-15	2021-05-20 19:06	01:13:13	1969247	500	423	3	74	+424.28 +/- 40.13	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1671698934 \ -pgnout /tmp/ncm-dbt-20210519-1834-004.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.37+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147084	ncm-et-4	2021-05-20 19:06	01:13:24	1972349	500	401	3	96	+377.87 +/- 35.05	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 918333197 \ -pgnout /tmp/ncm-dbt-20210519-1834-003.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.34+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147083	ncm-et-3	2021-05-20 19:06	01:13:07	1962457	500	420	1	79	+421.93 +/- 38.73	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3650632828 \ -pgnout /tmp/ncm-dbt-20210519-1834-002.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.46+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
147082	ncm-et-13	2021-05-20 19:06	01:13:57	1963845	500	411	2	87	+399.81 +/- 36.87	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3450668046 \ -pgnout /tmp/ncm-dbt-20210519-1834-001.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.44+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210519-1834 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:754fc8a8b5ca7466926d54465eeb1df4d4a481ac \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7

Commit

Commit ID	754fc8a8b5ca7466926d54465eeb1df4d4a481ac
Author	Stéphane Nicolet
Date	2021-05-19 18:34:37 UTC
Remove Tempo The Tempo variable was introduced 10 years ago in our search because the classical evaluation function was antisymmetrical in White and Black by design to gain speed: Eval(White to play) = -Eval(Black to play) Nowadays our neural networks know which side is to play in a position when they evaluate a position and are trained on real games, so the neural network encodes the advantage of moving as an output of search. This patch shows that the Tempo variable is not necessary anymore. STC: LLR: 2.94 (-2.94,2.94) <-2.50,0.50> Total: 33512 W: 2805 L: 2709 D: 27998 Ptnml(0-2): 80, 2209, 12095, 2279, 93 https://tests.stockfishchess.org/tests/view/60a44ceace8ea25a3ef03d30 LTC: LLR: 2.95 (-2.94,2.94) <-2.50,0.50> Total: 53920 W: 1807 L: 1760 D: 50353 Ptnml(0-2): 16, 1617, 23650, 1658, 19 https://tests.stockfishchess.org/tests/view/60a477f0ce8ea25a3ef03d49 We also tried a match (20000 games) at STC using purely classical, result was neutral: https://tests.stockfishchess.org/tests/view/60a4eebcce8ea25a3ef03db5 Note: there are two locations left in search.cpp where we assume antisymmetry of evaluation (in relation with a speed optimization for null moves in lines 770 and 1439), but as the values are just used for heuristic pruning this approximation should not hurt too much because the order of magnitude is still true most of the time. closes https://github.com/official-stockfish/Stockfish/pull/3481 Bench: 4015864