Dev Builds » 20210614-0724

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	Wins	Losses	Draws	Elo
ncm-et-3	08:28:37	1969945	3359	2784	12	563	+407.56 +/- 14.36
ncm-et-4	08:28:45	1963703	3342	2773	20	549	+405.94 +/- 14.55
ncm-et-9	08:28:41	1958864	3338	2686	14	638	+382.16 +/- 13.47
ncm-et-10	08:28:41	1953471	3305	2711	13	581	+398.07 +/- 14.13
ncm-et-13	08:28:45	1960610	3342	2791	13	538	+414.19 +/- 14.69
ncm-et-15	08:28:39	1955319	3314	2715	15	584	+396.4 +/- 14.1
			20000	16460	87	3453	+400.49 +/- 5.79

Test Detail

ID	Host	Started (UTC)	Duration	Base NPS	Games	Wins	Losses	Draws	Elo	PGN
148615	ncm-et-10	2021-06-15 04:23	00:47:35	1948284	305	254	0	51	+415.93 +/- 48.42	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1890047830 \ -pgnout /tmp/ncm-dbt-20210614-0724-042.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.64+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148614	ncm-et-15	2021-06-15 04:21	00:49:28	1942814	314	271	1	42	+449.18 +/- 53.87	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3920619126 \ -pgnout /tmp/ncm-dbt-20210614-0724-041.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.71+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148613	ncm-et-9	2021-06-15 04:19	00:52:09	1957557	338	269	3	66	+369.48 +/- 42.49	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1198114191 \ -pgnout /tmp/ncm-dbt-20210614-0724-040.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148612	ncm-et-13	2021-06-15 04:19	00:52:18	1962458	342	275	1	66	+382.83 +/- 42.39	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 530191794 \ -pgnout /tmp/ncm-dbt-20210614-0724-039.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.46+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148611	ncm-et-4	2021-06-15 04:18	00:53:30	1954651	342	291	3	48	+426.78 +/- 50.18	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4129817299 \ -pgnout /tmp/ncm-dbt-20210614-0724-038.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148610	ncm-et-3	2021-06-15 04:17	00:54:18	1978576	359	304	2	53	+425.73 +/- 47.68	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2130267125 \ -pgnout /tmp/ncm-dbt-20210614-0724-037.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.26+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148609	ncm-et-10	2021-06-15 03:06	01:17:01	1952220	500	423	0	77	+431.48 +/- 39.18	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4288981413 \ -pgnout /tmp/ncm-dbt-20210614-0724-036.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.59+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148608	ncm-et-15	2021-06-15 03:05	01:15:33	1966781	500	407	3	90	+389.56 +/- 36.25	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1348429747 \ -pgnout /tmp/ncm-dbt-20210614-0724-035.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.41+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148607	ncm-et-9	2021-06-15 03:03	01:15:11	1964471	500	401	2	97	+379.78 +/- 34.83	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 297549543 \ -pgnout /tmp/ncm-dbt-20210614-0724-034.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.43+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148606	ncm-et-3	2021-06-15 03:01	01:14:56	1972649	500	425	0	75	+436.43 +/- 39.73	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1302649375 \ -pgnout /tmp/ncm-dbt-20210614-0724-033.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.33+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148605	ncm-et-13	2021-06-15 03:01	01:17:19	1958627	500	423	1	76	+429.05 +/- 39.52	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 26462592 \ -pgnout /tmp/ncm-dbt-20210614-0724-032.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148604	ncm-et-4	2021-06-15 03:00	01:16:33	1957727	500	407	3	90	+389.56 +/- 36.25	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1899667120 \ -pgnout /tmp/ncm-dbt-20210614-0724-031.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148603	ncm-et-10	2021-06-15 01:47	01:17:39	1955155	500	427	4	69	+431.48 +/- 41.59	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1598471823 \ -pgnout /tmp/ncm-dbt-20210614-0724-030.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.55+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148602	ncm-et-15	2021-06-15 01:47	01:17:21	1937965	500	427	0	73	+441.5 +/- 40.29	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1073561251 \ -pgnout /tmp/ncm-dbt-20210614-0724-029.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.77+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148601	ncm-et-13	2021-06-15 01:45	01:15:34	1961536	500	423	4	73	+421.93 +/- 40.4	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4122675656 \ -pgnout /tmp/ncm-dbt-20210614-0724-028.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.47+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148600	ncm-et-4	2021-06-15 01:44	01:15:23	1968622	500	409	3	88	+393.6 +/- 36.68	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2846013359 \ -pgnout /tmp/ncm-dbt-20210614-0724-027.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.38+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148599	ncm-et-3	2021-06-15 01:44	01:16:08	1975297	500	405	3	92	+385.59 +/- 35.84	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4270842226 \ -pgnout /tmp/ncm-dbt-20210614-0724-026.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.30+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148598	ncm-et-9	2021-06-15 01:44	01:18:08	1949193	500	405	1	94	+389.56 +/- 35.35	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3438622368 \ -pgnout /tmp/ncm-dbt-20210614-0724-025.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.63+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148597	ncm-et-10	2021-06-15 00:30	01:16:19	1952069	500	411	2	87	+399.81 +/- 36.87	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3498234432 \ -pgnout /tmp/ncm-dbt-20210614-0724-024.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.59+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148596	ncm-et-15	2021-06-15 00:29	01:17:12	1955720	500	392	2	106	+363.2 +/- 33.24	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1938406418 \ -pgnout /tmp/ncm-dbt-20210614-0724-023.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148595	ncm-et-4	2021-06-15 00:28	01:15:51	1967234	500	434	3	63	+452.04 +/- 43.62	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 36238050 \ -pgnout /tmp/ncm-dbt-20210614-0724-022.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.40+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148594	ncm-et-3	2021-06-15 00:27	01:16:18	1962929	500	410	0	90	+401.92 +/- 36.1	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3624796786 \ -pgnout /tmp/ncm-dbt-20210614-0724-021.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.45+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148593	ncm-et-9	2021-06-15 00:27	01:16:22	1955719	500	396	3	101	+368.59 +/- 34.13	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4079641922 \ -pgnout /tmp/ncm-dbt-20210614-0724-020.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148592	ncm-et-13	2021-06-15 00:25	01:18:33	1954687	500	423	1	76	+429.05 +/- 39.52	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4199344865 \ -pgnout /tmp/ncm-dbt-20210614-0724-019.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148591	ncm-et-10	2021-06-14 23:14	01:16:08	1953290	500	397	1	102	+374.11 +/- 33.87	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3151607593 \ -pgnout /tmp/ncm-dbt-20210614-0724-018.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.57+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148590	ncm-et-15	2021-06-14 23:12	01:16:30	1961433	500	406	4	90	+385.59 +/- 36.27	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1182195757 \ -pgnout /tmp/ncm-dbt-20210614-0724-017.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.47+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148589	ncm-et-4	2021-06-14 23:12	01:15:32	1966501	500	398	1	101	+375.98 +/- 34.04	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 189841683 \ -pgnout /tmp/ncm-dbt-20210614-0724-016.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.41+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148588	ncm-et-9	2021-06-14 23:11	01:15:17	1963406	500	404	0	96	+389.56 +/- 34.9	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2672396007 \ -pgnout /tmp/ncm-dbt-20210614-0724-015.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.45+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148587	ncm-et-3	2021-06-14 23:11	01:15:30	1965075	500	418	3	79	+412.8 +/- 38.79	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 433493444 \ -pgnout /tmp/ncm-dbt-20210614-0724-014.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.43+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148586	ncm-et-13	2021-06-14 23:09	01:15:41	1960350	500	415	1	84	+410.58 +/- 37.5	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 900934648 \ -pgnout /tmp/ncm-dbt-20210614-0724-013.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148585	ncm-et-10	2021-06-14 21:57	01:15:40	1954959	500	403	1	96	+385.59 +/- 34.96	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3672038080 \ -pgnout /tmp/ncm-dbt-20210614-0724-012.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.55+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148584	ncm-et-4	2021-06-14 21:55	01:15:38	1968420	500	414	5	81	+399.81 +/- 38.28	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1476757955 \ -pgnout /tmp/ncm-dbt-20210614-0724-011.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.39+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148583	ncm-et-9	2021-06-14 21:55	01:15:32	1960467	500	405	3	92	+385.59 +/- 35.84	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 4140786495 \ -pgnout /tmp/ncm-dbt-20210614-0724-010.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148582	ncm-et-3	2021-06-14 21:55	01:15:46	1969244	500	416	2	82	+410.58 +/- 38.02	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3069243294 \ -pgnout /tmp/ncm-dbt-20210614-0724-009.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.37+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148581	ncm-et-15	2021-06-14 21:54	01:17:23	1954046	500	404	3	93	+383.64 +/- 35.64	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 464333408 \ -pgnout /tmp/ncm-dbt-20210614-0724-008.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148580	ncm-et-13	2021-06-14 21:54	01:14:15	1965689	500	409	5	86	+389.56 +/- 37.13	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1747067896 \ -pgnout /tmp/ncm-dbt-20210614-0724-007.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.42+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148579	ncm-et-3	2021-06-14 20:38	01:15:41	1965845	500	406	2	92	+389.56 +/- 35.8	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 2714950751 \ -pgnout /tmp/ncm-dbt-20210614-0724-006.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.42+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148578	ncm-et-4	2021-06-14 20:38	01:16:18	1962772	500	420	2	78	+419.61 +/- 39.03	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 3708997520 \ -pgnout /tmp/ncm-dbt-20210614-0724-005.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.46+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148577	ncm-et-9	2021-06-14 20:38	01:16:02	1961239	500	406	2	92	+389.56 +/- 35.8	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1263631053 \ -pgnout /tmp/ncm-dbt-20210614-0724-003.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.47+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148576	ncm-et-10	2021-06-14 20:38	01:18:19	1958320	500	396	5	99	+364.98 +/- 34.53	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 1661483187 \ -pgnout /tmp/ncm-dbt-20210614-0724-003.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148575	ncm-et-13	2021-06-14 20:38	01:15:05	1960925	500	423	0	77	+431.48 +/- 39.18	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 602020119 \ -pgnout /tmp/ncm-dbt-20210614-0724-002.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
148574	ncm-et-15	2021-06-14 20:38	01:15:12	1968479	500	408	2	90	+393.6 +/- 36.22	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 8 \ -srand 85696897 \ -pgnout /tmp/ncm-dbt-20210614-0724-001.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.38+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20210614-0724 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:f8c779dbe538315aa6f65556d0acf11640558504 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7

Commit

Commit ID	f8c779dbe538315aa6f65556d0acf11640558504
Author	JWmer
Date	2021-06-14 07:24:07 UTC
Update default net to nn-8e47cf062333.nnue This net is the result of training on data used by the Leela project. More precisely, we shuffled T60 and T74 data kindly provided by borg (for different Tnn, the data is a result of Leela selfplay with differently sized Leela nets). The data is available at vondele's google drive: https://drive.google.com/drive/folders/1mftuzYdl9o6tBaceR3d_VBQIrgKJsFpl. The Leela data comes in small chunks of .binpack files. To shuffle them, we simply used a small python script to randomly rename the files, and then concatenated them using `cat`. As validation data we picked a file of T60 data. We will further investigate T74 data. The training for the NNUE architecture used 200 epochs with the Python trainer from the Stockfish project. Unlike the previous run we tried with this data, this run does not have adjusted scaling — not because we didn't want to, but because we forgot. However, this training randomly skips 40% more positions than previous run. The loss was very spiky and decreased slower than it does usually. Training loss: https://github.com/official-stockfish/images/blob/main/training-loss-8e47cf062333.png Validation loss: https://github.com/official-stockfish/images/blob/main/validation-loss-8e47cf062333.png This is the exact training command: python train.py --smart-fen-skipping --random-fen-skipping 14 --batch-size 16384 --threads 4 --num-workers 4 --gpus 1 trainingdata\training_data.binpack validationdata\val.binpack --- 10k STC result: ELO: 3.61 +-3.3 (95%) LOS: 98.4% Total: 10000 W: 1241 L: 1137 D: 7622 Ptnml(0-2): 68, 841, 3086, 929, 76 https://tests.stockfishchess.org/tests/view/60c67e50457376eb8bcaae70 10k LTC result: ELO: 2.71 +-2.4 (95%) LOS: 98.8% Total: 10000 W: 659 L: 581 D: 8760 Ptnml(0-2): 22, 485, 3900, 579, 14 https://tests.stockfishchess.org/tests/view/60c69deb457376eb8bcaae98 Passed LTC: LLR: 2.93 (-2.94,2.94) <0.50,3.50> Total: 9648 W: 685 L: 545 D: 8418 Ptnml(0-2): 22, 448, 3740, 596, 18 https://tests.stockfishchess.org/tests/view/60c6d41c457376eb8bcaaecf --- closes https://github.com/official-stockfish/Stockfish/pull/3550 Bench: 4877339