Dev Builds » 20230218-1223

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	Wins	Losses	Draws	Elo
ncm-et-3	09:38:26	1957702	3358	2889	5	464	+447.82 +/- 15.82
ncm-et-4	09:38:46	1950266	3324	2848	5	471	+443.17 +/- 15.7
ncm-et-9	09:38:21	1950179	3314	2848	7	459	+445.75 +/- 15.91
ncm-et-10	09:38:48	1952362	3317	2853	2	462	+448.7 +/- 15.84
ncm-et-13	09:38:38	1956538	3365	2900	4	461	+450.19 +/- 15.87
ncm-et-15	09:38:49	1951443	3322	2861	5	456	+448.98 +/- 15.96
			20000	17199	28	2773	+447.43 +/- 6.46

Test Detail

ID	Host	Started (UTC)	Duration	Base NPS	Games	Wins	Losses	Draws	Elo
177469	ncm-et-9	2023-03-13 07:13	00:54:17	1959088	314	281	0	33	+502.39 +/- 61.26
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 2021514542 \ -pgnout /tmp/ncm-dbt-20230218-1223-066.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.50+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177468	ncm-et-10	2023-03-13 07:12	00:54:47	1951186	317	268	0	49	+430.78 +/- 49.5
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 1462671443 \ -pgnout /tmp/ncm-dbt-20230218-1223-065.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.60+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177467	ncm-et-15	2023-03-13 07:11	00:55:55	1955317	322	278	0	44	+453.87 +/- 52.45
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 4244113392 \ -pgnout /tmp/ncm-dbt-20230218-1223-064.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.55+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177466	ncm-et-4	2023-03-13 07:09	00:57:34	1920249	324	288	0	36	+492.17 +/- 58.44
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 1709584723 \ -pgnout /tmp/ncm-dbt-20230218-1223-063.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=25.00+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177465	ncm-et-3	2023-03-13 07:06	01:01:06	1959306	358	314	0	44	+473.56 +/- 52.51
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 2919665852 \ -pgnout /tmp/ncm-dbt-20230218-1223-062.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.50+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177464	ncm-et-13	2023-03-13 07:05	01:01:33	1950597	365	307	0	58	+425.57 +/- 45.33
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 1098856876 \ -pgnout /tmp/ncm-dbt-20230218-1223-061.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.61+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177445	ncm-et-9	2023-03-13 05:45	01:27:17	1950441	500	428	0	72	+444.08 +/- 40.59
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 2779832350 \ -pgnout /tmp/ncm-dbt-20230218-1223-060.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.61+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177444	ncm-et-10	2023-03-13 05:45	01:27:01	1953615	500	429	1	70	+444.09 +/- 41.26
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 3475687821 \ -pgnout /tmp/ncm-dbt-20230218-1223-059.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.57+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177443	ncm-et-15	2023-03-13 05:43	01:27:40	1949657	500	431	0	69	+452.04 +/- 41.5
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 3253023032 \ -pgnout /tmp/ncm-dbt-20230218-1223-058.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.62+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177442	ncm-et-4	2023-03-13 05:41	01:28:04	1939864	500	426	0	74	+438.95 +/- 40.01
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 1056557582 \ -pgnout /tmp/ncm-dbt-20230218-1223-057.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.74+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177441	ncm-et-3	2023-03-13 05:39	01:26:20	1954226	500	423	0	77	+431.48 +/- 39.18
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 3212995810 \ -pgnout /tmp/ncm-dbt-20230218-1223-056.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177440	ncm-et-13	2023-03-13 05:37	01:27:07	1951241	500	444	0	56	+490.71 +/- 46.32
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 3237736632 \ -pgnout /tmp/ncm-dbt-20230218-1223-055.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.60+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177421	ncm-et-9	2023-03-13 04:17	01:27:05	1956057	500	432	2	66	+449.35 +/- 42.58
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 1711513723 \ -pgnout /tmp/ncm-dbt-20230218-1223-054.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177420	ncm-et-10	2023-03-13 04:17	01:27:05	1941936	500	439	1	60	+471.92 +/- 44.73
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 2339731951 \ -pgnout /tmp/ncm-dbt-20230218-1223-053.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.72+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177419	ncm-et-4	2023-03-13 04:15	01:24:41	1962822	500	416	0	84	+415.04 +/- 37.43
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 2975682096 \ -pgnout /tmp/ncm-dbt-20230218-1223-052.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.45+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177418	ncm-et-15	2023-03-13 04:15	01:26:56	1950151	500	433	2	65	+452.04 +/- 42.92
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 2619068657 \ -pgnout /tmp/ncm-dbt-20230218-1223-051.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.61+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177417	ncm-et-13	2023-03-13 04:12	01:24:42	1961535	500	436	1	63	+463.16 +/- 43.6
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 559222800 \ -pgnout /tmp/ncm-dbt-20230218-1223-050.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.47+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177416	ncm-et-3	2023-03-13 04:12	01:26:28	1946455	500	426	1	73	+436.43 +/- 40.36
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 1737236363 \ -pgnout /tmp/ncm-dbt-20230218-1223-049.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.66+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177403	ncm-et-10	2023-03-13 02:51	01:25:29	1960321	500	418	0	82	+419.61 +/- 37.91
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 4205304304 \ -pgnout /tmp/ncm-dbt-20230218-1223-048.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177396	ncm-et-9	2023-03-13 02:49	01:27:31	1954659	500	416	1	83	+412.8 +/- 37.74
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 649470999 \ -pgnout /tmp/ncm-dbt-20230218-1223-047.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177395	ncm-et-15	2023-03-13 02:47	01:27:07	1956434	500	435	1	64	+460.32 +/- 43.24
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 2559647838 \ -pgnout /tmp/ncm-dbt-20230218-1223-046.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.53+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177394	ncm-et-4	2023-03-13 02:47	01:27:29	1958351	500	439	0	61	+474.93 +/- 44.28
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 1902471592 \ -pgnout /tmp/ncm-dbt-20230218-1223-045.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177393	ncm-et-3	2023-03-13 02:46	01:25:08	1965927	500	425	2	73	+431.48 +/- 40.4
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 4218735325 \ -pgnout /tmp/ncm-dbt-20230218-1223-044.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.42+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177392	ncm-et-13	2023-03-13 02:45	01:26:30	1954397	500	412	2	86	+401.92 +/- 37.09
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 1184303104 \ -pgnout /tmp/ncm-dbt-20230218-1223-043.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177384	ncm-et-10	2023-03-13 01:22	01:27:33	1955578	500	431	0	69	+452.04 +/- 41.5
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 3015766458 \ -pgnout /tmp/ncm-dbt-20230218-1223-042.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.55+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177383	ncm-et-9	2023-03-13 01:21	01:27:11	1932481	500	433	2	65	+452.04 +/- 42.92
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 4228581159 \ -pgnout /tmp/ncm-dbt-20230218-1223-041.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.84+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177382	ncm-et-15	2023-03-13 01:20	01:26:38	1950145	500	422	0	78	+429.05 +/- 38.92
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 4049012737 \ -pgnout /tmp/ncm-dbt-20230218-1223-040.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.61+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177381	ncm-et-4	2023-03-13 01:19	01:27:04	1953490	500	426	2	72	+433.94 +/- 40.69
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 3451293390 \ -pgnout /tmp/ncm-dbt-20230218-1223-039.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.57+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177380	ncm-et-13	2023-03-13 01:19	01:25:10	1965081	500	445	0	55	+494.02 +/- 46.77
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 3718750849 \ -pgnout /tmp/ncm-dbt-20230218-1223-038.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.43+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177379	ncm-et-3	2023-03-13 01:19	01:26:12	1962482	500	437	0	63	+468.95 +/- 43.54
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 728039229 \ -pgnout /tmp/ncm-dbt-20230218-1223-037.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.46+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177363	ncm-et-10	2023-03-12 23:53	01:28:21	1956345	500	442	0	58	+484.24 +/- 45.47
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 2516937883 \ -pgnout /tmp/ncm-dbt-20230218-1223-036.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177362	ncm-et-15	2023-03-12 23:53	01:26:44	1953739	500	437	1	62	+466.04 +/- 43.97
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 1478402507 \ -pgnout /tmp/ncm-dbt-20230218-1223-035.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.57+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177361	ncm-et-9	2023-03-12 23:52	01:28:17	1947228	500	435	1	64	+460.32 +/- 43.24
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 2302825741 \ -pgnout /tmp/ncm-dbt-20230218-1223-034.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.65+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177360	ncm-et-4	2023-03-12 23:52	01:27:11	1958469	500	416	2	82	+410.58 +/- 38.02
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 3625782226 \ -pgnout /tmp/ncm-dbt-20230218-1223-033.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177359	ncm-et-3	2023-03-12 23:50	01:27:54	1951326	500	438	2	60	+466.04 +/- 44.75
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 4247875311 \ -pgnout /tmp/ncm-dbt-20230218-1223-032.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.60+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177358	ncm-et-13	2023-03-12 23:50	01:28:24	1944453	500	425	0	75	+436.43 +/- 39.73
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 4169717833 \ -pgnout /tmp/ncm-dbt-20230218-1223-031.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.69+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177347	ncm-et-9	2023-03-12 22:25	01:26:43	1951304	500	423	1	76	+429.05 +/- 39.52
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 2459310921 \ -pgnout /tmp/ncm-dbt-20230218-1223-030.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.60+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177346	ncm-et-3	2023-03-12 22:24	01:25:18	1964194	500	426	0	74	+438.95 +/- 40.01
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 454968595 \ -pgnout /tmp/ncm-dbt-20230218-1223-029.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.44+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177345	ncm-et-15	2023-03-12 22:24	01:27:49	1944663	500	425	1	74	+433.94 +/- 40.08
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 1567898177 \ -pgnout /tmp/ncm-dbt-20230218-1223-028.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.68+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177344	ncm-et-10	2023-03-12 22:24	01:28:32	1947555	500	426	0	74	+438.95 +/- 40.01
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 649658513 \ -pgnout /tmp/ncm-dbt-20230218-1223-027.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.65+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177343	ncm-et-13	2023-03-12 22:24	01:25:12	1968467	500	431	1	68	+449.35 +/- 41.89
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 3650954039 \ -pgnout /tmp/ncm-dbt-20230218-1223-026.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.38+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
177342	ncm-et-4	2023-03-12 22:24	01:26:43	1958622	500	437	1	62	+466.04 +/- 43.97
cutechess-cli \ -debug \ -games 500 \ -concurrency 7 \ -srand 1463314437 \ -pgnout /tmp/ncm-dbt-20230218-1223-025.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20230218-1223 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7

Commit

Commit ID	2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8
Author	MinetaS
Date	2023-02-18 12:23:18 UTC
Fix overflow in add_dpbusd_epi32x2 This patch fixes 16bit overflow in _add_dpbusd_epi32x2 functions, that can be triggered in rare cases depending on the NNUE weights. While the code leads to some slowdown on affected architectures (most notably avx2), the fix is simpler than some of the other options discussed in https://github.com/official-stockfish/Stockfish/pull/4394 Code suggested by Sopel97. Result of "bench 4096 1 30 default depth nnue": \| Architecture \| master \| patch (gcc) \| patch (clang) \| \|---------------------\|-----------\|-------------\|---------------\| \| x86-64-vnni512 \| 762122798 \| 762122798 \| 762122798 \| \| x86-64-avx512 \| 769723503 \| 762122798 \| 762122798 \| \| x86-64-bmi2 \| 769723503 \| 762122798 \| 762122798 \| \| x86-64-ssse3 \| 769723503 \| 762122798 \| 762122798 \| \| x86-64 \| 762122798 \| 762122798 \| 762122798 \| Following architectures will experience ~4% slowdown due to an additional instruction in the middle of hot path: x86-64-avx512 * x86-64-bmi2 * x86-64-avx2 * x86-64-sse41-popcnt (x86-64-modern) * x86-64-ssse3 * x86-32-sse41-popcnt This patch clearly loses Elo against master with both STC and LTC. Failed non-regression STC (256bit fix only): LLR: -2.95 (-2.94,2.94) <-1.75,0.25> Total: 33528 W: 8769 L: 9049 D: 15710 Ptnml(0-2): 96, 3616, 9600, 3376, 76 https://tests.stockfishchess.org/tests/view/63e6a5b44299542b1e26a485 60+0.6 @ 30000 games: Elo: -1.67 +-1.7 (95%) LOS: 2.8% Total: 30000 W: 7848 L: 7992 D: 14160 Ptnml(0-2): 12, 2847, 9436, 2683, 22 nElo: -3.84 +-3.9 (95%) PairsRatio: 0.95 https://tests.stockfishchess.org/tests/view/63e7ac716d0e1db55f35a660 However, a test against nn-a3dc078bafc7.nnue, which is the latest "safe" network not causing the bug, passed with regular bounds. Passed STC: LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 160456 W: 42658 L: 42175 D: 75623 Ptnml(0-2): 487, 17638, 43469, 18173, 461 https://tests.stockfishchess.org/tests/view/63e89836d62a5d02b0fa82c8 closes https://github.com/official-stockfish/Stockfish/pull/4391 closes https://github.com/official-stockfish/Stockfish/pull/4394 No functional change