Dev Builds » 20180808-1534

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	Wins	Losses	Draws	Elo
ncm-et-3	08:38:19	1990235	3374	1721	99	1554	+182.04 +/- 8.47
ncm-et-4	08:38:36	1987543	3377	1726	101	1550	+182.24 +/- 8.49
ncm-et-9	08:38:30	1989086	3368	1743	84	1541	+187.43 +/- 8.49
ncm-et-10	08:38:28	1950852	3316	1692	98	1526	+182.02 +/- 8.55
ncm-et-13	08:38:11	1975836	3329	1752	86	1491	+191.06 +/- 8.65
ncm-et-15	08:38:04	1925488	3236	1654	94	1488	+182.64 +/- 8.65
			20000	10288	562	9150	+184.56 +/- 3.49

Test Detail

ID	Host	Started (UTC)	Duration	Base NPS	Games	Wins	Losses	Draws	Elo	PGN
49116	ncm-et-15	2018-08-09 10:09	00:35:41	1982165	236	115	8	113	+169.88 +/- 31.49	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 172219514 \ -pgnout /tmp/ncm-dbt-20180808-1534-042.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.22+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49115	ncm-et-10	2018-08-09 09:55	00:49:14	1935403	316	154	11	151	+169.51 +/- 27.23	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2499896914 \ -pgnout /tmp/ncm-dbt-20180808-1534-041.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.80+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49114	ncm-et-13	2018-08-09 09:53	00:51:28	1979864	329	170	5	154	+191.55 +/- 26.65	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 199545694 \ -pgnout /tmp/ncm-dbt-20180808-1534-040.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.24+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49113	ncm-et-9	2018-08-09 09:47	00:57:20	1992722	368	198	7	163	+199.78 +/- 26.15	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2614961124 \ -pgnout /tmp/ncm-dbt-20180808-1534-039.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.09+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49112	ncm-et-3	2018-08-09 09:47	00:57:37	1989401	374	189	14	171	+176.29 +/- 25.73	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3573708035 \ -pgnout /tmp/ncm-dbt-20180808-1534-038.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.13+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49111	ncm-et-4	2018-08-09 09:46	00:58:14	1987981	377	184	12	181	+171.13 +/- 24.8	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1267867881 \ -pgnout /tmp/ncm-dbt-20180808-1534-037.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.15+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49110	ncm-et-15	2018-08-09 08:51	01:16:25	1982954	500	252	14	234	+179.9 +/- 21.81	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3416957111 \ -pgnout /tmp/ncm-dbt-20180808-1534-036.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.21+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49109	ncm-et-10	2018-08-09 08:37	01:17:35	1981068	500	246	15	239	+173.67 +/- 21.55	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3258295579 \ -pgnout /tmp/ncm-dbt-20180808-1534-035.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.23+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49108	ncm-et-13	2018-08-09 08:32	01:19:31	1916753	500	249	15	236	+176.33 +/- 21.72	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3607979352 \ -pgnout /tmp/ncm-dbt-20180808-1534-034.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=25.04+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49107	ncm-et-3	2018-08-09 08:29	01:16:43	1990665	500	254	14	232	+181.7 +/- 21.92	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1008098487 \ -pgnout /tmp/ncm-dbt-20180808-1534-033.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.11+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49106	ncm-et-9	2018-08-09 08:29	01:17:15	1989875	500	258	4	238	+194.57 +/- 21.21	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 266472255 \ -pgnout /tmp/ncm-dbt-20180808-1534-032.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.12+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49105	ncm-et-4	2018-08-09 08:28	01:17:02	1975749	500	243	13	244	+172.78 +/- 21.21	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 784807375 \ -pgnout /tmp/ncm-dbt-20180808-1534-031.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.29+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49104	ncm-et-15	2018-08-09 07:32	01:17:33	1984519	500	268	17	215	+191.78 +/- 23.02	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2799397009 \ -pgnout /tmp/ncm-dbt-20180808-1534-030.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.19+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49103	ncm-et-10	2018-08-09 07:17	01:18:49	1908326	500	258	15	227	+184.42 +/- 22.24	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2817968251 \ -pgnout /tmp/ncm-dbt-20180808-1534-029.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=25.15+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49102	ncm-et-13	2018-08-09 07:14	01:16:52	1988612	500	278	12	210	+206.01 +/- 23.21	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 531698437 \ -pgnout /tmp/ncm-dbt-20180808-1534-028.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.14+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49101	ncm-et-3	2018-08-09 07:11	01:16:55	1990664	500	260	15	225	+186.25 +/- 22.36	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2601260913 \ -pgnout /tmp/ncm-dbt-20180808-1534-027.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.11+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49100	ncm-et-9	2018-08-09 07:11	01:16:39	1988771	500	260	15	225	+186.25 +/- 22.36	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2883349554 \ -pgnout /tmp/ncm-dbt-20180808-1534-026.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.14+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49099	ncm-et-4	2018-08-09 07:08	01:18:47	1988612	500	248	15	237	+175.44 +/- 21.67	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1379293007 \ -pgnout /tmp/ncm-dbt-20180808-1534-025.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.14+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49098	ncm-et-15	2018-08-09 06:07	01:24:00	1826280	500	248	16	236	+174.55 +/- 21.75	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1781638040 \ -pgnout /tmp/ncm-dbt-20180808-1534-024.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=26.28+0.26 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49097	ncm-et-10	2018-08-09 05:59	01:16:52	1982949	500	279	16	205	+203.11 +/- 23.63	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 4055427373 \ -pgnout /tmp/ncm-dbt-20180808-1534-023.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.21+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49096	ncm-et-13	2018-08-09 05:57	01:16:04	1985305	500	259	16	225	+184.42 +/- 22.39	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1585482471 \ -pgnout /tmp/ncm-dbt-20180808-1534-022.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.18+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49095	ncm-et-3	2018-08-09 05:54	01:16:27	1989874	500	254	7	239	+188.08 +/- 21.28	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3482522999 \ -pgnout /tmp/ncm-dbt-20180808-1534-021.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.12+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49094	ncm-et-9	2018-08-09 05:53	01:16:38	1987666	500	261	13	226	+189.0 +/- 22.25	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1104753346 \ -pgnout /tmp/ncm-dbt-20180808-1534-020.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.15+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49093	ncm-et-4	2018-08-09 05:52	01:14:58	1991139	500	264	15	221	+189.92 +/- 22.6	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1640478043 \ -pgnout /tmp/ncm-dbt-20180808-1534-019.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.11+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49092	ncm-et-15	2018-08-09 04:44	01:21:52	1908361	500	252	10	238	+183.51 +/- 21.45	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 474742922 \ -pgnout /tmp/ncm-dbt-20180808-1534-018.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=25.15+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49091	ncm-et-13	2018-08-09 04:38	01:18:04	1987825	500	250	13	237	+179.0 +/- 21.61	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3224169135 \ -pgnout /tmp/ncm-dbt-20180808-1534-017.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.15+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49090	ncm-et-10	2018-08-09 04:37	01:21:00	1914372	500	245	12	243	+175.44 +/- 21.24	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2256842268 \ -pgnout /tmp/ncm-dbt-20180808-1534-016.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=25.07+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49089	ncm-et-3	2018-08-09 04:35	01:17:17	1990348	500	250	20	230	+172.78 +/- 22.18	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3424211243 \ -pgnout /tmp/ncm-dbt-20180808-1534-015.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.12+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49088	ncm-et-9	2018-08-09 04:35	01:17:47	1988454	500	235	13	252	+165.8 +/- 20.78	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 259693510 \ -pgnout /tmp/ncm-dbt-20180808-1534-014.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.14+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49087	ncm-et-4	2018-08-09 04:34	01:17:13	1986567	500	258	16	226	+183.51 +/- 22.33	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2198077461 \ -pgnout /tmp/ncm-dbt-20180808-1534-013.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.16+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49086	ncm-et-15	2018-08-09 03:20	01:23:21	1875701	500	247	14	239	+175.44 +/- 21.52	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3529812427 \ -pgnout /tmp/ncm-dbt-20180808-1534-012.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=25.59+0.26 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49085	ncm-et-13	2018-08-09 03:18	01:18:31	1987193	500	282	15	203	+206.98 +/- 23.74	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3919674860 \ -pgnout /tmp/ncm-dbt-20180808-1534-011.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.15+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49084	ncm-et-4	2018-08-09 03:17	01:15:46	1992089	500	270	19	211	+191.78 +/- 23.31	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2611258938 \ -pgnout /tmp/ncm-dbt-20180808-1534-010.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.10+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49083	ncm-et-10	2018-08-09 03:17	01:18:26	1949486	500	246	18	236	+171.02 +/- 21.8	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3448533321 \ -pgnout /tmp/ncm-dbt-20180808-1534-009.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.62+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49082	ncm-et-9	2018-08-09 03:17	01:16:38	1988454	500	261	17	222	+185.33 +/- 22.59	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3965251615 \ -pgnout /tmp/ncm-dbt-20180808-1534-008.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.14+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49081	ncm-et-3	2018-08-09 03:17	01:17:39	1990190	500	259	12	229	+188.08 +/- 22.04	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3970705344 \ -pgnout /tmp/ncm-dbt-20180808-1534-007.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.12+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49080	ncm-et-3	2018-08-09 02:00	01:15:41	1990506	500	255	17	228	+179.9 +/- 22.23	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 986147278 \ -pgnout /tmp/ncm-dbt-20180808-1534-006.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.11+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49079	ncm-et-15	2018-08-09 02:00	01:19:12	1918438	500	272	15	213	+197.4 +/- 23.1	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 717757279 \ -pgnout /tmp/ncm-dbt-20180808-1534-005.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=25.02+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49078	ncm-et-4	2018-08-09 02:00	01:16:36	1990664	500	259	11	230	+189.0 +/- 21.95	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3060283842 \ -pgnout /tmp/ncm-dbt-20180808-1534-004.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.11+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49077	ncm-et-10	2018-08-09 02:00	01:16:32	1984363	500	264	11	225	+193.64 +/- 22.25	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 674619405 \ -pgnout /tmp/ncm-dbt-20180808-1534-003.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.19+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49076	ncm-et-9	2018-08-09 02:00	01:16:13	1987666	500	270	15	215	+195.51 +/- 22.97	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1183071648 \ -pgnout /tmp/ncm-dbt-20180808-1534-002.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.15+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
49075	ncm-et-13	2018-08-09 02:00	01:17:41	1985306	500	264	10	226	+194.57 +/- 22.15	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3179883167 \ -pgnout /tmp/ncm-dbt-20180808-1534-001.pgn \ -openings \ file=/home/chess/www/releases/20180808144939/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.18+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180808-1534 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180808-1534-d96c1c32a2fa109e7cc6cd07f6029cd13977121e/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish

Commit

Commit ID	d96c1c32a2fa109e7cc6cd07f6029cd13977121e
Author	Stefano Cardanobile
Date	2018-08-08 15:34:12 UTC
Introduce voting system for best move selection Introduce voting system for best move selction in multi-threads mode. Joint work with Stefan Geschwentner, based on ideas introduced by Michael Stembera. Moves are upvoted by every thread using the margin to the minimum score across threads and the completed depth. First thread voting for the winner move is selected as best thread. Passed STC, LTC. A further LTC test with only 4 threads failed with positive score. A LTC with 31 threads was stopped with LLR 0.77 after 25k games to avoid use of excessive resources (equivalent to 1.5M STC games). Similar ideas were proposed by Michael Stembera 2 years ago #507, #508. This implementation seems simpler and more understandable, the results slightly more promising. Further possible work: 1) Tweak of the formula using for assigning votes. 2) Use a different baseline for the score dependent part: maximum score or winning probability could make more sense. 3) Assign votes in `Thread::Search` as iterations are completed and use voting results to stop search. 4) Select best thread as the threads voting for best move with the highest completed depth or, alternatively, vote on PV moves. Link to SPRT tests [stopped LTC, 31 threads 20+0.02](http://tests.stockfishchess.org/tests/view/5b61dc090ebc5902bdb95192) LLR: 0.77 (-2.94,2.94) [0.00,5.00] Total: 25602 W: 3977 L: 3850 D: 17775 Elo: 1.70 [-0.68,4.07] (95%) [passed LTC, 8 threads 20+0.02](http://tests.stockfishchess.org/tests/view/5b5df5180ebc5902bdb9162d) LLR: 2.96 (-2.94,2.94) [0.00,5.00] Total: 44478 W: 7602 L: 7300 D: 29576 Elo: 1.92 [-0.29,3.94] (95%) [failed LTC, 4 threads 20+0.02](http://tests.stockfishchess.org/tests/view/5b5f39ef0ebc5902bdb92792) LLR: -2.94 (-2.94,2.94) [0.00,5.00] Total: 29922 W: 5286 L: 5285 D: 19351 Elo: 0.48 [-1.98,3.10] (95%) [passed STC, 4 threads 5+0.05](http://tests.stockfishchess.org/tests/view/5b5dbf0f0ebc5902bdb9131c) LLR: 2.97 (-2.94,2.94) [0.00,5.00] Total: 9108 W: 2033 L: 1858 D: 5217 Elo: 6.11 [1.26,10.89] (95%) No functional change (in simple threat mode)