Dev Builds » 20160514-1934

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	Wins	Losses	Draws	Elo
ncm-et-3	08:46:06	1997225	3658	578	325	2755	+24.07 +/- 5.57
ncm-et-4	08:45:01	1993213	3625	540	302	2783	+22.84 +/- 5.42
ncm-et-5	04:44:12	2024852	2019	326	160	1533	+28.63 +/- 7.38
ncm-et-6	04:45:22	2011002	1987	309	160	1518	+26.1 +/- 7.38
ncm-et-7	04:45:35	2023161	1996	343	158	1495	+32.29 +/- 7.57
ncm-et-9	04:01:07	1972760	1675	262	148	1265	+23.68 +/- 8.19
ncm-et-10	04:01:10	1968464	1660	269	147	1244	+25.58 +/- 8.32
ncm-et-13	04:01:13	1978516	1696	252	155	1289	+19.89 +/- 8.07
ncm-et-15	04:01:04	1980674	1684	271	155	1258	+23.97 +/- 8.31
			20000	3150	1710	15140	+25.06 +/- 2.36

Test Detail

ID	Host	Started (UTC)	Duration	Base NPS	Games	Wins	Losses	Draws	Elo	PGN
69356	ncm-et-4	2019-02-09 00:00	00:18:03	1967849	125	15	10	100	+13.9 +/- 27.23	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1721018660 \ -pgnout /tmp/ncm-dbt-20160514-1934-045.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.39+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69355	ncm-et-3	2019-02-08 23:55	00:23:14	1963226	160	25	18	117	+15.21 +/- 27.92	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2657505508 \ -pgnout /tmp/ncm-dbt-20160514-1934-044.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.45+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69354	ncm-et-10	2019-02-08 23:54	00:24:00	1971411	160	22	23	115	-2.17 +/- 28.61	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1563905575 \ -pgnout /tmp/ncm-dbt-20160514-1934-043.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.35+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69353	ncm-et-9	2019-02-08 23:54	00:24:45	1971665	175	34	17	124	+33.86 +/- 27.66	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 254971062 \ -pgnout /tmp/ncm-dbt-20160514-1934-042.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.34+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69352	ncm-et-15	2019-02-08 23:53	00:25:10	1985360	184	25	20	139	+9.44 +/- 24.85	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 657948592 \ -pgnout /tmp/ncm-dbt-20160514-1934-041.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.18+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69351	ncm-et-13	2019-02-08 23:51	00:27:41	1974063	196	25	16	155	+15.96 +/- 22.21	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 441817638 \ -pgnout /tmp/ncm-dbt-20160514-1934-040.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.32+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69350	ncm-et-4	2019-02-08 22:46	01:13:33	1966161	500	58	44	398	+9.73 +/- 13.75	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2787333048 \ -pgnout /tmp/ncm-dbt-20160514-1934-039.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.41+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69349	ncm-et-9	2019-02-08 22:43	01:09:46	1973118	500	68	44	388	+16.69 +/- 14.38	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1238708007 \ -pgnout /tmp/ncm-dbt-20160514-1934-038.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.33+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69348	ncm-et-10	2019-02-08 22:43	01:10:36	1967695	500	81	40	379	+28.55 +/- 14.88	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1008967075 \ -pgnout /tmp/ncm-dbt-20160514-1934-037.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.39+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69347	ncm-et-3	2019-02-08 22:43	01:11:27	1975194	500	83	45	372	+26.46 +/- 15.33	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1323512700 \ -pgnout /tmp/ncm-dbt-20160514-1934-036.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.30+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69346	ncm-et-15	2019-02-08 22:41	01:11:18	1992620	500	76	46	378	+20.87 +/- 14.99	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 741058218 \ -pgnout /tmp/ncm-dbt-20160514-1934-035.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.09+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69345	ncm-et-13	2019-02-08 22:40	01:10:01	1981464	500	87	46	367	+28.55 +/- 15.62	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1784261552 \ -pgnout /tmp/ncm-dbt-20160514-1934-034.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.22+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69344	ncm-et-3	2019-02-08 21:30	01:11:45	1971780	500	88	45	367	+29.95 +/- 15.61	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1307113292 \ -pgnout /tmp/ncm-dbt-20160514-1934-033.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.34+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69343	ncm-et-10	2019-02-08 21:29	01:12:26	1960623	500	77	42	381	+24.36 +/- 14.78	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3003670004 \ -pgnout /tmp/ncm-dbt-20160514-1934-032.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69342	ncm-et-9	2019-02-08 21:29	01:12:46	1973905	500	74	41	385	+22.96 +/- 14.54	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 766926996 \ -pgnout /tmp/ncm-dbt-20160514-1934-031.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.32+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69341	ncm-et-4	2019-02-08 21:29	01:15:46	1965536	500	75	40	385	+24.36 +/- 14.53	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 456244618 \ -pgnout /tmp/ncm-dbt-20160514-1934-030.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.42+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69340	ncm-et-15	2019-02-08 21:28	01:11:23	1978566	500	72	44	384	+19.48 +/- 14.62	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2987506885 \ -pgnout /tmp/ncm-dbt-20160514-1934-029.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.26+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69339	ncm-et-13	2019-02-08 21:26	01:12:47	1972534	500	66	40	394	+18.08 +/- 13.98	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 25354578 \ -pgnout /tmp/ncm-dbt-20160514-1934-028.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.33+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69338	ncm-et-3	2019-02-08 20:14	01:14:19	1963840	500	85	35	380	+34.86 +/- 14.76	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3071631493 \ -pgnout /tmp/ncm-dbt-20160514-1934-027.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.44+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69337	ncm-et-9	2019-02-08 20:14	01:13:50	1972353	500	86	46	368	+27.85 +/- 15.57	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3709915410 \ -pgnout /tmp/ncm-dbt-20160514-1934-026.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.34+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69336	ncm-et-4	2019-02-08 20:14	01:13:26	1941415	500	77	47	376	+20.87 +/- 15.12	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 726816252 \ -pgnout /tmp/ncm-dbt-20160514-1934-025.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.72+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69335	ncm-et-15	2019-02-08 20:14	01:13:13	1966152	500	98	45	357	+36.97 +/- 16.16	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 532825234 \ -pgnout /tmp/ncm-dbt-20160514-1934-024.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.41+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69334	ncm-et-10	2019-02-08 20:14	01:14:08	1974127	500	89	42	369	+32.76 +/- 15.47	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3099697579 \ -pgnout /tmp/ncm-dbt-20160514-1934-023.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.31+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
69333	ncm-et-13	2019-02-08 20:14	01:10:44	1986006	500	74	53	373	+14.6 +/- 15.33	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 599251717 \ -pgnout /tmp/ncm-dbt-20160514-1934-022.pgn \ -openings \ file=/home/chess/www/releases/20190208025456/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.17+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
1766	ncm-et-5	2018-02-18 23:17	00:03:11	2024590	19	2	2	15	-0.0 +/- 72.72	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 952285482 \ -pgnout /tmp/ncm-dbt-20160514-1934-021.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.71+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1765	ncm-et-6	2018-02-18 22:09	01:10:56	1996256	487	75	39	373	+25.73 +/- 14.84	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 819359782 \ -pgnout /tmp/ncm-dbt-20160514-1934-020.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.05+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1764	ncm-et-7	2018-02-18 22:09	01:11:12	2022140	496	87	45	364	+29.49 +/- 15.68	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2154501528 \ -pgnout /tmp/ncm-dbt-20160514-1934-019.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.74+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1763	ncm-et-3	2018-02-18 22:08	01:11:46	2024426	498	73	53	372	+13.96 +/- 15.33	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3725003052 \ -pgnout /tmp/ncm-dbt-20160514-1934-018.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.71+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1762	ncm-et-4	2018-02-18 22:07	01:11:06	2026718	500	79	41	380	+26.46 +/- 14.83	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2323801233 \ -pgnout /tmp/ncm-dbt-20160514-1934-017.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.68+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1761	ncm-et-5	2018-02-18 22:04	01:11:03	2025899	500	81	41	378	+27.85 +/- 14.95	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2691772629 \ -pgnout /tmp/ncm-dbt-20160514-1934-016.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.69+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1760	ncm-et-4	2018-02-18 20:57	01:08:48	2027538	500	79	35	386	+30.65 +/- 14.41	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 813980788 \ -pgnout /tmp/ncm-dbt-20160514-1934-015.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.67+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1759	ncm-et-6	2018-02-18 20:57	01:11:00	2027869	500	85	38	377	+32.76 +/- 14.97	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 494181274 \ -pgnout /tmp/ncm-dbt-20160514-1934-014.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.67+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1758	ncm-et-7	2018-02-18 20:55	01:12:05	2023120	500	94	35	371	+41.19 +/- 15.27	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2241475714 \ -pgnout /tmp/ncm-dbt-20160514-1934-013.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.73+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1757	ncm-et-3	2018-02-18 20:55	01:11:23	2028686	500	73	46	381	+18.78 +/- 14.82	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 473542573 \ -pgnout /tmp/ncm-dbt-20160514-1934-012.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.66+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1756	ncm-et-5	2018-02-18 20:53	01:09:58	2023773	500	82	36	382	+32.05 +/- 14.66	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 507875327 \ -pgnout /tmp/ncm-dbt-20160514-1934-011.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.72+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1755	ncm-et-4	2018-02-18 19:46	01:10:25	2024263	500	79	41	380	+26.46 +/- 14.83	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3435289652 \ -pgnout /tmp/ncm-dbt-20160514-1934-010.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.71+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1754	ncm-et-6	2018-02-18 19:44	01:11:18	2005743	500	81	45	374	+25.06 +/- 15.22	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3281836165 \ -pgnout /tmp/ncm-dbt-20160514-1934-009.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.93+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1753	ncm-et-3	2018-02-18 19:44	01:10:33	2025572	500	72	43	385	+20.17 +/- 14.56	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 339664600 \ -pgnout /tmp/ncm-dbt-20160514-1934-008.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.70+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1752	ncm-et-7	2018-02-18 19:44	01:10:37	2023447	500	81	42	377	+27.16 +/- 15.02	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1492067296 \ -pgnout /tmp/ncm-dbt-20160514-1934-007.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.72+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1751	ncm-et-5	2018-02-18 19:43	01:09:33	2024590	500	73	38	389	+24.36 +/- 14.27	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3372305531 \ -pgnout /tmp/ncm-dbt-20160514-1934-006.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.71+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1750	ncm-et-5	2018-02-18 18:31	01:10:27	2025408	500	88	43	369	+31.35 +/- 15.48	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3605420073 \ -pgnout /tmp/ncm-dbt-20160514-1934-005.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.70+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1749	ncm-et-6	2018-02-18 18:31	01:12:08	2014141	500	68	38	394	+20.87 +/- 13.96	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 772370684 \ -pgnout /tmp/ncm-dbt-20160514-1934-004.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.83+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1748	ncm-et-3	2018-02-18 18:31	01:11:39	2025081	500	79	40	381	+27.16 +/- 14.76	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3219356248 \ -pgnout /tmp/ncm-dbt-20160514-1934-003.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.70+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1747	ncm-et-7	2018-02-18 18:31	01:11:41	2023937	500	81	36	383	+31.35 +/- 14.6	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3304759025 \ -pgnout /tmp/ncm-dbt-20160514-1934-002.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.72+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1746	ncm-et-4	2018-02-18 18:31	01:13:54	2026228	500	78	44	378	+23.66 +/- 14.98	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 612690915 \ -pgnout /tmp/ncm-dbt-20160514-1934-001.pgn \ -openings \ file=/home/chess/www/releases/20180218135109/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.69+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20160514-1934 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20160514-1934-0784bd542bf17679febd9d9d87858fd0fd0424f9/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish

Commit

Commit ID	0784bd542bf17679febd9d9d87858fd0fd0424f9
Author	mstembera
Date	2016-05-14 19:34:55 UTC
Fix a multiPV bug in lazy SMP Where the helper threads were not doing multiPV at all. Regression tested sprt @ 5+0.05 th 7 LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 73918 W: 11891 L: 11853 D: 50174 bench: 8716243