Dev Builds » 20240530-2105

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo
ncm-dbt-01	05:25:56	1208904	1868	826 150 892	+131.7 +/- 7.2	0 26 234 646 28	+297.14 +/- 22.32
ncm-dbt-02	05:24:10	1229593	1866	835 134 897	+137.24 +/- 6.96	0 17 228 658 30	+314.76 +/- 22.63
ncm-dbt-03	05:25:39	1236177	1872	858 127 887	+143.27 +/- 6.9	0 14 212 675 35	+333.0 +/- 23.48
ncm-dbt-05	05:25:06	1236606	1866	832 135 899	+136.37 +/- 6.84	0 11 245 646 31	+310.93 +/- 21.77
ncm-dbt-06	05:26:42	1234909	1864	838 148 878	+135.02 +/- 6.82	0 12 246 646 28	+308.45 +/- 21.73
			9336	4189 694 4453	+136.71 +/- 3.11	0 80 1165 3271 152	+312.59 +/- 9.98

Test Detail

ID	Host	Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo	PGN
369053	ncm-dbt-02	1227376	366	164 27 175	+136.69 +/- 15.68	0 3 46 128 6	+312.37 +/- 51.1
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3106805514 \ -pgnout ncm-dbt-20240530-2105-020.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369052	ncm-dbt-05	1211647	366	167 30 169	+136.69 +/- 15.07	0 1 50 126 6	+312.37 +/- 48.59
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 583056592 \ -pgnout ncm-dbt-20240530-2105-019.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369051	ncm-dbt-06	1239203	364	160 23 181	+137.52 +/- 15.41	0 3 44 130 5	+319.18 +/- 52.32
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1659898178 \ -pgnout ncm-dbt-20240530-2105-018.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369050	ncm-dbt-01	1227484	368	161 33 174	+126.11 +/- 16.18	0 6 48 126 4	+284.16 +/- 49.9
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 358947868 \ -pgnout ncm-dbt-20240530-2105-017.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369049	ncm-dbt-03	1245280	372	174 19 179	+154.14 +/- 14.34	0 1 36 142 7	+377.59 +/- 58.2
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3032523612 \ -pgnout ncm-dbt-20240530-2105-016.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369048	ncm-dbt-06	1234903	500	227 41 232	+135.76 +/- 12.81	0 2 67 174 7	+312.48 +/- 41.9	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1194076018 \ -pgnout ncm-dbt-20240530-2105-015.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369047	ncm-dbt-02	1219133	500	224 38 238	+135.76 +/- 14.29	0 6 63 170 11	+301.33 +/- 43.45	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3955007161 \ -pgnout ncm-dbt-20240530-2105-014.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369046	ncm-dbt-01	1186834	500	226 38 236	+137.37 +/- 13.9	0 5 62 173 10	+309.64 +/- 43.82	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3342592042 \ -pgnout ncm-dbt-20240530-2105-013.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369045	ncm-dbt-05	1239651	500	220 38 242	+132.54 +/- 12.12	0 3 64 181 2	+315.35 +/- 43.03	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 112441548 \ -pgnout ncm-dbt-20240530-2105-012.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369044	ncm-dbt-03	1226088	500	228 38 234	+138.99 +/- 13.48	0 4 61 176 9	+318.25 +/- 44.18	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2717292524 \ -pgnout ncm-dbt-20240530-2105-011.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369043	ncm-dbt-01	1193506	500	218 37 245	+131.74 +/- 14.71	0 10 58 173 9	+293.29 +/- 44.99	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3461148796 \ -pgnout ncm-dbt-20240530-2105-010.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369042	ncm-dbt-02	1233484	500	221 30 249	+139.81 +/- 12.87	0 2 63 177 8	+324.17 +/- 43.32	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2529789716 \ -pgnout ncm-dbt-20240530-2105-009.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369041	ncm-dbt-06	1230902	500	222 43 235	+130.14 +/- 13.16	0 3 72 168 7	+293.29 +/- 40.39	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1202107627 \ -pgnout ncm-dbt-20240530-2105-008.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369040	ncm-dbt-03	1250738	500	225 37 238	+137.37 +/- 13.71	0 5 61 175 9	+312.48 +/- 44.19	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2999910764 \ -pgnout ncm-dbt-20240530-2105-007.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369039	ncm-dbt-05	1230702	500	233 30 237	+149.68 +/- 14.24	0 3 57 174 16	+336.46 +/- 45.77	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 878456027 \ -pgnout ncm-dbt-20240530-2105-006.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369038	ncm-dbt-03	1222605	500	231 33 236	+145.54 +/- 13.45	0 4 54 182 10	+339.63 +/- 47.1	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1601991733 \ -pgnout ncm-dbt-20240530-2105-005.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369037	ncm-dbt-02	1238382	500	226 39 235	+136.56 +/- 13.17	0 6 56 183 5	+321.19 +/- 46.14	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 895423327 \ -pgnout ncm-dbt-20240530-2105-004.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369036	ncm-dbt-01	1227792	500	221 42 237	+130.14 +/- 13.16	0 5 66 174 5	+298.62 +/- 42.41	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 290381435 \ -pgnout ncm-dbt-20240530-2105-003.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369035	ncm-dbt-05	1264425	500	212 37 251	+126.97 +/- 13.41	0 4 74 165 7	+282.94 +/- 39.86	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 119063709 \ -pgnout ncm-dbt-20240530-2105-002.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
369034	ncm-dbt-06	1234628	500	229 41 230	+137.37 +/- 13.53	0 4 63 174 9	+312.48 +/- 43.44	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2841064267 \ -pgnout ncm-dbt-20240530-2105-001.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20240530-2105 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c8375c2fbd398f07b8488ae2d1b12fa1251fb69f \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14

Commit

Commit ID	c8375c2fbd398f07b8488ae2d1b12fa1251fb69f
Author	Tomasz Sobczyk
Date	2024-05-30 21:05:25 UTC
On linux use sysfs instead of lscpu Use sysfs (https://www.kernel.org/doc/Documentation/ABI/stable/sysfs-devices-node) to determine processor to NUMA node mapping. Avoids problems on some machines with high core count where lscpu was showing high cpu utilization. closes https://github.com/official-stockfish/Stockfish/pull/5315 No functional change