Dev Builds » 20231021-0801

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo
ncm-dbt-01	09:54:40	1213420	3328	1407 293 1628	+120.96 +/- 5.23	1 42 491 1102 28	+271.33 +/- 15.38
ncm-dbt-02	09:50:12	1198061	3316	1395 298 1623	+119.43 +/- 5.32	0 41 518 1060 39	+262.31 +/- 14.96
ncm-dbt-03	09:55:28	1240542	3348	1442 276 1630	+126.28 +/- 5.34	0 43 468 1117 46	+281.09 +/- 15.76
ncm-dbt-04	09:55:36	1234408	3330	1419 274 1637	+124.54 +/- 5.44	1 49 463 1108 44	+276.6 +/- 15.85
ncm-dbt-05	09:51:16	1225951	3320	1412 269 1639	+124.71 +/- 5.15	0 30 494 1099 37	+279.34 +/- 15.3
ncm-dbt-06	09:55:23	1237227	3358	1459 298 1601	+125.28 +/- 5.3	0 38 490 1103 48	+277.24 +/- 15.39
			20000	8534 1708 9758	+123.54 +/- 2.16	2 243 2924 6589 242	+274.59 +/- 6.29

Test Detail

ID	Host	Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo	PGN
207892	ncm-dbt-02	1196987	316	137 32 147	+120.0 +/- 18.35	0 4 52 95 7	+252.04 +/- 47.74	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 95681221 \ -pgnout ncm-dbt-20231021-0801-042.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207891	ncm-dbt-05	1218551	320	131 22 167	+123.27 +/- 16.83	0 5 43 110 2	+280.89 +/- 52.84	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1117088278 \ -pgnout ncm-dbt-20231021-0801-041.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207890	ncm-dbt-01	1179649	328	130 34 164	+104.75 +/- 16.04	0 4 61 98 1	+229.78 +/- 43.74	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 374433756 \ -pgnout ncm-dbt-20231021-0801-040.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207889	ncm-dbt-04	1244014	330	148 35 147	+123.97 +/- 16.81	0 4 48 109 4	+275.83 +/- 49.9	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3901748607 \ -pgnout ncm-dbt-20231021-0801-039.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207888	ncm-dbt-03	1230009	348	145 33 170	+115.94 +/- 16.34	0 4 58 108 4	+252.28 +/- 45.09	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 364279127 \ -pgnout ncm-dbt-20231021-0801-038.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207887	ncm-dbt-06	1222974	358	164 38 156	+127.74 +/- 15.57	0 0 60 112 7	+278.42 +/- 43.58	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3019856410 \ -pgnout ncm-dbt-20231021-0801-037.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207886	ncm-dbt-05	1227305	500	210 39 251	+123.81 +/- 13.1	0 5 73 168 4	+280.42 +/- 40.21	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 568982910 \ -pgnout ncm-dbt-20231021-0801-036.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207885	ncm-dbt-02	1195246	500	204 49 247	+111.37 +/- 13.05	0 6 85 157 2	+247.41 +/- 37.09	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1338486897 \ -pgnout ncm-dbt-20231021-0801-035.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207884	ncm-dbt-01	1193122	500	208 36 256	+124.6 +/- 13.27	0 7 67 173 3	+285.49 +/- 42.08	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3448681809 \ -pgnout ncm-dbt-20231021-0801-034.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207883	ncm-dbt-04	1238149	500	217 36 247	+131.74 +/- 12.54	0 5 61 182 2	+312.48 +/- 44.19	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2167937409 \ -pgnout ncm-dbt-20231021-0801-033.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207882	ncm-dbt-03	1228166	500	214 44 242	+123.02 +/- 13.82	0 7 72 165 6	+273.0 +/- 40.54	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1378620330 \ -pgnout ncm-dbt-20231021-0801-032.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207881	ncm-dbt-06	1235900	500	216 44 240	+124.6 +/- 13.97	0 10 62 174 4	+282.94 +/- 43.58	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2290795653 \ -pgnout ncm-dbt-20231021-0801-031.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207880	ncm-dbt-05	1221227	500	212 42 246	+123.02 +/- 13.65	0 5 77 161 7	+270.57 +/- 39.07	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3759540836 \ -pgnout ncm-dbt-20231021-0801-030.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207879	ncm-dbt-01	1243787	500	218 37 245	+131.74 +/- 12.93	0 2 72 169 7	+298.62 +/- 40.29	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2646446664 \ -pgnout ncm-dbt-20231021-0801-029.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207878	ncm-dbt-02	1197418	500	209 36 255	+125.38 +/- 14.3	0 8 69 165 8	+275.45 +/- 41.43	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3012133836 \ -pgnout ncm-dbt-20231021-0801-028.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207877	ncm-dbt-04	1227396	500	211 44 245	+120.67 +/- 13.84	0 6 78 159 7	+263.42 +/- 38.85	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3419823084 \ -pgnout ncm-dbt-20231021-0801-027.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207876	ncm-dbt-03	1237638	500	209 38 253	+123.81 +/- 13.98	0 11 60 176 3	+282.94 +/- 44.17	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2493269304 \ -pgnout ncm-dbt-20231021-0801-026.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207875	ncm-dbt-06	1248377	500	203 45 252	+113.68 +/- 13.21	0 5 86 155 4	+249.64 +/- 36.79	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3376149345 \ -pgnout ncm-dbt-20231021-0801-025.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207874	ncm-dbt-05	1231106	500	218 44 238	+126.17 +/- 12.68	0 3 74 169 4	+288.06 +/- 39.79	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 4232956888 \ -pgnout ncm-dbt-20231021-0801-024.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207873	ncm-dbt-01	1230484	500	209 39 252	+123.02 +/- 14.16	0 10 65 170 5	+275.45 +/- 42.59	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3418048011 \ -pgnout ncm-dbt-20231021-0801-023.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207872	ncm-dbt-02	1195604	500	210 49 241	+116.0 +/- 13.54	0 7 79 160 4	+256.44 +/- 38.62	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1969612180 \ -pgnout ncm-dbt-20231021-0801-022.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207871	ncm-dbt-04	1228818	500	213 48 239	+119.11 +/- 14.84	0 11 71 160 8	+256.44 +/- 40.73	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 4211274847 \ -pgnout ncm-dbt-20231021-0801-021.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207870	ncm-dbt-03	1221330	500	218 37 245	+131.74 +/- 14.54	0 7 66 166 11	+288.06 +/- 42.4	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1705562014 \ -pgnout ncm-dbt-20231021-0801-020.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207869	ncm-dbt-06	1223356	500	225 44 231	+131.74 +/- 14.37	0 5 71 162 12	+285.49 +/- 40.81	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 545085970 \ -pgnout ncm-dbt-20231021-0801-019.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207868	ncm-dbt-05	1227112	500	205 44 251	+116.0 +/- 13.54	0 5 85 154 6	+251.89 +/- 37.03	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 511795743 \ -pgnout ncm-dbt-20231021-0801-018.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207867	ncm-dbt-01	1192880	500	225 42 233	+133.34 +/- 12.88	1 3 61 182 3	+318.25 +/- 44.18	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2975688541 \ -pgnout ncm-dbt-20231021-0801-017.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207866	ncm-dbt-02	1195787	500	206 34 260	+124.6 +/- 13.97	0 7 71 165 7	+275.45 +/- 40.84	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2509984877 \ -pgnout ncm-dbt-20231021-0801-016.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207865	ncm-dbt-04	1235034	500	209 39 252	+123.02 +/- 14.82	0 10 69 162 9	+265.78 +/- 41.36	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3181425580 \ -pgnout ncm-dbt-20231021-0801-015.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207864	ncm-dbt-03	1259545	500	203 42 255	+116.0 +/- 13.71	0 8 77 161 4	+256.44 +/- 39.15	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 83942935 \ -pgnout ncm-dbt-20231021-0801-014.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207863	ncm-dbt-06	1249969	500	214 43 243	+123.81 +/- 14.32	0 7 74 160 9	+268.17 +/- 39.97	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1849461349 \ -pgnout ncm-dbt-20231021-0801-013.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207862	ncm-dbt-05	1225893	500	220 45 235	+126.97 +/- 13.41	0 5 71 168 6	+285.49 +/- 40.81	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3108892020 \ -pgnout ncm-dbt-20231021-0801-012.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207861	ncm-dbt-02	1188646	500	218 48 234	+123.02 +/- 13.11	0 3 80 161 6	+273.0 +/- 38.12	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2594634459 \ -pgnout ncm-dbt-20231021-0801-011.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207860	ncm-dbt-01	1252451	500	204 53 243	+108.3 +/- 13.56	0 7 89 150 4	+234.38 +/- 36.22	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 200661536 \ -pgnout ncm-dbt-20231021-0801-010.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207859	ncm-dbt-03	1237226	500	229 44 227	+134.95 +/- 13.96	0 4 68 167 11	+298.62 +/- 41.71	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3052782129 \ -pgnout ncm-dbt-20231021-0801-009.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207858	ncm-dbt-04	1226224	500	221 38 241	+133.34 +/- 13.99	0 7 61 174 8	+301.33 +/- 44.13	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1692227229 \ -pgnout ncm-dbt-20231021-0801-008.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207857	ncm-dbt-06	1232909	500	219 39 242	+130.94 +/- 13.14	0 3 71 169 7	+295.94 +/- 40.69	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 495358208 \ -pgnout ncm-dbt-20231021-0801-007.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207856	ncm-dbt-02	1216744	500	211 50 239	+116.0 +/- 13.54	0 6 82 157 5	+254.16 +/- 37.82	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2149811013 \ -pgnout ncm-dbt-20231021-0801-006.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207855	ncm-dbt-01	1201572	500	213 52 235	+116.0 +/- 14.05	0 9 76 160 5	+254.16 +/- 39.42	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1705712178 \ -pgnout ncm-dbt-20231021-0801-005.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207854	ncm-dbt-05	1230463	500	216 33 251	+133.34 +/- 13.08	0 2 71 169 8	+301.33 +/- 40.6	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1178809893 \ -pgnout ncm-dbt-20231021-0801-004.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207853	ncm-dbt-03	1269883	500	224 38 238	+135.76 +/- 12.81	0 2 67 174 7	+312.48 +/- 41.9	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 460691178 \ -pgnout ncm-dbt-20231021-0801-003.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207852	ncm-dbt-04	1241226	500	200 34 266	+119.89 +/- 14.19	1 6 75 162 6	+265.78 +/- 39.69	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2340550807 \ -pgnout ncm-dbt-20231021-0801-002.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
207851	ncm-dbt-06	1247105	500	218 45 237	+125.38 +/- 13.79	0 8 66 171 5	+282.94 +/- 42.37	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 402557999 \ -pgnout ncm-dbt-20231021-0801-001.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20231021-0801 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:a4fedd8152e717a37ec8b8ddda0658364c1f5ee4 \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14

Commit

Commit ID	a4fedd8152e717a37ec8b8ddda0658364c1f5ee4
Author	Shahin M. Shahin
Date	2023-10-21 08:01:26 UTC
Fix greater than TB scores in null move pruning. This patch is a simplification and a fix to dealing with null moves scores that returns proven mates or TB scores by preventing 'null move pruning' if the nullvalue is in that range. Current solution downgrades nullValues on the non-PV node but the value can be used in a transposed PV-node to the same position afterwards (Triangulation), the later is prone to propagate a wrong score (96.05) to root that will not be refuted unless we search further. Score of (96.05) can be obtained be two methods, maxim static-eval returned on Pv update (mostly qSearch) this downgrade (clamp) in NMP and theoretically can happen with or without TBs but the second scenario is more dangerous than the first. This fixes the reproducible case in very common scenarios with TBs as shown in the debugging at discord. Fixes: #4699 Passed STC: https://tests.stockfishchess.org/tests/view/64c1eca8dc56e1650abba6f9 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 670048 W: 171132 L: 171600 D: 327316 Ptnml(0-2): 2134, 75687, 179820, 75279, 2104 Passed LTC: https://tests.stockfishchess.org/tests/view/64c5e130dc56e1650abc0438 LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 92868 W: 23642 L: 23499 D: 45727 Ptnml(0-2): 52, 9509, 27171, 9648, 54 closes https://github.com/official-stockfish/Stockfish/pull/4715 Bench: 1327410