Dev Builds » 20230922-1712

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo
ncm-dbt-01	09:54:46	1198495	3340	1478 248 1614	+134.25 +/- 5.07	1 26 425 1178 40	+310.47 +/- 16.54
ncm-dbt-02	09:50:02	1194952	3312	1411 257 1644	+126.35 +/- 5.18	0 33 473 1113 37	+284.54 +/- 15.66
ncm-dbt-03	09:54:22	1231469	3342	1448 266 1628	+128.43 +/- 5.2	0 32 469 1126 44	+288.73 +/- 15.73
ncm-dbt-04	09:54:23	1233220	3346	1452 266 1628	+128.73 +/- 5.25	0 38 455 1136 44	+289.75 +/- 15.99
ncm-dbt-05	09:50:38	1228722	3322	1437 264 1621	+128.2 +/- 5.1	0 27 472 1124 38	+290.22 +/- 15.66
ncm-dbt-06	09:53:59	1227442	3338	1455 268 1615	+129.19 +/- 5.22	0 35 455 1136 43	+291.6 +/- 15.98
			20000	8681 1569 9750	+129.19 +/- 2.11	1 191 2749 6813 246	+292.43 +/- 6.49

Test Detail

ID	Host	Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo	PGN
204158	ncm-dbt-02	1195026	312	133 20 159	+131.81 +/- 16.9	0 3 41 108 4	+300.46 +/- 54.22	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2521193624 \ -pgnout ncm-dbt-20230922-1712-042.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204157	ncm-dbt-05	1233254	322	142 30 150	+126.1 +/- 17.05	0 3 48 105 5	+278.3 +/- 49.81	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 918308461 \ -pgnout ncm-dbt-20230922-1712-041.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204156	ncm-dbt-01	1206542	340	152 27 161	+134.01 +/- 16.24	1 3 38 126 2	+322.24 +/- 56.44	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 4267720332 \ -pgnout ncm-dbt-20230922-1712-040.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204155	ncm-dbt-06	1210352	338	146 26 166	+128.96 +/- 15.79	0 4 43 120 2	+300.12 +/- 52.91	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1157704051 \ -pgnout ncm-dbt-20230922-1712-039.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204154	ncm-dbt-03	1238825	342	144 35 163	+114.73 +/- 15.92	0 3 59 106 3	+251.83 +/- 44.52	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3862951601 \ -pgnout ncm-dbt-20230922-1712-038.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204153	ncm-dbt-04	1250511	346	151 32 163	+124.57 +/- 16.89	0 5 49 114 5	+274.81 +/- 49.4	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1325400359 \ -pgnout ncm-dbt-20230922-1712-037.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204152	ncm-dbt-02	1195908	500	214 41 245	+125.38 +/- 14.13	0 8 68 167 7	+277.93 +/- 41.74	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3312146169 \ -pgnout ncm-dbt-20230922-1712-036.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204151	ncm-dbt-05	1229432	500	218 51 231	+120.67 +/- 12.41	0 1 85 160 4	+270.57 +/- 36.61	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3729305502 \ -pgnout ncm-dbt-20230922-1712-035.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204150	ncm-dbt-01	1190024	500	223 36 241	+136.56 +/- 13.36	0 5 60 178 7	+315.35 +/- 44.57	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2429246423 \ -pgnout ncm-dbt-20230922-1712-034.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204149	ncm-dbt-06	1252403	500	225 36 239	+138.18 +/- 13.5	0 3 65 172 10	+312.48 +/- 42.67	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2414063838 \ -pgnout ncm-dbt-20230922-1712-033.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204148	ncm-dbt-04	1221516	500	211 48 241	+117.55 +/- 13.87	0 9 73 164 4	+261.07 +/- 40.24	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2088021310 \ -pgnout ncm-dbt-20230922-1712-032.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204147	ncm-dbt-03	1218110	500	217 32 251	+134.95 +/- 13.78	0 6 61 175 8	+306.84 +/- 44.17	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 4179409554 \ -pgnout ncm-dbt-20230922-1712-031.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204146	ncm-dbt-05	1237698	500	227 37 236	+138.99 +/- 12.9	0 4 58 182 6	+327.18 +/- 45.37	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 647516543 \ -pgnout ncm-dbt-20230922-1712-030.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204145	ncm-dbt-02	1193161	500	207 38 255	+122.24 +/- 12.76	0 3 79 164 4	+275.45 +/- 38.39	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1921462737 \ -pgnout ncm-dbt-20230922-1712-029.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204144	ncm-dbt-01	1182416	500	218 39 243	+130.14 +/- 12.59	0 4 66 177 3	+304.07 +/- 42.38	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1910239795 \ -pgnout ncm-dbt-20230922-1712-028.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204143	ncm-dbt-04	1228804	500	223 37 240	+135.76 +/- 13.39	0 5 61 177 7	+312.48 +/- 44.19	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1426845613 \ -pgnout ncm-dbt-20230922-1712-027.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204142	ncm-dbt-06	1212809	500	210 47 243	+117.55 +/- 14.04	0 6 83 153 8	+251.89 +/- 37.57	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2264913632 \ -pgnout ncm-dbt-20230922-1712-026.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204141	ncm-dbt-03	1226709	500	216 31 253	+134.95 +/- 12.44	0 2 66 177 5	+315.35 +/- 42.24	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1435456781 \ -pgnout ncm-dbt-20230922-1712-025.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204140	ncm-dbt-05	1211303	500	218 33 249	+134.95 +/- 12.64	0 4 61 181 4	+318.25 +/- 44.18	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 103078627 \ -pgnout ncm-dbt-20230922-1712-024.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204139	ncm-dbt-02	1193697	500	225 42 233	+133.34 +/- 12.69	0 4 63 179 4	+312.48 +/- 43.44	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1533998637 \ -pgnout ncm-dbt-20230922-1712-023.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204138	ncm-dbt-01	1193809	500	213 33 254	+130.94 +/- 13.87	0 5 69 167 9	+290.66 +/- 41.43	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2637475112 \ -pgnout ncm-dbt-20230922-1712-022.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204137	ncm-dbt-04	1228144	500	215 38 247	+128.55 +/- 13.19	0 4 71 169 6	+290.66 +/- 40.76	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2407415277 \ -pgnout ncm-dbt-20230922-1712-021.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204136	ncm-dbt-06	1214797	500	224 33 243	+139.81 +/- 13.07	0 5 55 184 6	+330.23 +/- 46.62	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 263684043 \ -pgnout ncm-dbt-20230922-1712-020.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204135	ncm-dbt-03	1238679	500	216 37 247	+130.14 +/- 12.59	0 5 63 180 2	+306.84 +/- 43.45	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2066325387 \ -pgnout ncm-dbt-20230922-1712-019.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204134	ncm-dbt-05	1218625	500	207 30 263	+128.55 +/- 13.56	0 6 67 171 6	+290.66 +/- 42.08	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2863064621 \ -pgnout ncm-dbt-20230922-1712-018.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204133	ncm-dbt-02	1196937	500	195 36 269	+114.45 +/- 13.89	0 7 83 154 6	+247.41 +/- 37.61	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 717617874 \ -pgnout ncm-dbt-20230922-1712-017.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204132	ncm-dbt-01	1208354	500	224 34 242	+138.99 +/- 12.5	0 2 62 180 6	+327.18 +/- 43.69	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 18143044 \ -pgnout ncm-dbt-20230922-1712-016.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204131	ncm-dbt-04	1224079	500	214 38 248	+127.76 +/- 14.44	0 9 64 169 8	+282.94 +/- 42.98	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 502170488 \ -pgnout ncm-dbt-20230922-1712-015.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204130	ncm-dbt-03	1244012	500	216 39 245	+128.55 +/- 13.56	0 4 73 165 8	+285.49 +/- 40.16	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 846478503 \ -pgnout ncm-dbt-20230922-1712-014.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204129	ncm-dbt-06	1242808	500	225 31 244	+142.25 +/- 12.58	0 2 59 182 7	+336.46 +/- 44.87	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 803237340 \ -pgnout ncm-dbt-20230922-1712-013.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204128	ncm-dbt-01	1202622	500	227 48 225	+130.14 +/- 13.34	0 4 70 169 7	+293.29 +/- 41.07	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3089826730 \ -pgnout ncm-dbt-20230922-1712-012.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204127	ncm-dbt-05	1226067	500	214 46 240	+121.45 +/- 13.14	0 3 82 159 6	+268.17 +/- 37.61	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 4054480141 \ -pgnout ncm-dbt-20230922-1712-011.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204126	ncm-dbt-02	1191499	500	220 36 244	+134.15 +/- 12.86	0 2 69 172 7	+306.84 +/- 41.23	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 1136427380 \ -pgnout ncm-dbt-20230922-1712-010.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204125	ncm-dbt-06	1240406	500	211 55 234	+112.14 +/- 14.06	0 9 81 155 5	+243.0 +/- 38.14	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3737256806 \ -pgnout ncm-dbt-20230922-1712-009.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204124	ncm-dbt-04	1250007	500	218 33 249	+134.95 +/- 12.84	0 4 62 179 5	+315.35 +/- 43.81	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 137417148 \ -pgnout ncm-dbt-20230922-1712-008.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204123	ncm-dbt-03	1212438	500	217 46 237	+123.81 +/- 14.32	0 9 68 166 7	+273.0 +/- 41.7	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3326903856 \ -pgnout ncm-dbt-20230922-1712-007.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204122	ncm-dbt-06	1218523	500	214 40 246	+126.17 +/- 13.42	0 6 69 170 5	+285.49 +/- 41.44	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2759954570 \ -pgnout ncm-dbt-20230922-1712-006.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204121	ncm-dbt-02	1198436	500	217 44 239	+125.38 +/- 13.43	0 6 70 169 5	+282.94 +/- 41.13	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2245877416 \ -pgnout ncm-dbt-20230922-1712-005.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204120	ncm-dbt-05	1244675	500	211 37 252	+126.17 +/- 13.77	0 6 71 166 7	+280.42 +/- 40.83	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2217911901 \ -pgnout ncm-dbt-20230922-1712-004.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204119	ncm-dbt-01	1205702	500	221 31 248	+138.99 +/- 12.7	0 3 60 181 6	+327.18 +/- 44.54	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 2133660845 \ -pgnout ncm-dbt-20230922-1712-003.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204118	ncm-dbt-04	1229485	500	220 40 240	+130.94 +/- 13.32	0 2 75 164 9	+290.66 +/- 39.4	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3937278482 \ -pgnout ncm-dbt-20230922-1712-002.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14
204117	ncm-dbt-03	1241515	500	222 46 232	+127.76 +/- 13.92	0 3 79 157 11	+275.45 +/- 38.39	↓
cutechess-cli \ -rounds 259 \ -games 2 \ -concurrency 9 \ -srand 3420020650 \ -pgnout ncm-dbt-20230922-1712-001.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=64 \ option.Threads=2 \ -engine \ name=20230922-1712 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:952740b36ca46961a64457767f58dfbe71ae1ead \ -engine \ name=sf14 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:14

Commit

Commit ID	952740b36ca46961a64457767f58dfbe71ae1ead
Author	Sebastian Buchwald
Date	2023-09-22 17:12:53 UTC
Let CI check C++ includes The commit adds a CI workflow that uses the included-what-you-use (IWYU) tool to check for missing or superfluous includes in .cpp files and their corresponding .h files. This means that some .h files (especially in the nnue folder) are not checked yet. The CI setup looks like this: - We build IWYU from source to include some yet unreleased fixes. This IWYU version targets LLVM 17. Thus, we get the latest release candidate of LLVM 17 from LLVM's nightly packages. - The Makefile now has an analyze target that just build the object files (without linking) - The CI uses the analyze target with the IWYU tool as compiler to analyze the compiled .cpp file and its corresponding .h file. - If IWYU suggests a change the build fails (-Xiwyu --error). - To avoid false positives we use LLVM's libc++ as standard library - We have a custom mappings file that adds some mappings that are missing in IWYU's default mappings We also had to add one IWYU pragma to prevent a false positive in movegen.h. https://github.com/official-stockfish/Stockfish/pull/4783 No functional change