NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.
| Host | Duration | Avg Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo |
|---|---|---|---|---|---|---|---|
| ncm-dbt-01 | 00:26:44 | 584874 | 262 | 114 22 126 | +127.42 ± 17.15 | 0 2 36 92 1 | +297.72 ± 57.92 |
| ncm-dbt-02 | 00:27:51 | 588771 | 270 | 111 23 136 | +117.52 ± 18.88 | 0 5 39 89 2 | +261.68 ± 55.53 |
| ncm-dbt-03 | 00:27:36 | 586689 | 272 | 118 34 120 | +110.92 ± 17.98 | 0 5 42 89 0 | +250.57 ± 53.43 |
| ncm-dbt-04 | 00:27:28 | 568355 | 270 | 115 26 129 | +118.96 ± 17.99 | 0 4 39 91 1 | +270.48 ± 55.58 |
| ncm-dbt-05 | 00:27:39 | 585084 | 266 | 112 22 132 | +122.37 ± 18.1 | 0 2 42 86 3 | +271.87 ± 53.19 |
| 1340 | 570 127 643 | +119.34 ± 8.07 | 0 18 198 447 7 | +269.82 ± 24.28 | |||
| ID | Host | Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo | CLI | PGN | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
| 466383 | ncm-dbt-01 | 584874 | 262 | 114 22 126 | +127.42 ± 17.15 | 0 2 36 92 1 | +297.72 ± 57.92 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 335486947 \
-pgnout ncm-dbt-20260426-0718-005.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260426-0718 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:e17725f445e52544f749ef65107cda8ac93d0449 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 466382 | ncm-dbt-05 | 585084 | 266 | 112 22 132 | +122.37 ± 18.1 | 0 2 42 86 3 | +271.87 ± 53.19 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 1846897026 \
-pgnout ncm-dbt-20260426-0718-004.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260426-0718 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:e17725f445e52544f749ef65107cda8ac93d0449 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 466381 | ncm-dbt-03 | 586689 | 272 | 118 34 120 | +110.92 ± 17.98 | 0 5 42 89 0 | +250.57 ± 53.43 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 1333023623 \
-pgnout ncm-dbt-20260426-0718-003.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260426-0718 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:e17725f445e52544f749ef65107cda8ac93d0449 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 466380 | ncm-dbt-04 | 568355 | 270 | 115 26 129 | +118.96 ± 17.99 | 0 4 39 91 1 | +270.48 ± 55.58 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 2759518901 \
-pgnout ncm-dbt-20260426-0718-002.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260426-0718 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:e17725f445e52544f749ef65107cda8ac93d0449 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 466379 | ncm-dbt-02 | 588771 | 270 | 111 23 136 | +117.52 ± 18.88 | 0 5 39 89 2 | +261.68 ± 55.53 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 1372064721 \
-pgnout ncm-dbt-20260426-0718-001.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260426-0718 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:e17725f445e52544f749ef65107cda8ac93d0449 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| Commit ID | e17725f445e52544f749ef65107cda8ac93d0449 |
|---|---|
| Author | anematode |
| Date | 2026-04-26 07:18:06 UTC |
|
Constexpr attacks (pext only)
LLR: 2.97 (-2.94,2.94) <0.00,2.00>
Total: 38400 W: 10057 L: 9749 D: 18594
Ptnml(0-2): 93, 4110, 10498, 4394, 105
https://tests.stockfishchess.org/tests/view/69d2073261a12cebe17edc04
compile time generation leads to sharing tables through the binary, resulting
in gain on fishtest, as well as reduced memory usage. The downside is slightly
longer compilation time.
Using pdep reduces table size 4x, and gains a little outside of fishtest as well.
closes https://github.com/official-stockfish/Stockfish/pull/6706
No functional change
|
|