NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.
| Host | Duration | Avg Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo |
|---|---|---|---|---|---|---|---|
| ncm-dbt-01 | 00:50:22 | 582485 | 500 | 226 51 223 | +126.97 ± 13.04 | 0 5 69 172 4 | +290.66 ± 41.43 |
| ncm-dbt-02 | 00:52:15 | 585574 | 514 | 217 47 250 | +119.4 ± 12.77 | 0 4 83 166 4 | +266.92 ± 37.48 |
| ncm-dbt-03 | 00:53:16 | 585763 | 518 | 219 48 251 | +119.15 ± 13.05 | 0 6 80 169 4 | +266.25 ± 38.35 |
| ncm-dbt-04 | 00:53:06 | 567819 | 520 | 226 54 240 | +119.41 ± 13.01 | 0 6 80 170 4 | +267.06 ± 38.35 |
| ncm-dbt-05 | 00:52:54 | 580327 | 516 | 229 49 238 | +126.51 ± 12.79 | 0 6 69 180 3 | +292.0 ± 41.46 |
| 2568 | 1117 249 1202 | +122.24 ± 5.78 | 0 27 381 857 19 | +276.2 ± 17.45 | |||
| ID | Host | Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo | CLI | PGN | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
| 464140 | ncm-dbt-02 | 583908 | 14 | 5 0 9 | +129.72 ± 68.06 | 0 0 2 5 0 | +311.09 ± 530.6 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 3104912298 \
-pgnout ncm-dbt-20260402-1830-009.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260402-1830 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:347fcaa392d32a03e7d405e413115b444565c14c \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 464139 | ncm-dbt-05 | 576578 | 16 | 8 1 7 | +162.9 ± 50.11 | 0 0 1 7 0 | +470.09 ± 466.68 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 1679767428 \
-pgnout ncm-dbt-20260402-1830-008.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260402-1830 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:347fcaa392d32a03e7d405e413115b444565c14c \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 464138 | ncm-dbt-03 | 584201 | 18 | 9 2 7 | +142.52 ± 86.69 | 0 0 3 5 1 | +279.47 ± 313.13 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 2794403269 \
-pgnout ncm-dbt-20260402-1830-007.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260402-1830 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:347fcaa392d32a03e7d405e413115b444565c14c \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 464137 | ncm-dbt-04 | 567839 | 20 | 10 2 8 | +147.12 ± 52.02 | 0 0 2 8 0 | +381.52 ± 492.07 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 2210660392 \
-pgnout ncm-dbt-20260402-1830-006.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260402-1830 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:347fcaa392d32a03e7d405e413115b444565c14c \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 464136 | ncm-dbt-01 | 582485 | 500 | 226 51 223 | +126.97 ± 13.04 | 0 5 69 172 4 | +290.66 ± 41.43 | ↓ | |||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 1563709526 \
-pgnout ncm-dbt-20260402-1830-005.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260402-1830 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:347fcaa392d32a03e7d405e413115b444565c14c \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 464135 | ncm-dbt-02 | 587240 | 500 | 212 47 241 | +119.11 ± 12.99 | 0 4 81 161 4 | +265.78 ± 37.95 | ↓ | |||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 3545364559 \
-pgnout ncm-dbt-20260402-1830-004.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260402-1830 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:347fcaa392d32a03e7d405e413115b444565c14c \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 464134 | ncm-dbt-05 | 584076 | 500 | 221 48 231 | +125.38 ± 13.07 | 0 6 68 173 3 | +288.06 ± 41.76 | ↓ | |||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 4087256017 \
-pgnout ncm-dbt-20260402-1830-003.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260402-1830 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:347fcaa392d32a03e7d405e413115b444565c14c \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 464133 | ncm-dbt-04 | 567799 | 500 | 216 52 232 | +118.33 ± 13.35 | 0 6 78 162 4 | +263.42 ± 38.85 | ↓ | |||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 3374666322 \
-pgnout ncm-dbt-20260402-1830-002.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260402-1830 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:347fcaa392d32a03e7d405e413115b444565c14c \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 464132 | ncm-dbt-03 | 587325 | 500 | 210 46 244 | +118.33 ± 13.17 | 0 6 77 164 3 | +265.78 ± 39.12 | ↓ | |||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 2603514292 \
-pgnout ncm-dbt-20260402-1830-001.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260402-1830 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:347fcaa392d32a03e7d405e413115b444565c14c \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| Commit ID | 347fcaa392d32a03e7d405e413115b444565c14c |
|---|---|
| Author | anematode |
| Date | 2026-04-02 18:30:44 UTC |
|
Stack allocate NNUE buffer
Passed simp STC
LLR: 2.94 (-2.94,2.94) <-1.75,0.25>
Total: 29632 W: 7772 L: 7552 D: 14308
Ptnml(0-2): 76, 3155, 8147, 3349,
Id expect there to be a small speedup (bc the compiler can skip some
stores) but i haven’t tried to measure it
closes https://github.com/official-stockfish/Stockfish/pull/6688
No functional change
|
|