NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.
| Host | Duration | Avg Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo |
|---|---|---|---|---|---|---|---|
| ncm-dbt-01 | 00:52:47 | 584285 | 514 | 217 51 246 | +116.37 ± 13.14 | 0 6 83 164 4 | +257.8 ± 37.6 |
| ncm-dbt-02 | 00:53:04 | 585326 | 516 | 214 49 253 | +115.13 ± 12.78 | 0 5 86 164 3 | +256.39 ± 36.83 |
| ncm-dbt-03 | 00:52:11 | 582736 | 516 | 219 44 253 | +122.69 ± 13.2 | 0 6 76 171 5 | +274.78 ± 39.41 |
| ncm-dbt-04 | 00:52:39 | 568416 | 512 | 226 47 239 | +126.81 ± 13.03 | 0 4 75 171 6 | +285.35 ± 39.6 |
| ncm-dbt-05 | 00:53:13 | 591417 | 514 | 223 48 243 | +123.21 ± 12.89 | 0 7 70 178 2 | +283.68 ± 41.14 |
| 2572 | 1099 239 1234 | +120.82 ± 5.82 | 0 28 390 848 20 | +271.29 ± 17.24 | |||
| ID | Host | Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo | CLI | PGN | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
| 453599 | ncm-dbt-05 | 582277 | 14 | 6 2 6 | +102.04 ± 70.73 | 0 0 3 4 0 | +225.59 ± 263.0 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 1228113348 \
-pgnout ncm-dbt-20260204-1709-010.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260204-1709 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:9f42980dd2c6109aeb4a56b2f717c223e569e052 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 453598 | ncm-dbt-01 | 584034 | 14 | 5 0 9 | +129.72 ± 68.06 | 0 0 2 5 0 | +311.09 ± 530.6 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 2901690349 \
-pgnout ncm-dbt-20260204-1709-009.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260204-1709 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:9f42980dd2c6109aeb4a56b2f717c223e569e052 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 453597 | ncm-dbt-04 | 567482 | 12 | 5 1 6 | +120.31 ± 75.55 | 0 0 2 4 0 | +279.41 ± 548.26 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 3955883299 \
-pgnout ncm-dbt-20260204-1709-008.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260204-1709 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:9f42980dd2c6109aeb4a56b2f717c223e569e052 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 453596 | ncm-dbt-02 | 582903 | 16 | 4 1 11 | +65.88 ± 61.23 | 0 0 5 3 0 | +136.9 ± 147.45 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 3498723535 \
-pgnout ncm-dbt-20260204-1709-007.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260204-1709 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:9f42980dd2c6109aeb4a56b2f717c223e569e052 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 453595 | ncm-dbt-03 | 586266 | 16 | 6 2 8 | +88.72 ± 93.48 | 0 1 2 5 0 | +190.85 ± 457.95 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 2416090503 \
-pgnout ncm-dbt-20260204-1709-006.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260204-1709 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:9f42980dd2c6109aeb4a56b2f717c223e569e052 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 453594 | ncm-dbt-04 | 569350 | 500 | 221 46 233 | +126.97 ± 13.22 | 0 4 73 167 6 | +285.49 ± 40.16 | ↓ | |||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 3784479486 \
-pgnout ncm-dbt-20260204-1709-005.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260204-1709 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:9f42980dd2c6109aeb4a56b2f717c223e569e052 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 453593 | ncm-dbt-03 | 579207 | 500 | 213 42 245 | +123.81 ± 13.28 | 0 5 74 166 5 | +277.93 ± 39.92 | ↓ | |||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 1916199423 \
-pgnout ncm-dbt-20260204-1709-004.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260204-1709 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:9f42980dd2c6109aeb4a56b2f717c223e569e052 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 453592 | ncm-dbt-01 | 584537 | 500 | 212 51 237 | +116.0 ± 13.37 | 0 6 81 159 4 | +256.44 ± 38.07 | ↓ | |||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 3388457206 \
-pgnout ncm-dbt-20260204-1709-003.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260204-1709 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:9f42980dd2c6109aeb4a56b2f717c223e569e052 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 453591 | ncm-dbt-05 | 600558 | 500 | 217 46 237 | +123.81 ± 13.1 | 0 7 67 174 2 | +285.49 ± 42.08 | ↓ | |||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 950521610 \
-pgnout ncm-dbt-20260204-1709-002.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260204-1709 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:9f42980dd2c6109aeb4a56b2f717c223e569e052 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 453590 | ncm-dbt-02 | 587749 | 500 | 210 48 242 | +116.77 ± 13.01 | 0 5 81 161 3 | +261.07 ± 38.02 | ↓ | |||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 3942355114 \
-pgnout ncm-dbt-20260204-1709-001.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20260204-1709 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:9f42980dd2c6109aeb4a56b2f717c223e569e052 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| Commit ID | 9f42980dd2c6109aeb4a56b2f717c223e569e052 |
|---|---|
| Author | KazApps |
| Date | 2026-02-04 17:09:00 UTC |
|
refactor update_piece_threats to reduce branching
Passed STC Non-Regression:
https://tests.stockfishchess.org/tests/view/696f1a398b64097dacd231c3
LLR: 2.94 (-2.94,2.94) <-1.75,0.25>
Total: 122272 W: 31587 L: 31466 D: 59219
Ptnml(0-2): 301, 13358, 33750, 13373, 354
slight speedup as well:
1 thread bench:
sf_base = 2238429 +/- 1221 (95%)
sf_test = 2248298 +/- 1371 (95%)
diff = 9869 +/- 1571 (95%)
speedup = 0.44090% +/- 0.070% (95%)
32 thread speedtest:
sf_base = 41016996 +/- 83654 (95%)
sf_test = 41185801 +/- 84269 (95%)
diff = 168805 +/- 79986 (95%)
speedup = 0.41155% +/- 0.195% (95%)
closes https://github.com/official-stockfish/Stockfish/pull/6559
No functional change
|
|