NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.
| Host | Duration | Avg Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo |
|---|---|---|---|---|---|---|---|
| ncm-dbt-01 | 00:23:46 | 581028 | 230 | 14 101 115 | -138.28 ± 19.94 | 6 75 34 0 0 | -304.3 ± 58.88 |
| ncm-dbt-02 | 00:22:54 | 586774 | 224 | 15 104 105 | -146.08 ± 23.53 | 9 74 26 3 0 | -311.26 ± 68.9 |
| ncm-dbt-03 | 00:23:54 | 586012 | 238 | 14 104 120 | -138.24 ± 18.9 | 5 80 34 0 0 | -311.25 ± 58.98 |
| ncm-dbt-04 | 00:23:38 | 570388 | 228 | 23 98 107 | -118.7 ± 22.67 | 4 73 31 6 0 | -253.48 ± 62.18 |
| ncm-dbt-05 | 00:23:39 | 582444 | 232 | 19 107 106 | -138.71 ± 20.96 | 5 81 27 3 0 | -312.14 ± 67.55 |
| 1152 | 85 514 553 | -135.92 ± 9.5 | 29 383 152 12 0 | -297.57 ± 27.76 | |||
| ID | Host | Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo | CLI | PGN | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
| 445962 | ncm-dbt-02 | 586774 | 224 | 15 104 105 | -146.08 ± 23.53 | 9 74 26 3 0 | -311.26 ± 68.9 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 2957336563 \
-pgnout ncm-dbt-20210211-2129-005.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20210211-2129 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:573f0e364ff4c1e5928be2ca947f65c5d4e177d5 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 445961 | ncm-dbt-04 | 570388 | 228 | 23 98 107 | -118.7 ± 22.67 | 4 73 31 6 0 | -253.48 ± 62.18 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 3780803570 \
-pgnout ncm-dbt-20210211-2129-004.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20210211-2129 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:573f0e364ff4c1e5928be2ca947f65c5d4e177d5 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 445960 | ncm-dbt-01 | 581028 | 230 | 14 101 115 | -138.28 ± 19.94 | 6 75 34 0 0 | -304.3 ± 58.88 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 3851362903 \
-pgnout ncm-dbt-20210211-2129-003.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20210211-2129 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:573f0e364ff4c1e5928be2ca947f65c5d4e177d5 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 445959 | ncm-dbt-05 | 582444 | 232 | 19 107 106 | -138.71 ± 20.96 | 5 81 27 3 0 | -312.14 ± 67.55 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 483380477 \
-pgnout ncm-dbt-20210211-2129-002.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20210211-2129 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:573f0e364ff4c1e5928be2ca947f65c5d4e177d5 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 445958 | ncm-dbt-03 | 586012 | 238 | 14 104 120 | -138.24 ± 18.9 | 5 80 34 0 0 | -311.25 ± 58.98 | ||||
cutechess-cli \
-rounds 266 \
-games 2 \
-concurrency 16 \
-srand 150633322 \
-pgnout ncm-dbt-20210211-2129-001.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20210211-2129 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:573f0e364ff4c1e5928be2ca947f65c5d4e177d5 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| Commit ID | 573f0e364ff4c1e5928be2ca947f65c5d4e177d5 |
|---|---|
| Author | mattginsberg |
| Date | 2021-02-11 21:29:35 UTC |
|
Better code for hash table generation
This patch removes some magic numbers in TT bit management and introduce proper
constants in the code, to improve documentation and ease further modifications.
No function change
|
|