Dev Builds » 20221221-0614

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 11:16:01 1952210 3319 2846 4 469 +444.45 +/- 15.73
ncm-et-4 11:16:26 1956327 3330 2865 5 460 +447.84 +/- 15.89
ncm-et-9 11:16:17 1951530 3334 2908 4 422 +464.63 +/- 16.6
ncm-et-10 11:16:54 1947247 3329 2900 2 427 +463.92 +/- 16.49
ncm-et-13 11:16:55 1956116 3337 2906 4 427 +462.65 +/- 16.5
ncm-et-15 11:16:37 1954780 3351 2862 2 487 +440.83 +/- 15.42
20000 17287 21 2692 +453.81 +/- 6.55

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
163188 ncm-et-3 2022-12-21 21:09 01:04:12 1958545 319 282 0 37 +484.26 +/- 57.57
163187 ncm-et-10 2022-12-21 21:06 01:07:36 1937843 329 295 0 34 +505.47 +/- 60.3
163186 ncm-et-4 2022-12-21 21:06 01:07:44 1956798 330 280 0 50 +434.54 +/- 48.99
163185 ncm-et-13 2022-12-21 21:05 01:09:02 1952978 337 297 0 40 +480.0 +/- 55.23
163184 ncm-et-9 2022-12-21 21:05 01:08:40 1948914 334 299 0 35 +502.92 +/- 59.36
163183 ncm-et-15 2022-12-21 21:03 01:10:35 1961394 351 305 1 45 +457.66 +/- 51.97
163182 ncm-et-3 2022-12-21 19:26 01:42:35 1958403 500 437 0 63 +468.95 +/- 43.54
163181 ncm-et-10 2022-12-21 19:25 01:40:26 1948729 500 437 0 63 +468.95 +/- 43.54
163180 ncm-et-4 2022-12-21 19:24 01:40:34 1958962 500 425 0 75 +436.43 +/- 39.73
163179 ncm-et-13 2022-12-21 19:23 01:40:29 1958475 500 435 0 65 +463.15 +/- 42.83
163178 ncm-et-9 2022-12-21 19:23 01:41:25 1953764 500 434 0 66 +460.32 +/- 42.48
163177 ncm-et-15 2022-12-21 19:22 01:40:17 1951785 500 417 0 83 +417.31 +/- 37.67
163176 ncm-et-10 2022-12-21 17:43 01:41:16 1940160 500 443 0 57 +487.45 +/- 45.89
163175 ncm-et-3 2022-12-21 17:43 01:42:21 1950395 500 417 0 83 +417.31 +/- 37.67
163174 ncm-et-13 2022-12-21 17:40 01:43:05 1952736 500 433 0 67 +457.52 +/- 42.15
163173 ncm-et-4 2022-12-21 17:40 01:43:58 1950466 500 423 3 74 +424.28 +/- 40.13
163172 ncm-et-9 2022-12-21 17:40 01:42:19 1949959 500 445 0 55 +494.02 +/- 46.77
163171 ncm-et-15 2022-12-21 17:39 01:42:14 1938699 500 418 0 82 +419.61 +/- 37.91
163170 ncm-et-10 2022-12-21 16:01 01:41:41 1956807 500 444 0 56 +490.71 +/- 46.32
163169 ncm-et-13 2022-12-21 16:00 01:39:34 1953003 500 436 1 63 +463.16 +/- 43.6
163168 ncm-et-3 2022-12-21 15:59 01:42:48 1938596 500 414 0 86 +410.58 +/- 36.97
163167 ncm-et-4 2022-12-21 15:58 01:41:02 1957490 500 437 1 62 +466.04 +/- 43.97
163166 ncm-et-9 2022-12-21 15:58 01:41:02 1952068 500 434 2 64 +454.76 +/- 43.27
163165 ncm-et-15 2022-12-21 15:56 01:42:43 1947240 500 430 1 69 +446.7 +/- 41.57
163164 ncm-et-10 2022-12-21 14:19 01:40:54 1959853 500 426 2 72 +433.94 +/- 40.69
163163 ncm-et-13 2022-12-21 14:18 01:41:11 1960166 500 446 2 52 +490.71 +/- 48.23
163162 ncm-et-9 2022-12-21 14:17 01:40:14 1953176 500 437 1 62 +466.04 +/- 43.97
163161 ncm-et-4 2022-12-21 14:17 01:40:40 1959421 500 417 0 83 +417.31 +/- 37.67
163160 ncm-et-3 2022-12-21 14:17 01:42:14 1955743 500 428 1 71 +441.5 +/- 40.95
163159 ncm-et-15 2022-12-21 14:13 01:41:25 1958815 500 433 0 67 +457.52 +/- 42.15
163158 ncm-et-13 2022-12-21 12:36 01:41:39 1957570 500 441 1 58 +477.99 +/- 45.54
163157 ncm-et-9 2022-12-21 12:35 01:40:59 1952694 500 432 1 67 +452.04 +/- 42.22
163156 ncm-et-10 2022-12-21 12:35 01:43:15 1929465 500 429 0 71 +446.7 +/- 40.89
163155 ncm-et-3 2022-12-21 12:35 01:41:14 1957867 500 432 2 66 +449.35 +/- 42.58
163154 ncm-et-4 2022-12-21 12:35 01:41:34 1954518 500 438 0 62 +471.92 +/- 43.9
163153 ncm-et-15 2022-12-21 12:32 01:40:46 1958073 500 421 0 79 +426.65 +/- 38.66
163152 ncm-et-3 2022-12-21 10:53 01:40:37 1945921 500 436 1 63 +463.16 +/- 43.6
163151 ncm-et-9 2022-12-21 10:53 01:41:38 1950136 500 427 0 73 +441.5 +/- 40.29
163150 ncm-et-4 2022-12-21 10:53 01:40:54 1956635 500 445 1 54 +490.71 +/- 47.28
163149 ncm-et-13 2022-12-21 10:53 01:41:55 1957884 500 418 0 82 +419.61 +/- 37.91
163148 ncm-et-10 2022-12-21 10:53 01:41:46 1957874 500 426 0 74 +438.95 +/- 40.01
163147 ncm-et-15 2022-12-21 10:53 01:38:37 1967460 500 438 0 62 +471.92 +/- 43.9

Commit

Commit ID c620886181b5c0fb4a0c067b4173143a81819199
Author Linmiao Xu
Date 2022-12-21 06:14:58 UTC
Update default net to nn-335a9b2d8a80.nnue Created by retraining the master net with a combination of: the previous best dataset (Leela-dfrc_n5000.binpack), with about half the dataset filtered using depth6 multipv2 search to throw away positions where either of the 2 best moves are captures Leela T80 Oct and Nov training data rescored with best moves, adding ~9.5 billion positions Trained effectively the same way as the previous master net: python3 easy_train.py \ --experiment-name=leela-dfrc-filtered-T80-oct-nov \ --training-dataset=/data/leela-dfrc-filtered-T80-oct-nov.binpack \ --start-from-engine-test-net True \ --gpus="0," \ --start-lambda=1.0 \ --end-lambda=0.75 \ --gamma=0.995 \ --lr=4.375e-4 \ --tui=False \ --seed=$RANDOM \ --max_epoch=800 \ --auto-exit-timeout-on-training-finished=900 \ --network-testing-threads 20 \ --num-workers 6 Local testing at a fixed 25k nodes: experiments/experiment_leela-dfrc-filtered-T80-oct-nov/training/run_0/nn-epoch779.nnue localElo: run_0/nn-epoch779.nnue : 4.7 +/- 3.1 The new Leela T80 part of the dataset was prepared by downloading test80 training data from all of Oct 2022 and Nov 2022, rescoring with syzygy 6-piece tablebases and ~600 GB of 7-piece tablebases, saving best moves to exported .plain files, removing all positions with castling flags, then converting to binpacks and using interleave_binpacks.py to merge them together. Scripts used in this data conversion process are available at: https://github.com/linrock/lc0-data-converter Filtering binpack data using depth6 multipv2 search was done by modifying transform.cpp in the tools branch: https://github.com/linrock/Stockfish/tree/tools-filter-multipv2-no-rescore Links for downloading the training data (total size: 338 GB) are available at: https://robotmoon.com/nnue-training-data/ Passed STC: LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 30544 W: 8244 L: 7947 D: 14353 Ptnml(0-2): 93, 3243, 8302, 3542, 92 https://tests.stockfishchess.org/tests/view/63a0d377264a0cf18f86f82b Passed LTC: LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 32464 W: 8866 L: 8573 D: 15025 Ptnml(0-2): 19, 3054, 9794, 3345, 20 https://tests.stockfishchess.org/tests/view/63a10bc9fb452d3c44b1e016 closes https://github.com/official-stockfish/Stockfish/pull/4295 Bench 3554904
Copyright 2011–2024 Next Chess Move LLC