Dev Builds » 20160505-0653

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-27 11:06 02:10:54 2026312 924 133 81 710 +19.57 +/- 10.73
ncm-et-4 2018-02-27 11:06 02:10:50 2021818 901 150 85 666 +25.11 +/- 11.52
ncm-et-5 2018-02-27 11:06 02:11:07 2023041 920 137 78 705 +22.31 +/- 10.79
ncm-et-6 2018-02-27 11:06 02:11:08 2025490 897 157 67 673 +34.98 +/- 11.23
ncm-et-7 2018-02-27 11:06 02:10:55 1998474 906 147 76 683 +27.28 +/- 11.14
ncm-et-8 2018-02-27 11:06 02:11:02 1935272 881 132 69 680 +24.89 +/- 10.88
ncm-et-9 2018-02-27 11:06 02:11:01 2026227 898 148 86 664 +24.03 +/- 11.54
ncm-et-10 2018-02-27 11:06 02:11:03 2019371 917 155 81 681 +28.10 +/- 11.32
ncm-et-11 2018-02-27 11:05 02:11:16 2016127 927 149 86 692 +23.65 +/- 11.20
ncm-et-12 2018-02-27 11:05 02:11:15 2017746 912 156 88 668 +25.95 +/- 11.59
ncm-et-13 2018-02-27 11:05 02:11:13 2024755 917 161 74 682 +33.06 +/- 11.27
  10000 1625 871 7504 +26.25 +/- 3.38

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
3650 ncm-et-12 2018-02-27 11:05 01:11:15 2017908 500 87 49 364 +26.46 +/- 15.79 Show
3651 ncm-et-11 2018-02-27 11:05 01:09:46 2017746 500 79 45 376 +23.66 +/- 15.08 Show
3652 ncm-et-13 2018-02-27 11:05 01:11:23 2025572 500 94 45 361 +34.16 +/- 15.92 Show
3653 ncm-et-10 2018-02-27 11:06 01:11:57 2019046 500 87 54 359 +22.96 +/- 16.11 Show
3654 ncm-et-5 2018-02-27 11:06 01:11:02 2020510 500 70 46 384 +16.69 +/- 14.62 Show
3655 ncm-et-3 2018-02-27 11:06 01:08:38 2023937 500 74 38 388 +25.06 +/- 14.31 Show
3656 ncm-et-6 2018-02-27 11:06 01:13:11 2026554 500 86 32 382 +37.67 +/- 14.58 Show
3657 ncm-et-4 2018-02-27 11:06 01:11:44 2024099 500 89 50 361 +27.16 +/- 15.97 Show
3658 ncm-et-8 2018-02-27 11:06 01:12:37 1961336 500 79 39 382 +27.85 +/- 14.67 Show
3659 ncm-et-9 2018-02-27 11:06 01:12:00 2027046 500 77 42 381 +24.36 +/- 14.76 Show
3660 ncm-et-7 2018-02-27 11:06 01:11:44 1971048 500 84 41 375 +29.95 +/- 15.10 Show
3661 ncm-et-3 2018-02-27 12:15 01:01:00 2028686 424 59 43 322 +13.12 +/- 16.18 Show
3662 ncm-et-11 2018-02-27 12:17 01:00:13 2014507 427 70 41 316 +23.63 +/- 16.72 Show
3663 ncm-et-5 2018-02-27 12:18 00:58:49 2025572 420 67 32 321 +29.02 +/- 15.99 Show
3664 ncm-et-12 2018-02-27 12:18 00:58:44 2017583 412 69 39 304 +25.34 +/- 17.08 Show
3665 ncm-et-13 2018-02-27 12:18 00:58:33 2023937 417 67 29 321 +31.75 +/- 15.83 Show
3666 ncm-et-4 2018-02-27 12:19 00:57:49 2019536 401 61 35 305 +22.56 +/- 16.55 Show
3667 ncm-et-10 2018-02-27 12:19 00:57:50 2019696 417 68 27 322 +34.27 +/- 15.72 Show
3668 ncm-et-7 2018-02-27 12:19 00:57:55 2025899 406 63 35 308 +24.00 +/- 16.51 Show
3669 ncm-et-9 2018-02-27 12:19 00:57:44 2025408 398 71 44 283 +23.61 +/- 18.28 Show
3670 ncm-et-8 2018-02-27 12:20 00:57:06 1909207 381 53 30 298 +21.00 +/- 16.19 Show
3671 ncm-et-6 2018-02-27 12:20 00:56:41 2024426 397 71 35 291 +31.59 +/- 17.52 Show

Commit

Commit ID 5486911e019c8be689e75462e2fc36ef7eb2c84a
Author VoyagerOne
Date 2016-05-05 06:53:50 UTC
Commit Type Simplification
Simplify History LMR Formula

STC:
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 41713 W: 7589 L: 7504 D: 26620

LTC:
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 41353 W: 5484 L: 5391 D: 30478

Bench: 8946983

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-1 1690 203 116 1371 +17.90 +/- 7.16
ncm-et-2 2779 352 171 2256 +22.66 +/- 5.56
ncm-et-3 2753 357 147 2249 +26.55 +/- 5.49
ncm-et-4 2778 365 156 2257 +26.19 +/- 5.53
  10000 1277 590 8133 +23.91 +/- 2.91