Dev Builds » 20170109-0926

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-24 10:15 02:27:28 2026555 1000 315 48 637 +95.07 +/- 12.51
ncm-et-4 2018-02-24 10:15 02:28:20 2024677 1000 313 42 645 +96.57 +/- 12.32
ncm-et-5 2018-02-24 10:15 02:28:40 2021825 998 285 41 672 +86.70 +/- 11.83
ncm-et-6 2018-02-24 10:16 02:26:05 2024264 1000 300 50 650 +88.74 +/- 12.30
ncm-et-7 2018-02-24 10:15 02:28:58 2007593 1001 294 41 666 +89.76 +/- 11.95
ncm-et-8 2018-02-24 10:15 02:27:56 1984588 1000 310 39 651 +96.57 +/- 12.19
ncm-et-9 2018-02-24 10:15 02:28:56 2025001 995 288 42 665 +87.72 +/- 11.95
ncm-et-10 2018-02-24 10:15 02:27:55 2020673 1000 311 59 630 +89.48 +/- 12.72
ncm-et-11 2018-02-24 10:14 02:29:24 2000299 1007 312 35 660 +98.10 +/- 12.03
ncm-et-12 2018-02-24 10:15 02:28:38 1988641 999 286 55 658 +81.82 +/- 12.20
  10000 3014 452 6534 +91.04 +/- 3.86

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
2829 ncm-et-11 2018-02-24 10:14 01:12:59 1992598 500 141 20 339 +85.78 +/- 16.59 Show
2830 ncm-et-9 2018-02-24 10:15 01:13:46 2027046 500 144 24 332 +85.04 +/- 17.04 Show
2831 ncm-et-4 2018-02-24 10:15 01:12:39 2026720 500 148 23 329 +88.74 +/- 17.17 Show
2832 ncm-et-5 2018-02-24 10:15 01:14:04 2023773 500 158 22 320 +96.94 +/- 17.58 Show
2833 ncm-et-8 2018-02-24 10:15 01:12:45 1997000 500 156 14 330 +101.46 +/- 16.86 Show
2834 ncm-et-7 2018-02-24 10:15 01:12:36 2023774 500 139 20 341 +84.31 +/- 16.49 Show
2835 ncm-et-10 2018-02-24 10:15 01:13:37 2021162 500 160 32 308 +90.97 +/- 18.39 Show
2836 ncm-et-12 2018-02-24 10:15 01:14:34 1960670 500 151 31 318 +85.04 +/- 17.88 Show
2837 ncm-et-3 2018-02-24 10:15 01:12:57 2026063 500 155 24 321 +93.20 +/- 17.58 Show
2838 ncm-et-6 2018-02-24 10:16 01:12:39 2023936 500 151 23 326 +90.97 +/- 17.31 Show
2839 ncm-et-11 2018-02-24 11:29 01:12:23 2017584 500 169 15 316 +110.60 +/- 17.58 Show
2840 ncm-et-4 2018-02-24 11:29 01:14:28 2022633 500 165 19 316 +104.49 +/- 17.70 Show
2841 ncm-et-7 2018-02-24 11:29 01:13:44 1974577 500 155 21 324 +95.44 +/- 17.36 Show
2842 ncm-et-8 2018-02-24 11:29 01:13:55 1972175 500 154 25 321 +91.71 +/- 17.61 Show
2843 ncm-et-3 2018-02-24 11:30 01:13:17 2027046 500 160 24 316 +96.94 +/- 17.83 Show
2844 ncm-et-6 2018-02-24 11:30 01:12:11 2024591 500 149 27 324 +86.52 +/- 17.50 Show
2845 ncm-et-9 2018-02-24 11:30 01:13:56 2022956 495 144 18 333 +90.43 +/- 16.76 Show
2846 ncm-et-10 2018-02-24 11:30 01:13:05 2020184 500 151 27 322 +88.00 +/- 17.60 Show
2847 ncm-et-5 2018-02-24 11:30 01:13:21 2019877 498 127 19 352 +76.56 +/- 15.88 Show
2848 ncm-et-12 2018-02-24 11:31 01:12:49 2016611 499 135 24 340 +78.60 +/- 16.63 Show
2849 ncm-et-11 2018-02-24 12:42 00:01:33 1990716 7 2 0 5 +102.11 +/- 134.34 Show
2851 ncm-et-7 2018-02-24 12:44 00:00:10 2024427 1 0 0 1 -0.00 +/- 0.00 Show

Commit

Commit ID d39ffbeea6ad54c90123a352d50b65c5bda1561b
Author ElbertoOne
Date 2017-01-09 09:26:50 UTC
Commit Type Simplification
Simplified select best thread (#958)

Only select best thread if score is better and depth equal or larger.

STC (7 threads): http://tests.stockfishchess.org/tests/view/586a4d090ebc5903140c64b2
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 120297 W: 18652 L: 18682 D: 82963

LTC (7 threads): http://tests.stockfishchess.org/tests/view/586e31b30ebc5903140c663d
LLR: 2.96 (-2.94,2.94) [-3.00,1.00]
Total: 57187 W: 7035 L: 6959 D: 43193

bench: 4940355

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5044 1442 163 3439 +90.06 +/- 5.16
ncm-et-4 4956 1476 159 3321 +94.60 +/- 5.29
  10000 2918 322 6760 +92.31 +/- 3.69