Dev Builds » 20170109-0926

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-24 10:15 02:27:28 2026555 1000 315 48 637 +95.07 +/- 12.51
ncm-et-4 2018-02-24 10:15 02:28:20 2024677 1000 313 42 645 +96.57 +/- 12.32
ncm-et-5 2018-02-24 10:15 02:28:40 2021825 998 285 41 672 +86.70 +/- 11.83
ncm-et-6 2018-02-24 10:16 02:26:05 2024264 1000 300 50 650 +88.74 +/- 12.30
ncm-et-7 2018-02-24 10:15 02:28:58 2007593 1001 294 41 666 +89.76 +/- 11.95
ncm-et-8 2018-02-24 10:15 02:27:56 1984588 1000 310 39 651 +96.57 +/- 12.19
ncm-et-9 2018-02-24 10:15 02:28:56 2025001 995 288 42 665 +87.72 +/- 11.95
ncm-et-10 2018-02-24 10:15 02:27:55 2020673 1000 311 59 630 +89.48 +/- 12.72
ncm-et-11 2018-02-24 10:14 02:29:24 2000299 1007 312 35 660 +98.10 +/- 12.03
ncm-et-12 2018-02-24 10:15 02:28:38 1988641 999 286 55 658 +81.82 +/- 12.20
  10000 3014 452 6534 +91.04 +/- 3.86

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
2829 ncm-et-11 2018-02-24 10:14 01:12:59 1992598 500 141 20 339 +85.78 +/- 16.59 Show
2830 ncm-et-9 2018-02-24 10:15 01:13:46 2027046 500 144 24 332 +85.04 +/- 17.04 Show
2831 ncm-et-4 2018-02-24 10:15 01:12:39 2026720 500 148 23 329 +88.74 +/- 17.17 Show
2832 ncm-et-5 2018-02-24 10:15 01:14:04 2023773 500 158 22 320 +96.94 +/- 17.58 Show
2833 ncm-et-8 2018-02-24 10:15 01:12:45 1997000 500 156 14 330 +101.46 +/- 16.86 Show
2834 ncm-et-7 2018-02-24 10:15 01:12:36 2023774 500 139 20 341 +84.31 +/- 16.49 Show
2835 ncm-et-10 2018-02-24 10:15 01:13:37 2021162 500 160 32 308 +90.97 +/- 18.39 Show
2836 ncm-et-12 2018-02-24 10:15 01:14:34 1960670 500 151 31 318 +85.04 +/- 17.88 Show
2837 ncm-et-3 2018-02-24 10:15 01:12:57 2026063 500 155 24 321 +93.20 +/- 17.58 Show
2838 ncm-et-6 2018-02-24 10:16 01:12:39 2023936 500 151 23 326 +90.97 +/- 17.31 Show
2839 ncm-et-11 2018-02-24 11:29 01:12:23 2017584 500 169 15 316 +110.60 +/- 17.58 Show
2840 ncm-et-4 2018-02-24 11:29 01:14:28 2022633 500 165 19 316 +104.49 +/- 17.70 Show
2841 ncm-et-7 2018-02-24 11:29 01:13:44 1974577 500 155 21 324 +95.44 +/- 17.36 Show
2842 ncm-et-8 2018-02-24 11:29 01:13:55 1972175 500 154 25 321 +91.71 +/- 17.61 Show
2843 ncm-et-3 2018-02-24 11:30 01:13:17 2027046 500 160 24 316 +96.94 +/- 17.83 Show
2844 ncm-et-6 2018-02-24 11:30 01:12:11 2024591 500 149 27 324 +86.52 +/- 17.50 Show
2845 ncm-et-9 2018-02-24 11:30 01:13:56 2022956 495 144 18 333 +90.43 +/- 16.76 Show
2846 ncm-et-10 2018-02-24 11:30 01:13:05 2020184 500 151 27 322 +88.00 +/- 17.60 Show
2847 ncm-et-5 2018-02-24 11:30 01:13:21 2019877 498 127 19 352 +76.56 +/- 15.88 Show
2848 ncm-et-12 2018-02-24 11:31 01:12:49 2016611 499 135 24 340 +78.60 +/- 16.63 Show
2849 ncm-et-11 2018-02-24 12:42 00:01:33 1990716 7 2 0 5 +102.11 +/- 134.34 Show
2851 ncm-et-7 2018-02-24 12:44 00:00:10 2024427 1 0 0 1 -0.00 +/- 0.00 Show

Commit

Commit ID d39ffbeea6ad54c90123a352d50b65c5bda1561b
Author ElbertoOne
Date 2017-01-09 09:26:50 UTC
Commit Type Simplification
Simplified select best thread (#958)

Only select best thread if score is better and depth equal or larger.

STC (7 threads): http://tests.stockfishchess.org/tests/view/586a4d090ebc5903140c64b2
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 120297 W: 18652 L: 18682 D: 82963

LTC (7 threads): http://tests.stockfishchess.org/tests/view/586e31b30ebc5903140c663d
LLR: 2.96 (-2.94,2.94) [-3.00,1.00]
Total: 57187 W: 7035 L: 6959 D: 43193

bench: 4940355

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5044 1442 163 3439 +90.06 +/- 5.16
ncm-et-4 4956 1476 159 3321 +94.60 +/- 5.29
  10000 2918 322 6760 +92.31 +/- 3.69