Dev Builds » 20170309-0203

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-01 11:27 7374:50:46 2008682 6659 2075 305 4279 +94.62 +/- 4.80
ncm-et-4 2018-02-01 11:27 7374:50:51 2003647 6677 2098 330 4249 +94.24 +/- 4.85
ncm-et-9 2018-12-05 14:03 04:14:29 1966977 1691 515 73 1103 +92.97 +/- 9.38
ncm-et-10 2018-12-05 14:03 04:14:22 1966815 1647 523 62 1062 +99.91 +/- 9.57
ncm-et-13 2018-12-05 14:03 04:14:12 1983636 1684 497 78 1109 +88.30 +/- 9.34
ncm-et-15 2018-12-05 14:03 04:14:29 1960244 1642 509 84 1049 +92.02 +/- 9.76
  20000 6217 932 12851 +94.04 +/- 2.77

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
690 ncm-et-4 2018-02-01 11:27 01:13:28 2029180 500 144 25 331 +84.31 +/- 17.12 Show
691 ncm-et-3 2018-02-01 11:27 01:13:10 2025408 500 147 23 330 +88.00 +/- 17.12 Show
692 ncm-et-3 2018-02-01 12:41 01:12:09 2027704 500 164 21 315 +102.22 +/- 17.80 Show
693 ncm-et-4 2018-02-01 12:41 01:13:55 2027866 500 143 27 330 +82.10 +/- 17.21 Show
694 ncm-et-3 2018-02-01 13:54 01:12:48 2028851 500 164 28 308 +96.94 +/- 18.31 Show
695 ncm-et-4 2018-02-01 13:56 01:13:54 2029018 500 147 24 329 +87.26 +/- 17.19 Show
696 ncm-et-3 2018-02-01 15:08 01:14:00 2029673 500 161 25 314 +96.94 +/- 17.95 Show
697 ncm-et-4 2018-02-01 15:11 01:14:45 2026227 500 172 25 303 +105.25 +/- 18.48 Show
698 ncm-et-3 2018-02-01 16:23 01:13:05 2025245 500 162 25 313 +97.69 +/- 18.00 Show
699 ncm-et-4 2018-02-01 16:27 01:10:56 2027212 500 163 20 317 +102.22 +/- 17.67 Show
700 ncm-et-3 2018-02-01 17:38 01:13:53 2024590 500 148 23 329 +88.74 +/- 17.17 Show
701 ncm-et-4 2018-02-01 17:39 01:12:39 2025408 500 178 28 294 +107.54 +/- 18.99 Show
702 ncm-et-3 2018-02-01 18:53 01:12:59 2026882 500 151 25 324 +89.48 +/- 17.46 Show
703 ncm-et-4 2018-02-01 18:53 01:13:08 2025081 500 173 24 303 +106.78 +/- 18.46 Show
704 ncm-et-3 2018-02-01 20:07 01:13:51 2028687 500 141 18 341 +87.26 +/- 16.44 Show
705 ncm-et-4 2018-02-01 20:07 01:13:45 2024429 500 159 19 322 +99.95 +/- 17.40 Show
706 ncm-et-3 2018-02-01 21:22 01:13:18 2024100 500 156 17 327 +99.20 +/- 17.10 Show
707 ncm-et-4 2018-02-01 21:22 01:12:14 2027866 500 154 30 316 +88.00 +/- 17.96 Show
708 ncm-et-4 2018-02-01 22:36 01:13:15 2027539 500 154 23 323 +93.20 +/- 17.46 Show
709 ncm-et-3 2018-02-01 22:36 01:13:11 2026882 500 154 19 327 +96.19 +/- 17.16 Show
114815 ncm-et-15 2018-12-05 14:03 01:17:10 1956646 500 153 24 323 +91.71 +/- 17.48 Show
114816 ncm-et-3 2018-12-05 14:03 01:16:02 1962916 500 167 27 306 +99.95 +/- 18.38 Show
114817 ncm-et-9 2018-12-05 14:03 01:13:49 1969249 500 145 17 338 +90.97 +/- 16.56 Show
114818 ncm-et-10 2018-12-05 14:03 01:15:47 1975662 500 163 15 322 +106.01 +/- 17.28 Show
114819 ncm-et-13 2018-12-05 14:03 01:14:17 1984445 500 144 27 329 +82.83 +/- 17.26 Show
114820 ncm-et-4 2018-12-05 14:03 01:16:00 1933671 500 139 30 331 +76.98 +/- 17.22 Show
114821 ncm-et-9 2018-12-05 15:18 01:14:14 1959543 500 153 18 329 +96.19 +/- 17.03 Show
114822 ncm-et-13 2018-12-05 15:19 01:13:42 1976227 500 156 19 325 +97.69 +/- 17.26 Show
114823 ncm-et-10 2018-12-05 15:20 01:17:39 1954651 500 146 21 333 +88.74 +/- 16.92 Show
114824 ncm-et-3 2018-12-05 15:20 01:14:53 1965843 500 154 23 323 +93.20 +/- 17.46 Show
114825 ncm-et-4 2018-12-05 15:20 01:11:58 1962922 500 146 25 329 +85.78 +/- 17.21 Show
114826 ncm-et-15 2018-12-05 15:21 01:16:22 1965227 500 152 25 323 +90.22 +/- 17.51 Show
114827 ncm-et-9 2018-12-05 16:33 01:14:39 1970483 500 158 25 317 +94.70 +/- 17.80 Show
114828 ncm-et-13 2018-12-05 16:33 01:15:38 1995618 500 141 25 334 +82.10 +/- 16.97 Show
114829 ncm-et-4 2018-12-05 16:33 01:16:16 1919872 500 161 24 315 +97.69 +/- 17.87 Show
114830 ncm-et-3 2018-12-05 16:36 01:16:28 1961688 500 158 28 314 +92.46 +/- 18.01 Show
114831 ncm-et-10 2018-12-05 16:39 01:15:36 1966459 500 168 21 311 +105.25 +/- 17.99 Show
114832 ncm-et-15 2018-12-05 16:39 01:15:12 1959853 500 154 28 318 +89.48 +/- 17.82 Show
114833 ncm-et-9 2018-12-05 17:49 00:28:35 1968631 191 59 13 119 +85.35 +/- 29.58 Show
114834 ncm-et-13 2018-12-05 17:50 00:27:24 1978254 184 56 7 121 +94.81 +/- 28.19 Show
114835 ncm-et-4 2018-12-05 17:51 00:26:50 1964764 177 65 6 106 +120.41 +/- 31.08 Show
114836 ncm-et-3 2018-12-05 17:54 00:23:51 1963074 159 48 3 108 +101.09 +/- 28.84 Show
114837 ncm-et-15 2018-12-05 17:55 00:22:32 1959249 142 50 7 85 +108.61 +/- 35.11 Show
114838 ncm-et-10 2018-12-05 17:55 00:22:10 1970487 147 46 5 96 +99.54 +/- 31.66 Show

Commit

Commit ID cc76524c2e36345fcbf5fcdd3618a5dafd166b62
Author pb00068
Date 2017-03-09 02:03:01 UTC
Commit Type Non Functional
Further simplify skipping of plies with threads

No functional change

Closes #1020

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4972 1590 148 3234 +103.74 +/- 5.43
ncm-et-4 5028 1579 125 3324 +103.42 +/- 5.29
  10000 3169 273 6558 +103.58 +/- 3.79