Dev Builds » 20170309-0203

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded distro are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-01 11:27 7374:50:46 2008682 6659 2075 305 4279 +94.62 +/- 4.80
ncm-et-4 2018-02-01 11:27 7374:50:51 2003647 6677 2098 330 4249 +94.24 +/- 4.85
ncm-et-9 2018-12-05 14:03 04:14:29 1966977 1691 515 73 1103 +92.97 +/- 9.38
ncm-et-10 2018-12-05 14:03 04:14:22 1966815 1647 523 62 1062 +99.91 +/- 9.57
ncm-et-13 2018-12-05 14:03 04:14:12 1983636 1684 497 78 1109 +88.30 +/- 9.34
ncm-et-15 2018-12-05 14:03 04:14:29 1960244 1642 509 84 1049 +92.02 +/- 9.76
  20000 6217 932 12851 +94.04 +/- 2.77

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
690 ncm-et-4 2018-02-01 11:27 01:13:28 2029180 500 144 25 331 +84.31 +/- 17.12 Show
691 ncm-et-3 2018-02-01 11:27 01:13:10 2025408 500 147 23 330 +88.00 +/- 17.12 Show
692 ncm-et-3 2018-02-01 12:41 01:12:09 2027704 500 164 21 315 +102.22 +/- 17.80 Show
693 ncm-et-4 2018-02-01 12:41 01:13:55 2027866 500 143 27 330 +82.10 +/- 17.21 Show
694 ncm-et-3 2018-02-01 13:54 01:12:48 2028851 500 164 28 308 +96.94 +/- 18.31 Show
695 ncm-et-4 2018-02-01 13:56 01:13:54 2029018 500 147 24 329 +87.26 +/- 17.19 Show
696 ncm-et-3 2018-02-01 15:08 01:14:00 2029673 500 161 25 314 +96.94 +/- 17.95 Show
697 ncm-et-4 2018-02-01 15:11 01:14:45 2026227 500 172 25 303 +105.25 +/- 18.48 Show
698 ncm-et-3 2018-02-01 16:23 01:13:05 2025245 500 162 25 313 +97.69 +/- 18.00 Show
699 ncm-et-4 2018-02-01 16:27 01:10:56 2027212 500 163 20 317 +102.22 +/- 17.67 Show
700 ncm-et-3 2018-02-01 17:38 01:13:53 2024590 500 148 23 329 +88.74 +/- 17.17 Show
701 ncm-et-4 2018-02-01 17:39 01:12:39 2025408 500 178 28 294 +107.54 +/- 18.99 Show
702 ncm-et-3 2018-02-01 18:53 01:12:59 2026882 500 151 25 324 +89.48 +/- 17.46 Show
703 ncm-et-4 2018-02-01 18:53 01:13:08 2025081 500 173 24 303 +106.78 +/- 18.46 Show
704 ncm-et-3 2018-02-01 20:07 01:13:51 2028687 500 141 18 341 +87.26 +/- 16.44 Show
705 ncm-et-4 2018-02-01 20:07 01:13:45 2024429 500 159 19 322 +99.95 +/- 17.40 Show
706 ncm-et-3 2018-02-01 21:22 01:13:18 2024100 500 156 17 327 +99.20 +/- 17.10 Show
707 ncm-et-4 2018-02-01 21:22 01:12:14 2027866 500 154 30 316 +88.00 +/- 17.96 Show
708 ncm-et-4 2018-02-01 22:36 01:13:15 2027539 500 154 23 323 +93.20 +/- 17.46 Show
709 ncm-et-3 2018-02-01 22:36 01:13:11 2026882 500 154 19 327 +96.19 +/- 17.16 Show
114815 ncm-et-15 2018-12-05 14:03 01:17:10 1956646 500 153 24 323 +91.71 +/- 17.48 Show
114816 ncm-et-3 2018-12-05 14:03 01:16:02 1962916 500 167 27 306 +99.95 +/- 18.38 Show
114817 ncm-et-9 2018-12-05 14:03 01:13:49 1969249 500 145 17 338 +90.97 +/- 16.56 Show
114818 ncm-et-10 2018-12-05 14:03 01:15:47 1975662 500 163 15 322 +106.01 +/- 17.28 Show
114819 ncm-et-13 2018-12-05 14:03 01:14:17 1984445 500 144 27 329 +82.83 +/- 17.26 Show
114820 ncm-et-4 2018-12-05 14:03 01:16:00 1933671 500 139 30 331 +76.98 +/- 17.22 Show
114821 ncm-et-9 2018-12-05 15:18 01:14:14 1959543 500 153 18 329 +96.19 +/- 17.03 Show
114822 ncm-et-13 2018-12-05 15:19 01:13:42 1976227 500 156 19 325 +97.69 +/- 17.26 Show
114823 ncm-et-10 2018-12-05 15:20 01:17:39 1954651 500 146 21 333 +88.74 +/- 16.92 Show
114824 ncm-et-3 2018-12-05 15:20 01:14:53 1965843 500 154 23 323 +93.20 +/- 17.46 Show
114825 ncm-et-4 2018-12-05 15:20 01:11:58 1962922 500 146 25 329 +85.78 +/- 17.21 Show
114826 ncm-et-15 2018-12-05 15:21 01:16:22 1965227 500 152 25 323 +90.22 +/- 17.51 Show
114827 ncm-et-9 2018-12-05 16:33 01:14:39 1970483 500 158 25 317 +94.70 +/- 17.80 Show
114828 ncm-et-13 2018-12-05 16:33 01:15:38 1995618 500 141 25 334 +82.10 +/- 16.97 Show
114829 ncm-et-4 2018-12-05 16:33 01:16:16 1919872 500 161 24 315 +97.69 +/- 17.87 Show
114830 ncm-et-3 2018-12-05 16:36 01:16:28 1961688 500 158 28 314 +92.46 +/- 18.01 Show
114831 ncm-et-10 2018-12-05 16:39 01:15:36 1966459 500 168 21 311 +105.25 +/- 17.99 Show
114832 ncm-et-15 2018-12-05 16:39 01:15:12 1959853 500 154 28 318 +89.48 +/- 17.82 Show
114833 ncm-et-9 2018-12-05 17:49 00:28:35 1968631 191 59 13 119 +85.35 +/- 29.58 Show
114834 ncm-et-13 2018-12-05 17:50 00:27:24 1978254 184 56 7 121 +94.81 +/- 28.19 Show
114835 ncm-et-4 2018-12-05 17:51 00:26:50 1964764 177 65 6 106 +120.41 +/- 31.08 Show
114836 ncm-et-3 2018-12-05 17:54 00:23:51 1963074 159 48 3 108 +101.09 +/- 28.84 Show
114837 ncm-et-15 2018-12-05 17:55 00:22:32 1959249 142 50 7 85 +108.61 +/- 35.11 Show
114838 ncm-et-10 2018-12-05 17:55 00:22:10 1970487 147 46 5 96 +99.54 +/- 31.66 Show

Commit

Commit ID cc76524c2e36345fcbf5fcdd3618a5dafd166b62
Author pb00068
Date 2017-03-09 02:03:01 UTC
Commit Type Non Functional
Further simplify skipping of plies with threads

No functional change

Closes #1020

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4972 1590 148 3234 +103.74 +/- 5.43
ncm-et-4 5028 1579 125 3324 +103.42 +/- 5.29
  10000 3169 273 6558 +103.58 +/- 3.79