Dev Builds » 20170830-1302

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-21 15:45 5289:03:05 2005389 2972 1056 108 1808 +114.83 +/- 7.48
ncm-et-4 2018-02-21 15:45 5289:02:49 2003707 2937 1080 103 1754 +120.15 +/- 7.63
ncm-et-5 2018-02-21 15:45 03:05:57 2009673 1257 454 40 763 +118.86 +/- 11.48
ncm-et-6 2018-02-21 15:45 03:05:43 2024865 1251 424 45 782 +108.67 +/- 11.27
ncm-et-7 2018-02-21 15:44 03:06:08 2007328 1248 455 45 748 +118.54 +/- 11.68
ncm-et-8 2018-02-21 15:45 03:05:41 2021978 1247 450 48 749 +116.15 +/- 11.69
ncm-et-9 2018-02-21 15:45 5289:02:58 2003747 2918 1058 97 1763 +118.85 +/- 7.57
ncm-et-10 2018-02-21 15:44 5289:03:12 1985468 2878 1023 101 1754 +115.37 +/- 7.58
ncm-et-13 2018-09-29 20:35 04:12:56 1930687 1628 573 56 999 +114.29 +/- 10.02
ncm-et-15 2018-09-29 20:34 04:13:35 1946875 1664 593 63 1008 +114.65 +/- 10.04
  20000 7166 706 12128 +116.39 +/- 2.89

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
2233 ncm-et-7 2018-02-21 15:44 01:13:40 2001074 500 181 19 300 +116.78 +/- 18.48 Show
2234 ncm-et-10 2018-02-21 15:44 01:14:35 2021162 500 174 19 307 +111.37 +/- 18.14 Show
2235 ncm-et-4 2018-02-21 15:45 01:11:32 2023447 500 173 16 311 +112.91 +/- 17.85 Show
2236 ncm-et-3 2018-02-21 15:45 01:12:16 2026226 500 191 21 288 +123.02 +/- 19.12 Show
2237 ncm-et-5 2018-02-21 15:45 01:13:02 1979180 500 186 14 300 +124.60 +/- 18.33 Show
2238 ncm-et-6 2018-02-21 15:45 01:13:38 2026882 500 165 20 315 +103.73 +/- 17.77 Show
2239 ncm-et-9 2018-02-21 15:45 01:14:45 2024590 500 186 14 300 +124.60 +/- 18.33 Show
2240 ncm-et-8 2018-02-21 15:45 01:13:36 2022794 500 176 19 305 +112.91 +/- 18.23 Show
2241 ncm-et-4 2018-02-21 16:57 01:14:40 2023121 500 179 18 303 +116.00 +/- 18.30 Show
2242 ncm-et-3 2018-02-21 16:58 01:12:59 2027211 500 182 20 298 +116.78 +/- 18.60 Show
2243 ncm-et-5 2018-02-21 16:59 01:13:16 2024426 500 174 15 311 +114.45 +/- 17.82 Show
2244 ncm-et-7 2018-02-21 16:59 01:13:04 2024754 500 182 17 301 +119.11 +/- 18.37 Show
2245 ncm-et-6 2018-02-21 17:00 01:13:54 2021814 500 176 18 306 +113.68 +/- 18.16 Show
2246 ncm-et-8 2018-02-21 17:00 01:13:09 2021488 500 191 16 293 +126.97 +/- 18.74 Show
2247 ncm-et-10 2018-02-21 17:00 01:13:20 2017745 500 189 23 288 +119.89 +/- 19.17 Show
2248 ncm-et-9 2018-02-21 17:01 01:13:27 2021325 500 183 16 301 +120.67 +/- 18.34 Show
2249 ncm-et-3 2018-02-21 18:12 00:38:20 2025736 262 89 11 162 +106.66 +/- 25.01 Show
2250 ncm-et-4 2018-02-21 18:13 00:37:22 2025081 256 86 6 164 +112.33 +/- 24.15 Show
2251 ncm-et-5 2018-02-21 18:13 00:37:15 2025413 257 94 11 152 +116.37 +/- 26.19 Show
2252 ncm-et-7 2018-02-21 18:14 00:37:00 1996155 248 92 9 147 +120.94 +/- 26.49 Show
2253 ncm-et-8 2018-02-21 18:14 00:36:30 2021652 247 83 13 151 +101.23 +/- 26.19 Show
2254 ncm-et-6 2018-02-21 18:15 00:35:48 2025899 251 83 7 161 +108.60 +/- 24.46 Show
2255 ncm-et-10 2018-02-21 18:15 00:35:31 2019208 238 90 6 142 +128.13 +/- 26.66 Show
2256 ncm-et-9 2018-02-21 18:15 00:35:13 2024917 241 93 8 140 +128.04 +/- 27.23 Show
63618 ncm-et-9 2018-09-29 20:34 01:14:05 1988612 500 159 19 322 +99.95 +/- 17.40 Show
63619 ncm-et-15 2018-09-29 20:34 01:15:27 1953613 500 177 21 302 +112.14 +/- 18.43 Show
63620 ncm-et-10 2018-09-29 20:34 01:14:38 1984047 500 169 10 321 +114.45 +/- 17.16 Show
63621 ncm-et-4 2018-09-29 20:34 01:14:17 1990349 500 193 19 288 +126.18 +/- 19.07 Show
63622 ncm-et-3 2018-09-29 20:34 01:11:55 1989875 500 174 10 316 +118.33 +/- 17.41 Show
63623 ncm-et-13 2018-09-29 20:35 01:16:20 1942628 500 180 21 299 +114.45 +/- 18.58 Show
63624 ncm-et-3 2018-09-29 21:47 01:13:35 1989400 500 165 24 311 +100.71 +/- 18.07 Show
63625 ncm-et-9 2018-09-29 21:49 01:15:32 1989245 500 183 14 303 +122.24 +/- 18.18 Show
63626 ncm-et-4 2018-09-29 21:50 01:13:58 1990348 500 190 17 293 +125.39 +/- 18.77 Show
63627 ncm-et-10 2018-09-29 21:50 01:17:18 1949416 500 185 14 301 +123.81 +/- 18.28 Show
63628 ncm-et-15 2018-09-29 21:51 01:15:14 1952724 500 175 25 300 +107.54 +/- 18.63 Show
63629 ncm-et-13 2018-09-29 21:52 01:17:14 1886217 500 181 17 302 +118.33 +/- 18.32 Show
63630 ncm-et-3 2018-09-29 23:02 01:14:06 1988927 500 186 12 302 +126.18 +/- 18.16 Show
63631 ncm-et-4 2018-09-29 23:05 01:14:22 1985933 500 203 19 278 +134.15 +/- 19.57 Show
63632 ncm-et-9 2018-09-29 23:06 01:13:36 1987981 500 176 22 302 +110.60 +/- 18.46 Show
63633 ncm-et-15 2018-09-29 23:07 01:16:40 1900093 500 168 17 315 +108.30 +/- 17.69 Show
63634 ncm-et-10 2018-09-29 23:08 01:17:33 1925782 500 174 24 302 +107.54 +/- 18.51 Show
63635 ncm-et-13 2018-09-29 23:10 01:16:39 1955603 500 175 16 309 +114.45 +/- 17.95 Show
63636 ncm-et-3 2018-09-30 00:17 00:30:32 1990348 210 69 10 131 +100.31 +/- 27.85 Show
63637 ncm-et-4 2018-09-30 00:20 00:27:16 1987667 181 56 8 117 +94.39 +/- 29.02 Show
63638 ncm-et-9 2018-09-30 00:21 00:27:09 1989560 177 78 4 95 +154.73 +/- 33.42 Show
63639 ncm-et-15 2018-09-30 00:25 00:23:00 1981069 164 73 0 91 +166.28 +/- 33.07 Show
63640 ncm-et-10 2018-09-30 00:27 00:20:52 1980913 140 42 5 93 +94.05 +/- 31.97 Show
63641 ncm-et-13 2018-09-30 00:28 00:19:26 1938298 128 37 2 89 +97.48 +/- 31.25 Show

Commit

Commit ID bf485f4affc37cd408a65b66b8a3aad059bad5f3
Author Joost VandeVondele
Date 2017-08-30 13:02:40 UTC
Commit Type Simplification
Simplify away non-normal moves in SEE

credit goes to @mstembera for suggesting this approach.
SEE now deals with castling, promotion and en passant in a similar way.

passed STC
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 32902 W: 6079 L: 5979 D: 20844

passed LTC
LLR: 3.92 (-2.94,2.94) [-3.00,1.00]
Total: 110698 W: 14198 L: 14145 D: 82355

Bench: 5713905

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5012 1870 116 3026 +126.95 +/- 5.73
ncm-et-4 4988 1901 117 2970 +130.01 +/- 5.81
  10000 3771 233 5996 +128.48 +/- 4.08