Dev Builds » 20170930-1856

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-21 09:31 5201:01:02 2005393 2967 1079 109 1779 +117.91 +/- 7.57
ncm-et-4 2018-02-21 09:31 5201:01:04 2000557 2937 1090 100 1747 +121.88 +/- 7.65
ncm-et-5 2018-02-21 09:31 03:04:53 2023446 1239 443 39 757 +117.58 +/- 11.50
ncm-et-6 2018-02-21 09:31 03:04:50 2026994 1247 424 41 782 +110.27 +/- 11.23
ncm-et-7 2018-02-21 09:31 03:04:57 2011600 1256 446 43 767 +115.56 +/- 11.45
ncm-et-8 2018-02-21 09:31 03:03:58 1981649 1213 448 52 713 +117.73 +/- 12.09
ncm-et-9 2018-02-21 09:31 5201:01:04 2004276 2951 1061 106 1784 +116.63 +/- 7.54
ncm-et-10 2018-02-21 09:31 5201:01:14 1995873 2935 1112 102 1721 +124.65 +/- 7.74
ncm-et-13 2018-09-25 22:21 04:11:10 1892485 1592 605 50 937 +126.42 +/- 10.45
ncm-et-15 2018-09-25 22:21 04:11:12 1970126 1663 577 56 1030 +112.63 +/- 9.83
  20000 7285 698 12017 +118.86 +/- 2.91

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
2185 ncm-et-10 2018-02-21 09:31 01:11:16 2017909 500 182 14 304 +121.46 +/- 18.13 Show
2186 ncm-et-7 2018-02-21 09:31 01:13:29 2026718 500 187 17 296 +123.02 +/- 18.62 Show
2187 ncm-et-5 2018-02-21 09:31 01:13:18 2023120 500 180 13 307 +120.67 +/- 17.95 Show
2188 ncm-et-4 2018-02-21 09:31 01:14:29 1995969 500 183 20 297 +117.55 +/- 18.65 Show
2189 ncm-et-9 2018-02-21 09:31 01:13:05 2022140 500 198 15 287 +133.34 +/- 19.00 Show
2190 ncm-et-6 2018-02-21 09:31 01:14:21 2025572 500 172 17 311 +111.37 +/- 17.88 Show
2191 ncm-et-3 2018-02-21 09:31 01:11:38 2026063 500 188 18 294 +123.02 +/- 18.74 Show
2192 ncm-et-8 2018-02-21 09:31 01:15:17 1995053 500 170 26 304 +102.97 +/- 18.46 Show
2193 ncm-et-10 2018-02-21 10:43 01:13:59 2020674 500 201 13 286 +137.37 +/- 18.99 Show
2194 ncm-et-3 2018-02-21 10:44 01:11:48 2028199 500 188 14 298 +126.18 +/- 18.43 Show
2195 ncm-et-9 2018-02-21 10:45 01:11:40 2025081 500 182 20 298 +116.78 +/- 18.60 Show
2196 ncm-et-5 2018-02-21 10:45 01:14:29 2024099 500 182 17 301 +119.11 +/- 18.37 Show
2197 ncm-et-7 2018-02-21 10:45 01:11:14 2026063 500 180 18 302 +116.78 +/- 18.35 Show
2198 ncm-et-6 2018-02-21 10:46 01:11:44 2029839 500 159 16 325 +102.22 +/- 17.17 Show
2199 ncm-et-4 2018-02-21 10:46 01:13:41 2026393 500 204 11 285 +141.44 +/- 18.97 Show
2200 ncm-et-8 2018-02-21 10:48 01:13:20 1990855 500 197 20 283 +128.55 +/- 19.34 Show
2201 ncm-et-3 2018-02-21 11:57 00:38:55 2025408 282 109 6 167 +133.04 +/- 24.53 Show
2202 ncm-et-7 2018-02-21 11:58 00:37:48 1982019 256 79 8 169 +98.95 +/- 23.65 Show
2203 ncm-et-9 2018-02-21 11:58 00:37:48 2025736 265 98 12 155 +116.98 +/- 26.05 Show
2204 ncm-et-10 2018-02-21 11:58 00:37:23 2020673 257 85 12 160 +101.48 +/- 25.19 Show
2205 ncm-et-6 2018-02-21 11:59 00:36:21 2025572 247 93 8 146 +124.65 +/- 26.52 Show
2206 ncm-et-5 2018-02-21 12:01 00:34:39 2023120 239 81 9 149 +108.02 +/- 25.92 Show
2207 ncm-et-4 2018-02-21 12:01 00:34:11 2023772 241 83 4 154 +118.25 +/- 24.77 Show
2208 ncm-et-8 2018-02-21 12:02 00:32:56 1959040 213 81 6 126 +127.81 +/- 28.45 Show
63111 ncm-et-10 2018-09-25 22:21 01:13:22 1981538 500 198 17 285 +131.74 +/- 19.16 Show
63112 ncm-et-15 2018-09-25 22:21 01:17:20 1930083 500 183 17 300 +119.89 +/- 18.42 Show
63113 ncm-et-13 2018-09-25 22:21 01:19:11 1829608 500 205 13 282 +140.62 +/- 19.19 Show
63114 ncm-et-4 2018-09-25 22:21 01:12:08 1988612 500 184 14 302 +123.02 +/- 18.23 Show
63115 ncm-et-9 2018-09-25 22:21 01:13:10 1989246 500 169 16 315 +109.83 +/- 17.66 Show
63116 ncm-et-3 2018-09-25 22:21 01:14:18 1989243 500 170 24 306 +104.49 +/- 18.31 Show
63117 ncm-et-4 2018-09-25 23:34 01:13:43 1987981 500 186 16 298 +123.02 +/- 18.49 Show
63118 ncm-et-10 2018-09-25 23:35 01:15:02 1979663 500 191 20 289 +123.81 +/- 19.05 Show
63119 ncm-et-9 2018-09-25 23:35 01:13:47 1989401 500 181 20 299 +116.00 +/- 18.55 Show
63120 ncm-et-3 2018-09-25 23:36 01:12:44 1989875 500 177 18 305 +114.45 +/- 18.20 Show
63121 ncm-et-15 2018-09-25 23:39 01:12:52 1981540 500 163 21 316 +101.46 +/- 17.75 Show
63122 ncm-et-13 2018-09-25 23:41 01:15:27 1930607 500 195 21 284 +126.18 +/- 19.32 Show
63123 ncm-et-4 2018-09-26 00:49 01:12:24 1990823 500 169 25 306 +102.97 +/- 18.34 Show
63124 ncm-et-9 2018-09-26 00:50 01:13:38 1989559 500 172 16 312 +112.14 +/- 17.80 Show
63125 ncm-et-3 2018-09-26 00:50 01:13:42 1989244 500 175 23 302 +109.07 +/- 18.48 Show
63126 ncm-et-10 2018-09-26 00:51 01:13:32 1982007 500 188 19 293 +122.24 +/- 18.82 Show
63127 ncm-et-15 2018-09-26 00:53 01:13:27 1984047 500 174 15 311 +114.45 +/- 17.82 Show
63128 ncm-et-13 2018-09-26 00:58 01:19:32 1872551 500 171 11 318 +115.23 +/- 17.35 Show
63129 ncm-et-4 2018-09-26 02:02 00:29:39 1990350 196 81 10 105 +131.84 +/- 32.40 Show
63130 ncm-et-9 2018-09-26 02:05 00:27:13 1988769 186 61 7 118 +103.85 +/- 28.96 Show
63131 ncm-et-3 2018-09-26 02:05 00:26:53 1989716 185 72 6 107 +129.65 +/- 31.19 Show
63132 ncm-et-10 2018-09-26 02:06 00:26:13 1968645 178 67 7 104 +121.88 +/- 31.72 Show
63133 ncm-et-15 2018-09-26 02:07 00:24:19 1984833 163 57 3 103 +119.61 +/- 30.51 Show
63134 ncm-et-13 2018-09-26 02:18 00:13:42 1937175 92 34 5 53 +113.38 +/- 45.17 Show

Commit

Commit ID 07b5a28a68b4cc67f1447fce85fc910aa209b319
Author VoyagerOne
Date 2017-09-30 18:56:27 UTC
Commit Type Elo
Decrease reduction for exact PV nodes

STC:
LLR: 2.96 (-2.94,2.94) [0.00,5.00]
Total: 59004 W: 10621 L: 10249 D: 38134

LTC:
LLR: 2.95 (-2.94,2.94) [0.00,5.00]
Total: 25801 W: 3306 L: 3108 D: 19387

Bench: 5742466

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4987 1958 112 2917 +135.02 +/- 5.88
ncm-et-4 5013 1934 94 2985 +133.76 +/- 5.77
  10000 3892 206 5902 +134.39 +/- 4.12