Dev Builds » 20170930-1856

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-21 09:31 5201:01:02 2005393 2967 1079 109 1779 +117.91 +/- 7.57
ncm-et-4 2018-02-21 09:31 5201:01:04 2000557 2937 1090 100 1747 +121.88 +/- 7.65
ncm-et-5 2018-02-21 09:31 03:04:53 2023446 1239 443 39 757 +117.58 +/- 11.50
ncm-et-6 2018-02-21 09:31 03:04:50 2026994 1247 424 41 782 +110.27 +/- 11.23
ncm-et-7 2018-02-21 09:31 03:04:57 2011600 1256 446 43 767 +115.56 +/- 11.45
ncm-et-8 2018-02-21 09:31 03:03:58 1981649 1213 448 52 713 +117.73 +/- 12.09
ncm-et-9 2018-02-21 09:31 5201:01:04 2004276 2951 1061 106 1784 +116.63 +/- 7.54
ncm-et-10 2018-02-21 09:31 5201:01:14 1995873 2935 1112 102 1721 +124.65 +/- 7.74
ncm-et-13 2018-09-25 22:21 04:11:10 1892485 1592 605 50 937 +126.42 +/- 10.45
ncm-et-15 2018-09-25 22:21 04:11:12 1970126 1663 577 56 1030 +112.63 +/- 9.83
  20000 7285 698 12017 +118.86 +/- 2.91

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
2185 ncm-et-10 2018-02-21 09:31 01:11:16 2017909 500 182 14 304 +121.46 +/- 18.13 Show
2186 ncm-et-7 2018-02-21 09:31 01:13:29 2026718 500 187 17 296 +123.02 +/- 18.62 Show
2187 ncm-et-5 2018-02-21 09:31 01:13:18 2023120 500 180 13 307 +120.67 +/- 17.95 Show
2188 ncm-et-4 2018-02-21 09:31 01:14:29 1995969 500 183 20 297 +117.55 +/- 18.65 Show
2189 ncm-et-9 2018-02-21 09:31 01:13:05 2022140 500 198 15 287 +133.34 +/- 19.00 Show
2190 ncm-et-6 2018-02-21 09:31 01:14:21 2025572 500 172 17 311 +111.37 +/- 17.88 Show
2191 ncm-et-3 2018-02-21 09:31 01:11:38 2026063 500 188 18 294 +123.02 +/- 18.74 Show
2192 ncm-et-8 2018-02-21 09:31 01:15:17 1995053 500 170 26 304 +102.97 +/- 18.46 Show
2193 ncm-et-10 2018-02-21 10:43 01:13:59 2020674 500 201 13 286 +137.37 +/- 18.99 Show
2194 ncm-et-3 2018-02-21 10:44 01:11:48 2028199 500 188 14 298 +126.18 +/- 18.43 Show
2195 ncm-et-9 2018-02-21 10:45 01:11:40 2025081 500 182 20 298 +116.78 +/- 18.60 Show
2196 ncm-et-5 2018-02-21 10:45 01:14:29 2024099 500 182 17 301 +119.11 +/- 18.37 Show
2197 ncm-et-7 2018-02-21 10:45 01:11:14 2026063 500 180 18 302 +116.78 +/- 18.35 Show
2198 ncm-et-6 2018-02-21 10:46 01:11:44 2029839 500 159 16 325 +102.22 +/- 17.17 Show
2199 ncm-et-4 2018-02-21 10:46 01:13:41 2026393 500 204 11 285 +141.44 +/- 18.97 Show
2200 ncm-et-8 2018-02-21 10:48 01:13:20 1990855 500 197 20 283 +128.55 +/- 19.34 Show
2201 ncm-et-3 2018-02-21 11:57 00:38:55 2025408 282 109 6 167 +133.04 +/- 24.53 Show
2202 ncm-et-7 2018-02-21 11:58 00:37:48 1982019 256 79 8 169 +98.95 +/- 23.65 Show
2203 ncm-et-9 2018-02-21 11:58 00:37:48 2025736 265 98 12 155 +116.98 +/- 26.05 Show
2204 ncm-et-10 2018-02-21 11:58 00:37:23 2020673 257 85 12 160 +101.48 +/- 25.19 Show
2205 ncm-et-6 2018-02-21 11:59 00:36:21 2025572 247 93 8 146 +124.65 +/- 26.52 Show
2206 ncm-et-5 2018-02-21 12:01 00:34:39 2023120 239 81 9 149 +108.02 +/- 25.92 Show
2207 ncm-et-4 2018-02-21 12:01 00:34:11 2023772 241 83 4 154 +118.25 +/- 24.77 Show
2208 ncm-et-8 2018-02-21 12:02 00:32:56 1959040 213 81 6 126 +127.81 +/- 28.45 Show
63111 ncm-et-10 2018-09-25 22:21 01:13:22 1981538 500 198 17 285 +131.74 +/- 19.16 Show
63112 ncm-et-15 2018-09-25 22:21 01:17:20 1930083 500 183 17 300 +119.89 +/- 18.42 Show
63113 ncm-et-13 2018-09-25 22:21 01:19:11 1829608 500 205 13 282 +140.62 +/- 19.19 Show
63114 ncm-et-4 2018-09-25 22:21 01:12:08 1988612 500 184 14 302 +123.02 +/- 18.23 Show
63115 ncm-et-9 2018-09-25 22:21 01:13:10 1989246 500 169 16 315 +109.83 +/- 17.66 Show
63116 ncm-et-3 2018-09-25 22:21 01:14:18 1989243 500 170 24 306 +104.49 +/- 18.31 Show
63117 ncm-et-4 2018-09-25 23:34 01:13:43 1987981 500 186 16 298 +123.02 +/- 18.49 Show
63118 ncm-et-10 2018-09-25 23:35 01:15:02 1979663 500 191 20 289 +123.81 +/- 19.05 Show
63119 ncm-et-9 2018-09-25 23:35 01:13:47 1989401 500 181 20 299 +116.00 +/- 18.55 Show
63120 ncm-et-3 2018-09-25 23:36 01:12:44 1989875 500 177 18 305 +114.45 +/- 18.20 Show
63121 ncm-et-15 2018-09-25 23:39 01:12:52 1981540 500 163 21 316 +101.46 +/- 17.75 Show
63122 ncm-et-13 2018-09-25 23:41 01:15:27 1930607 500 195 21 284 +126.18 +/- 19.32 Show
63123 ncm-et-4 2018-09-26 00:49 01:12:24 1990823 500 169 25 306 +102.97 +/- 18.34 Show
63124 ncm-et-9 2018-09-26 00:50 01:13:38 1989559 500 172 16 312 +112.14 +/- 17.80 Show
63125 ncm-et-3 2018-09-26 00:50 01:13:42 1989244 500 175 23 302 +109.07 +/- 18.48 Show
63126 ncm-et-10 2018-09-26 00:51 01:13:32 1982007 500 188 19 293 +122.24 +/- 18.82 Show
63127 ncm-et-15 2018-09-26 00:53 01:13:27 1984047 500 174 15 311 +114.45 +/- 17.82 Show
63128 ncm-et-13 2018-09-26 00:58 01:19:32 1872551 500 171 11 318 +115.23 +/- 17.35 Show
63129 ncm-et-4 2018-09-26 02:02 00:29:39 1990350 196 81 10 105 +131.84 +/- 32.40 Show
63130 ncm-et-9 2018-09-26 02:05 00:27:13 1988769 186 61 7 118 +103.85 +/- 28.96 Show
63131 ncm-et-3 2018-09-26 02:05 00:26:53 1989716 185 72 6 107 +129.65 +/- 31.19 Show
63132 ncm-et-10 2018-09-26 02:06 00:26:13 1968645 178 67 7 104 +121.88 +/- 31.72 Show
63133 ncm-et-15 2018-09-26 02:07 00:24:19 1984833 163 57 3 103 +119.61 +/- 30.51 Show
63134 ncm-et-13 2018-09-26 02:18 00:13:42 1937175 92 34 5 53 +113.38 +/- 45.17 Show

Commit

Commit ID 07b5a28a68b4cc67f1447fce85fc910aa209b319
Author VoyagerOne
Date 2017-09-30 18:56:27 UTC
Commit Type Elo
Decrease reduction for exact PV nodes

STC:
LLR: 2.96 (-2.94,2.94) [0.00,5.00]
Total: 59004 W: 10621 L: 10249 D: 38134

LTC:
LLR: 2.95 (-2.94,2.94) [0.00,5.00]
Total: 25801 W: 3306 L: 3108 D: 19387

Bench: 5742466

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4987 1958 112 2917 +135.02 +/- 5.88
ncm-et-4 5013 1934 94 2985 +133.76 +/- 5.77
  10000 3892 206 5902 +134.39 +/- 4.12