Dev Builds » 20171022-0500

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-02 12:30 4960:58:17 2002638 2551 931 75 1545 +121.28 +/- 8.06
ncm-et-4 2018-03-02 12:30 4960:58:17 2001283 2514 924 83 1507 +120.88 +/- 8.21
ncm-et-5 2018-03-02 12:30 02:02:55 2012938 824 279 20 525 +113.03 +/- 13.52
ncm-et-6 2018-03-02 12:30 02:03:10 2026801 834 304 30 500 +118.54 +/- 14.29
ncm-et-7 2018-03-02 12:30 02:03:08 2024509 842 301 32 509 +115.02 +/- 14.15
ncm-et-8 2018-03-02 12:30 02:02:52 1930887 816 321 20 475 +134.50 +/- 14.64
ncm-et-9 2018-03-02 12:30 4960:58:19 2001288 2495 925 78 1492 +122.82 +/- 8.24
ncm-et-10 2018-03-02 12:30 4960:58:22 1987810 2514 939 84 1491 +123.06 +/- 8.28
ncm-et-11 2018-03-02 12:30 02:03:08 2003619 838 306 21 511 +123.06 +/- 13.93
ncm-et-12 2018-03-02 12:30 02:03:03 1990179 829 304 18 507 +124.99 +/- 13.92
ncm-et-13 2018-03-02 12:30 4960:58:24 1973922 2449 918 73 1458 +125.01 +/- 8.34
ncm-et-14 2018-03-02 12:30 02:03:08 2019372 848 299 24 525 +116.89 +/- 13.71
ncm-et-15 2018-09-25 01:17 04:11:02 1956477 1646 608 45 993 +123.83 +/- 10.04
  20000 7359 603 12038 +122.16 +/- 2.89

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
4392 ncm-et-9 2018-03-02 12:30 01:13:09 2026064 500 173 23 304 +107.54 +/- 18.39 Show
4393 ncm-et-11 2018-03-02 12:30 01:11:25 1990628 500 186 10 304 +127.76 +/- 17.99 Show
4394 ncm-et-6 2018-03-02 12:30 01:12:47 2026555 500 178 20 302 +113.68 +/- 18.41 Show
4395 ncm-et-13 2018-03-02 12:30 01:14:09 2023446 500 201 18 281 +133.34 +/- 19.39 Show
4396 ncm-et-5 2018-03-02 12:30 01:14:23 2002427 500 180 16 304 +118.33 +/- 18.19 Show
4397 ncm-et-3 2018-03-02 12:30 01:13:17 2027210 500 183 18 299 +119.11 +/- 18.50 Show
4398 ncm-et-10 2018-03-02 12:30 01:13:34 2019372 500 193 19 288 +126.18 +/- 19.07 Show
4399 ncm-et-7 2018-03-02 12:30 01:13:02 2023773 500 174 18 308 +112.14 +/- 18.06 Show
4400 ncm-et-14 2018-03-02 12:30 01:11:29 2018070 500 175 14 311 +116.00 +/- 17.79 Show
4401 ncm-et-4 2018-03-02 12:30 01:13:45 2024754 500 181 17 302 +118.33 +/- 18.32 Show
4402 ncm-et-12 2018-03-02 12:30 01:13:05 1988828 500 190 15 295 +126.97 +/- 18.61 Show
4403 ncm-et-8 2018-03-02 12:30 01:12:20 2022141 500 216 12 272 +150.51 +/- 19.66 Show
4404 ncm-et-11 2018-03-02 13:42 00:50:24 2016610 338 120 11 207 +116.19 +/- 22.02 Show
4405 ncm-et-14 2018-03-02 13:43 00:50:20 2020673 348 124 10 214 +118.17 +/- 21.56 Show
4406 ncm-et-8 2018-03-02 13:44 00:49:09 1839632 316 105 8 203 +110.20 +/- 21.71 Show
4407 ncm-et-6 2018-03-02 13:44 00:49:04 2027047 334 126 10 198 +125.90 +/- 22.69 Show
4408 ncm-et-9 2018-03-02 13:44 00:48:43 2027211 334 122 10 202 +121.19 +/- 22.33 Show
4409 ncm-et-7 2018-03-02 13:44 00:48:47 2025244 342 127 14 201 +119.27 +/- 22.77 Show
4410 ncm-et-12 2018-03-02 13:44 00:48:37 1991530 329 114 3 212 +122.00 +/- 20.84 Show
4411 ncm-et-3 2018-03-02 13:44 00:48:33 2027378 343 142 10 191 +140.96 +/- 23.46 Show
4412 ncm-et-10 2018-03-02 13:45 00:48:17 2016933 333 106 11 216 +101.95 +/- 21.11 Show
4413 ncm-et-4 2018-03-02 13:45 00:47:58 2023446 335 133 8 194 +136.22 +/- 22.95 Show
4414 ncm-et-13 2018-03-02 13:45 00:47:36 2022467 324 128 10 186 +132.62 +/- 23.64 Show
4415 ncm-et-5 2018-03-02 13:45 00:47:13 2023448 324 99 4 221 +104.95 +/- 19.93 Show
62991 ncm-et-3 2018-09-25 01:17 01:11:58 1989876 500 175 11 314 +118.33 +/- 17.54 Show
62992 ncm-et-10 2018-09-25 01:17 01:12:56 1980128 500 194 11 295 +133.34 +/- 18.47 Show
62993 ncm-et-4 2018-09-25 01:17 01:13:11 1990033 500 173 16 311 +112.91 +/- 17.85 Show
62994 ncm-et-9 2018-09-25 01:17 01:15:38 1990348 500 195 11 294 +134.15 +/- 18.52 Show
62995 ncm-et-13 2018-09-25 01:17 01:16:18 1944730 500 174 16 310 +113.68 +/- 17.90 Show
62996 ncm-et-15 2018-09-25 01:17 01:16:20 1941657 500 183 15 302 +121.46 +/- 18.26 Show
62997 ncm-et-3 2018-09-25 02:30 01:13:22 1992247 500 181 16 303 +119.11 +/- 18.24 Show
62998 ncm-et-10 2018-09-25 02:31 01:13:12 1980285 500 175 22 303 +109.83 +/- 18.41 Show
62999 ncm-et-4 2018-09-25 02:31 01:14:08 1989558 500 189 23 288 +119.89 +/- 19.17 Show
63000 ncm-et-9 2018-09-25 02:34 01:13:57 1986092 500 187 10 303 +128.55 +/- 18.04 Show
63001 ncm-et-13 2018-09-25 02:34 01:16:07 1952169 500 184 13 303 +123.81 +/- 18.15 Show
63002 ncm-et-15 2018-09-25 02:35 01:14:42 1940404 500 176 12 312 +118.33 +/- 17.67 Show
63003 ncm-et-3 2018-09-25 03:45 01:12:39 1990506 500 182 10 308 +124.60 +/- 17.80 Show
63004 ncm-et-10 2018-09-25 03:45 01:14:26 1949384 500 201 15 284 +135.76 +/- 19.15 Show
63005 ncm-et-4 2018-09-25 03:47 01:13:35 1990350 500 191 12 297 +130.15 +/- 18.41 Show
63006 ncm-et-9 2018-09-25 03:49 01:14:36 1990034 500 191 20 289 +123.81 +/- 19.05 Show
63007 ncm-et-15 2018-09-25 03:50 01:14:46 1980442 500 189 14 297 +126.97 +/- 18.48 Show
63008 ncm-et-13 2018-09-25 03:52 01:16:36 1928570 500 190 10 300 +130.94 +/- 18.19 Show
63009 ncm-et-3 2018-09-25 04:58 00:29:44 1988612 208 68 10 130 +99.52 +/- 27.95 Show
63010 ncm-et-10 2018-09-25 05:01 00:27:12 1980758 181 70 6 105 +128.39 +/- 31.49 Show
63011 ncm-et-4 2018-09-25 05:01 00:26:54 1989559 179 57 7 115 +99.70 +/- 29.23 Show
63012 ncm-et-9 2018-09-25 05:04 00:23:26 1987981 161 57 4 100 +118.80 +/- 31.37 Show
63013 ncm-et-15 2018-09-25 05:06 00:21:59 1963403 146 60 4 82 +140.44 +/- 35.79 Show
63014 ncm-et-13 2018-09-25 05:09 00:18:40 1972149 125 41 6 78 +99.95 +/- 36.16 Show

Commit

Commit ID 0dc3b0978dca0459ceb483ada3792080f4caad15
Author ceebo
Date 2017-10-22 05:00:46 UTC
Commit Type Non Functional
Add initiative to trace

No functional change

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4999 1845 122 3032 +124.86 +/- 5.72
ncm-et-4 5001 1900 85 3016 +132.11 +/- 5.70
  10000 3745 207 6048 +128.48 +/- 4.04