Dev Builds » 20161019-1929

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-22 15:40 01:53:33 2011464 766 201 40 525 +74.13 +/- 13.37
ncm-et-4 2018-03-22 15:40 01:53:17 2006984 791 204 45 542 +70.80 +/- 13.21
ncm-et-5 2018-03-22 15:40 01:53:24 2005447 756 185 37 534 +68.91 +/- 13.00
ncm-et-6 2018-03-22 15:40 01:53:32 2025817 774 213 39 522 +79.46 +/- 13.51
ncm-et-7 2018-03-22 15:40 01:53:35 2008077 764 191 41 532 +69.11 +/- 13.18
ncm-et-8 2018-03-22 15:40 01:53:20 1972688 745 206 41 498 +78.25 +/- 13.93
ncm-et-9 2018-03-22 15:40 01:53:34 2025819 784 191 39 554 +68.22 +/- 12.77
ncm-et-10 2018-03-22 15:40 01:53:22 2020022 781 203 44 534 +71.73 +/- 13.31
ncm-et-11 2018-03-22 15:40 01:53:20 2006283 769 213 39 517 +80.00 +/- 13.60
ncm-et-12 2018-03-22 15:40 01:53:16 2019534 779 214 37 528 +80.34 +/- 13.37
ncm-et-13 2018-03-22 15:40 01:53:20 2026310 763 193 44 526 +68.73 +/- 13.37
ncm-et-14 2018-03-22 15:40 01:53:22 2020673 759 202 41 516 +74.83 +/- 13.57
ncm-et-15 2018-03-22 15:40 01:53:40 2018884 769 198 31 540 +76.67 +/- 12.89
  10000 2614 518 6868 +73.92 +/- 3.69

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
11059 ncm-et-9 2018-03-22 15:40 01:10:44 2024263 500 122 21 357 +71.16 +/- 15.71 Show
11060 ncm-et-7 2018-03-22 15:40 01:12:35 2017147 500 132 24 344 +76.25 +/- 16.45 Show
11061 ncm-et-15 2018-03-22 15:40 01:12:50 2019209 500 131 25 344 +74.79 +/- 16.47 Show
11062 ncm-et-11 2018-03-22 15:40 01:13:15 2016611 500 137 28 335 +76.98 +/- 16.98 Show
11063 ncm-et-3 2018-03-22 15:40 01:13:17 2026554 500 130 32 338 +68.99 +/- 16.92 Show
11064 ncm-et-5 2018-03-22 15:40 01:13:34 2023610 500 121 26 353 +66.82 +/- 16.03 Show
11065 ncm-et-13 2018-03-22 15:40 01:13:14 2027374 500 127 25 348 +71.89 +/- 16.27 Show
11066 ncm-et-6 2018-03-22 15:40 01:12:00 2025899 500 132 27 341 +74.06 +/- 16.66 Show
11067 ncm-et-14 2018-03-22 15:40 01:13:55 2020836 500 137 26 337 +78.44 +/- 16.84 Show
11068 ncm-et-10 2018-03-22 15:40 01:11:57 2020348 500 124 26 350 +68.99 +/- 16.19 Show
11069 ncm-et-8 2018-03-22 15:40 01:13:39 2023283 500 148 29 323 +84.31 +/- 17.60 Show
11070 ncm-et-4 2018-03-22 15:40 01:10:08 1989051 500 129 28 343 +71.16 +/- 16.59 Show
11071 ncm-et-12 2018-03-22 15:40 01:11:45 2019696 500 145 22 333 +87.26 +/- 16.94 Show
11072 ncm-et-4 2018-03-22 16:52 00:41:26 2024917 291 75 17 199 +70.19 +/- 21.86 Show
11073 ncm-et-9 2018-03-22 16:52 00:41:07 2027374 284 69 18 197 +63.08 +/- 21.86 Show
11074 ncm-et-6 2018-03-22 16:54 00:39:49 2025735 274 81 12 181 +89.42 +/- 23.08 Show
11075 ncm-et-12 2018-03-22 16:54 00:39:49 2019372 279 69 15 195 +68.10 +/- 21.75 Show
11076 ncm-et-10 2018-03-22 16:54 00:39:43 2019696 281 79 18 184 +76.64 +/- 23.28 Show
11077 ncm-et-7 2018-03-22 16:54 00:39:17 1999006 264 59 17 188 +55.75 +/- 22.03 Show
11078 ncm-et-15 2018-03-22 16:55 00:39:07 2018558 269 67 6 196 +80.18 +/- 20.53 Show
11079 ncm-et-11 2018-03-22 16:55 00:38:23 1995955 269 76 11 182 +85.65 +/- 22.71 Show
11080 ncm-et-13 2018-03-22 16:55 00:38:24 2025245 263 66 19 178 +62.76 +/- 23.41 Show
11081 ncm-et-3 2018-03-22 16:55 00:38:34 1996373 266 71 8 187 +83.88 +/- 21.71 Show
11082 ncm-et-5 2018-03-22 16:55 00:38:08 1987284 256 64 11 181 +72.98 +/- 22.24 Show
11083 ncm-et-8 2018-03-22 16:56 00:37:58 1922092 245 58 12 175 +66.02 +/- 22.57 Show
11084 ncm-et-14 2018-03-22 16:56 00:37:45 2020510 259 65 15 179 +67.92 +/- 22.91 Show

Commit

Commit ID 9893e7fd5394bf5d835d7e538964a577c82aaf1f
Author Joost Vandevondele
Date 2016-10-19 19:29:00 UTC
Commit Type
Make valgrind testing part of travis ci.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5010 1173 163 3674 +71.01 +/- 4.76
ncm-et-4 4990 1147 208 3635 +66.17 +/- 4.85
  10000 2320 371 7309 +68.59 +/- 3.40