Dev Builds » 20161019-1929

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-22 15:40 01:53:33 2011464 766 201 40 525 +74.13 +/- 13.37
ncm-et-4 2018-03-22 15:40 01:53:17 2006984 791 204 45 542 +70.80 +/- 13.21
ncm-et-5 2018-03-22 15:40 01:53:24 2005447 756 185 37 534 +68.91 +/- 13.00
ncm-et-6 2018-03-22 15:40 01:53:32 2025817 774 213 39 522 +79.46 +/- 13.51
ncm-et-7 2018-03-22 15:40 01:53:35 2008077 764 191 41 532 +69.11 +/- 13.18
ncm-et-8 2018-03-22 15:40 01:53:20 1972688 745 206 41 498 +78.25 +/- 13.93
ncm-et-9 2018-03-22 15:40 01:53:34 2025819 784 191 39 554 +68.22 +/- 12.77
ncm-et-10 2018-03-22 15:40 01:53:22 2020022 781 203 44 534 +71.73 +/- 13.31
ncm-et-11 2018-03-22 15:40 01:53:20 2006283 769 213 39 517 +80.00 +/- 13.60
ncm-et-12 2018-03-22 15:40 01:53:16 2019534 779 214 37 528 +80.34 +/- 13.37
ncm-et-13 2018-03-22 15:40 01:53:20 2026310 763 193 44 526 +68.73 +/- 13.37
ncm-et-14 2018-03-22 15:40 01:53:22 2020673 759 202 41 516 +74.83 +/- 13.57
ncm-et-15 2018-03-22 15:40 01:53:40 2018884 769 198 31 540 +76.67 +/- 12.89
  10000 2614 518 6868 +73.92 +/- 3.69

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
11059 ncm-et-9 2018-03-22 15:40 01:10:44 2024263 500 122 21 357 +71.16 +/- 15.71 Show
11060 ncm-et-7 2018-03-22 15:40 01:12:35 2017147 500 132 24 344 +76.25 +/- 16.45 Show
11061 ncm-et-15 2018-03-22 15:40 01:12:50 2019209 500 131 25 344 +74.79 +/- 16.47 Show
11062 ncm-et-11 2018-03-22 15:40 01:13:15 2016611 500 137 28 335 +76.98 +/- 16.98 Show
11063 ncm-et-3 2018-03-22 15:40 01:13:17 2026554 500 130 32 338 +68.99 +/- 16.92 Show
11064 ncm-et-5 2018-03-22 15:40 01:13:34 2023610 500 121 26 353 +66.82 +/- 16.03 Show
11065 ncm-et-13 2018-03-22 15:40 01:13:14 2027374 500 127 25 348 +71.89 +/- 16.27 Show
11066 ncm-et-6 2018-03-22 15:40 01:12:00 2025899 500 132 27 341 +74.06 +/- 16.66 Show
11067 ncm-et-14 2018-03-22 15:40 01:13:55 2020836 500 137 26 337 +78.44 +/- 16.84 Show
11068 ncm-et-10 2018-03-22 15:40 01:11:57 2020348 500 124 26 350 +68.99 +/- 16.19 Show
11069 ncm-et-8 2018-03-22 15:40 01:13:39 2023283 500 148 29 323 +84.31 +/- 17.60 Show
11070 ncm-et-4 2018-03-22 15:40 01:10:08 1989051 500 129 28 343 +71.16 +/- 16.59 Show
11071 ncm-et-12 2018-03-22 15:40 01:11:45 2019696 500 145 22 333 +87.26 +/- 16.94 Show
11072 ncm-et-4 2018-03-22 16:52 00:41:26 2024917 291 75 17 199 +70.19 +/- 21.86 Show
11073 ncm-et-9 2018-03-22 16:52 00:41:07 2027374 284 69 18 197 +63.08 +/- 21.86 Show
11074 ncm-et-6 2018-03-22 16:54 00:39:49 2025735 274 81 12 181 +89.42 +/- 23.08 Show
11075 ncm-et-12 2018-03-22 16:54 00:39:49 2019372 279 69 15 195 +68.10 +/- 21.75 Show
11076 ncm-et-10 2018-03-22 16:54 00:39:43 2019696 281 79 18 184 +76.64 +/- 23.28 Show
11077 ncm-et-7 2018-03-22 16:54 00:39:17 1999006 264 59 17 188 +55.75 +/- 22.03 Show
11078 ncm-et-15 2018-03-22 16:55 00:39:07 2018558 269 67 6 196 +80.18 +/- 20.53 Show
11079 ncm-et-11 2018-03-22 16:55 00:38:23 1995955 269 76 11 182 +85.65 +/- 22.71 Show
11080 ncm-et-13 2018-03-22 16:55 00:38:24 2025245 263 66 19 178 +62.76 +/- 23.41 Show
11081 ncm-et-3 2018-03-22 16:55 00:38:34 1996373 266 71 8 187 +83.88 +/- 21.71 Show
11082 ncm-et-5 2018-03-22 16:55 00:38:08 1987284 256 64 11 181 +72.98 +/- 22.24 Show
11083 ncm-et-8 2018-03-22 16:56 00:37:58 1922092 245 58 12 175 +66.02 +/- 22.57 Show
11084 ncm-et-14 2018-03-22 16:56 00:37:45 2020510 259 65 15 179 +67.92 +/- 22.91 Show

Commit

Commit ID 9893e7fd5394bf5d835d7e538964a577c82aaf1f
Author Joost Vandevondele
Date 2016-10-19 19:29:00 UTC
Commit Type
Make valgrind testing part of travis ci.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5010 1173 163 3674 +71.01 +/- 4.76
ncm-et-4 4990 1147 208 3635 +66.17 +/- 4.85
  10000 2320 371 7309 +68.59 +/- 3.40