Dev Builds » 20161019-1929

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded distro are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-22 15:40 7205:15:03 1982402 2441 653 107 1681 +79.05 +/- 7.41
ncm-et-4 2018-03-22 15:40 7205:14:35 1982857 2481 664 113 1704 +78.47 +/- 7.38
ncm-et-5 2018-03-22 15:40 01:53:24 2005447 756 185 37 534 +68.91 +/- 13.00
ncm-et-6 2018-03-22 15:40 01:53:32 2025817 774 213 39 522 +79.46 +/- 13.51
ncm-et-7 2018-03-22 15:40 01:53:35 2008077 764 191 41 532 +69.11 +/- 13.18
ncm-et-8 2018-03-22 15:40 01:53:20 1972688 745 206 41 498 +78.25 +/- 13.93
ncm-et-9 2018-03-22 15:40 7205:15:05 1989480 2453 663 121 1669 +78.05 +/- 7.51
ncm-et-10 2018-03-22 15:40 7205:14:51 1985496 2444 702 127 1615 +83.30 +/- 7.76
ncm-et-11 2018-03-22 15:40 01:53:20 2006283 769 213 39 517 +80.00 +/- 13.60
ncm-et-12 2018-03-22 15:40 01:53:16 2019534 779 214 37 528 +80.34 +/- 13.37
ncm-et-13 2018-03-22 15:40 7205:14:51 1995665 2433 665 114 1654 +80.07 +/- 7.54
ncm-et-14 2018-03-22 15:40 01:53:22 2020673 759 202 41 516 +74.83 +/- 13.57
ncm-et-15 2018-03-22 15:40 7205:15:02 1992613 2402 685 105 1612 +85.58 +/- 7.67
  20000 5456 962 13582 +79.42 +/- 2.63

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
11059 ncm-et-9 2018-03-22 15:40 01:10:44 2024263 500 122 21 357 +71.16 +/- 15.71 Show
11060 ncm-et-7 2018-03-22 15:40 01:12:35 2017147 500 132 24 344 +76.25 +/- 16.45 Show
11061 ncm-et-15 2018-03-22 15:40 01:12:50 2019209 500 131 25 344 +74.79 +/- 16.47 Show
11062 ncm-et-11 2018-03-22 15:40 01:13:15 2016611 500 137 28 335 +76.98 +/- 16.98 Show
11063 ncm-et-3 2018-03-22 15:40 01:13:17 2026554 500 130 32 338 +68.99 +/- 16.92 Show
11064 ncm-et-5 2018-03-22 15:40 01:13:34 2023610 500 121 26 353 +66.82 +/- 16.03 Show
11065 ncm-et-13 2018-03-22 15:40 01:13:14 2027374 500 127 25 348 +71.89 +/- 16.27 Show
11066 ncm-et-6 2018-03-22 15:40 01:12:00 2025899 500 132 27 341 +74.06 +/- 16.66 Show
11067 ncm-et-14 2018-03-22 15:40 01:13:55 2020836 500 137 26 337 +78.44 +/- 16.84 Show
11068 ncm-et-10 2018-03-22 15:40 01:11:57 2020348 500 124 26 350 +68.99 +/- 16.19 Show
11069 ncm-et-8 2018-03-22 15:40 01:13:39 2023283 500 148 29 323 +84.31 +/- 17.60 Show
11070 ncm-et-4 2018-03-22 15:40 01:10:08 1989051 500 129 28 343 +71.16 +/- 16.59 Show
11071 ncm-et-12 2018-03-22 15:40 01:11:45 2019696 500 145 22 333 +87.26 +/- 16.94 Show
11072 ncm-et-4 2018-03-22 16:52 00:41:26 2024917 291 75 17 199 +70.19 +/- 21.86 Show
11073 ncm-et-9 2018-03-22 16:52 00:41:07 2027374 284 69 18 197 +63.08 +/- 21.86 Show
11074 ncm-et-6 2018-03-22 16:54 00:39:49 2025735 274 81 12 181 +89.42 +/- 23.08 Show
11075 ncm-et-12 2018-03-22 16:54 00:39:49 2019372 279 69 15 195 +68.10 +/- 21.75 Show
11076 ncm-et-10 2018-03-22 16:54 00:39:43 2019696 281 79 18 184 +76.64 +/- 23.28 Show
11077 ncm-et-7 2018-03-22 16:54 00:39:17 1999006 264 59 17 188 +55.75 +/- 22.03 Show
11078 ncm-et-15 2018-03-22 16:55 00:39:07 2018558 269 67 6 196 +80.18 +/- 20.53 Show
11079 ncm-et-11 2018-03-22 16:55 00:38:23 1995955 269 76 11 182 +85.65 +/- 22.71 Show
11080 ncm-et-13 2018-03-22 16:55 00:38:24 2025245 263 66 19 178 +62.76 +/- 23.41 Show
11081 ncm-et-3 2018-03-22 16:55 00:38:34 1996373 266 71 8 187 +83.88 +/- 21.71 Show
11082 ncm-et-5 2018-03-22 16:55 00:38:08 1987284 256 64 11 181 +72.98 +/- 22.24 Show
11083 ncm-et-8 2018-03-22 16:56 00:37:58 1922092 245 58 12 175 +66.02 +/- 22.57 Show
11084 ncm-et-14 2018-03-22 16:56 00:37:45 2020510 259 65 15 179 +67.92 +/- 22.91 Show
127680 ncm-et-9 2019-01-16 16:46 01:13:50 1969718 500 144 15 341 +91.71 +/- 16.35 Show
127681 ncm-et-4 2019-01-16 16:46 01:13:36 1967385 500 146 18 336 +90.97 +/- 16.69 Show
127682 ncm-et-13 2019-01-16 16:46 01:13:31 1975935 500 132 19 349 +79.90 +/- 16.07 Show
127683 ncm-et-15 2019-01-16 16:46 01:16:49 1990378 500 150 26 324 +88.00 +/- 17.48 Show
127684 ncm-et-10 2019-01-16 16:46 01:13:12 1971934 500 143 25 332 +83.57 +/- 17.07 Show
127685 ncm-et-3 2019-01-16 16:47 01:12:08 1973791 500 140 19 341 +85.78 +/- 16.47 Show
127686 ncm-et-3 2019-01-16 18:00 01:14:47 1968312 500 131 24 345 +75.52 +/- 16.39 Show
127687 ncm-et-10 2019-01-16 18:01 01:13:58 1967244 500 149 23 328 +89.48 +/- 17.21 Show
127688 ncm-et-13 2019-01-16 18:01 01:12:58 1986315 500 133 24 343 +76.98 +/- 16.50 Show
127689 ncm-et-4 2019-01-16 18:01 01:12:04 1966001 500 125 23 352 +71.89 +/- 16.02 Show
127690 ncm-et-9 2019-01-16 18:01 01:13:08 1972514 500 136 38 326 +68.99 +/- 17.61 Show
127691 ncm-et-15 2019-01-16 18:04 01:15:21 1973436 500 152 20 328 +93.95 +/- 17.14 Show
127692 ncm-et-4 2019-01-16 19:14 01:11:54 1983792 500 141 20 339 +85.78 +/- 16.59 Show
127693 ncm-et-13 2019-01-16 19:15 01:13:16 1972358 500 148 22 330 +89.48 +/- 17.09 Show
127694 ncm-et-9 2019-01-16 19:15 01:13:59 1972196 500 144 20 336 +88.00 +/- 16.74 Show
127695 ncm-et-10 2019-01-16 19:16 01:14:13 1968625 500 157 27 316 +92.46 +/- 17.89 Show
127696 ncm-et-3 2019-01-16 19:16 01:12:40 1966614 500 128 21 351 +75.52 +/- 16.02 Show
127697 ncm-et-15 2019-01-16 19:21 01:13:46 1983448 500 149 24 327 +88.74 +/- 17.29 Show
127698 ncm-et-4 2019-01-16 20:27 00:27:59 1965997 190 48 7 135 +76.17 +/- 25.55 Show
127699 ncm-et-13 2019-01-16 20:29 00:25:49 1986760 170 59 5 106 +114.32 +/- 30.55 Show
127700 ncm-et-3 2019-01-16 20:29 00:25:37 1962770 175 53 3 119 +102.11 +/- 27.40 Show
127701 ncm-et-9 2019-01-16 20:30 00:24:46 1970815 169 48 9 112 +81.65 +/- 29.53 Show
127702 ncm-et-10 2019-01-16 20:31 00:24:08 1965129 163 50 8 105 +91.59 +/- 30.79 Show
127703 ncm-et-15 2019-01-16 20:35 00:19:41 1970646 133 36 4 93 +85.27 +/- 30.94 Show

Commit

Commit ID 9893e7fd5394bf5d835d7e538964a577c82aaf1f
Author Joost Vandevondele
Date 2016-10-19 19:29:00 UTC
Commit Type
Make valgrind testing part of travis ci.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5010 1173 163 3674 +71.01 +/- 4.76
ncm-et-4 4990 1147 208 3635 +66.17 +/- 4.85
  10000 2320 371 7309 +68.59 +/- 3.40