Dev Builds » 20161019-1929

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-22 15:40 7205:15:03 1982402 2441 653 107 1681 +79.05 +/- 7.41
ncm-et-4 2018-03-22 15:40 7205:14:35 1982857 2481 664 113 1704 +78.47 +/- 7.38
ncm-et-5 2018-03-22 15:40 01:53:24 2005447 756 185 37 534 +68.91 +/- 13.00
ncm-et-6 2018-03-22 15:40 01:53:32 2025817 774 213 39 522 +79.46 +/- 13.51
ncm-et-7 2018-03-22 15:40 01:53:35 2008077 764 191 41 532 +69.11 +/- 13.18
ncm-et-8 2018-03-22 15:40 01:53:20 1972688 745 206 41 498 +78.25 +/- 13.93
ncm-et-9 2018-03-22 15:40 7205:15:05 1989480 2453 663 121 1669 +78.05 +/- 7.51
ncm-et-10 2018-03-22 15:40 7205:14:51 1985496 2444 702 127 1615 +83.30 +/- 7.76
ncm-et-11 2018-03-22 15:40 01:53:20 2006283 769 213 39 517 +80.00 +/- 13.60
ncm-et-12 2018-03-22 15:40 01:53:16 2019534 779 214 37 528 +80.34 +/- 13.37
ncm-et-13 2018-03-22 15:40 7205:14:51 1995665 2433 665 114 1654 +80.07 +/- 7.54
ncm-et-14 2018-03-22 15:40 01:53:22 2020673 759 202 41 516 +74.83 +/- 13.57
ncm-et-15 2018-03-22 15:40 7205:15:02 1992613 2402 685 105 1612 +85.58 +/- 7.67
  20000 5456 962 13582 +79.42 +/- 2.63

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
11059 ncm-et-9 2018-03-22 15:40 01:10:44 2024263 500 122 21 357 +71.16 +/- 15.71 Show
11060 ncm-et-7 2018-03-22 15:40 01:12:35 2017147 500 132 24 344 +76.25 +/- 16.45 Show
11061 ncm-et-15 2018-03-22 15:40 01:12:50 2019209 500 131 25 344 +74.79 +/- 16.47 Show
11062 ncm-et-11 2018-03-22 15:40 01:13:15 2016611 500 137 28 335 +76.98 +/- 16.98 Show
11063 ncm-et-3 2018-03-22 15:40 01:13:17 2026554 500 130 32 338 +68.99 +/- 16.92 Show
11064 ncm-et-5 2018-03-22 15:40 01:13:34 2023610 500 121 26 353 +66.82 +/- 16.03 Show
11065 ncm-et-13 2018-03-22 15:40 01:13:14 2027374 500 127 25 348 +71.89 +/- 16.27 Show
11066 ncm-et-6 2018-03-22 15:40 01:12:00 2025899 500 132 27 341 +74.06 +/- 16.66 Show
11067 ncm-et-14 2018-03-22 15:40 01:13:55 2020836 500 137 26 337 +78.44 +/- 16.84 Show
11068 ncm-et-10 2018-03-22 15:40 01:11:57 2020348 500 124 26 350 +68.99 +/- 16.19 Show
11069 ncm-et-8 2018-03-22 15:40 01:13:39 2023283 500 148 29 323 +84.31 +/- 17.60 Show
11070 ncm-et-4 2018-03-22 15:40 01:10:08 1989051 500 129 28 343 +71.16 +/- 16.59 Show
11071 ncm-et-12 2018-03-22 15:40 01:11:45 2019696 500 145 22 333 +87.26 +/- 16.94 Show
11072 ncm-et-4 2018-03-22 16:52 00:41:26 2024917 291 75 17 199 +70.19 +/- 21.86 Show
11073 ncm-et-9 2018-03-22 16:52 00:41:07 2027374 284 69 18 197 +63.08 +/- 21.86 Show
11074 ncm-et-6 2018-03-22 16:54 00:39:49 2025735 274 81 12 181 +89.42 +/- 23.08 Show
11075 ncm-et-12 2018-03-22 16:54 00:39:49 2019372 279 69 15 195 +68.10 +/- 21.75 Show
11076 ncm-et-10 2018-03-22 16:54 00:39:43 2019696 281 79 18 184 +76.64 +/- 23.28 Show
11077 ncm-et-7 2018-03-22 16:54 00:39:17 1999006 264 59 17 188 +55.75 +/- 22.03 Show
11078 ncm-et-15 2018-03-22 16:55 00:39:07 2018558 269 67 6 196 +80.18 +/- 20.53 Show
11079 ncm-et-11 2018-03-22 16:55 00:38:23 1995955 269 76 11 182 +85.65 +/- 22.71 Show
11080 ncm-et-13 2018-03-22 16:55 00:38:24 2025245 263 66 19 178 +62.76 +/- 23.41 Show
11081 ncm-et-3 2018-03-22 16:55 00:38:34 1996373 266 71 8 187 +83.88 +/- 21.71 Show
11082 ncm-et-5 2018-03-22 16:55 00:38:08 1987284 256 64 11 181 +72.98 +/- 22.24 Show
11083 ncm-et-8 2018-03-22 16:56 00:37:58 1922092 245 58 12 175 +66.02 +/- 22.57 Show
11084 ncm-et-14 2018-03-22 16:56 00:37:45 2020510 259 65 15 179 +67.92 +/- 22.91 Show
127680 ncm-et-9 2019-01-16 16:46 01:13:50 1969718 500 144 15 341 +91.71 +/- 16.35 Show
127681 ncm-et-4 2019-01-16 16:46 01:13:36 1967385 500 146 18 336 +90.97 +/- 16.69 Show
127682 ncm-et-13 2019-01-16 16:46 01:13:31 1975935 500 132 19 349 +79.90 +/- 16.07 Show
127683 ncm-et-15 2019-01-16 16:46 01:16:49 1990378 500 150 26 324 +88.00 +/- 17.48 Show
127684 ncm-et-10 2019-01-16 16:46 01:13:12 1971934 500 143 25 332 +83.57 +/- 17.07 Show
127685 ncm-et-3 2019-01-16 16:47 01:12:08 1973791 500 140 19 341 +85.78 +/- 16.47 Show
127686 ncm-et-3 2019-01-16 18:00 01:14:47 1968312 500 131 24 345 +75.52 +/- 16.39 Show
127687 ncm-et-10 2019-01-16 18:01 01:13:58 1967244 500 149 23 328 +89.48 +/- 17.21 Show
127688 ncm-et-13 2019-01-16 18:01 01:12:58 1986315 500 133 24 343 +76.98 +/- 16.50 Show
127689 ncm-et-4 2019-01-16 18:01 01:12:04 1966001 500 125 23 352 +71.89 +/- 16.02 Show
127690 ncm-et-9 2019-01-16 18:01 01:13:08 1972514 500 136 38 326 +68.99 +/- 17.61 Show
127691 ncm-et-15 2019-01-16 18:04 01:15:21 1973436 500 152 20 328 +93.95 +/- 17.14 Show
127692 ncm-et-4 2019-01-16 19:14 01:11:54 1983792 500 141 20 339 +85.78 +/- 16.59 Show
127693 ncm-et-13 2019-01-16 19:15 01:13:16 1972358 500 148 22 330 +89.48 +/- 17.09 Show
127694 ncm-et-9 2019-01-16 19:15 01:13:59 1972196 500 144 20 336 +88.00 +/- 16.74 Show
127695 ncm-et-10 2019-01-16 19:16 01:14:13 1968625 500 157 27 316 +92.46 +/- 17.89 Show
127696 ncm-et-3 2019-01-16 19:16 01:12:40 1966614 500 128 21 351 +75.52 +/- 16.02 Show
127697 ncm-et-15 2019-01-16 19:21 01:13:46 1983448 500 149 24 327 +88.74 +/- 17.29 Show
127698 ncm-et-4 2019-01-16 20:27 00:27:59 1965997 190 48 7 135 +76.17 +/- 25.55 Show
127699 ncm-et-13 2019-01-16 20:29 00:25:49 1986760 170 59 5 106 +114.32 +/- 30.55 Show
127700 ncm-et-3 2019-01-16 20:29 00:25:37 1962770 175 53 3 119 +102.11 +/- 27.40 Show
127701 ncm-et-9 2019-01-16 20:30 00:24:46 1970815 169 48 9 112 +81.65 +/- 29.53 Show
127702 ncm-et-10 2019-01-16 20:31 00:24:08 1965129 163 50 8 105 +91.59 +/- 30.79 Show
127703 ncm-et-15 2019-01-16 20:35 00:19:41 1970646 133 36 4 93 +85.27 +/- 30.94 Show

Commit

Commit ID 9893e7fd5394bf5d835d7e538964a577c82aaf1f
Author Joost Vandevondele
Date 2016-10-19 19:29:00 UTC
Commit Type
Make valgrind testing part of travis ci.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5010 1173 163 3674 +71.01 +/- 4.76
ncm-et-4 4990 1147 208 3635 +66.17 +/- 4.85
  10000 2320 371 7309 +68.59 +/- 3.40