Dev Builds » 20170617-0233

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-22 22:54 5740:29:23 2004273 2700 916 105 1679 +107.68 +/- 7.72
ncm-et-4 2018-02-22 22:54 5740:29:41 2001132 2694 937 101 1656 +111.49 +/- 7.80
ncm-et-5 2018-02-22 22:55 02:27:41 2020540 1000 338 35 627 +108.68 +/- 12.56
ncm-et-6 2018-02-22 22:54 02:29:16 2025354 1010 352 44 614 +109.43 +/- 12.91
ncm-et-7 2018-02-22 22:54 02:29:10 2011869 984 324 37 623 +104.37 +/- 12.58
ncm-et-8 2018-02-22 22:54 02:28:47 2020918 1000 354 39 607 +113.29 +/- 12.95
ncm-et-9 2018-02-22 22:54 5740:29:33 1969314 2592 937 235 1420 +96.50 +/- 8.87
ncm-et-10 2018-02-22 22:55 5740:29:11 1967294 2651 926 94 1631 +112.85 +/- 7.84
ncm-et-11 2018-02-22 22:54 02:27:27 2004783 1000 330 34 636 +106.01 +/- 12.40
ncm-et-12 2018-02-22 22:54 02:28:12 1992646 1000 352 29 619 +116.39 +/- 12.64
ncm-et-13 2018-10-19 23:09 04:15:05 1969646 1684 566 57 1061 +108.40 +/- 9.63
ncm-et-15 2018-10-19 23:09 04:15:25 1981934 1685 601 70 1014 +113.35 +/- 10.06
  20000 6933 880 12187 +108.55 +/- 2.89

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
2489 ncm-et-8 2018-02-22 22:54 01:13:58 2020510 500 176 20 304 +112.14 +/- 18.31 Show
2490 ncm-et-4 2018-02-22 22:54 01:13:45 2024918 500 175 16 309 +114.45 +/- 17.95 Show
2491 ncm-et-3 2018-02-22 22:54 01:12:13 2025572 500 178 22 300 +112.14 +/- 18.56 Show
2492 ncm-et-12 2018-02-22 22:54 01:13:52 2017095 500 171 13 316 +113.68 +/- 17.51 Show
2493 ncm-et-6 2018-02-22 22:54 01:13:25 2025574 500 177 26 297 +108.30 +/- 18.80 Show
2494 ncm-et-11 2018-02-22 22:54 01:12:56 1995709 500 161 19 320 +101.46 +/- 17.50 Show
2495 ncm-et-7 2018-02-22 22:54 01:15:38 2022956 500 161 14 325 +105.25 +/- 17.11 Show
2496 ncm-et-9 2018-02-22 22:54 01:14:07 2024263 500 193 12 295 +131.74 +/- 18.51 Show
2497 ncm-et-5 2018-02-22 22:55 01:13:49 2016817 500 172 16 312 +112.14 +/- 17.80 Show
2498 ncm-et-10 2018-02-22 22:55 01:14:32 2016772 500 172 15 313 +112.91 +/- 17.72 Show
2499 ncm-et-3 2018-02-23 00:08 01:12:42 2023609 500 155 19 326 +96.94 +/- 17.21 Show
2500 ncm-et-11 2018-02-23 00:09 01:13:19 2013856 500 169 15 316 +110.60 +/- 17.58 Show
2501 ncm-et-6 2018-02-23 00:09 01:11:25 2025899 500 170 17 313 +109.83 +/- 17.79 Show
2502 ncm-et-4 2018-02-23 00:09 01:13:26 2024427 500 172 19 309 +109.83 +/- 18.04 Show
2503 ncm-et-12 2018-02-23 00:09 01:13:07 1968196 500 181 16 303 +119.11 +/- 18.24 Show
2504 ncm-et-8 2018-02-23 00:09 01:13:37 2021325 500 178 19 303 +114.45 +/- 18.33 Show
2505 ncm-et-5 2018-02-23 00:10 01:12:40 2024263 500 166 19 315 +105.25 +/- 17.75 Show
2506 ncm-et-9 2018-02-23 00:10 01:13:34 2024264 500 179 20 301 +114.45 +/- 18.46 Show
2507 ncm-et-10 2018-02-23 00:11 01:13:08 2020510 496 175 14 307 +117.01 +/- 17.94 Show
2508 ncm-et-7 2018-02-23 00:11 01:12:19 2000781 484 163 23 298 +103.45 +/- 18.52 Show
2509 ncm-et-6 2018-02-23 01:22 00:02:00 2024590 10 5 1 4 +147.19 +/- 197.89 Show
2510 ncm-et-3 2018-02-23 01:22 00:02:01 2023283 10 3 0 7 +107.54 +/- 113.19 Show
65013 ncm-et-3 2018-10-19 23:09 01:14:31 1989242 500 177 23 300 +110.60 +/- 18.58 Show
65014 ncm-et-15 2018-10-19 23:09 01:14:10 1981543 500 186 20 294 +119.89 +/- 18.80 Show
65015 ncm-et-4 2018-10-19 23:09 01:14:13 1990507 500 184 15 301 +122.24 +/- 18.31 Show
65016 ncm-et-10 2018-10-19 23:09 01:17:45 1902603 500 165 23 312 +101.46 +/- 18.00 Show
65017 ncm-et-13 2018-10-19 23:09 01:15:29 1964686 500 160 16 324 +102.97 +/- 17.22 Show
65018 ncm-et-9 2018-10-19 23:09 01:19:30 1951002 500 183 36 281 +105.25 +/- 19.76 Show
65019 ncm-et-15 2018-10-20 00:24 01:16:15 1983892 500 179 21 300 +113.68 +/- 18.53 Show
65020 ncm-et-4 2018-10-20 00:24 01:13:58 1989874 500 167 18 315 +106.78 +/- 17.72 Show
65021 ncm-et-3 2018-10-20 00:24 01:14:11 1990191 500 182 18 300 +118.33 +/- 18.45 Show
65022 ncm-et-13 2018-10-20 00:25 01:13:39 1985776 500 158 21 321 +97.69 +/- 17.51 Show
65023 ncm-et-10 2018-10-20 00:27 01:14:37 1944400 500 179 19 302 +115.23 +/- 18.38 Show
65024 ncm-et-9 2018-10-20 00:29 01:19:29 1951762 500 221 36 243 +134.95 +/- 21.68 Show
65025 ncm-et-4 2018-10-20 01:39 01:15:21 1989244 500 174 22 304 +109.07 +/- 18.36 Show
65026 ncm-et-3 2018-10-20 01:39 01:14:50 1987981 500 160 17 323 +102.22 +/- 17.30 Show
65027 ncm-et-13 2018-10-20 01:40 01:14:49 1982535 500 168 13 319 +111.37 +/- 17.37 Show
65028 ncm-et-15 2018-10-20 01:41 01:13:49 1979037 500 167 22 311 +103.73 +/- 18.02 Show
65029 ncm-et-10 2018-10-20 01:43 01:15:13 1971977 500 173 19 308 +110.60 +/- 18.09 Show
65030 ncm-et-9 2018-10-20 01:50 01:18:38 1911155 500 133 113 254 +13.90 +/- 21.36 Show
65031 ncm-et-3 2018-10-20 02:55 00:28:22 1990032 190 61 6 123 +103.53 +/- 27.99 Show
65032 ncm-et-4 2018-10-20 02:55 00:28:39 1987824 194 65 11 118 +99.33 +/- 29.76 Show
65033 ncm-et-13 2018-10-20 02:56 00:27:53 1945585 184 80 7 97 +145.84 +/- 33.57 Show
65034 ncm-et-15 2018-10-20 02:56 00:27:56 1983262 185 69 7 109 +121.12 +/- 30.88 Show
65035 ncm-et-10 2018-10-20 02:59 00:24:33 1947503 155 62 4 89 +136.64 +/- 34.11 Show
65036 ncm-et-9 2018-10-20 03:10 00:14:18 1953437 92 28 18 46 +37.91 +/- 50.49 Show

Commit

Commit ID 27ba611a3da37423a3502e49beeebe11c9a11d8e
Author Marco Costalba
Date 2017-06-17 02:33:44 UTC
Commit Type Non Functional
Better naming in endgame code

And small clean-up of magic bitboards code.

No functional change.

Closes #1138

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4979 1838 134 3007 +123.90 +/- 5.77
ncm-et-4 5021 1880 119 3022 +127.26 +/- 5.74
  10000 3718 253 6029 +125.58 +/- 4.07