Dev Builds » 20170617-0233

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-22 22:54 5740:29:23 2004273 2700 916 105 1679 +107.68 +/- 7.72
ncm-et-4 2018-02-22 22:54 5740:29:41 2001132 2694 937 101 1656 +111.49 +/- 7.80
ncm-et-5 2018-02-22 22:55 02:27:41 2020540 1000 338 35 627 +108.68 +/- 12.56
ncm-et-6 2018-02-22 22:54 02:29:16 2025354 1010 352 44 614 +109.43 +/- 12.91
ncm-et-7 2018-02-22 22:54 02:29:10 2011869 984 324 37 623 +104.37 +/- 12.58
ncm-et-8 2018-02-22 22:54 02:28:47 2020918 1000 354 39 607 +113.29 +/- 12.95
ncm-et-9 2018-02-22 22:54 5740:29:33 1969314 2592 937 235 1420 +96.50 +/- 8.87
ncm-et-10 2018-02-22 22:55 5740:29:11 1967294 2651 926 94 1631 +112.85 +/- 7.84
ncm-et-11 2018-02-22 22:54 02:27:27 2004783 1000 330 34 636 +106.01 +/- 12.40
ncm-et-12 2018-02-22 22:54 02:28:12 1992646 1000 352 29 619 +116.39 +/- 12.64
ncm-et-13 2018-10-19 23:09 04:15:05 1969646 1684 566 57 1061 +108.40 +/- 9.63
ncm-et-15 2018-10-19 23:09 04:15:25 1981934 1685 601 70 1014 +113.35 +/- 10.06
  20000 6933 880 12187 +108.55 +/- 2.89

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
2489 ncm-et-8 2018-02-22 22:54 01:13:58 2020510 500 176 20 304 +112.14 +/- 18.31 Show
2490 ncm-et-4 2018-02-22 22:54 01:13:45 2024918 500 175 16 309 +114.45 +/- 17.95 Show
2491 ncm-et-3 2018-02-22 22:54 01:12:13 2025572 500 178 22 300 +112.14 +/- 18.56 Show
2492 ncm-et-12 2018-02-22 22:54 01:13:52 2017095 500 171 13 316 +113.68 +/- 17.51 Show
2493 ncm-et-6 2018-02-22 22:54 01:13:25 2025574 500 177 26 297 +108.30 +/- 18.80 Show
2494 ncm-et-11 2018-02-22 22:54 01:12:56 1995709 500 161 19 320 +101.46 +/- 17.50 Show
2495 ncm-et-7 2018-02-22 22:54 01:15:38 2022956 500 161 14 325 +105.25 +/- 17.11 Show
2496 ncm-et-9 2018-02-22 22:54 01:14:07 2024263 500 193 12 295 +131.74 +/- 18.51 Show
2497 ncm-et-5 2018-02-22 22:55 01:13:49 2016817 500 172 16 312 +112.14 +/- 17.80 Show
2498 ncm-et-10 2018-02-22 22:55 01:14:32 2016772 500 172 15 313 +112.91 +/- 17.72 Show
2499 ncm-et-3 2018-02-23 00:08 01:12:42 2023609 500 155 19 326 +96.94 +/- 17.21 Show
2500 ncm-et-11 2018-02-23 00:09 01:13:19 2013856 500 169 15 316 +110.60 +/- 17.58 Show
2501 ncm-et-6 2018-02-23 00:09 01:11:25 2025899 500 170 17 313 +109.83 +/- 17.79 Show
2502 ncm-et-4 2018-02-23 00:09 01:13:26 2024427 500 172 19 309 +109.83 +/- 18.04 Show
2503 ncm-et-12 2018-02-23 00:09 01:13:07 1968196 500 181 16 303 +119.11 +/- 18.24 Show
2504 ncm-et-8 2018-02-23 00:09 01:13:37 2021325 500 178 19 303 +114.45 +/- 18.33 Show
2505 ncm-et-5 2018-02-23 00:10 01:12:40 2024263 500 166 19 315 +105.25 +/- 17.75 Show
2506 ncm-et-9 2018-02-23 00:10 01:13:34 2024264 500 179 20 301 +114.45 +/- 18.46 Show
2507 ncm-et-10 2018-02-23 00:11 01:13:08 2020510 496 175 14 307 +117.01 +/- 17.94 Show
2508 ncm-et-7 2018-02-23 00:11 01:12:19 2000781 484 163 23 298 +103.45 +/- 18.52 Show
2509 ncm-et-6 2018-02-23 01:22 00:02:00 2024590 10 5 1 4 +147.19 +/- 197.89 Show
2510 ncm-et-3 2018-02-23 01:22 00:02:01 2023283 10 3 0 7 +107.54 +/- 113.19 Show
65013 ncm-et-3 2018-10-19 23:09 01:14:31 1989242 500 177 23 300 +110.60 +/- 18.58 Show
65014 ncm-et-15 2018-10-19 23:09 01:14:10 1981543 500 186 20 294 +119.89 +/- 18.80 Show
65015 ncm-et-4 2018-10-19 23:09 01:14:13 1990507 500 184 15 301 +122.24 +/- 18.31 Show
65016 ncm-et-10 2018-10-19 23:09 01:17:45 1902603 500 165 23 312 +101.46 +/- 18.00 Show
65017 ncm-et-13 2018-10-19 23:09 01:15:29 1964686 500 160 16 324 +102.97 +/- 17.22 Show
65018 ncm-et-9 2018-10-19 23:09 01:19:30 1951002 500 183 36 281 +105.25 +/- 19.76 Show
65019 ncm-et-15 2018-10-20 00:24 01:16:15 1983892 500 179 21 300 +113.68 +/- 18.53 Show
65020 ncm-et-4 2018-10-20 00:24 01:13:58 1989874 500 167 18 315 +106.78 +/- 17.72 Show
65021 ncm-et-3 2018-10-20 00:24 01:14:11 1990191 500 182 18 300 +118.33 +/- 18.45 Show
65022 ncm-et-13 2018-10-20 00:25 01:13:39 1985776 500 158 21 321 +97.69 +/- 17.51 Show
65023 ncm-et-10 2018-10-20 00:27 01:14:37 1944400 500 179 19 302 +115.23 +/- 18.38 Show
65024 ncm-et-9 2018-10-20 00:29 01:19:29 1951762 500 221 36 243 +134.95 +/- 21.68 Show
65025 ncm-et-4 2018-10-20 01:39 01:15:21 1989244 500 174 22 304 +109.07 +/- 18.36 Show
65026 ncm-et-3 2018-10-20 01:39 01:14:50 1987981 500 160 17 323 +102.22 +/- 17.30 Show
65027 ncm-et-13 2018-10-20 01:40 01:14:49 1982535 500 168 13 319 +111.37 +/- 17.37 Show
65028 ncm-et-15 2018-10-20 01:41 01:13:49 1979037 500 167 22 311 +103.73 +/- 18.02 Show
65029 ncm-et-10 2018-10-20 01:43 01:15:13 1971977 500 173 19 308 +110.60 +/- 18.09 Show
65030 ncm-et-9 2018-10-20 01:50 01:18:38 1911155 500 133 113 254 +13.90 +/- 21.36 Show
65031 ncm-et-3 2018-10-20 02:55 00:28:22 1990032 190 61 6 123 +103.53 +/- 27.99 Show
65032 ncm-et-4 2018-10-20 02:55 00:28:39 1987824 194 65 11 118 +99.33 +/- 29.76 Show
65033 ncm-et-13 2018-10-20 02:56 00:27:53 1945585 184 80 7 97 +145.84 +/- 33.57 Show
65034 ncm-et-15 2018-10-20 02:56 00:27:56 1983262 185 69 7 109 +121.12 +/- 30.88 Show
65035 ncm-et-10 2018-10-20 02:59 00:24:33 1947503 155 62 4 89 +136.64 +/- 34.11 Show
65036 ncm-et-9 2018-10-20 03:10 00:14:18 1953437 92 28 18 46 +37.91 +/- 50.49 Show

Commit

Commit ID 27ba611a3da37423a3502e49beeebe11c9a11d8e
Author Marco Costalba
Date 2017-06-17 02:33:44 UTC
Commit Type Non Functional
Better naming in endgame code

And small clean-up of magic bitboards code.

No functional change.

Closes #1138

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4979 1838 134 3007 +123.90 +/- 5.77
ncm-et-4 5021 1880 119 3022 +127.26 +/- 5.74
  10000 3718 253 6029 +125.58 +/- 4.07