Dev Builds » 20170901-1816

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-02 22:55 5057:27:14 2002222 2519 882 92 1545 +112.76 +/- 8.07
ncm-et-4 2018-03-02 22:54 5057:27:31 1995787 2544 942 81 1521 +122.41 +/- 8.17
ncm-et-5 2018-03-02 22:54 02:03:59 2022715 832 301 28 503 +118.38 +/- 14.18
ncm-et-6 2018-03-02 22:54 02:04:00 2024755 834 308 32 494 +119.48 +/- 14.45
ncm-et-7 2018-03-02 22:54 02:03:54 2025496 831 307 24 500 +123.24 +/- 14.19
ncm-et-8 2018-03-02 22:54 02:03:44 2001251 826 304 30 492 +119.78 +/- 14.43
ncm-et-9 2018-03-02 22:54 5057:27:24 2000948 2498 894 97 1507 +114.86 +/- 8.23
ncm-et-10 2018-03-02 22:54 5057:27:38 1994108 2500 891 92 1517 +115.07 +/- 8.17
ncm-et-11 2018-03-02 22:54 02:03:55 2015399 830 318 34 478 +123.88 +/- 14.82
ncm-et-12 2018-03-02 22:54 02:04:06 2020596 830 297 29 504 +116.35 +/- 14.16
ncm-et-13 2018-03-02 22:54 5057:27:18 1971316 2463 937 88 1438 +124.87 +/- 8.48
ncm-et-14 2018-03-02 22:55 02:03:32 2020675 833 308 25 500 +122.92 +/- 14.21
ncm-et-15 2018-09-29 12:09 04:12:59 1960643 1660 585 59 1016 +114.01 +/- 9.95
  20000 7274 711 12015 +118.39 +/- 2.91

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
4512 ncm-et-4 2018-03-02 22:54 01:12:11 2023940 500 178 23 299 +111.37 +/- 18.63 Show
4513 ncm-et-10 2018-03-02 22:54 01:13:28 2016446 500 177 31 292 +104.49 +/- 19.14 Show
4514 ncm-et-11 2018-03-02 22:54 01:14:18 2012566 500 188 17 295 +123.81 +/- 18.67 Show
4515 ncm-et-12 2018-03-02 22:54 01:13:19 2019377 500 174 16 310 +113.68 +/- 17.90 Show
4516 ncm-et-5 2018-03-02 22:54 01:13:18 2025081 500 179 16 305 +117.55 +/- 18.15 Show
4517 ncm-et-6 2018-03-02 22:54 01:13:44 2026063 500 186 22 292 +118.33 +/- 18.95 Show
4518 ncm-et-13 2018-03-02 22:54 01:13:12 2025244 500 173 17 310 +112.14 +/- 17.93 Show
4519 ncm-et-7 2018-03-02 22:54 01:13:10 2028689 500 189 13 298 +127.76 +/- 18.39 Show
4520 ncm-et-9 2018-03-02 22:54 01:13:01 2025899 500 172 18 310 +110.60 +/- 17.96 Show
4521 ncm-et-8 2018-03-02 22:54 01:14:32 2023609 500 188 17 295 +123.81 +/- 18.67 Show
4522 ncm-et-3 2018-03-02 22:55 01:12:23 2023775 500 167 16 317 +108.30 +/- 17.56 Show
4523 ncm-et-14 2018-03-02 22:55 01:12:53 2021978 500 184 16 300 +121.46 +/- 18.39 Show
4524 ncm-et-4 2018-03-03 00:08 00:50:33 1992225 342 139 6 197 +142.62 +/- 22.67 Show
4525 ncm-et-3 2018-03-03 00:08 00:49:42 2027374 345 115 15 215 +103.68 +/- 21.66 Show
4526 ncm-et-9 2018-03-03 00:09 00:49:30 2023282 328 114 15 199 +108.24 +/- 22.75 Show
4527 ncm-et-7 2018-03-03 00:09 00:49:25 2022303 331 118 11 202 +116.49 +/- 22.33 Show
4528 ncm-et-13 2018-03-03 00:09 00:49:18 2026063 336 126 10 200 +125.09 +/- 22.55 Show
4529 ncm-et-12 2018-03-03 00:09 00:49:28 2021814 330 123 13 194 +120.41 +/- 23.15 Show
4530 ncm-et-5 2018-03-03 00:09 00:49:22 2020349 332 122 12 198 +119.63 +/- 22.77 Show
4531 ncm-et-14 2018-03-03 00:09 00:49:20 2019371 333 124 9 200 +125.13 +/- 22.44 Show
4532 ncm-et-10 2018-03-03 00:09 00:49:20 2019859 333 121 13 199 +116.90 +/- 22.75 Show
4533 ncm-et-6 2018-03-03 00:09 00:48:56 2023447 334 122 10 202 +121.19 +/- 22.33 Show
4534 ncm-et-11 2018-03-03 00:10 00:48:18 2018232 330 130 17 183 +123.98 +/- 24.35 Show
4535 ncm-et-8 2018-03-03 00:10 00:47:50 1978893 326 116 13 197 +113.66 +/- 22.80 Show
63570 ncm-et-9 2018-09-29 12:09 01:14:18 1987666 500 169 19 312 +107.54 +/- 17.89 Show
63571 ncm-et-13 2018-09-29 12:09 01:16:47 1942906 500 194 14 292 +130.94 +/- 18.72 Show
63572 ncm-et-15 2018-09-29 12:09 01:15:57 1940064 500 168 16 316 +109.07 +/- 17.61 Show
63573 ncm-et-3 2018-09-29 12:09 01:14:50 1990507 500 184 19 297 +119.11 +/- 18.62 Show
63574 ncm-et-4 2018-09-29 12:09 01:13:14 1989720 500 186 14 300 +124.60 +/- 18.33 Show
63575 ncm-et-10 2018-09-29 12:09 01:15:16 1981538 500 185 18 297 +120.67 +/- 18.60 Show
63576 ncm-et-4 2018-09-29 13:23 01:14:07 1989086 500 207 17 276 +138.99 +/- 19.61 Show
63577 ncm-et-9 2018-09-29 13:24 01:14:54 1989874 500 183 20 297 +117.55 +/- 18.65 Show
63578 ncm-et-3 2018-09-29 13:25 01:14:24 1991614 500 169 8 323 +116.00 +/- 16.99 Show
63579 ncm-et-10 2018-09-29 13:25 01:15:51 1981851 500 181 18 301 +117.55 +/- 18.40 Show
63580 ncm-et-15 2018-09-29 13:26 01:14:12 1982007 500 177 21 302 +112.14 +/- 18.43 Show
63581 ncm-et-13 2018-09-29 13:27 01:17:33 1935347 500 189 18 293 +123.81 +/- 18.79 Show
63582 ncm-et-4 2018-09-29 14:38 01:13:11 1990190 500 177 13 310 +118.33 +/- 17.81 Show
63583 ncm-et-9 2018-09-29 14:40 01:14:53 1988457 500 184 17 299 +120.67 +/- 18.47 Show
63584 ncm-et-3 2018-09-29 14:40 01:13:52 1990664 500 189 31 280 +113.68 +/- 19.73 Show
63585 ncm-et-15 2018-09-29 14:41 01:16:39 1939747 500 184 13 303 +123.81 +/- 18.15 Show
63586 ncm-et-10 2018-09-29 14:42 01:13:44 1981851 500 163 9 328 +110.60 +/- 16.79 Show
63587 ncm-et-13 2018-09-29 14:45 01:15:10 1961398 500 204 24 272 +130.94 +/- 19.99 Show
63588 ncm-et-4 2018-09-29 15:53 00:28:57 1989559 202 55 8 139 +82.35 +/- 25.73 Show
63589 ncm-et-3 2018-09-29 15:55 00:26:42 1989400 174 58 3 113 +113.72 +/- 28.76 Show
63590 ncm-et-9 2018-09-29 15:56 00:25:45 1990507 170 72 8 90 +137.56 +/- 35.01 Show
63591 ncm-et-10 2018-09-29 15:57 00:24:45 1983105 167 64 3 100 +133.05 +/- 31.54 Show
63592 ncm-et-15 2018-09-29 15:59 00:22:56 1980755 160 56 9 95 +105.16 +/- 33.41 Show
63593 ncm-et-13 2018-09-29 16:02 00:20:02 1936938 127 51 5 71 +131.82 +/- 38.88 Show

Commit

Commit ID e385f194e970f0675bd4c3509bca4a6c81b6df5e
Author Joost VandeVondele
Date 2017-09-01 18:16:56 UTC
Commit Type Non Functional
Fix uninitialized memory usage

After increasing the number of threads, the histories were not cleared,
resulting in uninitialized memory usage.

This patch fixes this by clearing threads histories in Thread c'tor as
is the idomatic way.

This fixes issue 1227

No functional change.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4997 1888 119 2990 +128.56 +/- 5.78
ncm-et-4 5003 1947 124 2932 +132.70 +/- 5.88
  10000 3835 243 5922 +130.62 +/- 4.12