Dev Builds » 20161010-1429

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-17 07:41 04:53:46 2026392 2000 560 100 1340 +81.37 +/- 8.45
ncm-et-4 2018-02-17 07:41 04:54:03 2027129 1992 521 107 1364 +73.28 +/- 8.31
ncm-et-5 2018-02-17 07:41 04:53:58 2023512 2005 535 98 1372 +76.96 +/- 8.26
ncm-et-6 2018-02-17 07:41 04:52:50 2020895 2000 512 93 1395 +73.88 +/- 8.09
ncm-et-7 2018-02-17 07:41 04:54:07 2023481 2003 555 94 1354 +81.42 +/- 8.35
  10000 2683 492 6825 +77.38 +/- 3.71

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
1608 ncm-et-3 2018-02-17 07:41 01:11:59 2028194 500 143 27 330 +82.10 +/- 17.21 Show
1609 ncm-et-6 2018-02-17 07:41 01:12:36 2027538 500 118 31 351 +61.08 +/- 16.24 Show
1610 ncm-et-4 2018-02-17 07:41 01:12:23 2025081 500 131 28 341 +72.61 +/- 16.69 Show
1611 ncm-et-7 2018-02-17 07:41 01:12:37 2024590 500 141 21 338 +85.04 +/- 16.67 Show
1612 ncm-et-5 2018-02-17 07:41 01:12:31 2024100 500 112 26 362 +60.36 +/- 15.57 Show
1613 ncm-et-3 2018-02-17 08:54 01:11:38 2026555 500 137 25 338 +79.17 +/- 16.77 Show
1614 ncm-et-4 2018-02-17 08:55 01:13:02 2028358 500 134 22 344 +79.17 +/- 16.40 Show
1615 ncm-et-6 2018-02-17 08:55 01:11:44 2025737 500 135 23 342 +79.17 +/- 16.52 Show
1616 ncm-et-7 2018-02-17 08:55 01:12:29 2025572 500 139 27 334 +79.17 +/- 17.01 Show
1617 ncm-et-5 2018-02-17 08:55 01:11:30 2023936 500 126 24 350 +71.89 +/- 16.14 Show
1618 ncm-et-3 2018-02-17 10:07 01:12:29 2026391 500 150 23 327 +90.22 +/- 17.26 Show
1619 ncm-et-5 2018-02-17 10:08 01:12:21 2023283 500 147 33 320 +80.63 +/- 17.82 Show
1620 ncm-et-6 2018-02-17 10:08 01:11:45 2002112 500 133 20 347 +79.90 +/- 16.19 Show
1621 ncm-et-7 2018-02-17 10:09 01:10:13 2022793 500 131 24 345 +75.52 +/- 16.39 Show
1622 ncm-et-4 2018-02-17 10:09 01:13:12 2027538 500 118 35 347 +58.21 +/- 16.51 Show
1623 ncm-et-7 2018-02-17 11:20 01:13:04 2021329 500 144 22 334 +86.52 +/- 16.89 Show
1624 ncm-et-6 2018-02-17 11:21 01:13:15 2028194 500 126 19 355 +75.52 +/- 15.76 Show
1625 ncm-et-3 2018-02-17 11:21 01:14:10 2024427 500 130 25 345 +74.06 +/- 16.42 Show
1626 ncm-et-5 2018-02-17 11:21 01:11:48 2023121 500 150 15 335 +96.19 +/- 16.65 Show
1627 ncm-et-4 2018-02-17 11:23 01:11:57 2027538 492 138 22 332 +83.49 +/- 16.87 Show
1628 ncm-et-5 2018-02-17 12:34 00:01:07 2023120 5 0 0 5 -0.00 +/- 0.00 Show
1629 ncm-et-7 2018-02-17 12:34 00:01:02 2023119 3 0 0 3 -0.00 +/- 0.00 Show

Commit

Commit ID e61f7b1e6d0273ef9447efa01e90578adef4613e
Author Marco Costalba
Date 2016-10-10 14:29:29 UTC
Commit Type Non Functional
Add AppVeyor integration

It is like Trevis CI but for Windows platform.

Currently just compile builds, wthouth benching
the resulting executable.

No functional change.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5008 1147 164 3697 +69.09 +/- 4.72
ncm-et-4 4992 1179 186 3627 +70.05 +/- 4.85
  10000 2326 350 7324 +69.57 +/- 3.38