Dev Builds » 20170309-0203

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-01 11:27 12:22:26 2026802 5000 1548 224 3228 +94.25 +/- 5.51
ncm-et-4 2018-02-01 11:27 12:22:01 2026983 5000 1587 245 3168 +95.59 +/- 5.62
  10000 3135 469 6396 +94.92 +/- 3.94

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
690 ncm-et-4 2018-02-01 11:27 01:13:28 2029180 500 144 25 331 +84.31 +/- 17.12 Show
691 ncm-et-3 2018-02-01 11:27 01:13:10 2025408 500 147 23 330 +88.00 +/- 17.12 Show
692 ncm-et-3 2018-02-01 12:41 01:12:09 2027704 500 164 21 315 +102.22 +/- 17.80 Show
693 ncm-et-4 2018-02-01 12:41 01:13:55 2027866 500 143 27 330 +82.10 +/- 17.21 Show
694 ncm-et-3 2018-02-01 13:54 01:12:48 2028851 500 164 28 308 +96.94 +/- 18.31 Show
695 ncm-et-4 2018-02-01 13:56 01:13:54 2029018 500 147 24 329 +87.26 +/- 17.19 Show
696 ncm-et-3 2018-02-01 15:08 01:14:00 2029673 500 161 25 314 +96.94 +/- 17.95 Show
697 ncm-et-4 2018-02-01 15:11 01:14:45 2026227 500 172 25 303 +105.25 +/- 18.48 Show
698 ncm-et-3 2018-02-01 16:23 01:13:05 2025245 500 162 25 313 +97.69 +/- 18.00 Show
699 ncm-et-4 2018-02-01 16:27 01:10:56 2027212 500 163 20 317 +102.22 +/- 17.67 Show
700 ncm-et-3 2018-02-01 17:38 01:13:53 2024590 500 148 23 329 +88.74 +/- 17.17 Show
701 ncm-et-4 2018-02-01 17:39 01:12:39 2025408 500 178 28 294 +107.54 +/- 18.99 Show
702 ncm-et-3 2018-02-01 18:53 01:12:59 2026882 500 151 25 324 +89.48 +/- 17.46 Show
703 ncm-et-4 2018-02-01 18:53 01:13:08 2025081 500 173 24 303 +106.78 +/- 18.46 Show
704 ncm-et-3 2018-02-01 20:07 01:13:51 2028687 500 141 18 341 +87.26 +/- 16.44 Show
705 ncm-et-4 2018-02-01 20:07 01:13:45 2024429 500 159 19 322 +99.95 +/- 17.40 Show
706 ncm-et-3 2018-02-01 21:22 01:13:18 2024100 500 156 17 327 +99.20 +/- 17.10 Show
707 ncm-et-4 2018-02-01 21:22 01:12:14 2027866 500 154 30 316 +88.00 +/- 17.96 Show
708 ncm-et-4 2018-02-01 22:36 01:13:15 2027539 500 154 23 323 +93.20 +/- 17.46 Show
709 ncm-et-3 2018-02-01 22:36 01:13:11 2026882 500 154 19 327 +96.19 +/- 17.16 Show

Commit

Commit ID cc76524c2e36345fcbf5fcdd3618a5dafd166b62
Author pb00068
Date 2017-03-09 02:03:01 UTC
Commit Type Non Functional
Further simplify skipping of plies with threads

No functional change

Closes #1020

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4972 1590 148 3234 +103.74 +/- 5.43
ncm-et-4 5028 1579 125 3324 +103.42 +/- 5.29
  10000 3169 273 6558 +103.58 +/- 3.79