Dev Builds » 20160615-0647

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-09 16:43 01:45:20 2026145 711 149 59 503 +44.22 +/- 13.64
ncm-et-4 2018-03-09 16:43 01:45:15 1966991 692 129 55 508 +37.30 +/- 13.20
ncm-et-5 2018-03-09 16:43 01:45:09 2022713 721 130 62 529 +32.87 +/- 12.97
ncm-et-6 2018-03-09 16:43 01:45:16 2025572 718 112 52 554 +29.10 +/- 12.03
ncm-et-7 2018-03-09 16:43 01:45:04 2009108 724 149 47 528 +49.28 +/- 12.92
ncm-et-8 2018-03-09 16:43 01:45:00 2014432 720 135 54 531 +39.25 +/- 12.84
ncm-et-9 2018-03-09 16:43 01:45:14 2025654 715 141 48 526 +45.45 +/- 12.87
ncm-et-10 2018-03-09 16:42 01:45:21 2020266 714 132 55 527 +37.61 +/- 12.89
ncm-et-11 2018-03-09 16:42 01:45:17 2000671 703 143 52 508 +45.23 +/- 13.32
ncm-et-12 2018-03-09 16:43 01:45:23 2011439 710 147 45 518 +50.26 +/- 13.03
ncm-et-13 2018-03-09 16:43 01:45:22 2024591 705 122 68 515 +26.66 +/- 13.23
ncm-et-14 2018-03-09 16:43 01:45:22 2019617 721 136 53 532 +40.17 +/- 12.81
ncm-et-15 2018-03-09 16:42 01:45:16 2017665 733 118 61 554 +27.07 +/- 12.34
ncm-et-16 2018-03-09 16:43 01:45:22 1955788 713 137 56 520 +39.64 +/- 13.11
  10000 1880 767 7353 +38.83 +/- 3.46

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
6806 ncm-et-10 2018-03-09 16:42 01:13:05 2020022 500 88 36 376 +36.26 +/- 14.98 Show
6807 ncm-et-15 2018-03-09 16:42 01:10:06 2018395 500 79 43 378 +25.06 +/- 14.95 Show
6808 ncm-et-11 2018-03-09 16:42 01:14:48 1981808 500 101 36 363 +45.42 +/- 15.70 Show
6809 ncm-et-3 2018-03-09 16:43 01:13:09 2025572 500 109 44 347 +45.42 +/- 16.65 Show
6810 ncm-et-5 2018-03-09 16:43 01:11:44 2021162 500 95 44 361 +35.56 +/- 15.91 Show
6811 ncm-et-16 2018-03-09 16:43 01:13:47 1948418 500 95 35 370 +41.89 +/- 15.30 Show
6812 ncm-et-12 2018-03-09 16:43 01:12:39 2020510 500 109 27 364 +57.50 +/- 15.48 Show
6813 ncm-et-9 2018-03-09 16:43 01:13:07 2024590 500 96 33 371 +44.01 +/- 15.22 Show
6814 ncm-et-13 2018-03-09 16:43 01:14:59 2024264 500 88 48 364 +27.85 +/- 15.78 Show
6815 ncm-et-14 2018-03-09 16:43 01:11:31 2018883 500 88 42 370 +32.05 +/- 15.39 Show
6816 ncm-et-7 2018-03-09 16:43 01:11:38 2020851 500 98 37 365 +42.60 +/- 15.60 Show
6817 ncm-et-6 2018-03-09 16:43 01:13:08 2025408 500 87 43 370 +30.65 +/- 15.40 Show
6818 ncm-et-4 2018-03-09 16:43 01:14:55 1981141 500 97 38 365 +41.19 +/- 15.62 Show
6819 ncm-et-8 2018-03-09 16:43 01:12:26 2020673 500 95 36 369 +41.19 +/- 15.37 Show
6820 ncm-et-15 2018-03-09 17:54 00:33:43 2016935 233 39 18 176 +31.40 +/- 21.87 Show
6821 ncm-et-14 2018-03-09 17:56 00:32:26 2020350 221 48 11 162 +58.72 +/- 23.04 Show
6822 ncm-et-7 2018-03-09 17:56 00:31:59 1997364 224 51 10 163 +64.32 +/- 23.01 Show
6823 ncm-et-5 2018-03-09 17:56 00:31:58 2024263 221 35 18 168 +26.78 +/- 22.28 Show
6824 ncm-et-12 2018-03-09 17:57 00:31:17 2002367 210 38 18 154 +33.19 +/- 24.07 Show
6825 ncm-et-8 2018-03-09 17:57 00:31:08 2008190 220 40 18 162 +34.86 +/- 23.36 Show
6826 ncm-et-10 2018-03-09 17:57 00:30:48 2020510 214 44 19 151 +40.77 +/- 25.01 Show
6827 ncm-et-9 2018-03-09 17:57 00:30:41 2026718 215 45 15 155 +48.80 +/- 24.14 Show
6828 ncm-et-3 2018-03-09 17:57 00:30:44 2026718 211 40 15 156 +41.36 +/- 23.62 Show
6829 ncm-et-6 2018-03-09 17:57 00:30:39 2025736 218 25 9 184 +25.55 +/- 17.98 Show
6830 ncm-et-16 2018-03-09 17:58 00:30:08 1963157 213 42 21 150 +34.37 +/- 25.21 Show
6831 ncm-et-11 2018-03-09 17:59 00:29:02 2019534 203 42 16 145 +44.74 +/- 25.23 Show
6832 ncm-et-13 2018-03-09 17:59 00:28:57 2024917 205 34 20 151 +23.76 +/- 24.31 Show
6833 ncm-et-4 2018-03-09 17:59 00:28:53 1952841 192 32 17 143 +27.20 +/- 24.69 Show

Commit

Commit ID 126036abb093df88593ef9db67ac0b9a07f411a6
Author lucasart
Date 2016-06-15 06:47:08 UTC
Commit Type Non Functional
Do not hardcode Debug Log File

Allow to specifiy the log file name, this comes
handy in case of self-matches so that each SF
instance writes into a different log file.

No functional change.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-1 1736 257 79 1400 +35.75 +/- 7.06
ncm-et-2 2757 412 136 2209 +34.90 +/- 5.68
ncm-et-3 2745 418 129 2198 +36.71 +/- 5.69
ncm-et-4 2762 388 125 2249 +33.18 +/- 5.49
  10000 1475 469 8056 +35.07 +/- 2.95