Dev Builds » 20160615-0647

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-09 16:43 01:45:20 2026145 711 149 59 503 +44.22 +/- 13.64
ncm-et-4 2018-03-09 16:43 01:45:15 1966991 692 129 55 508 +37.30 +/- 13.20
ncm-et-5 2018-03-09 16:43 01:45:09 2022713 721 130 62 529 +32.87 +/- 12.97
ncm-et-6 2018-03-09 16:43 01:45:16 2025572 718 112 52 554 +29.10 +/- 12.03
ncm-et-7 2018-03-09 16:43 01:45:04 2009108 724 149 47 528 +49.28 +/- 12.92
ncm-et-8 2018-03-09 16:43 01:45:00 2014432 720 135 54 531 +39.25 +/- 12.84
ncm-et-9 2018-03-09 16:43 01:45:14 2025654 715 141 48 526 +45.45 +/- 12.87
ncm-et-10 2018-03-09 16:42 01:45:21 2020266 714 132 55 527 +37.61 +/- 12.89
ncm-et-11 2018-03-09 16:42 01:45:17 2000671 703 143 52 508 +45.23 +/- 13.32
ncm-et-12 2018-03-09 16:43 01:45:23 2011439 710 147 45 518 +50.26 +/- 13.03
ncm-et-13 2018-03-09 16:43 01:45:22 2024591 705 122 68 515 +26.66 +/- 13.23
ncm-et-14 2018-03-09 16:43 01:45:22 2019617 721 136 53 532 +40.17 +/- 12.81
ncm-et-15 2018-03-09 16:42 01:45:16 2017665 733 118 61 554 +27.07 +/- 12.34
ncm-et-16 2018-03-09 16:43 01:45:22 1955788 713 137 56 520 +39.64 +/- 13.11
  10000 1880 767 7353 +38.83 +/- 3.46

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
6806 ncm-et-10 2018-03-09 16:42 01:13:05 2020022 500 88 36 376 +36.26 +/- 14.98 Show
6807 ncm-et-15 2018-03-09 16:42 01:10:06 2018395 500 79 43 378 +25.06 +/- 14.95 Show
6808 ncm-et-11 2018-03-09 16:42 01:14:48 1981808 500 101 36 363 +45.42 +/- 15.70 Show
6809 ncm-et-3 2018-03-09 16:43 01:13:09 2025572 500 109 44 347 +45.42 +/- 16.65 Show
6810 ncm-et-5 2018-03-09 16:43 01:11:44 2021162 500 95 44 361 +35.56 +/- 15.91 Show
6811 ncm-et-16 2018-03-09 16:43 01:13:47 1948418 500 95 35 370 +41.89 +/- 15.30 Show
6812 ncm-et-12 2018-03-09 16:43 01:12:39 2020510 500 109 27 364 +57.50 +/- 15.48 Show
6813 ncm-et-9 2018-03-09 16:43 01:13:07 2024590 500 96 33 371 +44.01 +/- 15.22 Show
6814 ncm-et-13 2018-03-09 16:43 01:14:59 2024264 500 88 48 364 +27.85 +/- 15.78 Show
6815 ncm-et-14 2018-03-09 16:43 01:11:31 2018883 500 88 42 370 +32.05 +/- 15.39 Show
6816 ncm-et-7 2018-03-09 16:43 01:11:38 2020851 500 98 37 365 +42.60 +/- 15.60 Show
6817 ncm-et-6 2018-03-09 16:43 01:13:08 2025408 500 87 43 370 +30.65 +/- 15.40 Show
6818 ncm-et-4 2018-03-09 16:43 01:14:55 1981141 500 97 38 365 +41.19 +/- 15.62 Show
6819 ncm-et-8 2018-03-09 16:43 01:12:26 2020673 500 95 36 369 +41.19 +/- 15.37 Show
6820 ncm-et-15 2018-03-09 17:54 00:33:43 2016935 233 39 18 176 +31.40 +/- 21.87 Show
6821 ncm-et-14 2018-03-09 17:56 00:32:26 2020350 221 48 11 162 +58.72 +/- 23.04 Show
6822 ncm-et-7 2018-03-09 17:56 00:31:59 1997364 224 51 10 163 +64.32 +/- 23.01 Show
6823 ncm-et-5 2018-03-09 17:56 00:31:58 2024263 221 35 18 168 +26.78 +/- 22.28 Show
6824 ncm-et-12 2018-03-09 17:57 00:31:17 2002367 210 38 18 154 +33.19 +/- 24.07 Show
6825 ncm-et-8 2018-03-09 17:57 00:31:08 2008190 220 40 18 162 +34.86 +/- 23.36 Show
6826 ncm-et-10 2018-03-09 17:57 00:30:48 2020510 214 44 19 151 +40.77 +/- 25.01 Show
6827 ncm-et-9 2018-03-09 17:57 00:30:41 2026718 215 45 15 155 +48.80 +/- 24.14 Show
6828 ncm-et-3 2018-03-09 17:57 00:30:44 2026718 211 40 15 156 +41.36 +/- 23.62 Show
6829 ncm-et-6 2018-03-09 17:57 00:30:39 2025736 218 25 9 184 +25.55 +/- 17.98 Show
6830 ncm-et-16 2018-03-09 17:58 00:30:08 1963157 213 42 21 150 +34.37 +/- 25.21 Show
6831 ncm-et-11 2018-03-09 17:59 00:29:02 2019534 203 42 16 145 +44.74 +/- 25.23 Show
6832 ncm-et-13 2018-03-09 17:59 00:28:57 2024917 205 34 20 151 +23.76 +/- 24.31 Show
6833 ncm-et-4 2018-03-09 17:59 00:28:53 1952841 192 32 17 143 +27.20 +/- 24.69 Show

Commit

Commit ID 126036abb093df88593ef9db67ac0b9a07f411a6
Author lucasart
Date 2016-06-15 06:47:08 UTC
Commit Type Non Functional
Do not hardcode Debug Log File

Allow to specifiy the log file name, this comes
handy in case of self-matches so that each SF
instance writes into a different log file.

No functional change.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 2745 418 129 2198 +36.71 +/- 5.69
ncm-et-1 1736 257 79 1400 +35.75 +/- 7.06
ncm-et-2 2757 412 136 2209 +34.90 +/- 5.68
ncm-et-4 2762 388 125 2249 +33.18 +/- 5.49
  10000 1475 469 8056 +35.07 +/- 2.95