Dev Builds » 20160615-0647

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-09 16:43 8004:59:52 1987884 2377 467 194 1716 +40.08 +/- 7.28
ncm-et-4 2018-03-09 16:43 8004:59:44 1964628 2343 442 171 1730 +40.37 +/- 7.10
ncm-et-5 2018-03-09 16:43 01:45:09 2022713 721 130 62 529 +32.87 +/- 12.97
ncm-et-6 2018-03-09 16:43 01:45:16 2025572 718 112 52 554 +29.10 +/- 12.03
ncm-et-7 2018-03-09 16:43 01:45:04 2009108 724 149 47 528 +49.28 +/- 12.92
ncm-et-8 2018-03-09 16:43 01:45:00 2014432 720 135 54 531 +39.25 +/- 12.84
ncm-et-9 2018-03-09 16:43 8004:59:57 1989482 2387 456 188 1743 +39.17 +/- 7.15
ncm-et-10 2018-03-09 16:42 8004:59:46 1985592 2377 459 191 1727 +39.34 +/- 7.21
ncm-et-11 2018-03-09 16:42 01:45:17 2000671 703 143 52 508 +45.23 +/- 13.32
ncm-et-12 2018-03-09 16:43 01:45:23 2011439 710 147 45 518 +50.26 +/- 13.03
ncm-et-13 2018-03-09 16:43 8004:59:48 1989971 2394 442 200 1752 +35.24 +/- 7.13
ncm-et-14 2018-03-09 16:43 01:45:22 2019617 721 136 53 532 +40.17 +/- 12.81
ncm-et-15 2018-03-09 16:42 8005:00:02 1990932 2392 433 184 1775 +36.30 +/- 6.99
ncm-et-16 2018-03-09 16:43 01:45:22 1955788 713 137 56 520 +39.64 +/- 13.11
  20000 3788 1549 14663 +39.06 +/- 2.46

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
6806 ncm-et-10 2018-03-09 16:42 01:13:05 2020022 500 88 36 376 +36.26 +/- 14.98 Show
6807 ncm-et-15 2018-03-09 16:42 01:10:06 2018395 500 79 43 378 +25.06 +/- 14.95 Show
6808 ncm-et-11 2018-03-09 16:42 01:14:48 1981808 500 101 36 363 +45.42 +/- 15.70 Show
6809 ncm-et-3 2018-03-09 16:43 01:13:09 2025572 500 109 44 347 +45.42 +/- 16.65 Show
6810 ncm-et-5 2018-03-09 16:43 01:11:44 2021162 500 95 44 361 +35.56 +/- 15.91 Show
6811 ncm-et-16 2018-03-09 16:43 01:13:47 1948418 500 95 35 370 +41.89 +/- 15.30 Show
6812 ncm-et-12 2018-03-09 16:43 01:12:39 2020510 500 109 27 364 +57.50 +/- 15.48 Show
6813 ncm-et-9 2018-03-09 16:43 01:13:07 2024590 500 96 33 371 +44.01 +/- 15.22 Show
6814 ncm-et-13 2018-03-09 16:43 01:14:59 2024264 500 88 48 364 +27.85 +/- 15.78 Show
6815 ncm-et-14 2018-03-09 16:43 01:11:31 2018883 500 88 42 370 +32.05 +/- 15.39 Show
6816 ncm-et-7 2018-03-09 16:43 01:11:38 2020851 500 98 37 365 +42.60 +/- 15.60 Show
6817 ncm-et-6 2018-03-09 16:43 01:13:08 2025408 500 87 43 370 +30.65 +/- 15.40 Show
6818 ncm-et-4 2018-03-09 16:43 01:14:55 1981141 500 97 38 365 +41.19 +/- 15.62 Show
6819 ncm-et-8 2018-03-09 16:43 01:12:26 2020673 500 95 36 369 +41.19 +/- 15.37 Show
6820 ncm-et-15 2018-03-09 17:54 00:33:43 2016935 233 39 18 176 +31.40 +/- 21.87 Show
6821 ncm-et-14 2018-03-09 17:56 00:32:26 2020350 221 48 11 162 +58.72 +/- 23.04 Show
6822 ncm-et-7 2018-03-09 17:56 00:31:59 1997364 224 51 10 163 +64.32 +/- 23.01 Show
6823 ncm-et-5 2018-03-09 17:56 00:31:58 2024263 221 35 18 168 +26.78 +/- 22.28 Show
6824 ncm-et-12 2018-03-09 17:57 00:31:17 2002367 210 38 18 154 +33.19 +/- 24.07 Show
6825 ncm-et-8 2018-03-09 17:57 00:31:08 2008190 220 40 18 162 +34.86 +/- 23.36 Show
6826 ncm-et-10 2018-03-09 17:57 00:30:48 2020510 214 44 19 151 +40.77 +/- 25.01 Show
6827 ncm-et-9 2018-03-09 17:57 00:30:41 2026718 215 45 15 155 +48.80 +/- 24.14 Show
6828 ncm-et-3 2018-03-09 17:57 00:30:44 2026718 211 40 15 156 +41.36 +/- 23.62 Show
6829 ncm-et-6 2018-03-09 17:57 00:30:39 2025736 218 25 9 184 +25.55 +/- 17.98 Show
6830 ncm-et-16 2018-03-09 17:58 00:30:08 1963157 213 42 21 150 +34.37 +/- 25.21 Show
6831 ncm-et-11 2018-03-09 17:59 00:29:02 2019534 203 42 16 145 +44.74 +/- 25.23 Show
6832 ncm-et-13 2018-03-09 17:59 00:28:57 2024917 205 34 20 151 +23.76 +/- 24.31 Show
6833 ncm-et-4 2018-03-09 17:59 00:28:53 1952841 192 32 17 143 +27.20 +/- 24.69 Show
130316 ncm-et-13 2019-02-06 01:34 01:10:12 1977014 500 88 33 379 +38.37 +/- 14.77 Show
130317 ncm-et-3 2019-02-06 01:34 01:13:15 1963994 500 84 42 374 +29.25 +/- 15.17 Show
130318 ncm-et-10 2019-02-06 01:34 01:14:12 1969239 500 94 41 365 +36.97 +/- 15.66 Show
130319 ncm-et-4 2019-02-06 01:34 01:14:09 1981798 500 95 33 372 +43.30 +/- 15.16 Show
130320 ncm-et-9 2019-02-06 01:34 01:12:33 1970803 500 91 43 366 +33.46 +/- 15.62 Show
130321 ncm-et-15 2019-02-06 01:34 01:13:34 1988086 500 99 32 369 +46.84 +/- 15.31 Show
130322 ncm-et-13 2019-02-06 02:45 01:13:19 1966922 500 83 46 371 +25.76 +/- 15.38 Show
130323 ncm-et-9 2019-02-06 02:47 01:13:30 1968483 500 88 45 367 +29.95 +/- 15.59 Show
130324 ncm-et-3 2019-02-06 02:48 01:13:24 1975475 500 98 41 361 +39.78 +/- 15.87 Show
130325 ncm-et-15 2019-02-06 02:48 01:14:27 1968321 500 95 47 358 +33.46 +/- 16.10 Show
130326 ncm-et-10 2019-02-06 02:49 01:11:28 1963080 500 99 43 358 +39.08 +/- 16.06 Show
130327 ncm-et-4 2019-02-06 02:49 01:14:46 1948583 500 96 37 367 +41.19 +/- 15.49 Show
130328 ncm-et-13 2019-02-06 03:59 01:13:15 1974520 500 108 39 353 +48.25 +/- 16.27 Show
130329 ncm-et-10 2019-02-06 04:02 01:14:24 1966167 500 100 32 368 +47.55 +/- 15.36 Show
130330 ncm-et-9 2019-02-06 04:02 01:13:34 1967871 500 103 40 357 +44.01 +/- 16.07 Show
130331 ncm-et-3 2019-02-06 04:03 01:13:18 1967232 500 99 38 363 +42.60 +/- 15.72 Show
130332 ncm-et-15 2019-02-06 04:04 01:13:00 1976851 500 95 33 372 +43.30 +/- 15.16 Show
130333 ncm-et-4 2019-02-06 04:05 01:12:42 1984938 500 89 33 378 +39.08 +/- 14.83 Show
130334 ncm-et-13 2019-02-06 05:14 00:28:38 1972187 189 41 14 134 +49.98 +/- 26.32 Show
130335 ncm-et-9 2019-02-06 05:17 00:25:51 1978428 172 33 12 127 +42.63 +/- 26.20 Show
130336 ncm-et-3 2019-02-06 05:17 00:25:30 1968314 166 37 14 115 +48.45 +/- 28.95 Show
130337 ncm-et-10 2019-02-06 05:17 00:25:12 1974533 163 34 20 109 +29.91 +/- 30.62 Show
130338 ncm-et-15 2019-02-06 05:18 00:24:27 1977005 159 26 11 122 +32.87 +/- 25.79 Show
130339 ncm-et-4 2019-02-06 05:19 00:23:45 1938468 151 33 13 105 +46.29 +/- 30.26 Show

Commit

Commit ID 126036abb093df88593ef9db67ac0b9a07f411a6
Author lucasart
Date 2016-06-15 06:47:08 UTC
Commit Type Non Functional
Do not hardcode Debug Log File

Allow to specifiy the log file name, this comes
handy in case of self-matches so that each SF
instance writes into a different log file.

No functional change.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-1 1736 257 79 1400 +35.75 +/- 7.06
ncm-et-2 2757 412 136 2209 +34.90 +/- 5.68
ncm-et-3 2745 418 129 2198 +36.71 +/- 5.69
ncm-et-4 2762 388 125 2249 +33.18 +/- 5.49
  10000 1475 469 8056 +35.07 +/- 2.95