Dev Builds » 20180204-2042

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-04 22:34 5369:44:04 2015716 6649 2985 265 3399 +150.96 +/- 5.68
ncm-et-4 2018-02-04 22:28 5369:50:03 2017074 6712 3016 254 3442 +151.97 +/- 5.63
ncm-et-9 2018-09-16 11:53 04:24:43 1989125 1655 750 68 837 +152.22 +/- 11.47
ncm-et-10 2018-09-16 11:53 04:24:58 1961022 1644 719 73 852 +144.28 +/- 11.35
ncm-et-13 2018-09-16 11:53 04:24:53 1988417 1674 751 71 852 +149.77 +/- 11.37
ncm-et-15 2018-09-16 11:53 04:24:53 1982792 1666 736 74 856 +146.10 +/- 11.34
  20000 8957 805 10238 +150.35 +/- 3.27

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
828 ncm-et-4 2018-02-04 22:28 01:16:56 2026882 500 211 16 273 +143.07 +/- 19.74 Show
829 ncm-et-3 2018-02-04 22:34 01:16:56 2024590 500 222 26 252 +143.89 +/- 21.06 Show
830 ncm-et-4 2018-02-04 23:46 01:16:49 2029179 500 228 16 256 +157.24 +/- 20.62 Show
831 ncm-et-3 2018-02-04 23:52 01:16:43 2025736 500 239 12 249 +170.15 +/- 20.88 Show
832 ncm-et-4 2018-02-05 01:04 01:16:03 2027539 500 211 20 269 +139.81 +/- 20.05 Show
833 ncm-et-3 2018-02-05 01:09 01:16:24 2027374 500 236 21 243 +159.78 +/- 21.45 Show
834 ncm-et-4 2018-02-05 02:21 01:17:05 2025735 500 212 19 269 +141.44 +/- 20.02 Show
835 ncm-et-3 2018-02-05 02:27 01:19:54 2026718 500 214 22 264 +140.62 +/- 20.35 Show
836 ncm-et-4 2018-02-05 03:39 01:17:23 2027866 500 223 16 261 +153.02 +/- 20.36 Show
837 ncm-et-3 2018-02-05 03:48 01:17:24 2026554 500 230 15 255 +159.78 +/- 20.65 Show
838 ncm-et-4 2018-02-05 04:57 01:17:21 2028851 500 226 20 254 +152.18 +/- 20.83 Show
839 ncm-et-3 2018-02-05 05:06 01:16:14 2027046 500 223 17 260 +152.18 +/- 20.44 Show
840 ncm-et-4 2018-02-05 06:16 01:16:40 2026718 500 228 20 252 +153.86 +/- 20.94 Show
841 ncm-et-3 2018-02-05 06:24 01:17:37 2026067 500 203 18 279 +134.95 +/- 19.49 Show
842 ncm-et-4 2018-02-05 07:34 01:18:36 2025899 500 226 20 254 +152.18 +/- 20.83 Show
843 ncm-et-3 2018-02-05 07:42 01:17:33 2027374 500 235 23 242 +157.24 +/- 21.54 Show
844 ncm-et-4 2018-02-05 08:53 01:17:02 2024263 500 223 23 254 +147.19 +/- 20.90 Show
845 ncm-et-3 2018-02-05 09:01 01:18:16 2027046 500 229 23 248 +152.18 +/- 21.22 Show
846 ncm-et-4 2018-02-05 10:11 01:16:56 2026554 500 253 22 225 +173.67 +/- 22.48 Show
847 ncm-et-3 2018-02-05 10:20 01:12:52 2027375 479 224 23 232 +155.39 +/- 22.02 Show
848 ncm-et-4 2018-02-05 11:29 00:03:49 2028851 21 12 1 8 +202.06 +/- 130.53 Show
61839 ncm-et-15 2018-09-16 11:53 01:17:42 1982321 500 237 20 243 +161.49 +/- 21.42 Show
61840 ncm-et-10 2018-09-16 11:53 01:22:08 1938159 500 212 23 265 +138.18 +/- 20.33 Show
61841 ncm-et-4 2018-09-16 11:53 01:17:57 1989561 500 240 17 243 +166.66 +/- 21.35 Show
61842 ncm-et-13 2018-09-16 11:53 01:17:50 1987350 500 216 26 258 +138.99 +/- 20.75 Show
61843 ncm-et-9 2018-09-16 11:53 01:17:47 1990665 500 234 25 241 +154.70 +/- 21.63 Show
61844 ncm-et-3 2018-09-16 11:53 01:17:28 1989245 500 245 23 232 +165.80 +/- 22.10 Show
61845 ncm-et-3 2018-09-16 13:12 01:18:38 1992091 500 220 22 258 +145.54 +/- 20.67 Show
61846 ncm-et-15 2018-09-16 13:12 01:19:20 1983733 500 205 20 275 +134.95 +/- 19.74 Show
61847 ncm-et-9 2018-09-16 13:12 01:18:24 1989085 500 212 23 265 +138.18 +/- 20.33 Show
61848 ncm-et-13 2018-09-16 13:12 01:16:37 1987671 500 230 24 246 +152.18 +/- 21.34 Show
61849 ncm-et-4 2018-09-16 13:12 01:17:59 1991455 500 207 18 275 +138.18 +/- 19.69 Show
61850 ncm-et-10 2018-09-16 13:16 01:18:59 1980286 500 232 18 250 +158.93 +/- 20.99 Show
61851 ncm-et-13 2018-09-16 14:30 01:18:45 1989875 500 233 16 251 +161.49 +/- 20.89 Show
61852 ncm-et-4 2018-09-16 14:31 01:16:23 1987353 500 230 17 253 +158.08 +/- 20.81 Show
61853 ncm-et-3 2018-09-16 14:31 01:18:53 1986878 500 202 15 283 +136.56 +/- 19.20 Show
61854 ncm-et-9 2018-09-16 14:31 01:21:10 1988927 500 230 16 254 +158.93 +/- 20.73 Show
61855 ncm-et-15 2018-09-16 14:32 01:18:45 1982478 500 217 31 252 +135.76 +/- 21.14 Show
61856 ncm-et-10 2018-09-16 14:36 01:17:34 1982164 500 211 29 260 +132.54 +/- 20.70 Show
61857 ncm-et-4 2018-09-16 15:48 00:29:24 1989401 191 86 9 96 +148.49 +/- 34.16 Show
61858 ncm-et-13 2018-09-16 15:49 00:28:29 1988771 174 72 5 97 +141.05 +/- 32.97 Show
61859 ncm-et-3 2018-09-16 15:51 00:26:21 1985935 170 63 5 102 +123.49 +/- 31.55 Show
61860 ncm-et-15 2018-09-16 15:52 00:25:53 1982634 166 77 3 86 +166.57 +/- 35.24 Show
61861 ncm-et-9 2018-09-16 15:54 00:24:08 1987824 155 74 4 77 +169.11 +/- 37.77 Show
61862 ncm-et-10 2018-09-16 15:55 00:23:02 1943477 144 64 3 77 +157.07 +/- 37.14 Show

Commit

Commit ID e316e432d0903189945d9669151d7222a4c953d2
Author Stéphane Nicolet
Date 2018-02-04 20:42:56 UTC
Commit Type
Revert "Implement old 'multipv' search"

This revert the following commit:
https://github.com/official-stockfish/Stockfish/commit/44a7db0f9ac02d2461aff39e25f1ac9107ffbfac

Bug report by Ronald de Man in issue:
https://github.com/official-stockfish/Stockfish/issues/1392

Bench: 5023629