Dev Builds » 20180318-2317

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-19 00:25 4052:36:50 2000792 2451 1160 75 1216 +165.22 +/- 9.48
ncm-et-4 2018-03-19 00:25 4052:36:52 1996602 2458 1108 73 1277 +156.00 +/- 9.18
ncm-et-5 2018-03-19 00:25 01:58:00 2024509 779 324 22 433 +142.12 +/- 15.56
ncm-et-6 2018-03-19 00:25 01:57:56 2024673 762 337 25 400 +151.12 +/- 16.43
ncm-et-7 2018-03-19 00:25 01:58:16 2012128 758 370 23 365 +171.81 +/- 17.39
ncm-et-8 2018-03-19 00:25 01:57:59 1997927 766 343 24 399 +154.05 +/- 16.45
ncm-et-9 2018-03-19 00:25 4052:36:35 2000981 2465 1138 62 1265 +162.57 +/- 9.21
ncm-et-10 2018-03-19 00:24 4052:36:55 1980449 2444 1139 58 1247 +165.07 +/- 9.28
ncm-et-11 2018-03-19 00:25 01:57:40 1947815 725 337 21 367 +162.29 +/- 17.21
ncm-et-12 2018-03-19 00:25 01:57:59 2006576 769 364 13 392 +171.22 +/- 16.47
ncm-et-13 2018-03-19 00:25 4052:36:48 1954972 2385 1084 78 1223 +156.31 +/- 9.42
ncm-et-14 2018-03-19 00:24 01:58:18 2020103 783 349 19 415 +156.16 +/- 15.99
ncm-et-15 2018-03-19 00:25 4052:36:55 1992415 2455 1102 73 1280 +155.18 +/- 9.17
  20000 9155 566 10279 +159.55 +/- 3.24

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
9889 ncm-et-14 2018-03-19 00:24 01:15:14 2020347 500 228 10 262 +162.35 +/- 20.11 Show
9890 ncm-et-10 2018-03-19 00:24 01:15:07 2019697 500 234 13 253 +164.93 +/- 20.69 Show
9891 ncm-et-15 2018-03-19 00:25 01:16:53 2015798 500 232 17 251 +159.78 +/- 20.92 Show
9892 ncm-et-7 2018-03-19 00:25 01:17:27 1998192 500 242 19 239 +166.66 +/- 21.62 Show
9893 ncm-et-6 2018-03-19 00:25 01:16:17 2025081 500 232 12 256 +164.07 +/- 20.50 Show
9894 ncm-et-3 2018-03-19 00:25 01:15:40 2024918 500 233 19 248 +158.93 +/- 21.13 Show
9895 ncm-et-13 2018-03-19 00:25 01:15:25 2024590 500 231 12 257 +163.21 +/- 20.45 Show
9896 ncm-et-4 2018-03-19 00:25 01:14:31 2025081 500 236 12 252 +167.53 +/- 20.71 Show
9897 ncm-et-9 2018-03-19 00:25 01:14:17 2026226 500 220 12 268 +153.86 +/- 19.87 Show
9898 ncm-et-12 2018-03-19 00:25 01:15:51 2019209 500 240 9 251 +173.67 +/- 20.66 Show
9899 ncm-et-5 2018-03-19 00:25 01:14:44 2024263 500 203 12 285 +139.81 +/- 19.00 Show
9900 ncm-et-11 2018-03-19 00:25 01:22:33 1877397 500 235 14 251 +164.93 +/- 20.83 Show
9901 ncm-et-8 2018-03-19 00:25 01:15:05 2022956 500 218 17 265 +148.02 +/- 20.18 Show
9902 ncm-et-9 2018-03-19 01:40 00:42:33 2024263 279 133 7 139 +169.11 +/- 28.01 Show
9903 ncm-et-4 2018-03-19 01:40 00:42:28 1993609 284 131 9 144 +159.60 +/- 27.57 Show
9904 ncm-et-5 2018-03-19 01:41 00:42:11 2024754 279 121 10 148 +146.30 +/- 27.06 Show
9905 ncm-et-10 2018-03-19 01:41 00:42:07 2021325 274 129 6 139 +167.93 +/- 27.86 Show
9906 ncm-et-14 2018-03-19 01:41 00:42:00 2019858 283 121 9 153 +145.44 +/- 26.45 Show
9907 ncm-et-8 2018-03-19 01:41 00:41:48 1972897 266 125 7 134 +165.63 +/- 28.51 Show
9908 ncm-et-13 2018-03-19 01:41 00:41:41 2023938 277 125 8 144 +156.55 +/- 27.40 Show
9909 ncm-et-3 2018-03-19 01:41 00:41:23 2024754 279 134 8 137 +169.11 +/- 28.34 Show
9910 ncm-et-12 2018-03-19 01:42 00:41:03 1993943 269 124 4 141 +166.71 +/- 27.32 Show
9911 ncm-et-6 2018-03-19 01:42 00:40:34 2024264 262 105 13 144 +127.42 +/- 27.48 Show
9912 ncm-et-15 2018-03-19 01:42 00:40:22 2019533 265 102 6 157 +131.85 +/- 25.34 Show
9913 ncm-et-7 2018-03-19 01:43 00:39:43 2026064 258 128 4 126 +181.98 +/- 29.28 Show
9914 ncm-et-11 2018-03-19 01:48 00:34:03 2018233 225 102 7 116 +156.48 +/- 30.65 Show
60177 ncm-et-9 2018-09-03 16:42 01:16:36 1987350 500 222 12 266 +155.54 +/- 19.97 Show
60178 ncm-et-10 2018-09-03 16:43 01:18:36 1942258 500 226 13 261 +158.08 +/- 20.27 Show
60179 ncm-et-13 2018-09-03 16:43 01:18:54 1900300 500 214 17 269 +144.72 +/- 19.97 Show
60180 ncm-et-4 2018-09-03 16:43 01:16:52 1990348 500 218 20 262 +145.54 +/- 20.41 Show
60181 ncm-et-15 2018-09-03 16:43 01:15:09 1975796 500 225 21 254 +150.51 +/- 20.85 Show
60182 ncm-et-3 2018-09-03 16:43 01:15:29 1987666 500 240 15 245 +168.40 +/- 21.19 Show
60183 ncm-et-15 2018-09-03 17:59 01:15:54 1982321 500 226 14 260 +157.24 +/- 20.35 Show
60184 ncm-et-3 2018-09-03 18:00 01:17:35 1989876 500 239 19 242 +164.07 +/- 21.46 Show
60185 ncm-et-9 2018-09-03 18:00 01:15:19 1989559 500 233 8 259 +168.40 +/- 20.20 Show
60186 ncm-et-4 2018-09-03 18:01 01:15:01 1988769 500 215 12 273 +149.68 +/- 19.61 Show
60187 ncm-et-10 2018-09-03 18:02 01:15:45 1965056 500 243 9 248 +176.33 +/- 20.83 Show
60188 ncm-et-13 2018-09-03 18:03 01:19:40 1931969 500 237 22 241 +159.78 +/- 21.58 Show
60189 ncm-et-15 2018-09-03 19:16 01:15:55 1979504 500 238 9 253 +171.90 +/- 20.56 Show
60190 ncm-et-9 2018-09-03 19:16 01:15:32 1989401 500 243 14 243 +171.90 +/- 21.27 Show
60191 ncm-et-4 2018-09-03 19:17 01:16:21 1990823 500 240 12 248 +171.02 +/- 20.93 Show
60192 ncm-et-3 2018-09-03 19:18 01:15:20 1990032 500 229 9 262 +164.07 +/- 20.08 Show
60193 ncm-et-10 2018-09-03 19:19 01:14:54 1980755 500 224 11 265 +158.08 +/- 19.99 Show
60194 ncm-et-13 2018-09-03 19:23 01:18:51 1919548 500 231 18 251 +158.08 +/- 20.94 Show
60195 ncm-et-15 2018-09-03 20:33 00:28:30 1981538 190 79 6 105 +140.71 +/- 31.81 Show
60196 ncm-et-9 2018-09-03 20:33 00:28:07 1989085 186 87 9 90 +155.27 +/- 35.48 Show
60197 ncm-et-4 2018-09-03 20:34 00:27:16 1990980 174 68 8 98 +124.92 +/- 33.12 Show
60198 ncm-et-3 2018-09-03 20:35 00:26:51 1987508 172 85 5 82 +175.05 +/- 36.88 Show
60199 ncm-et-10 2018-09-03 20:35 00:26:20 1953602 170 83 6 81 +169.69 +/- 37.25 Show
60200 ncm-et-13 2018-09-03 20:43 00:18:02 1929486 108 46 1 61 +154.14 +/- 40.78 Show

Commit

Commit ID 194048503020ad35e221c36fd8817f569b728310
Author Joost VandeVondele
Date 2018-03-18 23:17:08 UTC
Commit Type Simplification
Simplify razoring logic

passed STC:
LLR: 2.96 (-2.94,2.94) [-3.00,1.00]
Total: 36574 W: 7523 L: 7430 D: 21621
http://tests.stockfishchess.org/tests/view/5aae11450ebc590299abf52f

No functional change.