Dev Builds » 20180303-1141

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-03 13:50 4549:15:26 2001671 2552 1198 105 1249 +159.06 +/- 9.43
ncm-et-4 2018-03-03 13:50 4549:15:52 1989117 2553 1177 103 1273 +155.83 +/- 9.32
ncm-et-5 2018-03-03 13:51 02:15:14 1982788 857 407 38 412 +160.03 +/- 16.50
ncm-et-6 2018-03-03 13:51 02:15:05 2024754 883 394 30 459 +152.28 +/- 15.37
ncm-et-7 2018-03-03 13:51 02:15:35 2024101 891 419 29 443 +163.08 +/- 15.74
ncm-et-8 2018-03-03 13:51 02:15:39 1983363 875 390 31 454 +151.47 +/- 15.47
ncm-et-9 2018-03-03 13:51 4549:15:03 2000777 2563 1181 82 1300 +159.27 +/- 9.15
ncm-et-10 2018-03-03 13:51 4549:15:05 1984725 2548 1148 78 1322 +155.52 +/- 9.03
ncm-et-11 2018-03-03 13:54 02:12:24 2006227 857 364 34 459 +141.06 +/- 15.35
ncm-et-12 2018-03-03 13:51 02:15:10 2006619 867 401 22 444 +162.84 +/- 15.57
ncm-et-13 2018-03-03 13:52 4549:13:39 1979306 2523 1167 89 1267 +158.62 +/- 9.30
ncm-et-14 2018-03-03 15:08 00:58:09 2020022 384 180 11 193 +164.11 +/- 23.78
ncm-et-15 2018-09-08 22:43 04:22:27 1963593 1647 738 58 851 +152.55 +/- 11.30
  20000 9164 710 10126 +156.68 +/- 3.29

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
4681 ncm-et-4 2018-03-03 13:50 01:17:42 1978522 500 246 13 241 +175.44 +/- 21.35 Show
4682 ncm-et-3 2018-03-03 13:50 01:16:32 2026227 500 217 22 261 +143.07 +/- 20.51 Show
4683 ncm-et-8 2018-03-03 13:51 01:17:28 1967901 500 213 17 270 +143.89 +/- 19.92 Show
4684 ncm-et-7 2018-03-03 13:51 01:15:51 2024591 500 245 13 242 +174.55 +/- 21.29 Show
4685 ncm-et-10 2018-03-03 13:51 01:17:17 2021814 500 221 19 260 +148.85 +/- 20.49 Show
4686 ncm-et-9 2018-03-03 13:51 01:16:49 2024264 500 230 13 257 +161.49 +/- 20.48 Show
4687 ncm-et-5 2018-03-03 13:51 01:19:34 1942455 500 244 18 238 +169.27 +/- 21.65 Show
4688 ncm-et-12 2018-03-03 13:51 01:18:11 1991098 500 231 16 253 +159.78 +/- 20.78 Show
4689 ncm-et-6 2018-03-03 13:51 01:16:18 2024426 500 219 16 265 +149.68 +/- 20.15 Show
4690 ncm-et-13 2018-03-03 13:52 01:14:20 2024265 500 245 19 236 +169.27 +/- 21.79 Show
4691 ncm-et-11 2018-03-03 13:54 01:16:34 1991781 500 208 19 273 +138.18 +/- 19.82 Show
4692 ncm-et-13 2018-03-03 15:07 00:58:43 2022306 386 175 11 200 +157.60 +/- 23.24 Show
4693 ncm-et-7 2018-03-03 15:08 00:58:40 2023610 391 174 16 201 +148.89 +/- 23.40 Show
4694 ncm-et-3 2018-03-03 15:08 00:57:58 2025244 377 167 16 194 +147.41 +/- 23.83 Show
4695 ncm-et-14 2018-03-03 15:08 00:58:09 2020022 384 180 11 193 +164.11 +/- 23.78 Show
4696 ncm-et-6 2018-03-03 15:09 00:57:42 2025081 383 175 14 194 +155.70 +/- 23.81 Show
4697 ncm-et-4 2018-03-03 15:09 00:57:14 1996046 370 175 14 181 +161.98 +/- 24.79 Show
4698 ncm-et-9 2018-03-03 15:09 00:57:31 2027211 376 184 18 174 +164.71 +/- 25.56 Show
4699 ncm-et-8 2018-03-03 15:09 00:57:06 1998824 375 177 14 184 +161.78 +/- 24.57 Show
4700 ncm-et-10 2018-03-03 15:09 00:57:01 2020184 377 182 16 179 +164.21 +/- 25.08 Show
4701 ncm-et-12 2018-03-03 15:10 00:55:54 2022140 367 170 6 191 +167.04 +/- 23.52 Show
4702 ncm-et-11 2018-03-03 15:11 00:54:45 2020673 357 156 15 186 +145.11 +/- 24.29 Show
4703 ncm-et-5 2018-03-03 15:12 00:54:35 2023120 357 163 20 174 +147.42 +/- 25.51 Show
60861 ncm-et-3 2018-09-08 22:43 01:17:07 1990665 500 234 13 253 +164.93 +/- 20.69 Show
60862 ncm-et-9 2018-09-08 22:43 01:16:52 1988139 500 233 16 251 +161.49 +/- 20.89 Show
60863 ncm-et-15 2018-09-08 22:43 01:16:51 1981700 500 220 18 262 +148.85 +/- 20.36 Show
60864 ncm-et-4 2018-09-08 22:43 01:16:51 1991614 500 228 24 248 +150.51 +/- 21.24 Show
60865 ncm-et-10 2018-09-08 22:43 01:16:00 1978878 500 224 15 261 +154.70 +/- 20.33 Show
60866 ncm-et-13 2018-09-08 22:43 01:21:06 1920051 500 228 17 255 +156.39 +/- 20.70 Show
60867 ncm-et-10 2018-09-09 00:00 01:16:57 1982635 500 212 11 277 +148.02 +/- 19.37 Show
60868 ncm-et-9 2018-09-09 00:01 01:16:43 1987037 500 224 13 263 +156.39 +/- 20.16 Show
60869 ncm-et-15 2018-09-09 00:01 01:18:31 1956897 500 235 20 245 +159.78 +/- 21.31 Show
60870 ncm-et-4 2018-09-09 00:01 01:17:52 1988454 500 218 23 259 +143.07 +/- 20.64 Show
60871 ncm-et-3 2018-09-09 00:01 01:16:36 1989874 500 259 25 216 +176.33 +/- 23.06 Show
60872 ncm-et-13 2018-09-09 00:05 01:16:53 1988769 500 216 22 262 +142.26 +/- 20.46 Show
60873 ncm-et-10 2018-09-09 01:18 01:20:02 1924240 500 236 14 250 +165.80 +/- 20.88 Show
60874 ncm-et-9 2018-09-09 01:19 01:17:12 1990032 500 225 18 257 +153.02 +/- 20.62 Show
60875 ncm-et-3 2018-09-09 01:19 01:18:19 1989559 500 232 23 245 +154.70 +/- 21.38 Show
60876 ncm-et-4 2018-09-09 01:20 01:16:58 1990190 500 219 18 263 +148.02 +/- 20.31 Show
60877 ncm-et-15 2018-09-09 01:21 01:20:17 1934705 500 218 14 268 +150.51 +/- 19.93 Show
60878 ncm-et-13 2018-09-09 01:23 01:19:23 1935760 500 239 15 246 +167.53 +/- 21.13 Show
60879 ncm-et-9 2018-09-09 02:37 00:28:42 1987981 187 85 4 98 +161.13 +/- 33.02 Show
60880 ncm-et-4 2018-09-09 02:38 00:27:39 1989876 183 91 11 81 +162.85 +/- 37.84 Show
60881 ncm-et-3 2018-09-09 02:38 00:27:27 1988454 175 89 6 80 +179.13 +/- 37.64 Show
60882 ncm-et-10 2018-09-09 02:39 00:26:23 1980599 171 73 3 95 +151.08 +/- 33.02 Show
60883 ncm-et-15 2018-09-09 02:42 00:23:31 1981070 147 65 6 76 +147.75 +/- 38.16 Show
60884 ncm-et-13 2018-09-09 02:44 00:21:47 1984682 137 64 5 68 +160.06 +/- 40.52 Show

Commit

Commit ID cad300cfab869a4e8dcc6b286f9b2e60d2827bed
Author Joost VandeVondele
Date 2018-03-03 11:41:35 UTC
Commit Type Simplification
No extra stage for QS recaptures.

remove the QRECAPTURES and QSEARCH_RECAPTURES stages as they can be
incoorporated in QCAPTURES stage with a simple condition on depth.

passed STC:
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 214964 W: 46188 L: 46443 D: 122333
http://tests.stockfishchess.org/tests/view/5a98544b0ebc590297cc8e35

passed LTC:
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 14552 W: 2404 L: 2274 D: 9874
http://tests.stockfishchess.org/tests/view/5a9947b20ebc590297cc8e93

Bench: 6361582