Dev Builds » 20170429-0338

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-05 04:37 01:46:41 2026227 701 225 34 442 +97.12 +/- 15.09
ncm-et-4 2018-03-05 04:37 01:46:43 2024756 712 253 28 431 +113.68 +/- 15.38
ncm-et-5 2018-03-05 04:37 01:46:34 2023692 726 237 32 457 +100.84 +/- 14.80
ncm-et-6 2018-03-05 04:37 01:46:42 2026231 721 239 29 453 +104.21 +/- 14.83
ncm-et-7 2018-03-05 04:37 01:46:23 2012398 711 248 33 430 +108.45 +/- 15.48
ncm-et-8 2018-03-05 04:37 01:46:23 1906393 692 231 25 436 +106.66 +/- 15.06
ncm-et-9 2018-03-05 04:37 01:46:41 2025490 728 223 25 480 +96.93 +/- 14.06
ncm-et-10 2018-03-05 04:37 01:46:33 2018070 724 249 25 450 +111.14 +/- 14.87
ncm-et-11 2018-03-05 04:37 01:46:35 1985574 694 224 27 443 +101.41 +/- 14.90
ncm-et-12 2018-03-05 04:37 01:46:24 2020673 724 253 22 449 +114.86 +/- 14.85
ncm-et-13 2018-03-05 04:37 01:46:30 2025327 726 230 31 465 +97.73 +/- 14.56
ncm-et-14 2018-03-05 04:37 01:46:30 2017098 718 218 30 470 +93.14 +/- 14.34
ncm-et-15 2018-03-05 04:37 01:46:30 2021244 720 232 28 460 +101.21 +/- 14.61
ncm-et-16 2018-03-05 04:37 01:46:44 2020837 703 248 27 428 +113.05 +/- 15.40
  10000 3310 396 6294 +104.26 +/- 3.97

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
5126 ncm-et-6 2018-03-05 04:37 01:12:22 2026391 500 166 19 315 +105.25 +/- 17.75 Show
5127 ncm-et-16 2018-03-05 04:37 01:15:23 2020186 500 174 20 306 +110.60 +/- 18.21 Show
5128 ncm-et-4 2018-03-05 04:37 01:14:32 2025411 500 177 18 305 +114.45 +/- 18.20 Show
5129 ncm-et-14 2018-03-05 04:37 01:14:33 2018883 500 159 19 322 +99.95 +/- 17.40 Show
5130 ncm-et-12 2018-03-05 04:37 01:12:35 2020999 500 174 17 309 +112.91 +/- 17.98 Show
5131 ncm-et-9 2018-03-05 04:37 01:13:06 2024590 500 151 14 335 +97.69 +/- 16.62 Show
5132 ncm-et-3 2018-03-05 04:37 01:15:32 2026390 500 165 27 308 +98.44 +/- 18.28 Show
5133 ncm-et-5 2018-03-05 04:37 01:12:25 2024590 500 160 19 321 +100.71 +/- 17.45 Show
5134 ncm-et-7 2018-03-05 04:37 01:14:31 2022304 500 172 26 302 +104.49 +/- 18.55 Show
5135 ncm-et-11 2018-03-05 04:37 01:15:42 1952913 500 151 20 329 +93.20 +/- 17.09 Show
5136 ncm-et-10 2018-03-05 04:37 01:11:50 2017907 500 176 18 306 +113.68 +/- 18.16 Show
5137 ncm-et-15 2018-03-05 04:37 01:12:57 2020347 500 168 18 314 +107.54 +/- 17.77 Show
5138 ncm-et-13 2018-03-05 04:37 01:12:26 2025736 500 156 17 327 +99.20 +/- 17.10 Show
5139 ncm-et-8 2018-03-05 04:37 01:14:33 1954230 500 166 17 317 +106.78 +/- 17.59 Show
5140 ncm-et-10 2018-03-05 05:50 00:33:22 2018233 224 73 7 144 +105.50 +/- 25.93 Show
5141 ncm-et-6 2018-03-05 05:50 00:32:59 2026071 221 73 10 138 +101.86 +/- 27.08 Show
5142 ncm-et-5 2018-03-05 05:50 00:32:47 2022793 226 77 13 136 +101.15 +/- 27.81 Show
5143 ncm-et-13 2018-03-05 05:51 00:32:43 2024918 226 74 14 138 +94.50 +/- 27.55 Show
5144 ncm-et-12 2018-03-05 05:51 00:32:27 2020347 224 79 5 140 +119.25 +/- 26.36 Show
5145 ncm-et-15 2018-03-05 05:51 00:32:11 2022141 220 64 10 146 +87.06 +/- 25.69 Show
5146 ncm-et-9 2018-03-05 05:51 00:32:13 2026390 228 72 11 145 +95.27 +/- 26.29 Show
5147 ncm-et-14 2018-03-05 05:52 00:30:36 2015312 218 59 11 148 +77.77 +/- 25.32 Show
5148 ncm-et-4 2018-03-05 05:52 00:30:49 2024101 212 76 10 126 +111.88 +/- 28.82 Show
5149 ncm-et-7 2018-03-05 05:52 00:30:31 2002491 211 76 7 128 +117.95 +/- 28.13 Show
5150 ncm-et-8 2018-03-05 05:53 00:30:26 1858555 192 65 8 119 +106.35 +/- 29.17 Show
5151 ncm-et-16 2018-03-05 05:53 00:29:59 2021488 203 74 7 122 +119.13 +/- 28.94 Show
5152 ncm-et-3 2018-03-05 05:53 00:29:47 2026063 201 60 7 134 +93.83 +/- 26.54 Show
5153 ncm-et-11 2018-03-05 05:54 00:29:32 2018234 194 73 7 114 +123.11 +/- 30.17 Show

Commit

Commit ID b948b037a52dea37d26a7210f75405be7f43bf58
Author Rocky640
Date 2017-04-29 03:38:03 UTC
Commit Type Simplification
Remove cap in kingDanger initialization

Passed STC
http://tests.stockfishchess.org/tests/view/58fd53be0ebc59035df33eb5
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 52048 W: 9397 L: 9329 D: 33322

Passed LTC
http://tests.stockfishchess.org/tests/view/58ff9e0a0ebc59035df33f5c
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 35382 W: 4650 L: 4549 D: 26183

Bench: 5872717

Closes #1087

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4985 1740 147 3098 +115.06 +/- 5.64
ncm-et-4 5015 1728 141 3146 +113.85 +/- 5.57
  10000 3468 288 6244 +114.45 +/- 3.96