Dev Builds » 20170429-0338

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded distro are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-05 04:37 6382:03:06 1984741 2352 782 96 1474 +104.37 +/- 8.23
ncm-et-4 2018-03-05 04:37 6382:03:01 1986666 2376 797 88 1491 +106.93 +/- 8.15
ncm-et-5 2018-03-05 04:37 01:46:34 2023692 726 237 32 457 +100.84 +/- 14.80
ncm-et-6 2018-03-05 04:37 01:46:42 2026231 721 239 29 453 +104.21 +/- 14.83
ncm-et-7 2018-03-05 04:37 01:46:23 2012398 711 248 33 430 +108.45 +/- 15.48
ncm-et-8 2018-03-05 04:37 01:46:23 1906393 692 231 25 436 +106.66 +/- 15.06
ncm-et-9 2018-03-05 04:37 6382:02:56 1985733 2404 797 91 1516 +105.13 +/- 8.08
ncm-et-10 2018-03-05 04:37 6382:02:56 1983194 2389 788 96 1505 +103.60 +/- 8.13
ncm-et-11 2018-03-05 04:37 01:46:35 1985574 694 224 27 443 +101.41 +/- 14.90
ncm-et-12 2018-03-05 04:37 01:46:24 2020673 724 253 22 449 +114.86 +/- 14.85
ncm-et-13 2018-03-05 04:37 6382:02:48 1989802 2399 818 93 1488 +108.38 +/- 8.21
ncm-et-14 2018-03-05 04:37 01:46:30 2017098 718 218 30 470 +93.14 +/- 14.34
ncm-et-15 2018-03-05 04:37 6382:03:00 1983807 2391 781 98 1512 +102.09 +/- 8.10
ncm-et-16 2018-03-05 04:37 01:46:44 2020837 703 248 27 428 +113.05 +/- 15.40
  20000 6661 787 12552 +105.14 +/- 2.81

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
5126 ncm-et-6 2018-03-05 04:37 01:12:22 2026391 500 166 19 315 +105.25 +/- 17.75 Show
5127 ncm-et-16 2018-03-05 04:37 01:15:23 2020186 500 174 20 306 +110.60 +/- 18.21 Show
5128 ncm-et-4 2018-03-05 04:37 01:14:32 2025411 500 177 18 305 +114.45 +/- 18.20 Show
5129 ncm-et-14 2018-03-05 04:37 01:14:33 2018883 500 159 19 322 +99.95 +/- 17.40 Show
5130 ncm-et-12 2018-03-05 04:37 01:12:35 2020999 500 174 17 309 +112.91 +/- 17.98 Show
5131 ncm-et-9 2018-03-05 04:37 01:13:06 2024590 500 151 14 335 +97.69 +/- 16.62 Show
5132 ncm-et-3 2018-03-05 04:37 01:15:32 2026390 500 165 27 308 +98.44 +/- 18.28 Show
5133 ncm-et-5 2018-03-05 04:37 01:12:25 2024590 500 160 19 321 +100.71 +/- 17.45 Show
5134 ncm-et-7 2018-03-05 04:37 01:14:31 2022304 500 172 26 302 +104.49 +/- 18.55 Show
5135 ncm-et-11 2018-03-05 04:37 01:15:42 1952913 500 151 20 329 +93.20 +/- 17.09 Show
5136 ncm-et-10 2018-03-05 04:37 01:11:50 2017907 500 176 18 306 +113.68 +/- 18.16 Show
5137 ncm-et-15 2018-03-05 04:37 01:12:57 2020347 500 168 18 314 +107.54 +/- 17.77 Show
5138 ncm-et-13 2018-03-05 04:37 01:12:26 2025736 500 156 17 327 +99.20 +/- 17.10 Show
5139 ncm-et-8 2018-03-05 04:37 01:14:33 1954230 500 166 17 317 +106.78 +/- 17.59 Show
5140 ncm-et-10 2018-03-05 05:50 00:33:22 2018233 224 73 7 144 +105.50 +/- 25.93 Show
5141 ncm-et-6 2018-03-05 05:50 00:32:59 2026071 221 73 10 138 +101.86 +/- 27.08 Show
5142 ncm-et-5 2018-03-05 05:50 00:32:47 2022793 226 77 13 136 +101.15 +/- 27.81 Show
5143 ncm-et-13 2018-03-05 05:51 00:32:43 2024918 226 74 14 138 +94.50 +/- 27.55 Show
5144 ncm-et-12 2018-03-05 05:51 00:32:27 2020347 224 79 5 140 +119.25 +/- 26.36 Show
5145 ncm-et-15 2018-03-05 05:51 00:32:11 2022141 220 64 10 146 +87.06 +/- 25.69 Show
5146 ncm-et-9 2018-03-05 05:51 00:32:13 2026390 228 72 11 145 +95.27 +/- 26.29 Show
5147 ncm-et-14 2018-03-05 05:52 00:30:36 2015312 218 59 11 148 +77.77 +/- 25.32 Show
5148 ncm-et-4 2018-03-05 05:52 00:30:49 2024101 212 76 10 126 +111.88 +/- 28.82 Show
5149 ncm-et-7 2018-03-05 05:52 00:30:31 2002491 211 76 7 128 +117.95 +/- 28.13 Show
5150 ncm-et-8 2018-03-05 05:53 00:30:26 1858555 192 65 8 119 +106.35 +/- 29.17 Show
5151 ncm-et-16 2018-03-05 05:53 00:29:59 2021488 203 74 7 122 +119.13 +/- 28.94 Show
5152 ncm-et-3 2018-03-05 05:53 00:29:47 2026063 201 60 7 134 +93.83 +/- 26.54 Show
5153 ncm-et-11 2018-03-05 05:54 00:29:32 2018234 194 73 7 114 +123.11 +/- 30.17 Show
113584 ncm-et-10 2018-11-25 22:27 01:16:05 1960639 500 150 40 310 +77.71 +/- 18.42 Show
113585 ncm-et-4 2018-11-25 22:27 01:15:18 1971776 500 180 12 308 +121.46 +/- 17.87 Show
113586 ncm-et-3 2018-11-25 22:27 01:16:18 1959388 500 181 21 298 +115.23 +/- 18.63 Show
113587 ncm-et-15 2018-11-25 22:27 01:14:18 1962309 500 168 17 315 +108.30 +/- 17.69 Show
113588 ncm-et-9 2018-11-25 22:28 01:15:34 1967871 500 168 15 317 +109.83 +/- 17.53 Show
113589 ncm-et-13 2018-11-25 22:28 01:14:36 1976232 500 175 16 309 +114.45 +/- 17.95 Show
113590 ncm-et-15 2018-11-25 23:43 01:14:26 1957130 500 161 20 319 +100.71 +/- 17.58 Show
113591 ncm-et-13 2018-11-25 23:43 01:14:27 1966768 500 161 16 323 +103.73 +/- 17.27 Show
113592 ncm-et-4 2018-11-25 23:44 01:14:26 1961698 500 157 25 318 +93.95 +/- 17.75 Show
113593 ncm-et-9 2018-11-25 23:44 01:13:36 1964766 500 171 20 309 +108.30 +/- 18.07 Show
113594 ncm-et-10 2018-11-25 23:44 01:14:45 1970818 500 165 12 323 +109.83 +/- 17.14 Show
113595 ncm-et-3 2018-11-25 23:45 01:15:52 1966151 500 161 20 319 +100.71 +/- 17.58 Show
113596 ncm-et-15 2018-11-26 00:58 01:15:15 1975985 500 162 23 315 +99.20 +/- 17.85 Show
113597 ncm-et-13 2018-11-26 00:59 01:14:10 1974676 500 194 23 283 +123.81 +/- 19.42 Show
113598 ncm-et-9 2018-11-26 00:59 01:13:08 1962302 500 174 20 306 +110.60 +/- 18.21 Show
113599 ncm-et-4 2018-11-26 00:59 01:13:43 1973781 500 147 15 338 +93.95 +/- 16.50 Show
113600 ncm-et-10 2018-11-26 01:00 01:14:13 1965389 500 171 15 314 +112.14 +/- 17.68 Show
113601 ncm-et-3 2018-11-26 01:02 01:14:39 1965688 500 169 16 315 +109.83 +/- 17.66 Show
113602 ncm-et-9 2018-11-26 02:13 00:26:29 1968479 176 61 11 104 +101.50 +/- 32.06 Show
113603 ncm-et-4 2018-11-26 02:14 00:25:36 1963226 164 60 8 96 +114.09 +/- 33.22 Show
113604 ncm-et-13 2018-11-26 02:14 00:25:32 1970481 173 58 7 108 +105.56 +/- 30.53 Show
113605 ncm-et-15 2018-11-26 02:15 00:25:00 1964929 171 58 10 103 +100.22 +/- 31.99 Show
113606 ncm-et-10 2018-11-26 02:16 00:23:59 1966180 165 53 4 108 +106.38 +/- 29.54 Show
113607 ncm-et-3 2018-11-26 02:17 00:22:18 1964763 151 46 5 100 +96.76 +/- 30.80 Show

Commit

Commit ID b948b037a52dea37d26a7210f75405be7f43bf58
Author Rocky640
Date 2017-04-29 03:38:03 UTC
Commit Type Simplification
Remove cap in kingDanger initialization

Passed STC
http://tests.stockfishchess.org/tests/view/58fd53be0ebc59035df33eb5
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 52048 W: 9397 L: 9329 D: 33322

Passed LTC
http://tests.stockfishchess.org/tests/view/58ff9e0a0ebc59035df33f5c
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 35382 W: 4650 L: 4549 D: 26183

Bench: 5872717

Closes #1087

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4985 1740 147 3098 +115.06 +/- 5.64
ncm-et-4 5015 1728 141 3146 +113.85 +/- 5.57
  10000 3468 288 6244 +114.45 +/- 3.96