Dev Builds » 20170205-2340

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded distro are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-06 04:04 6750:10:50 1988036 2382 759 97 1526 +99.17 +/- 8.02
ncm-et-4 2018-03-06 04:04 6750:10:37 1970871 2397 712 91 1594 +92.11 +/- 7.71
ncm-et-5 2018-03-06 04:04 01:47:00 2010745 720 210 40 470 +83.61 +/- 14.50
ncm-et-6 2018-03-06 04:04 01:46:39 2026309 723 196 29 498 +81.73 +/- 13.57
ncm-et-7 2018-03-06 04:04 01:47:07 1989772 699 204 31 464 +87.81 +/- 14.38
ncm-et-8 2018-03-06 04:04 01:47:07 1977036 701 207 30 464 +89.67 +/- 14.38
ncm-et-9 2018-03-06 04:04 6750:10:14 1990951 2368 739 104 1525 +95.50 +/- 8.03
ncm-et-10 2018-03-06 04:04 6750:10:17 1986327 2391 750 115 1526 +94.54 +/- 8.08
ncm-et-11 2018-03-06 04:04 01:47:16 2017828 724 218 31 475 +91.82 +/- 14.27
ncm-et-12 2018-03-06 04:04 01:47:00 2004856 715 226 18 471 +104.08 +/- 14.08
ncm-et-13 2018-03-06 04:04 6750:10:49 1996709 2401 713 109 1579 +89.32 +/- 7.83
ncm-et-14 2018-03-06 04:04 01:47:02 2019133 714 225 30 459 +97.36 +/- 14.63
ncm-et-15 2018-03-06 04:04 6750:10:47 1977437 2352 724 101 1527 +94.28 +/- 7.99
ncm-et-16 2018-03-06 04:04 01:47:13 2020755 713 222 36 455 +92.78 +/- 14.82
  20000 6105 862 13033 +93.26 +/- 2.73

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
5490 ncm-et-11 2018-03-06 04:04 01:14:19 2016772 500 156 18 326 +98.44 +/- 17.18 Show
5491 ncm-et-14 2018-03-06 04:04 01:13:54 2016124 500 151 16 333 +96.19 +/- 16.78 Show
5492 ncm-et-16 2018-03-06 04:04 01:13:39 2020673 500 163 25 312 +98.44 +/- 18.04 Show
5493 ncm-et-15 2018-03-06 04:04 01:14:26 2016122 500 155 26 319 +91.71 +/- 17.73 Show
5494 ncm-et-7 2018-03-06 04:04 01:15:54 1954789 500 139 20 341 +84.31 +/- 16.49 Show
5495 ncm-et-3 2018-03-06 04:04 01:14:33 2025572 500 158 22 320 +96.94 +/- 17.58 Show
5496 ncm-et-8 2018-03-06 04:04 01:14:41 2023282 500 141 21 338 +85.04 +/- 16.67 Show
5497 ncm-et-12 2018-03-06 04:04 01:13:54 1991477 500 159 13 328 +104.49 +/- 16.93 Show
5498 ncm-et-13 2018-03-06 04:04 01:10:58 2025408 500 135 27 338 +76.25 +/- 16.81 Show
5499 ncm-et-5 2018-03-06 04:04 01:14:13 2001457 500 149 27 324 +86.52 +/- 17.50 Show
5500 ncm-et-4 2018-03-06 04:04 01:14:07 2004955 500 148 22 330 +89.48 +/- 17.09 Show
5501 ncm-et-9 2018-03-06 04:04 01:15:00 2025736 500 164 23 313 +100.71 +/- 17.95 Show
5502 ncm-et-6 2018-03-06 04:04 01:12:09 2026063 500 139 18 343 +85.78 +/- 16.34 Show
5503 ncm-et-10 2018-03-06 04:04 01:12:46 2018720 500 149 25 326 +88.00 +/- 17.36 Show
5504 ncm-et-13 2018-03-06 05:16 00:34:44 2026063 240 69 18 153 +74.97 +/- 25.95 Show
5505 ncm-et-6 2018-03-06 05:18 00:33:06 2026554 223 57 11 155 +72.71 +/- 24.41 Show
5506 ncm-et-10 2018-03-06 05:19 00:32:24 2018070 217 74 16 127 +95.17 +/- 29.21 Show
5507 ncm-et-16 2018-03-06 05:19 00:32:11 2020837 213 59 11 143 +79.66 +/- 25.93 Show
5508 ncm-et-14 2018-03-06 05:19 00:31:44 2022141 214 74 14 126 +100.09 +/- 29.18 Show
5509 ncm-et-12 2018-03-06 05:19 00:31:42 2018234 215 67 5 143 +103.12 +/- 25.43 Show
5510 ncm-et-5 2018-03-06 05:19 00:31:24 2020033 220 61 13 146 +77.04 +/- 25.92 Show
5511 ncm-et-11 2018-03-06 05:19 00:31:34 2018883 224 62 13 149 +77.25 +/- 25.61 Show
5512 ncm-et-4 2018-03-06 05:19 00:31:33 1995383 210 71 10 129 +103.91 +/- 28.21 Show
5513 ncm-et-15 2018-03-06 05:20 00:31:25 2019208 215 59 11 145 +78.90 +/- 25.68 Show
5514 ncm-et-3 2018-03-06 05:20 00:31:18 2026063 204 55 8 141 +81.51 +/- 25.48 Show
5515 ncm-et-8 2018-03-06 05:20 00:31:03 1930790 201 66 9 126 +101.30 +/- 28.30 Show
5516 ncm-et-9 2018-03-06 05:21 00:30:21 2023282 205 60 7 138 +91.91 +/- 26.01 Show
5517 ncm-et-7 2018-03-06 05:21 00:29:50 2024754 199 65 11 123 +96.70 +/- 28.97 Show
115217 ncm-et-9 2018-12-08 13:58 01:14:31 1977479 500 138 27 335 +78.44 +/- 16.96 Show
115218 ncm-et-15 2018-12-08 13:59 01:13:18 1968166 500 155 27 318 +90.97 +/- 17.80 Show
115219 ncm-et-3 2018-12-08 13:59 01:13:36 1976184 500 166 27 307 +99.20 +/- 18.33 Show
115220 ncm-et-4 2018-12-08 13:59 01:17:31 1921971 500 159 21 320 +98.44 +/- 17.56 Show
115221 ncm-et-10 2018-12-08 13:59 01:14:15 1960935 500 155 22 323 +94.70 +/- 17.43 Show
115222 ncm-et-13 2018-12-08 13:59 01:13:12 1973430 500 167 14 319 +109.83 +/- 17.40 Show
115649 ncm-et-10 2018-12-12 07:18 01:14:27 1974901 500 160 30 310 +92.46 +/- 18.25 Show
115650 ncm-et-4 2018-12-12 07:18 01:13:27 1964457 500 138 14 348 +88.00 +/- 15.97 Show
115651 ncm-et-3 2018-12-12 07:18 01:15:24 1963381 500 161 13 326 +106.01 +/- 17.02 Show
115652 ncm-et-15 2018-12-12 07:18 01:18:12 1932105 500 151 20 329 +93.20 +/- 17.09 Show
115653 ncm-et-9 2018-12-12 07:18 01:15:13 1978521 500 151 21 328 +92.46 +/- 17.16 Show
115654 ncm-et-13 2018-12-12 07:18 01:16:18 1984543 500 150 23 327 +90.22 +/- 17.26 Show
115655 ncm-et-4 2018-12-12 08:32 01:13:54 1964149 500 136 20 344 +82.10 +/- 16.34 Show
115656 ncm-et-10 2018-12-12 08:33 01:14:06 1979110 500 152 15 333 +97.69 +/- 16.75 Show
115657 ncm-et-9 2018-12-12 08:34 01:14:45 1974377 500 180 20 300 +115.23 +/- 18.50 Show
115658 ncm-et-3 2018-12-12 08:34 01:13:39 1973015 500 166 22 312 +102.97 +/- 17.97 Show
115659 ncm-et-13 2018-12-12 08:35 01:14:43 1985632 500 151 17 332 +95.44 +/- 16.86 Show
115660 ncm-et-15 2018-12-12 08:37 01:15:20 1964660 500 157 14 329 +102.22 +/- 16.91 Show
115661 ncm-et-4 2018-12-12 09:47 00:27:27 1974311 187 60 4 123 +107.33 +/- 27.52 Show
115662 ncm-et-10 2018-12-12 09:48 00:26:21 1966224 174 60 7 107 +109.30 +/- 30.82 Show
115663 ncm-et-3 2018-12-12 09:49 00:25:43 1964000 178 53 5 120 +96.07 +/- 27.72 Show
115664 ncm-et-9 2018-12-12 09:50 00:24:33 1966312 163 46 6 111 +87.04 +/- 28.91 Show
115665 ncm-et-13 2018-12-12 09:51 00:23:37 1985179 161 41 10 110 +67.74 +/- 29.51 Show
115666 ncm-et-15 2018-12-12 09:53 00:21:11 1964362 137 47 3 87 +115.68 +/- 33.28 Show

Commit

Commit ID 0553b46829156bb0c9efb0c9bdaaedc2045e997c
Author VoyagerOne
Date 2017-02-05 23:40:30 UTC
Commit Type Simplification
Simplify Queen Mobility

STC:
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 85997 W: 15550 L: 15540 D: 54907

LTC:
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 25333 W: 3370 L: 3256 D: 18707

Bench: 6459194

Closes #991

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 7965 2450 258 5257 +98.15 +/- 4.24
ncm-et-4 2035 627 60 1348 +99.43 +/- 8.33
  10000 3077 318 6605 +98.41 +/- 3.78