Dev Builds » 20170205-2340

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-06 04:04 01:47:13 2025818 704 213 30 461 +92.43 +/- 14.49
ncm-et-4 2018-03-06 04:04 01:47:03 2000169 710 219 32 459 +93.72 +/- 14.63
ncm-et-5 2018-03-06 04:04 01:47:00 2010745 720 210 40 470 +83.61 +/- 14.50
ncm-et-6 2018-03-06 04:04 01:46:39 2026309 723 196 29 498 +81.73 +/- 13.57
ncm-et-7 2018-03-06 04:04 01:47:07 1989772 699 204 31 464 +87.81 +/- 14.38
ncm-et-8 2018-03-06 04:04 01:47:07 1977036 701 207 30 464 +89.67 +/- 14.38
ncm-et-9 2018-03-06 04:04 01:46:44 2024509 705 224 30 451 +98.14 +/- 14.79
ncm-et-10 2018-03-06 04:04 01:46:33 2018395 717 223 41 453 +90.16 +/- 14.97
ncm-et-11 2018-03-06 04:04 01:47:16 2017828 724 218 31 475 +91.82 +/- 14.27
ncm-et-12 2018-03-06 04:04 01:47:00 2004856 715 226 18 471 +104.08 +/- 14.08
ncm-et-13 2018-03-06 04:04 01:47:05 2025736 740 204 45 491 +75.83 +/- 14.13
ncm-et-14 2018-03-06 04:04 01:47:02 2019133 714 225 30 459 +97.36 +/- 14.63
ncm-et-15 2018-03-06 04:04 01:47:14 2017665 715 214 37 464 +87.83 +/- 14.59
ncm-et-16 2018-03-06 04:04 01:47:13 2020755 713 222 36 455 +92.78 +/- 14.82
  10000 3005 460 6535 +90.41 +/- 3.86

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
5490 ncm-et-11 2018-03-06 04:04 01:14:19 2016772 500 156 18 326 +98.44 +/- 17.18 Show
5491 ncm-et-14 2018-03-06 04:04 01:13:54 2016124 500 151 16 333 +96.19 +/- 16.78 Show
5492 ncm-et-16 2018-03-06 04:04 01:13:39 2020673 500 163 25 312 +98.44 +/- 18.04 Show
5493 ncm-et-15 2018-03-06 04:04 01:14:26 2016122 500 155 26 319 +91.71 +/- 17.73 Show
5494 ncm-et-7 2018-03-06 04:04 01:15:54 1954789 500 139 20 341 +84.31 +/- 16.49 Show
5495 ncm-et-3 2018-03-06 04:04 01:14:33 2025572 500 158 22 320 +96.94 +/- 17.58 Show
5496 ncm-et-8 2018-03-06 04:04 01:14:41 2023282 500 141 21 338 +85.04 +/- 16.67 Show
5497 ncm-et-12 2018-03-06 04:04 01:13:54 1991477 500 159 13 328 +104.49 +/- 16.93 Show
5498 ncm-et-13 2018-03-06 04:04 01:10:58 2025408 500 135 27 338 +76.25 +/- 16.81 Show
5499 ncm-et-5 2018-03-06 04:04 01:14:13 2001457 500 149 27 324 +86.52 +/- 17.50 Show
5500 ncm-et-4 2018-03-06 04:04 01:14:07 2004955 500 148 22 330 +89.48 +/- 17.09 Show
5501 ncm-et-9 2018-03-06 04:04 01:15:00 2025736 500 164 23 313 +100.71 +/- 17.95 Show
5502 ncm-et-6 2018-03-06 04:04 01:12:09 2026063 500 139 18 343 +85.78 +/- 16.34 Show
5503 ncm-et-10 2018-03-06 04:04 01:12:46 2018720 500 149 25 326 +88.00 +/- 17.36 Show
5504 ncm-et-13 2018-03-06 05:16 00:34:44 2026063 240 69 18 153 +74.97 +/- 25.95 Show
5505 ncm-et-6 2018-03-06 05:18 00:33:06 2026554 223 57 11 155 +72.71 +/- 24.41 Show
5506 ncm-et-10 2018-03-06 05:19 00:32:24 2018070 217 74 16 127 +95.17 +/- 29.21 Show
5507 ncm-et-16 2018-03-06 05:19 00:32:11 2020837 213 59 11 143 +79.66 +/- 25.93 Show
5508 ncm-et-14 2018-03-06 05:19 00:31:44 2022141 214 74 14 126 +100.09 +/- 29.18 Show
5509 ncm-et-12 2018-03-06 05:19 00:31:42 2018234 215 67 5 143 +103.12 +/- 25.43 Show
5510 ncm-et-5 2018-03-06 05:19 00:31:24 2020033 220 61 13 146 +77.04 +/- 25.92 Show
5511 ncm-et-11 2018-03-06 05:19 00:31:34 2018883 224 62 13 149 +77.25 +/- 25.61 Show
5512 ncm-et-4 2018-03-06 05:19 00:31:33 1995383 210 71 10 129 +103.91 +/- 28.21 Show
5513 ncm-et-15 2018-03-06 05:20 00:31:25 2019208 215 59 11 145 +78.90 +/- 25.68 Show
5514 ncm-et-3 2018-03-06 05:20 00:31:18 2026063 204 55 8 141 +81.51 +/- 25.48 Show
5515 ncm-et-8 2018-03-06 05:20 00:31:03 1930790 201 66 9 126 +101.30 +/- 28.30 Show
5516 ncm-et-9 2018-03-06 05:21 00:30:21 2023282 205 60 7 138 +91.91 +/- 26.01 Show
5517 ncm-et-7 2018-03-06 05:21 00:29:50 2024754 199 65 11 123 +96.70 +/- 28.97 Show

Commit

Commit ID 0553b46829156bb0c9efb0c9bdaaedc2045e997c
Author VoyagerOne
Date 2017-02-05 23:40:30 UTC
Commit Type Simplification
Simplify Queen Mobility

STC:
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 85997 W: 15550 L: 15540 D: 54907

LTC:
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 25333 W: 3370 L: 3256 D: 18707

Bench: 6459194

Closes #991

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 7965 2450 258 5257 +98.15 +/- 4.24
ncm-et-4 2035 627 60 1348 +99.43 +/- 8.33
  10000 3077 318 6605 +98.41 +/- 3.78