Dev Builds » 20160315-0354

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-26 14:30 01:44:36 2025409 721 84 86 551 -0.96 +/- 12.30
ncm-et-4 2018-03-26 14:30 01:44:28 2024837 720 97 68 555 +14.00 +/- 12.11
ncm-et-5 2018-03-26 14:30 01:44:19 2024267 713 97 68 548 +14.14 +/- 12.23
ncm-et-6 2018-03-26 14:30 01:44:19 2025001 713 89 80 544 +4.39 +/- 12.40
ncm-et-7 2018-03-26 14:30 01:44:18 1996128 715 82 82 551 -0.00 +/- 12.18
ncm-et-8 2018-03-26 14:30 01:44:28 1961577 711 94 62 555 +15.65 +/- 11.92
ncm-et-9 2018-03-26 14:30 01:44:19 2024837 719 100 78 541 +10.63 +/- 12.61
ncm-et-10 2018-03-26 14:30 01:44:32 2018396 729 96 79 554 +8.10 +/- 12.34
ncm-et-11 2018-03-26 14:30 01:44:19 2016286 730 93 70 567 +10.95 +/- 11.88
ncm-et-12 2018-03-26 14:31 01:43:51 1984438 713 96 68 549 +13.65 +/- 12.20
ncm-et-13 2018-03-26 14:30 01:44:25 2024672 728 95 67 566 +13.37 +/- 11.87
ncm-et-14 2018-03-26 14:30 01:44:40 2021246 716 104 83 529 +10.19 +/- 12.98
ncm-et-15 2018-03-26 14:30 01:44:27 2018234 714 100 75 539 +12.17 +/- 12.59
ncm-et-16 2018-03-26 14:30 01:44:12 1893017 658 97 72 489 +13.21 +/- 13.42
  10000 1324 1038 7638 +9.94 +/- 3.30

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
12382 ncm-et-14 2018-03-26 14:30 01:12:13 2022306 500 67 59 374 +5.56 +/- 15.27 Show
12383 ncm-et-3 2018-03-26 14:30 01:11:44 2025410 500 53 59 388 -4.17 +/- 14.40 Show
12384 ncm-et-9 2018-03-26 14:30 01:10:25 2024918 500 72 50 378 +15.30 +/- 15.00 Show
12385 ncm-et-8 2018-03-26 14:30 01:11:14 1978526 500 67 41 392 +18.08 +/- 14.09 Show
12386 ncm-et-13 2018-03-26 14:30 01:09:14 2024100 500 72 34 394 +26.46 +/- 13.90 Show
12387 ncm-et-5 2018-03-26 14:30 01:11:55 2025413 500 72 47 381 +17.39 +/- 14.80 Show
12388 ncm-et-15 2018-03-26 14:30 01:11:52 2018395 500 67 51 382 +11.12 +/- 14.77 Show
12389 ncm-et-4 2018-03-26 14:30 01:10:45 2025408 500 66 42 392 +16.69 +/- 14.10 Show
12390 ncm-et-10 2018-03-26 14:30 01:10:35 2019045 500 67 53 380 +9.73 +/- 14.89 Show
12391 ncm-et-11 2018-03-26 14:30 01:09:26 2016447 500 61 49 390 +8.34 +/- 14.26 Show
12392 ncm-et-6 2018-03-26 14:30 01:11:39 2023447 500 60 50 390 +6.95 +/- 14.26 Show
12393 ncm-et-7 2018-03-26 14:30 01:11:33 1967010 500 57 56 387 +0.69 +/- 14.47 Show
12394 ncm-et-16 2018-03-26 14:30 01:18:50 1825903 500 73 50 377 +15.99 +/- 15.06 Show
12395 ncm-et-12 2018-03-26 14:31 01:11:32 1976735 500 62 48 390 +9.73 +/- 14.26 Show
12396 ncm-et-13 2018-03-26 15:41 00:33:23 2025244 228 23 33 172 -15.25 +/- 22.30 Show
12397 ncm-et-11 2018-03-26 15:42 00:33:07 2016125 230 32 21 177 +16.63 +/- 21.49 Show
12398 ncm-et-9 2018-03-26 15:42 00:32:05 2024755 219 28 28 163 -0.00 +/- 23.27 Show
12399 ncm-et-10 2018-03-26 15:43 00:32:09 2017746 229 29 26 174 +4.55 +/- 22.05 Show
12400 ncm-et-4 2018-03-26 15:43 00:31:56 2024265 220 31 26 163 +7.90 +/- 23.36 Show
12401 ncm-et-8 2018-03-26 15:43 00:31:26 1944628 211 27 21 163 +9.88 +/- 22.34 Show
12402 ncm-et-3 2018-03-26 15:44 00:31:05 2025408 221 31 27 163 +6.29 +/- 23.46 Show
12403 ncm-et-7 2018-03-26 15:44 00:30:57 2025245 215 25 26 164 -1.62 +/- 22.62 Show
12404 ncm-et-6 2018-03-26 15:44 00:30:53 2026555 213 29 30 154 -1.63 +/- 24.56 Show
12405 ncm-et-15 2018-03-26 15:44 00:30:48 2018072 214 33 24 157 +14.62 +/- 23.99 Show
12406 ncm-et-5 2018-03-26 15:44 00:30:37 2023120 213 25 21 167 +6.53 +/- 21.67 Show
12407 ncm-et-12 2018-03-26 15:44 00:30:31 1992140 213 34 20 159 +22.87 +/- 23.40 Show
12408 ncm-et-14 2018-03-26 15:44 00:30:41 2020186 216 37 24 155 +20.94 +/- 24.56 Show
12409 ncm-et-16 2018-03-26 15:51 00:23:35 1960131 158 24 22 112 +4.40 +/- 29.25 Show

Commit

Commit ID 60590577f2117dbc9305184660a3fe8fe6f89f85
Author VoyagerOne
Date 2016-03-15 03:54:49 UTC
Commit Type Non Functional
A small simplification in movepick.h

No functional change

Resolves #597

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-1 2370 211 204 1955 +1.03 +/- 5.85
ncm-et-3 3784 373 287 3124 +7.90 +/- 4.61
ncm-et-4 3846 341 288 3217 +4.79 +/- 4.43
  10000 925 779 8296 +5.07 +/- 2.81