Dev Builds » 20160409-0842

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-26 07:25 01:44:33 2026637 711 90 81 540 +4.40 +/- 12.51
ncm-et-4 2018-03-26 07:25 01:44:38 1986224 689 97 73 519 +12.11 +/- 12.86
ncm-et-5 2018-03-26 07:25 01:44:34 2021106 712 97 70 545 +13.18 +/- 12.33
ncm-et-6 2018-03-26 07:26 01:44:31 2024590 707 91 77 539 +6.88 +/- 12.47
ncm-et-7 2018-03-26 07:26 01:44:30 2011696 724 95 68 561 +12.96 +/- 11.98
ncm-et-8 2018-03-26 07:26 01:44:25 1984210 709 114 73 522 +20.11 +/- 13.08
ncm-et-9 2018-03-26 07:25 01:44:41 2005365 721 100 74 547 +12.53 +/- 12.43
ncm-et-10 2018-03-26 07:25 01:44:32 2020348 725 104 79 542 +11.99 +/- 12.68
ncm-et-11 2018-03-26 07:25 01:44:23 2013330 711 85 65 561 +9.78 +/- 11.70
ncm-et-12 2018-03-26 07:26 01:44:28 2020105 706 94 76 536 +8.86 +/- 12.55
ncm-et-13 2018-03-26 07:26 01:44:16 2022630 733 109 65 559 +20.88 +/- 12.19
ncm-et-14 2018-03-26 07:26 01:44:34 2020836 713 105 64 544 +20.00 +/- 12.36
ncm-et-15 2018-03-26 07:25 01:44:27 2018802 720 117 75 528 +20.29 +/- 13.05
ncm-et-16 2018-03-26 07:25 01:44:31 1994740 719 107 66 546 +19.83 +/- 12.40
  10000 1405 1006 7589 +13.87 +/- 3.33

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
12270 ncm-et-3 2018-03-26 07:25 01:11:52 2027210 500 61 53 386 +5.56 +/- 14.52 Show
12271 ncm-et-15 2018-03-26 07:25 01:10:09 2018720 500 80 54 366 +18.08 +/- 15.72 Show
12272 ncm-et-5 2018-03-26 07:25 01:12:53 2017784 500 77 44 379 +22.96 +/- 14.90 Show
12273 ncm-et-9 2018-03-26 07:25 01:10:45 1985157 500 71 56 373 +10.43 +/- 15.32 Show
12274 ncm-et-10 2018-03-26 07:25 01:10:57 2020999 500 67 54 379 +9.04 +/- 14.96 Show
12275 ncm-et-4 2018-03-26 07:25 01:14:54 1947198 500 74 52 374 +15.30 +/- 15.25 Show
12276 ncm-et-11 2018-03-26 07:25 01:12:10 2007451 500 61 44 395 +11.82 +/- 13.92 Show
12277 ncm-et-16 2018-03-26 07:25 01:12:38 1968969 500 71 45 384 +18.08 +/- 14.61 Show
12278 ncm-et-14 2018-03-26 07:26 01:11:46 2020999 500 72 47 381 +17.39 +/- 14.80 Show
12279 ncm-et-12 2018-03-26 07:26 01:12:40 2019048 500 64 58 378 +4.17 +/- 15.03 Show
12280 ncm-et-7 2018-03-26 07:26 01:10:35 2025081 500 71 45 384 +18.08 +/- 14.61 Show
12281 ncm-et-6 2018-03-26 07:26 01:12:32 2024590 500 65 52 383 +9.04 +/- 14.71 Show
12282 ncm-et-8 2018-03-26 07:26 01:12:03 2009018 500 86 53 361 +22.96 +/- 15.99 Show
12283 ncm-et-13 2018-03-26 07:26 01:09:13 2022956 500 72 41 387 +21.57 +/- 14.40 Show
12284 ncm-et-13 2018-03-26 08:37 00:33:16 2022303 233 37 24 172 +19.40 +/- 22.76 Show
12285 ncm-et-15 2018-03-26 08:37 00:32:31 2018883 220 37 21 162 +25.31 +/- 23.46 Show
12286 ncm-et-7 2018-03-26 08:38 00:32:06 1998310 224 24 23 177 +1.55 +/- 20.84 Show
12287 ncm-et-9 2018-03-26 08:38 00:32:08 2025572 221 29 18 174 +17.31 +/- 21.05 Show
12288 ncm-et-10 2018-03-26 08:38 00:31:48 2019697 225 37 25 163 +18.55 +/- 23.78 Show
12289 ncm-et-3 2018-03-26 08:39 00:30:54 2026064 211 29 28 154 +1.65 +/- 24.37 Show
12290 ncm-et-14 2018-03-26 08:39 00:31:01 2020673 213 33 17 163 +26.15 +/- 22.46 Show
12291 ncm-et-11 2018-03-26 08:39 00:30:26 2019209 211 24 21 166 +4.94 +/- 21.64 Show
12292 ncm-et-8 2018-03-26 08:39 00:30:35 1959402 209 28 20 161 +13.31 +/- 22.53 Show
12293 ncm-et-16 2018-03-26 08:40 00:30:06 2020510 219 36 21 162 +23.83 +/- 23.37 Show
12294 ncm-et-6 2018-03-26 08:40 00:30:11 2024590 207 26 25 156 +1.68 +/- 23.49 Show
12295 ncm-et-12 2018-03-26 08:40 00:30:00 2021162 206 30 18 158 +20.26 +/- 22.81 Show
12296 ncm-et-5 2018-03-26 08:40 00:29:53 2024427 212 20 26 166 -9.84 +/- 21.76 Show
12297 ncm-et-4 2018-03-26 08:42 00:27:57 2025249 189 23 21 145 +3.68 +/- 23.90 Show

Commit

Commit ID d30994ecd54bf96db88016fb6d92ff2c4614bc2e
Author Marco Costalba
Date 2016-04-09 08:42:04 UTC
Commit Type Non Functional
Hide global visibility when not needed

Also move PieceValue definition in psqt.cpp,
where it is initialized.

Fix a warning in popcount16() with Intel compiler

No functional change.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-1 2360 262 175 1923 +12.81 +/- 6.01
ncm-et-3 3807 423 273 3111 +13.70 +/- 4.70
ncm-et-4 3833 410 262 3161 +13.42 +/- 4.59
  10000 1095 710 8195 +13.38 +/- 2.88