Dev Builds » 20160903-0621

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-08 20:58 01:45:48 2025818 727 173 46 508 +61.32 +/- 13.54
ncm-et-4 2018-03-08 20:58 01:45:51 2017290 720 165 41 514 +60.44 +/- 13.23
ncm-et-5 2018-03-08 20:58 01:45:51 2007759 709 193 38 478 +77.20 +/- 14.15
ncm-et-6 2018-03-08 20:58 01:45:49 2026636 725 192 47 486 +70.44 +/- 14.17
ncm-et-7 2018-03-08 20:58 01:45:52 1994378 712 161 43 508 +58.12 +/- 13.34
ncm-et-8 2018-03-08 20:58 01:45:42 2020838 703 165 58 480 +53.30 +/- 14.25
ncm-et-9 2018-03-08 20:58 01:45:55 2025163 710 165 44 501 +59.79 +/- 13.55
ncm-et-10 2018-03-08 20:58 01:45:42 2018884 711 164 40 507 +61.22 +/- 13.33
ncm-et-11 2018-03-08 20:58 01:45:58 2019453 703 173 43 487 +65.00 +/- 13.88
ncm-et-12 2018-03-08 20:58 01:45:27 1992204 708 181 41 486 +69.62 +/- 13.94
ncm-et-13 2018-03-08 20:58 01:45:48 2023774 716 170 40 506 +63.79 +/- 13.42
ncm-et-14 2018-03-08 20:58 01:45:54 2021409 707 162 46 499 +57.52 +/- 13.59
ncm-et-15 2018-03-08 20:58 01:45:48 2018234 726 182 45 499 +66.36 +/- 13.78
ncm-et-16 2018-03-08 20:58 01:46:01 2006020 724 165 50 509 +55.66 +/- 13.52
  10001 2411 622 6968 +62.83 +/- 3.66

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
6498 ncm-et-14 2018-03-08 20:58 01:12:00 2020185 500 113 31 356 +57.50 +/- 15.98 Show
6499 ncm-et-6 2018-03-08 20:58 01:11:30 2027046 500 124 32 344 +64.66 +/- 16.61 Show
6500 ncm-et-16 2018-03-08 20:58 01:11:28 1988267 500 120 32 348 +61.79 +/- 16.41 Show
6501 ncm-et-11 2018-03-08 20:58 01:14:02 2019046 500 124 31 345 +65.38 +/- 16.54 Show
6502 ncm-et-7 2018-03-08 20:58 01:13:02 1991867 500 124 31 345 +65.38 +/- 16.54 Show
6503 ncm-et-3 2018-03-08 20:58 01:11:09 2026554 500 122 32 346 +63.23 +/- 16.51 Show
6504 ncm-et-10 2018-03-08 20:58 01:13:30 2018396 500 109 29 362 +56.07 +/- 15.63 Show
6505 ncm-et-4 2018-03-08 20:58 01:12:09 2021653 500 115 28 357 +61.08 +/- 15.87 Show
6506 ncm-et-9 2018-03-08 20:58 01:14:21 2025245 500 119 33 348 +60.36 +/- 16.43 Show
6507 ncm-et-5 2018-03-08 20:58 01:12:40 2009552 500 141 29 330 +79.17 +/- 17.25 Show
6508 ncm-et-13 2018-03-08 20:58 01:12:58 2025408 500 120 34 346 +60.36 +/- 16.55 Show
6509 ncm-et-15 2018-03-08 20:58 01:10:47 2019533 500 128 28 344 +70.44 +/- 16.53 Show
6510 ncm-et-8 2018-03-08 20:58 01:14:01 2019859 500 111 39 350 +50.38 +/- 16.42 Show
6511 ncm-et-12 2018-03-08 20:58 01:13:43 1966984 500 126 26 348 +70.44 +/- 16.29 Show
6512 ncm-et-15 2018-03-08 22:10 00:33:35 2016934 226 54 17 155 +57.40 +/- 24.96 Show
6513 ncm-et-3 2018-03-08 22:10 00:33:14 2025081 227 51 14 162 +57.14 +/- 23.67 Show
6514 ncm-et-16 2018-03-08 22:11 00:33:07 2023773 224 45 18 161 +42.08 +/- 23.85 Show
6515 ncm-et-6 2018-03-08 22:11 00:32:53 2026226 225 68 15 142 +83.41 +/- 26.93 Show
6516 ncm-et-14 2018-03-08 22:11 00:32:29 2022632 207 49 15 143 +57.59 +/- 25.85 Show
6517 ncm-et-4 2018-03-08 22:11 00:32:16 2012926 220 50 13 157 +58.99 +/- 24.01 Show
6518 ncm-et-5 2018-03-08 22:12 00:31:45 2005966 209 52 9 148 +72.52 +/- 24.58 Show
6519 ncm-et-7 2018-03-08 22:12 00:31:23 1996888 212 37 12 163 +41.16 +/- 22.10 Show
6520 ncm-et-13 2018-03-08 22:12 00:31:25 2022140 216 50 6 160 +71.78 +/- 22.56 Show
6521 ncm-et-10 2018-03-08 22:13 00:30:46 2019371 211 55 11 145 +73.53 +/- 25.45 Show
6522 ncm-et-12 2018-03-08 22:13 00:30:19 2017423 208 55 15 138 +67.66 +/- 26.86 Show
6523 ncm-et-11 2018-03-08 22:13 00:30:29 2019860 203 49 12 142 +64.04 +/- 25.57 Show
6524 ncm-et-8 2018-03-08 22:13 00:30:15 2021817 203 54 19 130 +60.51 +/- 28.32 Show
6525 ncm-et-9 2018-03-08 22:14 00:30:08 2025081 210 46 11 153 +58.45 +/- 23.86 Show

Commit

Commit ID c5828c4eba9e4e3f448e8370f24804da719a5120
Author Marco Costalba
Date 2016-09-03 06:21:05 UTC
Commit Type
Fix syzygy with partial TB

In case we have installed a not complete set of 6-men tables and
there is 6 piece position on board, but no corresponding
tablebase engine is not using any syzygy at all.

Reported by Jouni Uski, fix by Peter Österlund,
confirmed as a bug by Ronald de Man.

bench: 7591630

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5004 1052 228 3724 +57.74 +/- 4.73
ncm-et-4 4996 995 259 3742 +51.56 +/- 4.71
  10000 2047 487 7466 +54.65 +/- 3.34