Dev Builds » 20160903-0621

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-08 20:58 01:45:48 2025818 727 173 46 508 +61.32 +/- 13.54
ncm-et-4 2018-03-08 20:58 01:45:51 2017290 720 165 41 514 +60.44 +/- 13.23
ncm-et-5 2018-03-08 20:58 01:45:51 2007759 709 193 38 478 +77.20 +/- 14.15
ncm-et-6 2018-03-08 20:58 01:45:49 2026636 725 192 47 486 +70.44 +/- 14.17
ncm-et-7 2018-03-08 20:58 01:45:52 1994378 712 161 43 508 +58.12 +/- 13.34
ncm-et-8 2018-03-08 20:58 01:45:42 2020838 703 165 58 480 +53.30 +/- 14.25
ncm-et-9 2018-03-08 20:58 01:45:55 2025163 710 165 44 501 +59.79 +/- 13.55
ncm-et-10 2018-03-08 20:58 01:45:42 2018884 711 164 40 507 +61.22 +/- 13.33
ncm-et-11 2018-03-08 20:58 01:45:58 2019453 703 173 43 487 +65.00 +/- 13.88
ncm-et-12 2018-03-08 20:58 01:45:27 1992204 708 181 41 486 +69.62 +/- 13.94
ncm-et-13 2018-03-08 20:58 01:45:48 2023774 716 170 40 506 +63.79 +/- 13.42
ncm-et-14 2018-03-08 20:58 01:45:54 2021409 707 162 46 499 +57.52 +/- 13.59
ncm-et-15 2018-03-08 20:58 01:45:48 2018234 726 182 45 499 +66.36 +/- 13.78
ncm-et-16 2018-03-08 20:58 01:46:01 2006020 724 165 50 509 +55.66 +/- 13.52
  10001 2411 622 6968 +62.83 +/- 3.66

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
6498 ncm-et-14 2018-03-08 20:58 01:12:00 2020185 500 113 31 356 +57.50 +/- 15.98 Show
6499 ncm-et-6 2018-03-08 20:58 01:11:30 2027046 500 124 32 344 +64.66 +/- 16.61 Show
6500 ncm-et-16 2018-03-08 20:58 01:11:28 1988267 500 120 32 348 +61.79 +/- 16.41 Show
6501 ncm-et-11 2018-03-08 20:58 01:14:02 2019046 500 124 31 345 +65.38 +/- 16.54 Show
6502 ncm-et-7 2018-03-08 20:58 01:13:02 1991867 500 124 31 345 +65.38 +/- 16.54 Show
6503 ncm-et-3 2018-03-08 20:58 01:11:09 2026554 500 122 32 346 +63.23 +/- 16.51 Show
6504 ncm-et-10 2018-03-08 20:58 01:13:30 2018396 500 109 29 362 +56.07 +/- 15.63 Show
6505 ncm-et-4 2018-03-08 20:58 01:12:09 2021653 500 115 28 357 +61.08 +/- 15.87 Show
6506 ncm-et-9 2018-03-08 20:58 01:14:21 2025245 500 119 33 348 +60.36 +/- 16.43 Show
6507 ncm-et-5 2018-03-08 20:58 01:12:40 2009552 500 141 29 330 +79.17 +/- 17.25 Show
6508 ncm-et-13 2018-03-08 20:58 01:12:58 2025408 500 120 34 346 +60.36 +/- 16.55 Show
6509 ncm-et-15 2018-03-08 20:58 01:10:47 2019533 500 128 28 344 +70.44 +/- 16.53 Show
6510 ncm-et-8 2018-03-08 20:58 01:14:01 2019859 500 111 39 350 +50.38 +/- 16.42 Show
6511 ncm-et-12 2018-03-08 20:58 01:13:43 1966984 500 126 26 348 +70.44 +/- 16.29 Show
6512 ncm-et-15 2018-03-08 22:10 00:33:35 2016934 226 54 17 155 +57.40 +/- 24.96 Show
6513 ncm-et-3 2018-03-08 22:10 00:33:14 2025081 227 51 14 162 +57.14 +/- 23.67 Show
6514 ncm-et-16 2018-03-08 22:11 00:33:07 2023773 224 45 18 161 +42.08 +/- 23.85 Show
6515 ncm-et-6 2018-03-08 22:11 00:32:53 2026226 225 68 15 142 +83.41 +/- 26.93 Show
6516 ncm-et-14 2018-03-08 22:11 00:32:29 2022632 207 49 15 143 +57.59 +/- 25.85 Show
6517 ncm-et-4 2018-03-08 22:11 00:32:16 2012926 220 50 13 157 +58.99 +/- 24.01 Show
6518 ncm-et-5 2018-03-08 22:12 00:31:45 2005966 209 52 9 148 +72.52 +/- 24.58 Show
6519 ncm-et-7 2018-03-08 22:12 00:31:23 1996888 212 37 12 163 +41.16 +/- 22.10 Show
6520 ncm-et-13 2018-03-08 22:12 00:31:25 2022140 216 50 6 160 +71.78 +/- 22.56 Show
6521 ncm-et-10 2018-03-08 22:13 00:30:46 2019371 211 55 11 145 +73.53 +/- 25.45 Show
6522 ncm-et-12 2018-03-08 22:13 00:30:19 2017423 208 55 15 138 +67.66 +/- 26.86 Show
6523 ncm-et-11 2018-03-08 22:13 00:30:29 2019860 203 49 12 142 +64.04 +/- 25.57 Show
6524 ncm-et-8 2018-03-08 22:13 00:30:15 2021817 203 54 19 130 +60.51 +/- 28.32 Show
6525 ncm-et-9 2018-03-08 22:14 00:30:08 2025081 210 46 11 153 +58.45 +/- 23.86 Show

Commit

Commit ID c5828c4eba9e4e3f448e8370f24804da719a5120
Author Marco Costalba
Date 2016-09-03 06:21:05 UTC
Commit Type
Fix syzygy with partial TB

In case we have installed a not complete set of 6-men tables and
there is 6 piece position on board, but no corresponding
tablebase engine is not using any syzygy at all.

Reported by Jouni Uski, fix by Peter Österlund,
confirmed as a bug by Ronald de Man.

bench: 7591630

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5004 1052 228 3724 +57.74 +/- 4.73
ncm-et-4 4996 995 259 3742 +51.56 +/- 4.71
  10000 2047 487 7466 +54.65 +/- 3.34