Dev Builds » 20160903-0621

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-08 20:58 7765:55:44 1988526 2402 608 139 1655 +68.72 +/- 7.54
ncm-et-4 2018-03-08 20:58 7765:55:36 1979191 2372 589 143 1640 +66.11 +/- 7.57
ncm-et-5 2018-03-08 20:58 01:45:51 2007759 709 193 38 478 +77.20 +/- 14.15
ncm-et-6 2018-03-08 20:58 01:45:49 2026636 725 192 47 486 +70.44 +/- 14.17
ncm-et-7 2018-03-08 20:58 01:45:52 1994378 712 161 43 508 +58.12 +/- 13.34
ncm-et-8 2018-03-08 20:58 01:45:42 2020838 703 165 58 480 +53.30 +/- 14.25
ncm-et-9 2018-03-08 20:58 7765:55:39 1993399 2386 568 156 1662 +60.60 +/- 7.51
ncm-et-10 2018-03-08 20:58 7765:55:33 1984724 2378 564 137 1677 +63.07 +/- 7.38
ncm-et-11 2018-03-08 20:58 01:45:58 2019453 703 173 43 487 +65.00 +/- 13.88
ncm-et-12 2018-03-08 20:58 01:45:27 1992204 708 181 41 486 +69.62 +/- 13.94
ncm-et-13 2018-03-08 20:58 7765:55:33 1992117 2372 594 144 1634 +66.72 +/- 7.60
ncm-et-14 2018-03-08 20:58 01:45:54 2021409 707 162 46 499 +57.52 +/- 13.59
ncm-et-15 2018-03-08 20:58 7765:55:20 1987829 2399 604 153 1642 +66.10 +/- 7.62
ncm-et-16 2018-03-08 20:58 01:46:01 2006020 724 165 50 509 +55.66 +/- 13.52
  20000 4919 1238 13843 +64.68 +/- 2.61

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
6498 ncm-et-14 2018-03-08 20:58 01:12:00 2020185 500 113 31 356 +57.50 +/- 15.98 Show
6499 ncm-et-6 2018-03-08 20:58 01:11:30 2027046 500 124 32 344 +64.66 +/- 16.61 Show
6500 ncm-et-16 2018-03-08 20:58 01:11:28 1988267 500 120 32 348 +61.79 +/- 16.41 Show
6501 ncm-et-11 2018-03-08 20:58 01:14:02 2019046 500 124 31 345 +65.38 +/- 16.54 Show
6502 ncm-et-7 2018-03-08 20:58 01:13:02 1991867 500 124 31 345 +65.38 +/- 16.54 Show
6503 ncm-et-3 2018-03-08 20:58 01:11:09 2026554 500 122 32 346 +63.23 +/- 16.51 Show
6504 ncm-et-10 2018-03-08 20:58 01:13:30 2018396 500 109 29 362 +56.07 +/- 15.63 Show
6505 ncm-et-4 2018-03-08 20:58 01:12:09 2021653 500 115 28 357 +61.08 +/- 15.87 Show
6506 ncm-et-9 2018-03-08 20:58 01:14:21 2025245 500 119 33 348 +60.36 +/- 16.43 Show
6507 ncm-et-5 2018-03-08 20:58 01:12:40 2009552 500 141 29 330 +79.17 +/- 17.25 Show
6508 ncm-et-13 2018-03-08 20:58 01:12:58 2025408 500 120 34 346 +60.36 +/- 16.55 Show
6509 ncm-et-15 2018-03-08 20:58 01:10:47 2019533 500 128 28 344 +70.44 +/- 16.53 Show
6510 ncm-et-8 2018-03-08 20:58 01:14:01 2019859 500 111 39 350 +50.38 +/- 16.42 Show
6511 ncm-et-12 2018-03-08 20:58 01:13:43 1966984 500 126 26 348 +70.44 +/- 16.29 Show
6512 ncm-et-15 2018-03-08 22:10 00:33:35 2016934 226 54 17 155 +57.40 +/- 24.96 Show
6513 ncm-et-3 2018-03-08 22:10 00:33:14 2025081 227 51 14 162 +57.14 +/- 23.67 Show
6514 ncm-et-16 2018-03-08 22:11 00:33:07 2023773 224 45 18 161 +42.08 +/- 23.85 Show
6515 ncm-et-6 2018-03-08 22:11 00:32:53 2026226 225 68 15 142 +83.41 +/- 26.93 Show
6516 ncm-et-14 2018-03-08 22:11 00:32:29 2022632 207 49 15 143 +57.59 +/- 25.85 Show
6517 ncm-et-4 2018-03-08 22:11 00:32:16 2012926 220 50 13 157 +58.99 +/- 24.01 Show
6518 ncm-et-5 2018-03-08 22:12 00:31:45 2005966 209 52 9 148 +72.52 +/- 24.58 Show
6519 ncm-et-7 2018-03-08 22:12 00:31:23 1996888 212 37 12 163 +41.16 +/- 22.10 Show
6520 ncm-et-13 2018-03-08 22:12 00:31:25 2022140 216 50 6 160 +71.78 +/- 22.56 Show
6521 ncm-et-10 2018-03-08 22:13 00:30:46 2019371 211 55 11 145 +73.53 +/- 25.45 Show
6522 ncm-et-12 2018-03-08 22:13 00:30:19 2017423 208 55 15 138 +67.66 +/- 26.86 Show
6523 ncm-et-11 2018-03-08 22:13 00:30:29 2019860 203 49 12 142 +64.04 +/- 25.57 Show
6524 ncm-et-8 2018-03-08 22:13 00:30:15 2021817 203 54 19 130 +60.51 +/- 28.32 Show
6525 ncm-et-9 2018-03-08 22:14 00:30:08 2025081 210 46 11 153 +58.45 +/- 23.86 Show
128918 ncm-et-15 2019-01-26 06:44 01:13:24 1969880 500 119 27 354 +64.66 +/- 16.00 Show
128919 ncm-et-4 2019-01-26 06:44 01:14:12 1964919 500 127 28 345 +69.71 +/- 16.48 Show
128920 ncm-et-10 2019-01-26 06:44 01:15:17 1958777 500 117 25 358 +64.66 +/- 15.75 Show
128921 ncm-et-9 2019-01-26 06:44 01:14:11 1974987 500 119 33 348 +60.36 +/- 16.43 Show
128922 ncm-et-13 2019-01-26 06:44 01:13:29 1974697 500 122 31 347 +63.95 +/- 16.44 Show
128923 ncm-et-3 2019-01-26 06:44 01:13:18 1970959 500 134 27 339 +75.52 +/- 16.76 Show
128924 ncm-et-15 2019-01-26 07:59 01:14:20 1975759 500 122 31 347 +63.95 +/- 16.44 Show
128925 ncm-et-3 2019-01-26 07:59 01:14:16 1961228 500 136 26 338 +77.71 +/- 16.79 Show
128926 ncm-et-13 2019-01-26 07:59 01:14:37 1977010 500 143 34 323 +76.98 +/- 17.69 Show
128927 ncm-et-4 2019-01-26 07:59 01:13:55 1975513 500 118 36 346 +57.50 +/- 16.58 Show
128928 ncm-et-9 2019-01-26 07:59 01:14:19 1990070 500 119 34 347 +59.64 +/- 16.50 Show
128929 ncm-et-10 2019-01-26 08:01 01:11:52 1983327 500 112 35 353 +53.93 +/- 16.21 Show
128930 ncm-et-10 2019-01-26 09:13 01:14:16 1966779 500 128 30 342 +68.99 +/- 16.68 Show
128931 ncm-et-3 2019-01-26 09:14 01:12:25 1964764 500 116 31 353 +59.64 +/- 16.14 Show
128932 ncm-et-15 2019-01-26 09:14 01:12:57 1971579 500 134 36 330 +68.99 +/- 17.38 Show
128933 ncm-et-4 2019-01-26 09:14 01:13:40 1961689 500 136 25 339 +78.44 +/- 16.72 Show
128934 ncm-et-13 2019-01-26 09:14 01:14:48 1980936 500 119 30 351 +62.51 +/- 16.22 Show
128935 ncm-et-9 2019-01-26 09:15 01:11:57 1972979 500 125 33 342 +64.66 +/- 16.73 Show
128936 ncm-et-3 2019-01-26 10:27 00:26:03 1982567 175 49 9 117 +80.84 +/- 28.73 Show
128937 ncm-et-9 2019-01-26 10:28 00:25:39 1972030 176 40 12 124 +55.75 +/- 27.39 Show
128938 ncm-et-15 2019-01-26 10:28 00:25:14 1973287 173 47 14 112 +67.10 +/- 30.25 Show
128939 ncm-et-10 2019-01-26 10:29 00:24:31 1961695 167 43 7 117 +76.09 +/- 27.82 Show
128940 ncm-et-4 2019-01-26 10:29 00:24:12 1938445 152 43 13 96 +69.48 +/- 33.05 Show
128941 ncm-et-13 2019-01-26 10:30 00:23:05 1972513 156 40 9 107 +69.97 +/- 29.78 Show

Commit

Commit ID c5828c4eba9e4e3f448e8370f24804da719a5120
Author Marco Costalba
Date 2016-09-03 06:21:05 UTC
Commit Type
Fix syzygy with partial TB

In case we have installed a not complete set of 6-men tables and
there is 6 piece position on board, but no corresponding
tablebase engine is not using any syzygy at all.

Reported by Jouni Uski, fix by Peter Österlund,
confirmed as a bug by Ronald de Man.

bench: 7591630

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5004 1052 228 3724 +57.74 +/- 4.73
ncm-et-4 4996 995 259 3742 +51.56 +/- 4.71
  10000 2047 487 7466 +54.65 +/- 3.34