Dev Builds » 20160625-0946

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-09 13:09 7970:31:12 1989279 2389 438 169 1782 +39.29 +/- 6.92
ncm-et-4 2018-03-09 13:09 7970:31:07 1972681 2364 416 175 1773 +35.54 +/- 6.92
ncm-et-5 2018-03-09 13:09 01:45:08 2023283 727 135 61 531 +35.49 +/- 12.98
ncm-et-6 2018-03-09 13:09 01:45:22 2027620 713 140 62 511 +38.16 +/- 13.43
ncm-et-7 2018-03-09 13:09 01:45:18 2024100 709 111 59 539 +25.53 +/- 12.44
ncm-et-8 2018-03-09 13:09 01:45:07 2010142 713 130 54 529 +37.18 +/- 12.80
ncm-et-9 2018-03-09 13:09 7970:31:01 1987917 2386 455 185 1746 +39.48 +/- 7.13
ncm-et-10 2018-03-09 13:09 7970:30:53 1988336 2404 453 199 1752 +36.85 +/- 7.15
ncm-et-11 2018-03-09 13:09 01:45:18 2015805 715 128 56 531 +35.11 +/- 12.78
ncm-et-12 2018-03-09 13:09 01:45:17 2007756 719 145 51 523 +45.68 +/- 13.05
ncm-et-13 2018-03-09 13:09 7970:31:18 1990252 2376 440 186 1750 +37.28 +/- 7.09
ncm-et-14 2018-03-09 13:09 01:45:15 2020266 713 139 43 531 +47.07 +/- 12.64
ncm-et-15 2018-03-09 13:09 7970:31:10 1992243 2362 456 195 1711 +38.55 +/- 7.27
ncm-et-16 2018-03-09 13:09 01:45:29 2021651 710 142 61 507 +39.81 +/- 13.51
  20000 3728 1556 14716 +37.88 +/- 2.44

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
6750 ncm-et-16 2018-03-09 13:09 01:12:29 2021977 500 90 45 365 +31.35 +/- 15.70 Show
6751 ncm-et-4 2018-03-09 13:09 01:13:29 2024591 500 85 31 384 +37.67 +/- 14.45 Show
6752 ncm-et-13 2018-03-09 13:09 01:14:09 2022793 500 88 37 375 +35.56 +/- 15.05 Show
6753 ncm-et-3 2018-03-09 13:09 01:12:20 2025739 500 81 37 382 +30.65 +/- 14.65 Show
6754 ncm-et-6 2018-03-09 13:09 01:12:22 2027538 500 91 47 362 +30.65 +/- 15.88 Show
6755 ncm-et-14 2018-03-09 13:09 01:12:49 2020510 500 99 31 370 +47.55 +/- 15.24 Show
6756 ncm-et-12 2018-03-09 13:09 01:13:02 1995653 500 110 43 347 +46.84 +/- 16.63 Show
6757 ncm-et-11 2018-03-09 13:09 01:11:24 2017420 500 88 35 377 +36.97 +/- 14.91 Show
6758 ncm-et-10 2018-03-09 13:09 01:10:43 2019045 500 96 33 371 +44.01 +/- 15.22 Show
6759 ncm-et-9 2018-03-09 13:09 01:12:02 2025899 500 96 34 370 +43.30 +/- 15.29 Show
6760 ncm-et-15 2018-03-09 13:09 01:13:47 2020021 500 92 41 367 +35.56 +/- 15.55 Show
6761 ncm-et-7 2018-03-09 13:09 01:13:55 2023773 500 77 40 383 +25.76 +/- 14.63 Show
6762 ncm-et-5 2018-03-09 13:09 01:11:55 2023773 500 99 38 363 +42.60 +/- 15.72 Show
6763 ncm-et-8 2018-03-09 13:09 01:13:04 1997979 500 94 40 366 +37.67 +/- 15.59 Show
6764 ncm-et-10 2018-03-09 14:21 00:33:07 2019859 232 41 22 169 +28.52 +/- 23.16 Show
6765 ncm-et-11 2018-03-09 14:22 00:32:27 2014190 215 40 21 154 +30.78 +/- 24.59 Show
6766 ncm-et-9 2018-03-09 14:22 00:31:37 2027210 218 33 16 169 +27.15 +/- 21.70 Show
6767 ncm-et-5 2018-03-09 14:22 00:31:46 2022793 227 36 23 168 +19.92 +/- 22.97 Show
6768 ncm-et-3 2018-03-09 14:23 00:31:39 2026882 221 42 12 167 +47.46 +/- 22.18 Show
6769 ncm-et-6 2018-03-09 14:23 00:31:33 2027702 213 49 15 149 +55.94 +/- 25.12 Show
6770 ncm-et-16 2018-03-09 14:23 00:31:33 2021325 210 52 16 142 +60.15 +/- 26.29 Show
6771 ncm-et-14 2018-03-09 14:23 00:31:00 2020021 213 40 12 161 +45.94 +/- 22.61 Show
6772 ncm-et-12 2018-03-09 14:23 00:30:48 2019859 219 35 8 176 +43.05 +/- 19.88 Show
6773 ncm-et-8 2018-03-09 14:24 00:30:36 2022305 213 36 14 163 +36.01 +/- 22.32 Show
6774 ncm-et-4 2018-03-09 14:24 00:30:22 1936491 204 26 19 159 +11.93 +/- 22.36 Show
6775 ncm-et-15 2018-03-09 14:24 00:29:47 2019859 207 37 18 152 +31.98 +/- 24.22 Show
6776 ncm-et-7 2018-03-09 14:24 00:29:55 2024427 209 34 19 156 +24.98 +/- 23.60 Show
6777 ncm-et-13 2018-03-09 14:24 00:29:43 2029015 199 38 18 143 +35.04 +/- 25.41 Show
130106 ncm-et-13 2019-02-04 11:30 01:13:07 1986136 500 99 39 362 +41.89 +/- 15.79 Show
130107 ncm-et-3 2019-02-04 11:30 01:14:23 1993050 500 93 36 371 +39.78 +/- 15.26 Show
130108 ncm-et-15 2019-02-04 11:30 01:15:24 1978880 500 96 43 361 +36.97 +/- 15.90 Show
130109 ncm-et-9 2019-02-04 11:30 01:14:19 1973434 500 99 38 363 +42.60 +/- 15.72 Show
130110 ncm-et-4 2019-02-04 11:30 01:14:38 1964768 500 95 24 381 +49.67 +/- 14.49 Show
130111 ncm-et-10 2019-02-04 11:31 01:14:16 1980768 500 96 43 361 +36.97 +/- 15.90 Show
130112 ncm-et-13 2019-02-04 12:45 01:14:07 1965535 500 88 41 371 +32.76 +/- 15.33 Show
130113 ncm-et-9 2019-02-04 12:46 01:12:42 1971880 500 104 41 355 +44.01 +/- 16.19 Show
130114 ncm-et-3 2019-02-04 12:46 01:12:25 1960156 500 88 44 368 +30.65 +/- 15.52 Show
130115 ncm-et-10 2019-02-04 12:46 01:13:28 1963539 500 85 42 373 +29.95 +/- 15.22 Show
130116 ncm-et-4 2019-02-04 12:46 01:12:28 1966698 500 82 42 376 +27.85 +/- 15.05 Show
130117 ncm-et-15 2019-02-04 12:47 01:13:52 1973895 500 94 43 363 +35.56 +/- 15.79 Show
130118 ncm-et-3 2019-02-04 13:59 01:14:22 1963074 500 97 32 371 +45.42 +/- 15.20 Show
130119 ncm-et-9 2019-02-04 14:00 01:13:34 1965701 500 91 44 365 +32.76 +/- 15.69 Show
130120 ncm-et-13 2019-02-04 14:00 01:13:09 1969093 500 101 36 363 +45.42 +/- 15.70 Show
130121 ncm-et-4 2019-02-04 14:00 01:14:32 1984129 500 101 47 352 +37.67 +/- 16.42 Show
130122 ncm-et-10 2019-02-04 14:00 01:12:33 1972098 500 99 42 359 +39.78 +/- 15.99 Show
130123 ncm-et-15 2019-02-04 14:02 01:14:27 1984731 500 109 37 354 +50.38 +/- 16.19 Show
130124 ncm-et-13 2019-02-04 15:14 00:26:05 1968942 177 26 15 136 +21.62 +/- 24.53 Show
130125 ncm-et-10 2019-02-04 15:14 00:25:45 1974707 172 36 17 119 +38.54 +/- 28.62 Show
130126 ncm-et-9 2019-02-04 15:14 00:25:40 1963379 168 32 12 124 +41.56 +/- 26.54 Show
130127 ncm-et-3 2019-02-04 15:15 00:25:12 1966770 168 37 8 123 +60.58 +/- 26.44 Show
130128 ncm-et-4 2019-02-04 15:15 00:24:28 1959407 160 27 12 121 +32.67 +/- 26.34 Show
130129 ncm-et-15 2019-02-04 15:17 00:22:45 1976073 155 28 13 114 +33.73 +/- 27.91 Show

Commit

Commit ID 190d2ea4bc433a0c047ede87f5d9cc241de2b1e2
Author Marco Costalba
Date 2016-06-25 09:46:17 UTC
Commit Type Simplification
Restore standard passed pawn definition

Use the usual and accepted passed pawn semantic
instead of a non-standard one and remove a FIXME.

STC (http://tests.stockfishchess.org/tests/view/576401350ebc5972faa1608d):
LLR: 2.96 (-2.94,2.94) [-3.00,1.00]
Total: 29646 W: 5663 L: 5557 D: 18426

LTC (http://tests.stockfishchess.org/tests/view/5764e4e90ebc5972faa160c3):
LLR: 2.96 (-2.94,2.94) [-3.00,1.00]
Total: 40224 W: 5578 L: 5484 D: 29162

bench: 7543902

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-1 3724 542 197 2985 +32.28 +/- 4.90
ncm-et-4 6276 942 297 5037 +35.83 +/- 3.75
  10000 1484 494 8022 +34.51 +/- 2.98