Dev Builds » 20160619-1604

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-25 03:42 01:53:26 2026554 774 133 51 590 +36.95 +/- 11.77
ncm-et-4 2018-03-25 03:42 01:53:21 2001908 773 147 57 569 +40.64 +/- 12.41
ncm-et-5 2018-03-25 03:42 01:53:30 2021980 760 136 66 558 +32.09 +/- 12.62
ncm-et-6 2018-03-25 03:42 01:53:24 2026473 765 151 54 560 +44.29 +/- 12.55
ncm-et-7 2018-03-25 03:42 01:53:37 2017962 767 149 54 564 +43.26 +/- 12.46
ncm-et-8 2018-03-25 03:42 01:53:30 2006471 768 135 74 559 +27.65 +/- 12.74
ncm-et-9 2018-03-25 03:42 01:53:41 2024918 757 145 67 545 +35.93 +/- 12.97
ncm-et-10 2018-03-25 03:42 01:53:21 2019372 772 162 60 550 +46.17 +/- 12.95
ncm-et-11 2018-03-25 03:42 01:53:24 2017177 766 145 78 543 +30.47 +/- 13.19
ncm-et-12 2018-03-25 03:42 01:53:28 2003746 767 124 54 589 +31.80 +/- 11.72
ncm-et-13 2018-03-25 03:42 01:53:22 2025327 781 160 49 572 +49.72 +/- 12.36
ncm-et-14 2018-03-25 03:42 01:53:24 2021246 779 157 52 570 +47.12 +/- 12.42
ncm-et-15 2018-03-25 03:42 01:53:31 2018151 771 142 58 571 +38.00 +/- 12.34
  10000 1886 774 7340 +38.80 +/- 3.47

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
11865 ncm-et-3 2018-03-25 03:42 01:12:24 2026718 500 84 33 383 +35.56 +/- 14.54 Show
11866 ncm-et-9 2018-03-25 03:42 01:14:23 2024590 500 85 49 366 +25.06 +/- 15.68 Show
11867 ncm-et-4 2018-03-25 03:42 01:11:24 2025573 500 94 45 361 +34.16 +/- 15.92 Show
11868 ncm-et-7 2018-03-25 03:42 01:12:52 2009860 500 96 30 374 +46.13 +/- 15.00 Show
11869 ncm-et-14 2018-03-25 03:42 01:10:30 2022958 500 92 44 364 +33.46 +/- 15.74 Show
11870 ncm-et-13 2018-03-25 03:42 01:12:16 2025899 500 110 30 360 +56.07 +/- 15.75 Show
11871 ncm-et-11 2018-03-25 03:42 01:11:40 2016446 500 87 47 366 +27.85 +/- 15.66 Show
11872 ncm-et-5 2018-03-25 03:42 01:12:50 2024100 500 84 39 377 +31.35 +/- 14.96 Show
11873 ncm-et-8 2018-03-25 03:42 01:12:27 2021489 500 84 52 364 +22.27 +/- 15.82 Show
11874 ncm-et-10 2018-03-25 03:42 01:12:28 2020836 500 103 37 360 +46.13 +/- 15.87 Show
11875 ncm-et-15 2018-03-25 03:42 01:12:13 2017907 500 94 43 363 +35.56 +/- 15.79 Show
11876 ncm-et-6 2018-03-25 03:42 01:12:32 2026063 500 98 37 365 +42.60 +/- 15.60 Show
11877 ncm-et-12 2018-03-25 03:42 01:12:15 1988929 500 72 33 395 +27.16 +/- 13.82 Show
11878 ncm-et-14 2018-03-25 04:54 00:41:10 2019533 279 65 8 206 +71.99 +/- 19.95 Show
11879 ncm-et-4 2018-03-25 04:55 00:40:11 1978242 273 53 12 208 +52.58 +/- 19.57 Show
11880 ncm-et-11 2018-03-25 04:55 00:39:58 2017908 266 58 31 177 +35.39 +/- 24.03 Show
11881 ncm-et-13 2018-03-25 04:56 00:39:20 2024754 281 50 19 212 +38.49 +/- 19.86 Show
11882 ncm-et-3 2018-03-25 04:56 00:39:17 2026390 274 49 18 207 +39.48 +/- 20.05 Show
11883 ncm-et-15 2018-03-25 04:56 00:39:32 2018395 271 48 15 208 +42.52 +/- 19.58 Show
11884 ncm-et-12 2018-03-25 04:56 00:39:28 2018563 267 52 21 194 +40.52 +/- 21.53 Show
11885 ncm-et-8 2018-03-25 04:56 00:39:17 1991453 268 51 22 195 +37.74 +/- 21.49 Show
11886 ncm-et-10 2018-03-25 04:56 00:39:07 2017908 272 59 23 190 +46.26 +/- 22.39 Show
11887 ncm-et-6 2018-03-25 04:56 00:39:05 2026883 265 53 17 195 +47.49 +/- 21.12 Show
11888 ncm-et-7 2018-03-25 04:56 00:38:59 2026063 267 53 24 190 +37.89 +/- 22.18 Show
11889 ncm-et-5 2018-03-25 04:56 00:38:53 2019860 260 52 27 181 +33.51 +/- 23.14 Show
11890 ncm-et-9 2018-03-25 04:58 00:37:33 2025245 257 60 18 179 +57.29 +/- 22.96 Show

Commit

Commit ID 6d58bf777caa32336676a51f45816a9019d88fcb
Author ElbertoOne
Date 2016-06-19 16:04:22 UTC
Commit Type Simplification
On IID do not always search with cutNode = true

On IID now search with cutNode value instead of fixed value true.

STC (http://tests.stockfishchess.org/tests/view/575fa3860ebc5972faa15f67):
LLR: 2.96 (-2.94,2.94) [-3.00,1.00]
Total: 163974 W: 30744 L: 30874 D: 102356

LTC (http://tests.stockfishchess.org/tests/view/5763b0640ebc5972faa16075):
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 48363 W: 6611 L: 6528 D: 35224

Bench: 7806393

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 3839 568 201 3070 +33.32 +/- 4.84
ncm-et-1 2332 380 115 1837 +39.65 +/- 6.37
ncm-et-4 3829 566 197 3066 +33.59 +/- 4.83
  10000 1514 513 7973 +34.90 +/- 3.02