Dev Builds » 20160619-1604

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-25 03:42 01:53:26 2026554 774 133 51 590 +36.95 +/- 11.77
ncm-et-4 2018-03-25 03:42 01:53:21 2001908 773 147 57 569 +40.64 +/- 12.41
ncm-et-5 2018-03-25 03:42 01:53:30 2021980 760 136 66 558 +32.09 +/- 12.62
ncm-et-6 2018-03-25 03:42 01:53:24 2026473 765 151 54 560 +44.29 +/- 12.55
ncm-et-7 2018-03-25 03:42 01:53:37 2017962 767 149 54 564 +43.26 +/- 12.46
ncm-et-8 2018-03-25 03:42 01:53:30 2006471 768 135 74 559 +27.65 +/- 12.74
ncm-et-9 2018-03-25 03:42 01:53:41 2024918 757 145 67 545 +35.93 +/- 12.97
ncm-et-10 2018-03-25 03:42 01:53:21 2019372 772 162 60 550 +46.17 +/- 12.95
ncm-et-11 2018-03-25 03:42 01:53:24 2017177 766 145 78 543 +30.47 +/- 13.19
ncm-et-12 2018-03-25 03:42 01:53:28 2003746 767 124 54 589 +31.80 +/- 11.72
ncm-et-13 2018-03-25 03:42 01:53:22 2025327 781 160 49 572 +49.72 +/- 12.36
ncm-et-14 2018-03-25 03:42 01:53:24 2021246 779 157 52 570 +47.12 +/- 12.42
ncm-et-15 2018-03-25 03:42 01:53:31 2018151 771 142 58 571 +38.00 +/- 12.34
  10000 1886 774 7340 +38.80 +/- 3.47

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
11865 ncm-et-3 2018-03-25 03:42 01:12:24 2026718 500 84 33 383 +35.56 +/- 14.54 Show
11866 ncm-et-9 2018-03-25 03:42 01:14:23 2024590 500 85 49 366 +25.06 +/- 15.68 Show
11867 ncm-et-4 2018-03-25 03:42 01:11:24 2025573 500 94 45 361 +34.16 +/- 15.92 Show
11868 ncm-et-7 2018-03-25 03:42 01:12:52 2009860 500 96 30 374 +46.13 +/- 15.00 Show
11869 ncm-et-14 2018-03-25 03:42 01:10:30 2022958 500 92 44 364 +33.46 +/- 15.74 Show
11870 ncm-et-13 2018-03-25 03:42 01:12:16 2025899 500 110 30 360 +56.07 +/- 15.75 Show
11871 ncm-et-11 2018-03-25 03:42 01:11:40 2016446 500 87 47 366 +27.85 +/- 15.66 Show
11872 ncm-et-5 2018-03-25 03:42 01:12:50 2024100 500 84 39 377 +31.35 +/- 14.96 Show
11873 ncm-et-8 2018-03-25 03:42 01:12:27 2021489 500 84 52 364 +22.27 +/- 15.82 Show
11874 ncm-et-10 2018-03-25 03:42 01:12:28 2020836 500 103 37 360 +46.13 +/- 15.87 Show
11875 ncm-et-15 2018-03-25 03:42 01:12:13 2017907 500 94 43 363 +35.56 +/- 15.79 Show
11876 ncm-et-6 2018-03-25 03:42 01:12:32 2026063 500 98 37 365 +42.60 +/- 15.60 Show
11877 ncm-et-12 2018-03-25 03:42 01:12:15 1988929 500 72 33 395 +27.16 +/- 13.82 Show
11878 ncm-et-14 2018-03-25 04:54 00:41:10 2019533 279 65 8 206 +71.99 +/- 19.95 Show
11879 ncm-et-4 2018-03-25 04:55 00:40:11 1978242 273 53 12 208 +52.58 +/- 19.57 Show
11880 ncm-et-11 2018-03-25 04:55 00:39:58 2017908 266 58 31 177 +35.39 +/- 24.03 Show
11881 ncm-et-13 2018-03-25 04:56 00:39:20 2024754 281 50 19 212 +38.49 +/- 19.86 Show
11882 ncm-et-3 2018-03-25 04:56 00:39:17 2026390 274 49 18 207 +39.48 +/- 20.05 Show
11883 ncm-et-15 2018-03-25 04:56 00:39:32 2018395 271 48 15 208 +42.52 +/- 19.58 Show
11884 ncm-et-12 2018-03-25 04:56 00:39:28 2018563 267 52 21 194 +40.52 +/- 21.53 Show
11885 ncm-et-8 2018-03-25 04:56 00:39:17 1991453 268 51 22 195 +37.74 +/- 21.49 Show
11886 ncm-et-10 2018-03-25 04:56 00:39:07 2017908 272 59 23 190 +46.26 +/- 22.39 Show
11887 ncm-et-6 2018-03-25 04:56 00:39:05 2026883 265 53 17 195 +47.49 +/- 21.12 Show
11888 ncm-et-7 2018-03-25 04:56 00:38:59 2026063 267 53 24 190 +37.89 +/- 22.18 Show
11889 ncm-et-5 2018-03-25 04:56 00:38:53 2019860 260 52 27 181 +33.51 +/- 23.14 Show
11890 ncm-et-9 2018-03-25 04:58 00:37:33 2025245 257 60 18 179 +57.29 +/- 22.96 Show

Commit

Commit ID 6d58bf777caa32336676a51f45816a9019d88fcb
Author ElbertoOne
Date 2016-06-19 16:04:22 UTC
Commit Type Simplification
On IID do not always search with cutNode = true

On IID now search with cutNode value instead of fixed value true.

STC (http://tests.stockfishchess.org/tests/view/575fa3860ebc5972faa15f67):
LLR: 2.96 (-2.94,2.94) [-3.00,1.00]
Total: 163974 W: 30744 L: 30874 D: 102356

LTC (http://tests.stockfishchess.org/tests/view/5763b0640ebc5972faa16075):
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 48363 W: 6611 L: 6528 D: 35224

Bench: 7806393

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-1 2332 380 115 1837 +39.65 +/- 6.37
ncm-et-3 3839 568 201 3070 +33.32 +/- 4.84
ncm-et-4 3829 566 197 3066 +33.59 +/- 4.83
  10000 1514 513 7973 +34.90 +/- 3.02