Dev Builds » 20160625-0946

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-09 13:09 01:45:26 2026311 721 123 49 549 +35.79 +/- 12.23
ncm-et-4 2018-03-09 13:09 01:45:20 1980541 704 111 50 543 +30.18 +/- 12.15
ncm-et-5 2018-03-09 13:09 01:45:08 2023283 727 135 61 531 +35.49 +/- 12.98
ncm-et-6 2018-03-09 13:09 01:45:22 2027620 713 140 62 511 +38.16 +/- 13.43
ncm-et-7 2018-03-09 13:09 01:45:18 2024100 709 111 59 539 +25.53 +/- 12.44
ncm-et-8 2018-03-09 13:09 01:45:07 2010142 713 130 54 529 +37.18 +/- 12.80
ncm-et-9 2018-03-09 13:09 01:45:06 2026555 718 129 50 539 +38.38 +/- 12.52
ncm-et-10 2018-03-09 13:09 01:45:16 2019452 732 137 55 540 +39.08 +/- 12.73
ncm-et-11 2018-03-09 13:09 01:45:18 2015805 715 128 56 531 +35.11 +/- 12.78
ncm-et-12 2018-03-09 13:09 01:45:17 2007756 719 145 51 523 +45.68 +/- 13.05
ncm-et-13 2018-03-09 13:09 01:45:19 2025904 699 126 55 518 +35.41 +/- 12.96
ncm-et-14 2018-03-09 13:09 01:45:15 2020266 713 139 43 531 +47.07 +/- 12.64
ncm-et-15 2018-03-09 13:09 01:45:01 2019940 707 129 59 519 +34.51 +/- 13.08
ncm-et-16 2018-03-09 13:09 01:45:29 2021651 710 142 61 507 +39.81 +/- 13.51
  10000 1825 765 7410 +36.97 +/- 3.42

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
6750 ncm-et-16 2018-03-09 13:09 01:12:29 2021977 500 90 45 365 +31.35 +/- 15.70 Show
6751 ncm-et-4 2018-03-09 13:09 01:13:29 2024591 500 85 31 384 +37.67 +/- 14.45 Show
6752 ncm-et-13 2018-03-09 13:09 01:14:09 2022793 500 88 37 375 +35.56 +/- 15.05 Show
6753 ncm-et-3 2018-03-09 13:09 01:12:20 2025739 500 81 37 382 +30.65 +/- 14.65 Show
6754 ncm-et-6 2018-03-09 13:09 01:12:22 2027538 500 91 47 362 +30.65 +/- 15.88 Show
6755 ncm-et-14 2018-03-09 13:09 01:12:49 2020510 500 99 31 370 +47.55 +/- 15.24 Show
6756 ncm-et-12 2018-03-09 13:09 01:13:02 1995653 500 110 43 347 +46.84 +/- 16.63 Show
6757 ncm-et-11 2018-03-09 13:09 01:11:24 2017420 500 88 35 377 +36.97 +/- 14.91 Show
6758 ncm-et-10 2018-03-09 13:09 01:10:43 2019045 500 96 33 371 +44.01 +/- 15.22 Show
6759 ncm-et-9 2018-03-09 13:09 01:12:02 2025899 500 96 34 370 +43.30 +/- 15.29 Show
6760 ncm-et-15 2018-03-09 13:09 01:13:47 2020021 500 92 41 367 +35.56 +/- 15.55 Show
6761 ncm-et-7 2018-03-09 13:09 01:13:55 2023773 500 77 40 383 +25.76 +/- 14.63 Show
6762 ncm-et-5 2018-03-09 13:09 01:11:55 2023773 500 99 38 363 +42.60 +/- 15.72 Show
6763 ncm-et-8 2018-03-09 13:09 01:13:04 1997979 500 94 40 366 +37.67 +/- 15.59 Show
6764 ncm-et-10 2018-03-09 14:21 00:33:07 2019859 232 41 22 169 +28.52 +/- 23.16 Show
6765 ncm-et-11 2018-03-09 14:22 00:32:27 2014190 215 40 21 154 +30.78 +/- 24.59 Show
6766 ncm-et-9 2018-03-09 14:22 00:31:37 2027210 218 33 16 169 +27.15 +/- 21.70 Show
6767 ncm-et-5 2018-03-09 14:22 00:31:46 2022793 227 36 23 168 +19.92 +/- 22.97 Show
6768 ncm-et-3 2018-03-09 14:23 00:31:39 2026882 221 42 12 167 +47.46 +/- 22.18 Show
6769 ncm-et-6 2018-03-09 14:23 00:31:33 2027702 213 49 15 149 +55.94 +/- 25.12 Show
6770 ncm-et-16 2018-03-09 14:23 00:31:33 2021325 210 52 16 142 +60.15 +/- 26.29 Show
6771 ncm-et-14 2018-03-09 14:23 00:31:00 2020021 213 40 12 161 +45.94 +/- 22.61 Show
6772 ncm-et-12 2018-03-09 14:23 00:30:48 2019859 219 35 8 176 +43.05 +/- 19.88 Show
6773 ncm-et-8 2018-03-09 14:24 00:30:36 2022305 213 36 14 163 +36.01 +/- 22.32 Show
6774 ncm-et-4 2018-03-09 14:24 00:30:22 1936491 204 26 19 159 +11.93 +/- 22.36 Show
6775 ncm-et-15 2018-03-09 14:24 00:29:47 2019859 207 37 18 152 +31.98 +/- 24.22 Show
6776 ncm-et-7 2018-03-09 14:24 00:29:55 2024427 209 34 19 156 +24.98 +/- 23.60 Show
6777 ncm-et-13 2018-03-09 14:24 00:29:43 2029015 199 38 18 143 +35.04 +/- 25.41 Show

Commit

Commit ID 190d2ea4bc433a0c047ede87f5d9cc241de2b1e2
Author Marco Costalba
Date 2016-06-25 09:46:17 UTC
Commit Type Simplification
Restore standard passed pawn definition

Use the usual and accepted passed pawn semantic
instead of a non-standard one and remove a FIXME.

STC (http://tests.stockfishchess.org/tests/view/576401350ebc5972faa1608d):
LLR: 2.96 (-2.94,2.94) [-3.00,1.00]
Total: 29646 W: 5663 L: 5557 D: 18426

LTC (http://tests.stockfishchess.org/tests/view/5764e4e90ebc5972faa160c3):
LLR: 2.96 (-2.94,2.94) [-3.00,1.00]
Total: 40224 W: 5578 L: 5484 D: 29162

bench: 7543902

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-1 3724 542 197 2985 +32.28 +/- 4.90
ncm-et-4 6276 942 297 5037 +35.83 +/- 3.75
  10000 1484 494 8022 +34.51 +/- 2.98