Dev Builds » 20170617-0230

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 06:05:03 2002335 2455 841 87 1527 +110.27 +/- 8.08
ncm-et-4 06:09:20 1998427 2503 873 103 1527 +110.46 +/- 8.17
ncm-et-5 01:54:04 2023202 779 282 39 458 +112.11 +/- 15.18
ncm-et-6 01:53:43 2025163 766 268 23 475 +115.17 +/- 14.45
ncm-et-7 01:53:44 1997604 749 270 23 456 +119.02 +/- 14.85
ncm-et-8 01:53:39 2022303 787 285 24 478 +119.75 +/- 14.51
ncm-et-9 06:09:22 1954134 2373 884 117 1372 +116.47 +/- 8.8
ncm-et-10 06:09:31 1977496 2432 842 80 1510 +112.65 +/- 8.12
ncm-et-11 01:54:14 1969363 744 249 27 468 +106.92 +/- 14.56
ncm-et-12 01:54:03 2016620 765 291 24 450 +126.58 +/- 15.11
ncm-et-13 06:09:11 1988596 2433 868 100 1465 +113.55 +/- 8.38
ncm-et-14 01:54:10 2018964 780 254 34 492 +100.72 +/- 14.27
ncm-et-15 06:08:41 1964041 2434 866 110 1458 +111.6 +/- 8.43
20000 7073 791 12136 +112.95 +/- 2.9

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
57186 ncm-et-9 2018-10-20 07:28 00:15:33 1952068 102 39 5 58 +120.41 +/- 43.22
57185 ncm-et-15 2018-10-20 07:20 00:23:46 1982949 160 48 12 100 +79.53 +/- 32.4
57184 ncm-et-10 2018-10-20 07:18 00:25:43 1979979 167 55 6 106 +105.03 +/- 30.56
57183 ncm-et-13 2018-10-20 07:18 00:26:00 1947656 162 60 12 90 +106.13 +/- 35.18
57182 ncm-et-3 2018-10-20 07:17 00:26:26 1991456 174 68 5 101 +131.77 +/- 32.03
57181 ncm-et-4 2018-10-20 07:10 00:34:16 1990192 235 86 9 140 +118.2 +/- 27.19
57180 ncm-et-9 2018-10-20 06:07 01:20:13 1891308 500 185 30 285 +111.37 +/- 19.49
57179 ncm-et-15 2018-10-20 06:04 01:14:58 1980602 500 179 24 297 +111.37 +/- 18.78
57178 ncm-et-13 2018-10-20 05:58 01:18:24 1989086 500 180 18 302 +116.78 +/- 18.38
57177 ncm-et-3 2018-10-20 05:58 01:13:51 1989874 500 152 20 328 +93.95 +/- 17.16
57176 ncm-et-10 2018-10-20 05:58 01:18:48 1961518 500 172 15 313 +112.91 +/- 17.75
57175 ncm-et-4 2018-10-20 05:56 01:12:41 1990665 500 177 20 303 +112.91 +/- 18.38
57174 ncm-et-15 2018-10-20 04:48 01:14:53 1980598 500 185 26 289 +114.45 +/- 19.22
57173 ncm-et-9 2018-10-20 04:45 01:20:31 1924378 500 184 23 293 +116.0 +/- 18.95
57172 ncm-et-10 2018-10-20 04:44 01:13:27 1980757 500 159 14 327 +103.73 +/- 17.03
57171 ncm-et-3 2018-10-20 04:43 01:14:10 1990192 500 169 9 322 +115.23 +/- 17.1
57170 ncm-et-13 2018-10-20 04:42 01:15:04 1977524 500 185 23 292 +116.78 +/- 19.0
57169 ncm-et-4 2018-10-20 04:40 01:14:40 1989718 500 171 18 311 +109.83 +/- 17.94
57168 ncm-et-4 2018-10-20 03:25 01:13:42 1985304 500 174 19 307 +111.37 +/- 18.16
57167 ncm-et-15 2018-10-20 03:25 01:21:25 1801518 500 185 17 298 +121.46 +/- 18.55
57166 ncm-et-3 2018-10-20 03:25 01:16:37 1989874 500 181 23 296 +113.68 +/- 18.8
57165 ncm-et-9 2018-10-20 03:25 01:18:52 1903779 500 208 35 257 +125.39 +/- 20.97
57164 ncm-et-10 2018-10-20 03:25 01:17:19 1905120 500 178 20 302 +113.68 +/- 18.43
57163 ncm-et-13 2018-10-20 03:25 01:15:51 1965021 500 166 17 317 +106.78 +/- 17.62
9192 ncm-et-11 2018-03-17 06:59 00:35:30 2019697 244 85 9 150 +111.94 +/- 25.98
9191 ncm-et-7 2018-03-17 06:58 00:37:11 2023610 249 97 8 144 +129.92 +/- 26.9
9190 ncm-et-9 2018-03-17 06:56 00:38:52 2025735 271 91 7 173 +111.35 +/- 23.63
9189 ncm-et-6 2018-03-17 06:56 00:38:39 2025408 266 89 4 173 +115.05 +/- 23.18
9188 ncm-et-10 2018-03-17 06:56 00:39:15 2018557 265 95 15 155 +108.26 +/- 26.26
9187 ncm-et-12 2018-03-17 06:56 00:39:16 2012567 265 106 7 152 +136.4 +/- 26.11
9186 ncm-et-13 2018-03-17 06:55 00:39:35 2025408 271 102 12 157 +119.93 +/- 25.97
9185 ncm-et-15 2018-03-17 06:55 00:39:48 2020185 274 77 11 186 +85.37 +/- 22.44
9184 ncm-et-4 2018-03-17 06:55 00:40:03 2011564 268 92 10 166 +109.82 +/- 24.64
9183 ncm-et-14 2018-03-17 06:55 00:40:09 2019208 280 82 10 188 +91.39 +/- 22.36
9182 ncm-et-3 2018-03-17 06:54 00:40:27 2025572 281 110 8 163 +132.14 +/- 25.18
9181 ncm-et-5 2018-03-17 06:54 00:40:48 2021977 279 108 17 154 +117.62 +/- 26.74
9180 ncm-et-8 2018-03-17 06:53 00:41:34 2022466 287 101 8 178 +116.79 +/- 23.59
9179 ncm-et-15 2018-03-17 05:40 01:13:51 2018395 500 192 20 288 +124.6 +/- 19.12
9178 ncm-et-7 2018-03-17 05:40 01:16:33 1971598 500 173 15 312 +113.68 +/- 17.8
9177 ncm-et-13 2018-03-17 05:39 01:14:17 2026882 500 175 18 307 +112.91 +/- 18.13
9176 ncm-et-8 2018-03-17 05:39 01:12:05 2022140 500 184 16 300 +121.46 +/- 18.42
9175 ncm-et-3 2018-03-17 05:39 01:13:32 2027046 500 161 22 317 +99.2 +/- 17.75
9174 ncm-et-12 2018-03-17 05:39 01:14:47 2020674 500 185 17 298 +121.46 +/- 18.55
9173 ncm-et-5 2018-03-17 05:39 01:13:16 2024427 500 174 22 304 +109.07 +/- 18.39
9172 ncm-et-4 2018-03-17 05:39 01:13:58 2023122 500 173 27 300 +104.49 +/- 18.7
9171 ncm-et-6 2018-03-17 05:39 01:15:04 2024918 500 179 19 302 +115.23 +/- 18.41
9170 ncm-et-11 2018-03-17 05:39 01:18:44 1919029 500 164 18 318 +104.49 +/- 17.6
9169 ncm-et-9 2018-03-17 05:39 01:15:21 2027538 500 177 17 306 +115.23 +/- 18.15
9168 ncm-et-14 2018-03-17 05:39 01:14:01 2018720 500 172 24 304 +106.01 +/- 18.44
9167 ncm-et-10 2018-03-17 05:39 01:14:59 2019046 500 183 10 307 +125.39 +/- 17.87

Commit

Commit ID f907d5b7d93a161bc88aeaec403631de9de092f9
Author Brian Sheppard
Date 2017-06-17 02:30:19 UTC
Move depth calculation in probCut The change passed an STC regression: LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 59350 W: 10793 L: 10738 D: 37819 I verified that there was no change in performance on my machine, but of course YMMV: Results for 40 tests for each version: Base Test Diff Mean 2014338 2016121 -1783 StDev 62655 63441 3860 p-value: 0.678 speedup: 0.001 No functional change. Closes #1137
Copyright 2011–2024 Next Chess Move LLC