Dev Builds » 20170818-1604

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 10:16:29 2011553 4159 1428 132 2599 +111.99 +/- 6.17
ncm-et-4 10:16:58 2011542 4211 1509 147 2555 +116.56 +/- 6.3
ncm-et-5 06:09:55 2024101 2499 910 84 1505 +119.32 +/- 8.22
ncm-et-6 06:09:58 2008945 2491 890 96 1505 +114.74 +/- 8.24
ncm-et-9 04:08:16 1988455 1659 626 57 976 +124.2 +/- 10.28
ncm-et-10 04:08:02 1972458 1646 617 61 968 +122.16 +/- 10.34
ncm-et-13 04:08:07 1971340 1660 594 54 1012 +117.28 +/- 9.97
ncm-et-15 04:08:08 1982204 1675 605 51 1019 +119.4 +/- 9.93
20000 7179 682 12139 +117.11 +/- 2.89

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
56031 ncm-et-10 2018-10-01 22:58 00:21:15 1976850 146 60 3 83 +143.24 +/- 35.3
56030 ncm-et-3 2018-10-01 22:57 00:22:56 1990824 156 47 3 106 +100.72 +/- 29.16
56029 ncm-et-9 2018-10-01 22:55 00:24:11 1989401 159 66 4 89 +143.05 +/- 34.35
56028 ncm-et-13 2018-10-01 22:55 00:24:36 1987825 160 54 7 99 +105.16 +/- 32.11
56027 ncm-et-15 2018-10-01 22:54 00:25:50 1983419 175 66 7 102 +121.9 +/- 32.12
56026 ncm-et-4 2018-10-01 22:49 00:30:55 1990349 204 79 13 112 +116.59 +/- 31.45
56025 ncm-et-13 2018-10-01 21:42 01:11:36 1989559 500 175 13 312 +116.78 +/- 17.73
56024 ncm-et-10 2018-10-01 21:41 01:16:21 1951163 500 173 17 310 +112.14 +/- 17.96
56023 ncm-et-3 2018-10-01 21:40 01:15:20 1987981 500 163 21 316 +101.46 +/- 17.78
56022 ncm-et-9 2018-10-01 21:39 01:15:01 1988769 500 185 23 292 +116.78 +/- 19.0
56021 ncm-et-15 2018-10-01 21:37 01:15:20 1981539 500 189 15 296 +126.18 +/- 18.58
56020 ncm-et-4 2018-10-01 21:34 01:13:27 1988927 500 165 16 319 +106.78 +/- 17.49
56019 ncm-et-13 2018-10-01 20:26 01:15:08 1975627 500 179 16 305 +117.55 +/- 18.17
56018 ncm-et-9 2018-10-01 20:24 01:14:18 1989717 500 178 15 307 +117.55 +/- 18.04
56017 ncm-et-3 2018-10-01 20:24 01:15:22 1990032 500 159 18 323 +100.71 +/- 17.35
56016 ncm-et-10 2018-10-01 20:24 01:15:52 1980598 500 194 16 290 +129.35 +/- 18.91
56015 ncm-et-15 2018-10-01 20:23 01:13:39 1980598 500 183 16 301 +120.67 +/- 18.37
56014 ncm-et-4 2018-10-01 20:21 01:11:39 1989559 500 178 16 306 +116.78 +/- 18.12
56013 ncm-et-15 2018-10-01 19:08 01:13:19 1983262 500 167 13 320 +110.6 +/- 17.34
56012 ncm-et-13 2018-10-01 19:08 01:16:47 1932349 500 186 18 296 +121.46 +/- 18.67
56011 ncm-et-3 2018-10-01 19:08 01:14:37 1991139 500 176 18 306 +113.68 +/- 18.18
56010 ncm-et-10 2018-10-01 19:08 01:14:34 1981224 500 190 25 285 +119.11 +/- 19.39
56009 ncm-et-4 2018-10-01 19:08 01:12:10 1989717 500 172 20 308 +109.07 +/- 18.14
56008 ncm-et-9 2018-10-01 19:08 01:14:46 1985934 500 197 15 288 +132.54 +/- 18.98
1310 ncm-et-3 2018-02-14 07:58 00:01:13 2025081 3 2 0 1 +279.24 +/- 576.89
1309 ncm-et-4 2018-02-14 07:57 00:01:38 2027375 7 0 0 7 0.0 +/- 4.35
1308 ncm-et-6 2018-02-14 06:47 01:12:14 2026718 491 185 13 293 +127.09 +/- 18.58
1307 ncm-et-5 2018-02-14 06:45 01:13:54 2024754 499 182 22 295 +115.47 +/- 18.82
1306 ncm-et-3 2018-02-14 06:43 01:13:55 2025736 500 178 13 309 +119.11 +/- 17.88
1305 ncm-et-4 2018-02-14 06:43 01:13:27 2025899 500 172 16 312 +112.14 +/- 17.83
1304 ncm-et-6 2018-02-14 05:31 01:14:42 1989741 500 164 25 311 +99.2 +/- 18.12
1303 ncm-et-5 2018-02-14 05:29 01:15:18 2021977 500 175 14 311 +116.0 +/- 17.82
1302 ncm-et-4 2018-02-14 05:28 01:13:07 2027210 500 171 16 313 +111.37 +/- 17.78
1301 ncm-et-3 2018-02-14 05:28 01:13:22 2026228 500 165 16 319 +106.78 +/- 17.49
1300 ncm-et-3 2018-02-14 04:15 01:12:05 2026883 500 192 12 296 +130.94 +/- 18.49
1299 ncm-et-6 2018-02-14 04:14 01:15:20 2024590 500 195 16 289 +130.15 +/- 18.96
1298 ncm-et-4 2018-02-14 04:13 01:13:51 2026227 500 188 24 288 +118.33 +/- 19.22
1297 ncm-et-5 2018-02-14 04:13 01:14:22 2023937 500 204 25 271 +130.15 +/- 20.09
1296 ncm-et-6 2018-02-14 03:00 01:13:05 2025899 500 175 21 304 +110.6 +/- 18.36
1295 ncm-et-5 2018-02-14 02:59 01:12:26 2024101 500 178 8 314 +123.02 +/- 17.46
1294 ncm-et-3 2018-02-14 02:59 01:14:38 2024917 500 174 16 310 +113.68 +/- 17.93
1293 ncm-et-4 2018-02-14 02:58 01:14:21 2023772 500 187 8 305 +130.15 +/- 17.9
1292 ncm-et-3 2018-02-14 01:45 01:13:01 2026718 500 172 15 313 +112.91 +/- 17.75
1291 ncm-et-6 2018-02-14 01:44 01:14:37 1977779 500 171 21 308 +107.54 +/- 18.17
1290 ncm-et-4 2018-02-14 01:44 01:12:23 2026390 500 197 18 285 +130.15 +/- 19.22
1289 ncm-et-5 2018-02-14 01:44 01:13:55 2025736 500 171 15 314 +112.14 +/- 17.7

Commit

Commit ID 444d99b6d24ba823c8c1ed7a94f3c15b0a536024
Author Marco Costalba
Date 2017-08-18 16:04:38 UTC
Rewrite benchmark First step in improving bench to handle arbitrary UCI commands so to test many more code paths. This first patch just set the new code structure. No functional change.
Copyright 2011–2024 Next Chess Move LLC