Dev Builds » 20170621-2037

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 06:13:28 2002240 2503 886 100 1517 +112.92 +/- 8.21
ncm-et-4 06:13:51 1997243 2543 905 94 1544 +114.81 +/- 8.11
ncm-et-5 02:02:59 2023854 833 293 27 513 +114.97 +/- 13.97
ncm-et-6 02:02:56 2026063 850 308 22 520 +121.64 +/- 13.82
ncm-et-7 02:02:47 1983134 819 286 27 506 +113.77 +/- 14.05
ncm-et-8 02:02:59 1977363 827 305 26 496 +121.99 +/- 14.31
ncm-et-9 06:14:01 1975971 2438 873 180 1385 +101.56 +/- 8.89
ncm-et-10 06:13:53 1993526 2553 895 94 1564 +112.81 +/- 8.04
ncm-et-11 02:02:45 2011148 834 312 37 485 +119.01 +/- 14.74
ncm-et-12 02:03:01 2021489 834 286 34 514 +108.36 +/- 14.04
ncm-et-13 06:14:02 1990300 2486 882 87 1517 +115.15 +/- 8.16
ncm-et-14 02:03:06 2020266 817 311 41 465 +119.3 +/- 15.18
ncm-et-15 04:11:03 1971939 1663 623 72 968 +119.63 +/- 10.42
20000 7165 841 11994 +113.76 +/- 2.93

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
57114 ncm-et-9 2018-10-19 18:36 00:14:47 1953740 91 37 9 45 +110.48 +/- 51.01
57113 ncm-et-13 2018-10-19 18:28 00:22:48 1988772 155 58 3 94 +128.89 +/- 32.5
57112 ncm-et-15 2018-10-19 18:26 00:24:42 1984205 163 58 5 100 +117.22 +/- 31.72
57111 ncm-et-3 2018-10-19 18:23 00:27:10 1990823 179 62 10 107 +103.92 +/- 31.45
57110 ncm-et-4 2018-10-19 18:21 00:29:47 1989558 204 59 7 138 +90.56 +/- 25.99
57109 ncm-et-10 2018-10-19 18:20 00:30:31 1980598 207 77 7 123 +122.3 +/- 28.94
57108 ncm-et-9 2018-10-19 17:17 01:17:34 1947528 500 196 54 250 +101.46 +/- 21.48
57107 ncm-et-13 2018-10-19 17:13 01:14:22 1988769 500 178 17 305 +116.0 +/- 18.2
57106 ncm-et-15 2018-10-19 17:08 01:16:50 1934674 500 190 22 288 +121.46 +/- 19.17
57105 ncm-et-3 2018-10-19 17:08 01:14:34 1988928 500 163 22 315 +100.71 +/- 17.85
57104 ncm-et-4 2018-10-19 17:07 01:12:35 1991299 500 183 20 297 +117.55 +/- 18.68
57103 ncm-et-10 2018-10-19 17:06 01:13:15 1981851 500 176 17 307 +114.45 +/- 18.1
57102 ncm-et-9 2018-10-19 15:58 01:18:33 1949488 500 163 49 288 +80.63 +/- 19.62
57101 ncm-et-13 2018-10-19 15:56 01:15:40 1979727 500 179 19 302 +115.23 +/- 18.41
57100 ncm-et-3 2018-10-19 15:52 01:14:45 1991614 500 183 21 296 +116.78 +/- 18.75
57099 ncm-et-15 2018-10-19 15:52 01:15:20 1984675 500 191 25 284 +119.89 +/- 19.44
57098 ncm-et-4 2018-10-19 15:51 01:15:00 1990507 500 195 19 286 +127.76 +/- 19.2
57097 ncm-et-10 2018-10-19 15:51 01:14:21 1980599 500 166 18 316 +106.01 +/- 17.69
57096 ncm-et-9 2018-10-19 14:37 01:19:51 1951304 500 169 39 292 +92.46 +/- 19.3
57095 ncm-et-10 2018-10-19 14:37 01:12:43 1978881 500 169 21 310 +106.01 +/- 18.07
57094 ncm-et-3 2018-10-19 14:37 01:14:09 1987823 500 170 12 318 +113.68 +/- 17.41
57093 ncm-et-13 2018-10-19 14:37 01:18:09 1931423 500 184 13 303 +123.81 +/- 18.17
57092 ncm-et-15 2018-10-19 14:37 01:14:11 1984204 500 184 20 296 +118.33 +/- 18.73
57091 ncm-et-4 2018-10-19 14:37 01:13:30 1990665 500 169 24 307 +103.73 +/- 18.29
4806 ncm-et-14 2018-03-04 13:11 00:47:26 2021325 317 115 13 189 +115.91 +/- 23.42
4805 ncm-et-7 2018-03-04 13:11 00:47:28 2000512 319 122 10 187 +127.4 +/- 23.49
4804 ncm-et-11 2018-03-04 13:09 00:48:45 2018073 334 125 16 193 +117.69 +/- 23.48
4803 ncm-et-13 2018-03-04 13:09 00:49:05 2026555 331 113 14 204 +107.19 +/- 22.34
4802 ncm-et-9 2018-03-04 13:09 00:49:18 2027539 347 129 12 206 +121.92 +/- 22.35
4801 ncm-et-5 2018-03-04 13:09 00:49:21 2024590 333 109 6 218 +111.1 +/- 20.65
4800 ncm-et-12 2018-03-04 13:09 00:49:38 2022630 334 104 18 212 +91.52 +/- 21.85
4799 ncm-et-8 2018-03-04 13:09 00:49:37 1989821 327 124 9 194 +127.63 +/- 22.91
4798 ncm-et-10 2018-03-04 13:08 00:49:50 2019045 346 127 13 206 +118.91 +/- 22.39
4797 ncm-et-4 2018-03-04 13:08 00:49:55 1995693 339 123 10 206 +120.41 +/- 22.1
4796 ncm-et-3 2018-03-04 13:08 00:49:43 2027374 324 119 13 192 +118.0 +/- 23.26
4795 ncm-et-6 2018-03-04 13:07 00:51:09 2025081 350 133 12 205 +125.27 +/- 22.49
4794 ncm-et-5 2018-03-04 11:54 01:13:38 2023119 500 184 21 295 +117.55 +/- 18.8
4793 ncm-et-12 2018-03-04 11:54 01:13:23 2020349 500 182 16 302 +119.89 +/- 18.32
4792 ncm-et-7 2018-03-04 11:54 01:15:19 1965757 500 164 17 319 +105.25 +/- 17.52
4791 ncm-et-4 2018-03-04 11:54 01:13:04 2025736 500 176 14 310 +116.78 +/- 17.86
4790 ncm-et-13 2018-03-04 11:54 01:13:58 2026556 500 170 21 309 +106.78 +/- 18.12
4789 ncm-et-8 2018-03-04 11:54 01:13:22 1964906 500 181 17 302 +118.33 +/- 18.35
4788 ncm-et-11 2018-03-04 11:54 01:14:00 2004223 500 187 21 292 +119.89 +/- 18.95
4787 ncm-et-10 2018-03-04 11:54 01:13:13 2020184 500 180 18 302 +116.78 +/- 18.38
4786 ncm-et-6 2018-03-04 11:54 01:11:47 2027046 500 175 10 315 +119.11 +/- 17.48
4785 ncm-et-3 2018-03-04 11:54 01:13:07 2026882 500 189 22 289 +120.67 +/- 19.12
4784 ncm-et-9 2018-03-04 11:54 01:13:58 2026227 500 179 17 304 +116.78 +/- 18.25
4783 ncm-et-14 2018-03-04 11:54 01:15:40 2019208 500 196 28 276 +121.46 +/- 19.9

Commit

Commit ID 3cb02004596f868ae405b09fbf3a2038a680a989
Author Joost VandeVondele
Date 2017-06-21 20:37:58 UTC
Fix four data races. the nodes, tbHits, rootDepth and lastInfoTime variables are read by multiple threads, but not declared atomic, leading to data races as found by -fsanitize=thread. This patch fixes this issue. It is based on top of the CI-threading branch (PR #1129), and should fix the corresponding CI error messages. The patch passed an STC check for no regression: http://tests.stockfishchess.org/tests/view/5925d5590ebc59035df34b9f LLR: 2.96 (-2.94,2.94) [-3.00,1.00] Total: 169597 W: 29938 L: 30066 D: 109593 Whereas rootDepth and lastInfoTime are not performance critical, nodes and tbHits are. Indeed, an earlier version using relaxed atomic updates on the latter two variables failed STC testing (http://tests.stockfishchess.org/tests/view/592001700ebc59035df34924), which can be shown to be due to x86-32 (http://tests.stockfishchess.org/tests/view/592330ac0ebc59035df34a89). Indeed, the latter have no instruction to atomically update a 64bit variable. The proposed solution thus uses a variable in Position that is accessed only by one thread, which is copied every few thousand nodes to the shared variable in Thread. No functional change. Closes #1130 Closes #1129
Copyright 2011–2024 Next Chess Move LLC