Dev Builds » 20160918-0613

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 04:27:24 1991559 1841 453 92 1296 +69.02 +/- 8.38
ncm-et-4 06:07:01 1978262 2480 651 129 1700 +74.24 +/- 7.44
ncm-et-5 01:44:31 2023364 738 201 38 499 +78.02 +/- 13.83
ncm-et-6 01:44:33 2025246 716 189 34 493 +76.42 +/- 13.74
ncm-et-7 01:44:29 2008207 712 170 45 497 +61.63 +/- 13.72
ncm-et-8 01:44:09 1958257 686 174 28 484 +75.09 +/- 13.6
ncm-et-9 06:05:39 1989957 2504 648 147 1709 +70.47 +/- 7.47
ncm-et-10 06:10:14 1986034 2478 650 131 1697 +73.86 +/- 7.45
ncm-et-11 01:44:18 2006375 726 198 26 502 +83.91 +/- 13.46
ncm-et-12 01:44:34 2006863 707 179 40 488 +69.21 +/- 13.88
ncm-et-13 06:06:44 1993411 2514 633 145 1736 +68.31 +/- 7.36
ncm-et-14 01:44:35 2018966 719 175 38 506 +67.02 +/- 13.44
ncm-et-15 06:05:56 1986363 2473 661 132 1680 +75.49 +/- 7.53
ncm-et-16 01:44:15 2003981 706 169 48 489 +60.14 +/- 13.93
20000 5151 1073 13776 +71.85 +/- 2.61

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
67124 ncm-et-3 2019-01-23 02:52 00:25:44 1963072 176 43 12 121 +61.84 +/- 28.17
67123 ncm-et-4 2019-01-23 02:39 00:39:36 1974717 266 70 13 183 +75.62 +/- 22.61
67122 ncm-et-15 2019-01-23 02:38 00:40:00 1971874 264 79 14 171 +87.34 +/- 24.14
67121 ncm-et-10 2019-01-23 02:38 00:40:08 1976875 265 81 12 172 +92.6 +/- 23.92
67120 ncm-et-9 2019-01-23 02:37 00:41:42 1971887 284 80 15 189 +80.95 +/- 22.69
67119 ncm-et-13 2019-01-23 02:36 00:42:24 1973282 294 69 18 207 +60.89 +/- 21.14
67118 ncm-et-4 2019-01-23 01:24 01:13:31 1976444 500 126 23 351 +72.61 +/- 16.09
67117 ncm-et-10 2019-01-23 01:24 01:13:30 1969863 500 126 28 346 +68.99 +/- 16.46
67116 ncm-et-15 2019-01-23 01:24 01:13:39 1968162 500 135 30 335 +74.06 +/- 17.05
67115 ncm-et-9 2019-01-23 01:23 01:12:35 1972188 500 126 35 339 +63.95 +/- 16.94
67114 ncm-et-13 2019-01-23 01:23 01:12:18 1982251 500 114 29 357 +59.64 +/- 15.91
67113 ncm-et-15 2019-01-23 00:09 01:14:04 1973428 500 145 17 338 +90.97 +/- 16.58
67112 ncm-et-9 2019-01-23 00:09 01:13:35 1971116 500 121 32 347 +62.51 +/- 16.49
67111 ncm-et-13 2019-01-23 00:08 01:13:03 1987415 500 128 32 340 +67.55 +/- 16.84
67110 ncm-et-4 2019-01-23 00:08 01:15:05 1968717 500 138 39 323 +69.71 +/- 17.8
67109 ncm-et-3 2019-01-23 00:08 01:05:38 1972253 451 112 24 315 +68.67 +/- 17.13
67108 ncm-et-10 2019-01-23 00:08 01:14:40 1973202 500 122 32 346 +63.23 +/- 16.54
67065 ncm-et-15 2019-01-22 14:09 01:13:58 1966623 500 130 26 344 +73.34 +/- 16.51
67064 ncm-et-4 2019-01-22 14:09 01:14:17 1945916 500 139 20 341 +84.31 +/- 16.52
67063 ncm-et-10 2019-01-22 14:09 01:17:23 1955568 500 144 25 331 +84.31 +/- 17.14
67062 ncm-et-3 2019-01-22 14:09 01:11:54 1970675 500 126 21 353 +74.06 +/- 15.94
67061 ncm-et-13 2019-01-22 14:09 01:14:23 1965228 500 127 25 348 +71.89 +/- 16.29
67060 ncm-et-9 2019-01-22 14:09 01:13:12 1973902 500 137 22 341 +81.37 +/- 16.57
6236 ncm-et-8 2018-03-08 13:17 00:28:18 1958398 186 52 8 126 +83.78 +/- 27.38
6235 ncm-et-12 2018-03-08 13:15 00:30:30 2020186 207 47 13 147 +57.59 +/- 24.99
6234 ncm-et-15 2018-03-08 13:15 00:30:40 2018396 209 57 13 139 +74.25 +/- 26.63
6233 ncm-et-3 2018-03-08 13:15 00:30:49 2026391 214 45 10 159 +57.34 +/- 22.99
6232 ncm-et-16 2018-03-08 13:15 00:30:53 1986964 206 45 13 148 +54.41 +/- 24.71
6231 ncm-et-4 2018-03-08 13:14 00:31:11 2024591 214 54 10 150 +72.47 +/- 24.68
6230 ncm-et-7 2018-03-08 13:14 00:31:06 1992479 212 47 13 152 +56.21 +/- 24.39
6229 ncm-et-13 2018-03-08 13:14 00:31:44 2025081 220 61 11 148 +80.37 +/- 25.47
6228 ncm-et-10 2018-03-08 13:14 00:32:01 2019697 213 57 10 146 +77.95 +/- 25.34
6227 ncm-et-9 2018-03-08 13:14 00:32:00 2026390 220 53 13 154 +63.88 +/- 24.58
6226 ncm-et-11 2018-03-08 13:14 00:31:57 1995489 226 61 13 152 +74.93 +/- 25.26
6225 ncm-et-6 2018-03-08 13:13 00:32:13 2023445 216 60 9 147 +83.61 +/- 25.25
6224 ncm-et-14 2018-03-08 13:13 00:32:25 2016608 219 58 5 156 +85.78 +/- 23.44
6223 ncm-et-5 2018-03-08 13:13 00:33:05 2022792 238 54 13 171 +60.46 +/- 22.86
6222 ncm-et-3 2018-03-08 12:00 01:13:19 2025408 500 127 25 348 +71.89 +/- 16.29
6221 ncm-et-15 2018-03-08 12:00 01:13:35 2019698 500 115 32 353 +58.21 +/- 16.18
6220 ncm-et-8 2018-03-08 12:00 01:15:51 1958117 500 122 20 358 +71.89 +/- 15.66
6219 ncm-et-11 2018-03-08 12:00 01:12:21 2017262 500 137 13 350 +88.0 +/- 15.86
6218 ncm-et-10 2018-03-08 12:00 01:12:32 2020999 500 120 24 356 +67.55 +/- 15.86
6217 ncm-et-12 2018-03-08 12:00 01:14:04 1993540 500 132 27 341 +74.06 +/- 16.69
6216 ncm-et-4 2018-03-08 12:00 01:13:21 1979191 500 124 24 352 +70.44 +/- 16.06
6215 ncm-et-16 2018-03-08 12:00 01:13:22 2020999 500 124 35 341 +62.51 +/- 16.84
6214 ncm-et-14 2018-03-08 12:00 01:12:10 2021325 500 117 33 350 +58.93 +/- 16.35
6213 ncm-et-9 2018-03-08 12:00 01:12:35 2024264 500 131 30 339 +71.16 +/- 16.85
6212 ncm-et-13 2018-03-08 12:00 01:12:52 2027210 500 134 30 336 +73.34 +/- 17.0
6211 ncm-et-7 2018-03-08 12:00 01:13:23 2023936 500 123 32 345 +63.95 +/- 16.59
6210 ncm-et-6 2018-03-08 12:00 01:12:20 2027047 500 129 25 346 +73.34 +/- 16.39
6209 ncm-et-5 2018-03-08 12:00 01:11:26 2023937 500 147 25 328 +86.52 +/- 17.29

Commit

Commit ID 4b0043ae7c92507d690eb4c4eb6249550d0891ff
Author Joost Vandevondele
Date 2016-09-18 06:13:34 UTC
Use fixed depth bench to make PGO builds more reproducible Discussed on fishcooking proposal and objdump verification: https://groups.google.com/d/msg/fishcooking/4_ausUwMXP0/EGPsMYqOFAAJ verified no significant speed difference between depth and time: https://groups.google.com/d/msg/fishcooking/4_ausUwMXP0/KazW5QZmFgAJ stockfish_time - stats: mean = 2207232.56 std = 7079.51 std/mean = 0.003207 stockfish_depth - stats: mean = 2201783.57 std = 6356.69 std/mean = 0.002887 No functional change
Copyright 2011–2024 Next Chess Move LLC