Dev Builds » 20180714-0613

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:39:55 1989579 3343 1662 102 1579 +175.72 +/- 8.38
ncm-et-4 08:39:48 1990152 3379 1696 87 1596 +179.98 +/- 8.31
ncm-et-9 08:39:33 1988100 3326 1664 87 1575 +179.07 +/- 8.37
ncm-et-10 08:39:31 1969329 3326 1657 96 1573 +176.92 +/- 8.39
ncm-et-13 08:39:45 1982860 3322 1694 83 1545 +183.94 +/- 8.46
ncm-et-15 08:39:32 1964511 3304 1670 105 1529 +178.86 +/- 8.55
20000 10043 560 9397 +179.07 +/- 3.43

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
49314 ncm-et-15 2018-08-11 00:40 00:18:37 1982634 121 53 6 62 +142.43 +/- 42.61
49313 ncm-et-3 2018-08-11 00:32 00:26:46 1990190 169 74 5 90 +150.63 +/- 34.65
49312 ncm-et-10 2018-08-11 00:32 00:26:47 1981381 178 88 6 84 +173.08 +/- 36.63
49311 ncm-et-9 2018-08-11 00:32 00:27:21 1988297 170 74 8 88 +142.35 +/- 35.59
49310 ncm-et-13 2018-08-11 00:31 00:28:05 1987193 182 98 2 82 +203.82 +/- 36.67
49309 ncm-et-4 2018-08-11 00:31 00:28:07 1990507 180 89 7 84 +170.83 +/- 36.78
49308 ncm-et-15 2018-08-10 23:17 01:21:46 1906451 500 248 19 233 +171.9 +/- 21.99
49307 ncm-et-9 2018-08-10 23:14 01:16:28 1988141 500 238 8 254 +172.78 +/- 20.49
49306 ncm-et-4 2018-08-10 23:14 01:16:07 1989876 500 273 11 216 +202.15 +/- 22.8
49305 ncm-et-10 2018-08-10 23:14 01:17:38 1979196 500 248 12 240 +178.11 +/- 21.41
49304 ncm-et-13 2018-08-10 23:13 01:17:35 1987824 500 245 12 243 +175.44 +/- 21.24
49303 ncm-et-3 2018-08-10 23:12 01:18:53 1990191 500 255 20 225 +177.22 +/- 22.48
49302 ncm-et-15 2018-08-10 21:59 01:17:47 1980443 500 253 9 238 +185.33 +/- 21.42
49301 ncm-et-4 2018-08-10 21:56 01:17:03 1990351 500 240 15 245 +168.4 +/- 21.22
49300 ncm-et-9 2018-08-10 21:55 01:17:58 1988297 500 276 8 216 +207.95 +/- 22.7
49299 ncm-et-10 2018-08-10 21:55 01:17:47 1982008 500 237 17 246 +164.07 +/- 21.22
49298 ncm-et-3 2018-08-10 21:54 01:16:47 1991456 500 245 14 241 +173.67 +/- 21.41
49297 ncm-et-13 2018-08-10 21:54 01:17:55 1989400 500 258 12 230 +187.16 +/- 21.98
49296 ncm-et-9 2018-08-10 20:37 01:17:23 1990032 500 270 9 221 +201.19 +/- 22.42
49295 ncm-et-4 2018-08-10 20:37 01:18:07 1989085 500 238 11 251 +170.15 +/- 20.76
49294 ncm-et-13 2018-08-10 20:36 01:15:57 1987666 500 257 15 228 +183.51 +/- 22.19
49293 ncm-et-10 2018-08-10 20:36 01:17:09 1980756 500 262 13 225 +189.92 +/- 22.31
49292 ncm-et-15 2018-08-10 20:36 01:21:00 1922906 500 263 23 214 +181.7 +/- 23.19
49291 ncm-et-3 2018-08-10 20:36 01:17:00 1989559 500 240 11 249 +171.9 +/- 20.87
46091 ncm-et-13 2018-07-16 12:59 00:22:29 1987193 140 61 4 75 +150.16 +/- 37.92
46090 ncm-et-10 2018-07-16 12:58 00:24:29 1920905 148 76 3 69 +187.73 +/- 40.18
46089 ncm-et-9 2018-07-16 12:57 00:25:01 1987667 156 83 5 68 +190.85 +/- 41.07
46088 ncm-et-15 2018-07-16 12:55 00:27:34 1984047 183 93 8 82 +174.76 +/- 37.45
46087 ncm-et-3 2018-07-16 12:54 00:27:43 1989874 174 82 7 85 +160.23 +/- 36.39
46086 ncm-et-4 2018-07-16 12:51 00:31:09 1991455 199 108 4 87 +201.49 +/- 35.98
46085 ncm-et-13 2018-07-16 11:40 01:18:12 1988140 500 266 13 221 +193.64 +/- 22.55
46084 ncm-et-9 2018-07-16 11:38 01:17:50 1987824 500 233 15 252 +162.35 +/- 20.84
46083 ncm-et-10 2018-07-16 11:37 01:19:42 1942922 500 243 13 244 +172.78 +/- 21.21
46082 ncm-et-15 2018-07-16 11:36 01:17:56 1980911 500 259 16 225 +184.42 +/- 22.39
46081 ncm-et-3 2018-07-16 11:35 01:18:26 1987508 500 252 18 230 +176.33 +/- 22.14
46080 ncm-et-4 2018-07-16 11:34 01:15:39 1989717 500 245 13 242 +174.55 +/- 21.33
46079 ncm-et-13 2018-07-16 10:20 01:19:15 1987984 500 263 10 227 +193.64 +/- 22.09
46078 ncm-et-9 2018-07-16 10:19 01:18:40 1987035 500 252 16 232 +178.11 +/- 21.98
46077 ncm-et-15 2018-07-16 10:18 01:16:54 1980131 500 251 11 238 +181.7 +/- 21.49
46076 ncm-et-4 2018-07-16 10:17 01:15:39 1990350 500 252 13 235 +180.8 +/- 21.72
46075 ncm-et-10 2018-07-16 10:17 01:19:07 1984676 500 248 17 235 +173.67 +/- 21.83
46074 ncm-et-3 2018-07-16 10:16 01:17:30 1988138 500 264 18 218 +187.16 +/- 22.85
46073 ncm-et-10 2018-07-16 08:59 01:16:52 1982791 500 255 15 230 +181.7 +/- 22.07
46072 ncm-et-9 2018-07-16 08:59 01:18:52 1987508 500 238 18 244 +164.07 +/- 21.35
46071 ncm-et-15 2018-07-16 08:59 01:17:58 1978566 500 250 13 237 +179.0 +/- 21.61
46070 ncm-et-13 2018-07-16 08:59 01:20:17 1947481 500 246 15 239 +173.67 +/- 21.55
46069 ncm-et-4 2018-07-16 08:58 01:17:57 1989875 500 251 13 236 +179.9 +/- 21.66
46068 ncm-et-3 2018-07-16 08:58 01:16:50 1989719 500 250 9 241 +182.61 +/- 21.25

Commit

Commit ID d2d4e85f25061aacd65a8b458b79cad15b74a5bb
Author candirufish
Date 2018-07-14 06:13:15 UTC
Tuned Values after 2 million spsa games Various king and pawn eval values tuned after 2 million games. Rounding slightly adjusted. LTC: http://tests.stockfishchess.org/tests/view/5b477a260ebc5978f4be3ed4 LLR: 2.95 (-2.94,2.94) [0.00,4.00] Total: 32783 W: 5852 L: 5588 D: 21343 STC: http://tests.stockfishchess.org/tests/view/5b472d420ebc5978f4be3e4d LLR: 3.23 (-2.94,2.94) [0.00,4.00] Total: 44380 W: 10201 L: 9841 D: 24338 I think I reached the limit of the fishtest framework. It frequently crashed at 2 million games already. The small values also moved a lot throughout the entire tuning session though with smaller margin. The passed danger and close enemies values seems the most sensitive (changing close enemies alone to 6 failed before but now it passes), whether or not they are close to optimal I don't know, but it seems some parameters are also correlated to others. Closes https://github.com/official-stockfish/Stockfish/pull/1670 bench: 5103722
Copyright 2011–2024 Next Chess Move LLC