Dev Builds » 20180327-1514

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 06:03:55 2001389 2400 1134 74 1192 +164.79 +/- 9.59
ncm-et-4 06:03:55 1998240 2380 1072 85 1223 +153.32 +/- 9.45
ncm-et-5 01:47:55 2022874 706 320 24 362 +155.23 +/- 17.38
ncm-et-6 01:48:00 2026390 726 327 27 372 +152.7 +/- 17.18
ncm-et-7 01:47:18 2006641 715 337 29 349 +160.11 +/- 17.89
ncm-et-8 01:47:34 1982101 713 339 20 354 +167.27 +/- 17.58
ncm-et-9 06:03:48 2000665 2415 1145 71 1199 +166.11 +/- 9.55
ncm-et-10 06:03:28 1973400 2368 1078 61 1229 +159.56 +/- 9.35
ncm-et-11 01:47:54 2016935 714 331 23 360 +160.37 +/- 17.45
ncm-et-12 01:48:01 2000188 697 313 20 364 +155.7 +/- 17.21
ncm-et-13 06:03:20 1949092 2356 1054 76 1226 +153.49 +/- 9.4
ncm-et-14 01:47:53 2019861 716 348 20 348 +171.95 +/- 17.79
ncm-et-15 06:03:43 1985122 2369 1051 76 1242 +152.0 +/- 9.33
ncm-et-16 01:47:45 1987250 725 342 22 361 +164.66 +/- 17.43
20000 9191 628 10181 +159.0 +/- 3.27

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
52110 ncm-et-10 2018-09-02 05:41 00:22:44 1979035 148 62 5 81 +141.08 +/- 36.45
52109 ncm-et-4 2018-09-02 05:39 00:25:23 1990664 168 76 6 86 +154.14 +/- 35.84
52108 ncm-et-13 2018-09-02 05:38 00:25:47 1772300 150 64 5 81 +144.44 +/- 36.54
52107 ncm-et-15 2018-09-02 05:37 00:26:40 1954721 165 75 3 87 +162.51 +/- 34.98
52106 ncm-et-9 2018-09-02 05:36 00:27:37 1990190 180 78 10 92 +138.09 +/- 35.0
52105 ncm-et-3 2018-09-02 05:36 00:28:32 1992248 189 91 8 90 +163.71 +/- 35.5
52104 ncm-et-10 2018-09-02 04:23 01:17:18 1928325 500 221 17 262 +150.51 +/- 20.36
52103 ncm-et-13 2018-09-02 04:22 01:14:54 1986725 500 227 15 258 +157.24 +/- 20.52
52102 ncm-et-4 2018-09-02 04:22 01:16:05 1990191 500 216 14 270 +148.85 +/- 19.86
52101 ncm-et-15 2018-09-02 04:20 01:16:21 1979505 500 224 15 261 +154.7 +/- 20.36
52100 ncm-et-9 2018-09-02 04:19 01:16:31 1989559 500 246 15 239 +173.67 +/- 21.55
52099 ncm-et-3 2018-09-02 04:18 01:16:32 1987823 500 248 15 237 +175.44 +/- 21.67
52098 ncm-et-15 2018-09-02 03:03 01:15:32 1984675 500 230 12 258 +162.35 +/- 20.42
52097 ncm-et-10 2018-09-02 03:03 01:18:29 1911479 500 245 11 244 +176.33 +/- 21.15
52096 ncm-et-4 2018-09-02 03:03 01:17:26 1987981 500 232 17 251 +159.78 +/- 20.95
52095 ncm-et-9 2018-09-02 03:02 01:16:03 1986255 500 251 15 234 +178.11 +/- 21.84
52094 ncm-et-3 2018-09-02 03:02 01:15:21 1990191 500 235 13 252 +165.8 +/- 20.78
52093 ncm-et-13 2018-09-02 03:01 01:19:52 1899699 500 241 13 246 +171.02 +/- 21.1
52092 ncm-et-10 2018-09-02 01:45 01:17:00 1982007 500 234 15 251 +163.21 +/- 20.89
52091 ncm-et-15 2018-09-02 01:45 01:17:15 1953417 500 205 14 281 +139.81 +/- 19.3
52090 ncm-et-3 2018-09-02 01:45 01:15:27 1990032 500 240 21 239 +163.21 +/- 21.7
52089 ncm-et-4 2018-09-02 01:45 01:17:09 1986564 500 235 28 237 +153.02 +/- 21.93
52088 ncm-et-9 2018-09-02 01:45 01:15:49 1987824 500 221 6 273 +159.78 +/- 19.41
52087 ncm-et-13 2018-09-02 01:45 01:15:03 1984678 500 221 24 255 +144.72 +/- 20.89
12721 ncm-et-12 2018-03-27 21:54 00:30:22 2017096 197 86 8 103 +145.51 +/- 32.71
12720 ncm-et-13 2018-03-27 21:53 00:31:06 2028524 206 98 6 102 +166.92 +/- 32.91
12719 ncm-et-15 2018-03-27 21:53 00:31:16 2019371 204 83 8 113 +134.01 +/- 30.85
12718 ncm-et-5 2018-03-27 21:53 00:31:17 2022630 206 95 8 103 +156.53 +/- 32.9
12717 ncm-et-4 2018-03-27 21:52 00:31:50 2025412 212 99 3 110 +169.64 +/- 31.05
12716 ncm-et-11 2018-03-27 21:52 00:31:58 2015963 214 98 5 111 +161.74 +/- 31.17
12715 ncm-et-3 2018-03-27 21:52 00:32:11 2023775 211 97 6 108 +160.33 +/- 31.79
12714 ncm-et-8 2018-03-27 21:52 00:31:56 1977328 213 106 6 101 +176.99 +/- 33.24
12713 ncm-et-14 2018-03-27 21:52 00:32:14 2017908 216 99 9 108 +154.14 +/- 32.17
12712 ncm-et-10 2018-03-27 21:51 00:33:01 2019370 220 106 3 111 +176.41 +/- 31.04
12711 ncm-et-7 2018-03-27 21:51 00:32:51 1990652 215 95 10 110 +145.27 +/- 31.85
12710 ncm-et-6 2018-03-27 21:50 00:33:47 2025899 226 89 12 125 +123.3 +/- 29.57
12709 ncm-et-16 2018-03-27 21:50 00:34:04 1956106 225 105 6 114 +164.07 +/- 30.95
12708 ncm-et-9 2018-03-27 21:49 00:34:37 2025083 235 123 7 105 +187.9 +/- 32.84
12707 ncm-et-7 2018-03-27 20:35 01:14:27 2022630 500 242 19 239 +166.66 +/- 21.65
12706 ncm-et-9 2018-03-27 20:35 01:13:11 2025081 500 226 18 256 +153.86 +/- 20.7
12705 ncm-et-13 2018-03-27 20:35 01:16:38 2022630 500 203 13 284 +138.99 +/- 19.12
12704 ncm-et-10 2018-03-27 20:35 01:14:56 2020186 500 210 10 280 +147.19 +/- 19.21
12703 ncm-et-4 2018-03-27 20:35 01:16:02 2008632 500 214 17 269 +144.72 +/- 20.0
12702 ncm-et-8 2018-03-27 20:35 01:15:38 1986875 500 233 14 253 +163.21 +/- 20.75
12701 ncm-et-11 2018-03-27 20:35 01:15:56 2017908 500 233 18 249 +159.78 +/- 21.08
12700 ncm-et-16 2018-03-27 20:35 01:13:41 2018395 500 237 16 247 +164.93 +/- 21.14
12699 ncm-et-6 2018-03-27 20:35 01:14:13 2026882 500 238 15 247 +166.66 +/- 21.11
12698 ncm-et-15 2018-03-27 20:35 01:16:39 2019045 500 234 24 242 +155.54 +/- 21.59
12697 ncm-et-12 2018-03-27 20:35 01:17:39 1983281 500 227 12 261 +159.78 +/- 20.26
12696 ncm-et-5 2018-03-27 20:35 01:16:38 2023119 500 225 16 259 +154.7 +/- 20.49
12695 ncm-et-3 2018-03-27 20:35 01:15:52 2024269 500 223 11 266 +157.24 +/- 19.97
12694 ncm-et-14 2018-03-27 20:35 01:15:39 2021814 500 249 11 240 +179.9 +/- 21.37

Commit

Commit ID 367304e930e967d90523025b34f25c2a9b60de8f
Author Ondrej Mosnáček
Date 2018-03-27 15:14:55 UTC
Fix dynamic contempt for MultiPV Use rootMoves[PVIdx].previousScore instead of bestValue for dynamic contempt. This is equivalent for MultiPV=1 (bench remained the same, even for higher depths), but more correct for MultiPV. STC (MultiPV=3): LLR: 2.95 (-2.94,2.94) [0.00,5.00] Total: 2657 W: 1079 L: 898 D: 680 http://tests.stockfishchess.org/tests/view/5aaa47cb0ebc590297330403 LTC (MultiPV=3): LLR: 2.95 (-2.94,2.94) [0.00,5.00] Total: 2390 W: 874 L: 706 D: 810 http://tests.stockfishchess.org/tests/view/5aaa593a0ebc59029733040b VLTC 240+2.4 (MultiPV=3): LLR: 2.96 (-2.94,2.94) [0.00,5.00] Total: 2399 W: 861 L: 694 D: 844 http://tests.stockfishchess.org/tests/view/5aaf983e0ebc5902a182131f LTC (MultiPV=4, Skill Level=17): LLR: 2.95 (-2.94,2.94) [0.00,5.00] Total: 747 W: 333 L: 175 D: 239 http://tests.stockfishchess.org/tests/view/5aabccee0ebc5902997ff006 Note: although the ELO differences seem huge, they are inflated by the nature of Skill Level / MultiPV search, so I don't think they can be reasonably compared with classic ELO strength. See https://github.com/official-stockfish/Stockfish/pull/1491 for some verifications searches with MultiPV = 10 at depths 12 and 24 from the starting position and the position after 1.e4, comparing the outputs of the full PV by the old master and by this patch. No functional change for MultiPV=1
Copyright 2011–2024 Next Chess Move LLC