Dev Builds » 20180406-2331

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-04-07 00:14 3422:51:00 2001283 2386 1117 72 1197 +163.20 +/- 9.54
ncm-et-4 2018-04-07 00:14 3422:51:06 1998104 2390 1062 94 1234 +149.27 +/- 9.41
ncm-et-5 2018-04-07 00:14 01:48:46 2022550 720 338 14 368 +168.40 +/- 17.03
ncm-et-6 2018-04-07 00:14 01:48:49 2026310 724 346 22 356 +167.32 +/- 17.56
ncm-et-7 2018-04-07 00:15 01:48:28 2025408 722 318 32 372 +145.59 +/- 17.21
ncm-et-8 2018-04-07 00:14 01:48:20 1984807 709 324 24 361 +156.87 +/- 17.39
ncm-et-9 2018-04-07 00:14 3422:51:07 2001816 2408 1093 84 1231 +155.13 +/- 9.41
ncm-et-10 2018-04-07 00:14 3422:51:10 1983717 2359 1057 81 1221 +152.91 +/- 9.43
ncm-et-11 2018-04-07 00:14 01:48:34 1991222 709 335 22 352 +164.70 +/- 17.65
ncm-et-12 2018-04-07 00:14 01:48:39 2020350 702 325 19 358 +162.31 +/- 17.38
ncm-et-13 2018-04-07 00:15 3422:50:39 1959508 2361 1068 55 1238 +159.38 +/- 9.26
ncm-et-14 2018-04-07 00:14 01:48:28 2018314 712 327 23 362 +158.49 +/- 17.35
ncm-et-15 2018-04-07 00:14 3422:50:53 1994296 2384 1091 72 1221 +158.69 +/- 9.42
ncm-et-16 2018-04-07 00:14 01:48:43 2020023 714 334 26 354 +160.37 +/- 17.66
  20000 9135 640 10225 +157.55 +/- 3.26

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
16375 ncm-et-6 2018-04-07 00:14 01:15:20 2025737 500 232 14 254 +162.35 +/- 20.67 Show
16376 ncm-et-9 2018-04-07 00:14 01:15:11 2027046 500 236 21 243 +159.78 +/- 21.45 Show
16377 ncm-et-15 2018-04-07 00:14 01:16:16 2018396 500 242 18 240 +167.53 +/- 21.54 Show
16378 ncm-et-16 2018-04-07 00:14 01:14:47 2019861 500 239 19 242 +164.07 +/- 21.46 Show
16379 ncm-et-5 2018-04-07 00:14 01:14:31 2022143 500 243 9 248 +176.33 +/- 20.83 Show
16380 ncm-et-4 2018-04-07 00:14 01:17:06 2011850 500 240 18 242 +165.80 +/- 21.43 Show
16381 ncm-et-10 2018-04-07 00:14 01:15:26 2018232 500 221 19 260 +148.85 +/- 20.49 Show
16382 ncm-et-12 2018-04-07 00:14 01:16:15 2019537 500 233 10 257 +166.66 +/- 20.38 Show
16383 ncm-et-8 2018-04-07 00:14 01:15:40 1977188 500 226 17 257 +154.70 +/- 20.60 Show
16384 ncm-et-11 2018-04-07 00:14 01:16:41 1965346 500 242 15 243 +170.15 +/- 21.30 Show
16385 ncm-et-3 2018-04-07 00:14 01:14:53 2026718 500 233 11 256 +165.80 +/- 20.47 Show
16386 ncm-et-14 2018-04-07 00:14 01:15:38 2018883 500 232 18 250 +158.93 +/- 20.99 Show
16387 ncm-et-7 2018-04-07 00:15 01:14:37 2025244 500 224 21 255 +149.68 +/- 20.80 Show
16388 ncm-et-13 2018-04-07 00:15 01:15:01 2024754 500 234 13 253 +164.93 +/- 20.69 Show
16389 ncm-et-5 2018-04-07 01:30 00:33:10 2022956 220 95 5 120 +150.97 +/- 29.61 Show
16390 ncm-et-16 2018-04-07 01:30 00:32:51 2020185 214 95 7 112 +151.85 +/- 31.15 Show
16391 ncm-et-7 2018-04-07 01:30 00:32:46 2025572 222 94 11 117 +136.51 +/- 30.74 Show
16392 ncm-et-3 2018-04-07 01:30 00:32:38 2025899 216 95 7 114 +150.27 +/- 30.82 Show
16393 ncm-et-9 2018-04-07 01:31 00:32:30 2026391 219 90 4 125 +144.18 +/- 28.58 Show
16394 ncm-et-6 2018-04-07 01:31 00:32:24 2026882 224 114 8 102 +178.65 +/- 33.32 Show
16395 ncm-et-10 2018-04-07 01:31 00:32:17 2019370 214 98 10 106 +151.85 +/- 32.55 Show
16396 ncm-et-13 2018-04-07 01:31 00:32:02 2025411 222 108 7 107 +170.57 +/- 32.25 Show
16397 ncm-et-8 2018-04-07 01:31 00:31:34 1992426 209 98 7 104 +162.10 +/- 32.61 Show
16398 ncm-et-14 2018-04-07 01:31 00:31:45 2017745 212 95 5 112 +157.46 +/- 30.88 Show
16399 ncm-et-15 2018-04-07 01:32 00:31:25 2018720 211 110 4 97 +191.95 +/- 33.78 Show
16400 ncm-et-12 2018-04-07 01:32 00:31:20 2021162 202 92 9 101 +151.72 +/- 33.28 Show
16401 ncm-et-11 2018-04-07 01:32 00:30:48 2017097 209 93 7 109 +151.97 +/- 31.61 Show
16402 ncm-et-4 2018-04-07 01:33 00:30:22 2022794 206 82 14 110 +119.15 +/- 31.89 Show
59271 ncm-et-9 2018-08-27 10:47 01:15:10 1991140 500 230 21 249 +154.70 +/- 21.12 Show
59272 ncm-et-3 2018-08-27 10:47 01:16:47 1990032 500 233 20 247 +158.08 +/- 21.21 Show
59273 ncm-et-10 2018-08-27 10:47 01:18:18 1920865 500 215 20 265 +143.07 +/- 20.26 Show
59274 ncm-et-13 2018-08-27 10:47 01:16:55 1990190 500 202 9 289 +141.44 +/- 18.70 Show
59275 ncm-et-4 2018-08-27 10:47 01:14:46 1991298 500 221 20 259 +148.02 +/- 20.57 Show
59276 ncm-et-15 2018-08-27 10:47 01:16:44 1981851 500 212 12 276 +147.19 +/- 19.46 Show
59277 ncm-et-4 2018-08-27 12:03 01:15:53 1988612 500 229 15 256 +158.93 +/- 20.59 Show
59278 ncm-et-9 2018-08-27 12:03 01:13:45 1987982 500 228 10 262 +162.35 +/- 20.11 Show
59279 ncm-et-3 2018-08-27 12:05 01:16:10 1988138 500 246 17 237 +171.90 +/- 21.69 Show
59280 ncm-et-13 2018-08-27 12:05 01:16:05 1987826 500 231 12 257 +163.21 +/- 20.45 Show
59281 ncm-et-15 2018-08-27 12:05 01:15:49 1981539 500 212 19 269 +141.44 +/- 20.02 Show
59282 ncm-et-10 2018-08-27 12:07 01:16:38 1981381 500 207 17 276 +138.99 +/- 19.61 Show
59283 ncm-et-9 2018-08-27 13:18 01:16:48 1990667 500 229 23 248 +152.18 +/- 21.22 Show
59284 ncm-et-4 2018-08-27 13:20 01:16:10 1986721 500 209 19 272 +138.99 +/- 19.87 Show
59285 ncm-et-15 2018-08-27 13:22 01:16:02 1981538 500 236 12 252 +167.53 +/- 20.71 Show
59286 ncm-et-3 2018-08-27 13:22 01:16:04 1988140 500 231 13 256 +162.35 +/- 20.53 Show
59287 ncm-et-13 2018-08-27 13:22 01:17:39 1958430 500 237 12 251 +168.40 +/- 20.77 Show
59288 ncm-et-10 2018-08-27 13:24 01:16:56 1980130 500 243 11 246 +174.55 +/- 21.01 Show
59289 ncm-et-9 2018-08-27 14:36 00:29:26 1987667 189 80 5 104 +145.88 +/- 31.87 Show
59290 ncm-et-4 2018-08-27 14:37 00:28:09 1987350 184 81 8 95 +145.84 +/- 34.15 Show
59291 ncm-et-15 2018-08-27 14:39 00:26:01 1983733 173 79 7 87 +153.94 +/- 35.78 Show
59292 ncm-et-3 2018-08-27 14:39 00:26:08 1988772 170 79 4 87 +164.58 +/- 35.28 Show
59293 ncm-et-13 2018-08-27 14:41 00:24:27 1770435 139 56 2 81 +142.46 +/- 35.23 Show
59294 ncm-et-10 2018-08-27 14:42 00:23:18 1982321 145 73 4 68 +179.84 +/- 40.60 Show

Commit

Commit ID 759d129e4760938ded462a05061b421e18990937
Author Mark Tenzer
Date 2018-04-06 23:31:23 UTC
Commit Type Elo
Introduce Overload

This patch applies a S(10, 5) bonus for every square that is:

- Occupied by an enemy piece which is not a pawn
- Attacked exactly once by our pieces
- Defended exactly once by enemy pieces

The idea is that these pieces must be defended. Their defenders have
dramatically limited mobility, and they are vulnerable to our future
attack.

As with connectivity, there are probably many more tests to be run in
this area. In particular:

- I believe @snicolet's queen overload tests have demonstrated a potential
  need for a queen overload bonus above and beyond this one; however, the
  conditions for "overload" in this patch are different (excluding pieces
  we attack twice).  My next test after this is (hopefully) merged will be
  to intersect the Bitboard I define here with the enemy's queen attacks and
  attempt to give additional bonus.
- Perhaps we should exclude pieces attacked by pawns--can pawns really be
  overloaded? Should they have the same weight, or less?  This didn't work
  with a previous version, but it could work with this one.
- More generally, different pieces may need more or less bonus. We could
  change bonuses based on what type of enemy piece is being overloaded, what
  type of friendly piece is attacking, and/or what type of piece is being
  defended by the overloaded piece and attacked by us, or any intersection
  of these three.  For example, here attacked/defended pawns are excluded,
  but they're not totally worthless targets, and could be added again with
  a smaller bonus.
- This list is by no means exhaustive.

STC:
LLR: 2.96 (-2.94,2.94) [0.00,5.00]
Total: 17439 W: 3599 L: 3390 D: 10450
http://tests.stockfishchess.org/tests/view/5ac78a2e0ebc59435923735e

LTC:
LLR: 2.95 (-2.94,2.94) [0.00,5.00]
Total: 43304 W: 6533 L: 6256 D: 30515
http://tests.stockfishchess.org/tests/view/5ac7a1d80ebc59435923736f

Closes https://github.com/official-stockfish/Stockfish/pull/1533

Bench: 5248871

----------------

This is my first time opening a PR, so I apologize if there are errors.
There are too many people to thank since I submitted my first test just
over a month ago. Thank you all for the warm welcome and here is to more
green patches!

In particular, I would like to thank:
- @crossbr, whose comment in a FishCooking thread first inspired me to
            consider the overloading of pieces other than queens,
- @snicolet, whose queen overload tests inspired this one and served as
             the base of my first overload attempts,
- @protonspring, whose connectivity tests inspired this one and who provided
                 much of the feedback needed to take this from red to green,
- @vondele, who kindly corrected me when I submitted a bad LTC test,
- @Rocky640, who has helped me over and over again in the past month.

Thank you all!