Dev Builds » 20180513-0520

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-05-14 17:40 2376:56:34 2001895 2399 1132 59 1208 +167.21 +/- 9.45
ncm-et-4 2018-05-14 17:40 2376:56:40 1990445 2405 1111 67 1227 +161.53 +/- 9.38
ncm-et-5 2018-05-14 17:40 01:48:59 2020030 699 339 15 345 +174.34 +/- 17.71
ncm-et-6 2018-05-14 17:40 01:49:12 2026554 719 341 17 361 +168.67 +/- 17.30
ncm-et-7 2018-05-14 17:40 01:48:55 2025900 729 334 24 371 +157.76 +/- 17.15
ncm-et-8 2018-05-14 17:41 01:48:46 2006755 707 344 22 341 +170.78 +/- 18.00
ncm-et-9 2018-05-14 17:40 2376:56:26 2000478 2393 1139 68 1186 +167.34 +/- 9.59
ncm-et-10 2018-05-14 17:40 2376:56:37 1980121 2387 1146 72 1169 +168.37 +/- 9.69
ncm-et-11 2018-05-14 17:40 01:49:08 2019940 712 323 19 370 +158.49 +/- 17.03
ncm-et-12 2018-05-14 17:40 01:48:56 2011044 709 344 18 347 +172.70 +/- 17.74
ncm-et-13 2018-05-14 17:40 2376:56:32 1964764 2346 1089 85 1172 +158.92 +/- 9.68
ncm-et-14 2018-05-14 17:40 01:48:58 2021651 724 333 20 371 +160.77 +/- 17.06
ncm-et-15 2018-05-14 17:40 2376:56:36 1976293 2366 1135 69 1162 +168.64 +/- 9.70
ncm-et-16 2018-05-14 17:40 01:49:01 2020837 705 319 22 364 +156.08 +/- 17.25
  20000 9429 577 9994 +165.19 +/- 3.30

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
37618 ncm-et-6 2018-05-14 17:40 01:14:12 2026390 500 238 11 251 +170.15 +/- 20.73 Show
37619 ncm-et-7 2018-05-14 17:40 01:14:17 2026063 500 229 15 256 +158.93 +/- 20.59 Show
37620 ncm-et-11 2018-05-14 17:40 01:15:58 2020021 500 231 15 254 +160.64 +/- 20.70 Show
37621 ncm-et-12 2018-05-14 17:40 01:16:32 2001414 500 246 11 243 +177.22 +/- 21.18 Show
37622 ncm-et-5 2018-05-14 17:40 01:17:01 2019547 500 237 8 255 +171.90 +/- 20.41 Show
37623 ncm-et-13 2018-05-14 17:40 01:13:33 2026063 500 218 23 259 +143.07 +/- 20.64 Show
37624 ncm-et-4 2018-05-14 17:40 01:14:55 1985116 500 241 11 248 +172.78 +/- 20.90 Show
37625 ncm-et-16 2018-05-14 17:40 01:17:07 2019371 500 238 17 245 +164.93 +/- 21.24 Show
37626 ncm-et-10 2018-05-14 17:40 01:14:26 2018558 500 242 17 241 +168.40 +/- 21.46 Show
37627 ncm-et-3 2018-05-14 17:40 01:16:31 2025081 500 245 13 242 +174.55 +/- 21.29 Show
37628 ncm-et-9 2018-05-14 17:40 01:15:48 2024264 500 246 15 239 +173.67 +/- 21.52 Show
37629 ncm-et-14 2018-05-14 17:40 01:14:10 2021162 500 235 14 251 +164.93 +/- 20.83 Show
37630 ncm-et-15 2018-05-14 17:40 01:15:45 2019534 500 227 17 256 +155.54 +/- 20.65 Show
37631 ncm-et-8 2018-05-14 17:41 01:16:59 1989409 500 240 13 247 +170.15 +/- 21.02 Show
37632 ncm-et-13 2018-05-14 18:55 00:34:28 2025245 225 102 10 113 +150.88 +/- 31.43 Show
37633 ncm-et-6 2018-05-14 18:55 00:33:55 2026718 219 103 6 110 +165.33 +/- 31.53 Show
37634 ncm-et-7 2018-05-14 18:56 00:33:33 2025736 229 105 9 115 +155.21 +/- 31.06 Show
37635 ncm-et-14 2018-05-14 18:56 00:33:44 2022140 224 98 6 120 +151.65 +/- 29.82 Show
37636 ncm-et-10 2018-05-14 18:56 00:33:19 2022467 220 92 6 122 +143.45 +/- 29.38 Show
37637 ncm-et-4 2018-05-14 18:56 00:33:02 2000421 219 86 3 130 +138.59 +/- 27.59 Show
37638 ncm-et-15 2018-05-14 18:57 00:32:01 2016610 209 114 4 91 +203.26 +/- 35.11 Show
37639 ncm-et-9 2018-05-14 18:57 00:32:02 2025572 214 103 6 105 +169.83 +/- 32.40 Show
37640 ncm-et-11 2018-05-14 18:57 00:32:04 2019858 212 92 4 116 +153.48 +/- 30.00 Show
37641 ncm-et-12 2018-05-14 18:58 00:31:19 2020673 209 98 7 104 +162.10 +/- 32.61 Show
37642 ncm-et-3 2018-05-14 18:58 00:31:25 2024100 209 92 5 112 +153.97 +/- 30.80 Show
37643 ncm-et-5 2018-05-14 18:58 00:30:52 2020512 199 102 7 90 +180.53 +/- 35.51 Show
37644 ncm-et-16 2018-05-14 18:59 00:30:49 2022303 205 81 5 119 +135.25 +/- 29.34 Show
37645 ncm-et-8 2018-05-14 18:59 00:30:42 2024100 207 104 9 94 +172.32 +/- 34.86 Show
58527 ncm-et-4 2018-08-21 14:17 01:15:24 1989559 500 229 17 254 +157.24 +/- 20.75 Show
58528 ncm-et-3 2018-08-21 14:17 01:14:53 1990191 500 239 8 253 +173.67 +/- 20.52 Show
58529 ncm-et-10 2018-08-21 14:17 01:15:25 1982008 500 233 15 252 +162.35 +/- 20.81 Show
58530 ncm-et-13 2018-08-21 14:17 01:18:00 1964697 500 243 14 243 +171.90 +/- 21.27 Show
58531 ncm-et-9 2018-08-21 14:17 01:17:20 1989558 500 233 16 251 +161.49 +/- 20.89 Show
58532 ncm-et-15 2018-08-21 14:17 01:15:51 1953329 500 257 13 230 +185.33 +/- 21.98 Show
58533 ncm-et-3 2018-08-21 15:33 01:16:56 1990508 500 234 17 249 +161.49 +/- 21.02 Show
58534 ncm-et-4 2018-08-21 15:34 01:15:56 1989401 500 235 14 251 +164.93 +/- 20.83 Show
58535 ncm-et-10 2018-08-21 15:34 01:17:01 1941759 500 242 16 242 +169.27 +/- 21.38 Show
58536 ncm-et-15 2018-08-21 15:34 01:18:52 1946476 500 232 16 252 +160.64 +/- 20.83 Show
58537 ncm-et-9 2018-08-21 15:36 01:16:53 1988296 500 242 8 250 +176.33 +/- 20.68 Show
58538 ncm-et-13 2018-08-21 15:36 01:20:08 1886979 500 212 14 274 +145.54 +/- 19.63 Show
58539 ncm-et-4 2018-08-21 16:51 01:16:37 1988769 500 235 21 244 +158.93 +/- 21.39 Show
58540 ncm-et-3 2018-08-21 16:51 01:15:00 1992088 500 240 12 248 +171.02 +/- 20.93 Show
58541 ncm-et-10 2018-08-21 16:52 01:16:12 1980911 500 254 14 232 +181.70 +/- 21.89 Show
58542 ncm-et-9 2018-08-21 16:54 01:15:41 1989401 500 233 17 250 +160.64 +/- 20.97 Show
58543 ncm-et-15 2018-08-21 16:54 01:16:01 1982165 500 235 13 252 +165.80 +/- 20.75 Show
58544 ncm-et-13 2018-08-21 16:57 01:17:45 1958613 500 256 18 226 +179.90 +/- 22.34 Show
58545 ncm-et-3 2018-08-21 18:07 00:29:50 1989402 190 82 4 104 +151.57 +/- 31.76 Show
58546 ncm-et-4 2018-08-21 18:08 00:28:46 1989401 186 85 1 100 +169.11 +/- 31.98 Show
58547 ncm-et-10 2018-08-21 18:09 00:28:00 1935020 167 83 4 80 +178.58 +/- 37.19 Show
58548 ncm-et-9 2018-08-21 18:10 00:26:28 1985776 179 82 6 91 +157.48 +/- 34.77 Show
58549 ncm-et-15 2018-08-21 18:11 00:25:48 1939641 157 70 6 81 +150.36 +/- 36.90 Show
58550 ncm-et-13 2018-08-21 18:16 00:20:37 1926985 121 58 6 57 +159.68 +/- 44.87 Show

Commit

Commit ID bf01bd07551dd4e2d68d82b305cc5d89a4c23bb0
Author Stéphane Nicolet
Date 2018-05-13 05:20:39 UTC
Commit Type Elo
Tweak kingAttackersCount and KingAttackWeights

Use the whole kingRing for pawn attackers instead of only the squares directly
around the king. This tends to give quite a lot more kingAttackersCount, so to
compensate and to avoid raising the  king danger too fast we lower the values
in the KingAttackWeights array a little bit.

STC:
LLR: 2.95 (-2.94,2.94) [0.00,4.00]
Total: 51892 W: 10723 L: 10369 D: 30800
http://tests.stockfishchess.org/tests/view/5af6d4dd0ebc5968e652428e

LTC:
LLR: 2.96 (-2.94,2.94) [0.00,4.00]
Total: 24536 W: 3737 L: 3515 D: 17284
http://tests.stockfishchess.org/tests/view/5af709890ebc5968e65242ac

Credits to user @xoroshiro for the idea of using the kingRing for pawn attackers.

How to continue? It seems that the KingAttackWeights[] array stores values
which are quite Elo-sensitive, yet they have not been tuned with SPSA recently.
There might be easy Elo points to get there.

Closes https://github.com/official-stockfish/Stockfish/pull/1597

Bench: 5282815