Dev Builds » 20180513-0520

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-05-14 17:40 2376:56:34 2001895 2399 1132 59 1208 +167.21 +/- 9.45
ncm-et-4 2018-05-14 17:40 2376:56:40 1990445 2405 1111 67 1227 +161.53 +/- 9.38
ncm-et-5 2018-05-14 17:40 01:48:59 2020030 699 339 15 345 +174.34 +/- 17.71
ncm-et-6 2018-05-14 17:40 01:49:12 2026554 719 341 17 361 +168.67 +/- 17.30
ncm-et-7 2018-05-14 17:40 01:48:55 2025900 729 334 24 371 +157.76 +/- 17.15
ncm-et-8 2018-05-14 17:41 01:48:46 2006755 707 344 22 341 +170.78 +/- 18.00
ncm-et-9 2018-05-14 17:40 2376:56:26 2000478 2393 1139 68 1186 +167.34 +/- 9.59
ncm-et-10 2018-05-14 17:40 2376:56:37 1980121 2387 1146 72 1169 +168.37 +/- 9.69
ncm-et-11 2018-05-14 17:40 01:49:08 2019940 712 323 19 370 +158.49 +/- 17.03
ncm-et-12 2018-05-14 17:40 01:48:56 2011044 709 344 18 347 +172.70 +/- 17.74
ncm-et-13 2018-05-14 17:40 2376:56:32 1964764 2346 1089 85 1172 +158.92 +/- 9.68
ncm-et-14 2018-05-14 17:40 01:48:58 2021651 724 333 20 371 +160.77 +/- 17.06
ncm-et-15 2018-05-14 17:40 2376:56:36 1976293 2366 1135 69 1162 +168.64 +/- 9.70
ncm-et-16 2018-05-14 17:40 01:49:01 2020837 705 319 22 364 +156.08 +/- 17.25
  20000 9429 577 9994 +165.19 +/- 3.30

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
37618 ncm-et-6 2018-05-14 17:40 01:14:12 2026390 500 238 11 251 +170.15 +/- 20.73 Show
37619 ncm-et-7 2018-05-14 17:40 01:14:17 2026063 500 229 15 256 +158.93 +/- 20.59 Show
37620 ncm-et-11 2018-05-14 17:40 01:15:58 2020021 500 231 15 254 +160.64 +/- 20.70 Show
37621 ncm-et-12 2018-05-14 17:40 01:16:32 2001414 500 246 11 243 +177.22 +/- 21.18 Show
37622 ncm-et-5 2018-05-14 17:40 01:17:01 2019547 500 237 8 255 +171.90 +/- 20.41 Show
37623 ncm-et-13 2018-05-14 17:40 01:13:33 2026063 500 218 23 259 +143.07 +/- 20.64 Show
37624 ncm-et-4 2018-05-14 17:40 01:14:55 1985116 500 241 11 248 +172.78 +/- 20.90 Show
37625 ncm-et-16 2018-05-14 17:40 01:17:07 2019371 500 238 17 245 +164.93 +/- 21.24 Show
37626 ncm-et-10 2018-05-14 17:40 01:14:26 2018558 500 242 17 241 +168.40 +/- 21.46 Show
37627 ncm-et-3 2018-05-14 17:40 01:16:31 2025081 500 245 13 242 +174.55 +/- 21.29 Show
37628 ncm-et-9 2018-05-14 17:40 01:15:48 2024264 500 246 15 239 +173.67 +/- 21.52 Show
37629 ncm-et-14 2018-05-14 17:40 01:14:10 2021162 500 235 14 251 +164.93 +/- 20.83 Show
37630 ncm-et-15 2018-05-14 17:40 01:15:45 2019534 500 227 17 256 +155.54 +/- 20.65 Show
37631 ncm-et-8 2018-05-14 17:41 01:16:59 1989409 500 240 13 247 +170.15 +/- 21.02 Show
37632 ncm-et-13 2018-05-14 18:55 00:34:28 2025245 225 102 10 113 +150.88 +/- 31.43 Show
37633 ncm-et-6 2018-05-14 18:55 00:33:55 2026718 219 103 6 110 +165.33 +/- 31.53 Show
37634 ncm-et-7 2018-05-14 18:56 00:33:33 2025736 229 105 9 115 +155.21 +/- 31.06 Show
37635 ncm-et-14 2018-05-14 18:56 00:33:44 2022140 224 98 6 120 +151.65 +/- 29.82 Show
37636 ncm-et-10 2018-05-14 18:56 00:33:19 2022467 220 92 6 122 +143.45 +/- 29.38 Show
37637 ncm-et-4 2018-05-14 18:56 00:33:02 2000421 219 86 3 130 +138.59 +/- 27.59 Show
37638 ncm-et-15 2018-05-14 18:57 00:32:01 2016610 209 114 4 91 +203.26 +/- 35.11 Show
37639 ncm-et-9 2018-05-14 18:57 00:32:02 2025572 214 103 6 105 +169.83 +/- 32.40 Show
37640 ncm-et-11 2018-05-14 18:57 00:32:04 2019858 212 92 4 116 +153.48 +/- 30.00 Show
37641 ncm-et-12 2018-05-14 18:58 00:31:19 2020673 209 98 7 104 +162.10 +/- 32.61 Show
37642 ncm-et-3 2018-05-14 18:58 00:31:25 2024100 209 92 5 112 +153.97 +/- 30.80 Show
37643 ncm-et-5 2018-05-14 18:58 00:30:52 2020512 199 102 7 90 +180.53 +/- 35.51 Show
37644 ncm-et-16 2018-05-14 18:59 00:30:49 2022303 205 81 5 119 +135.25 +/- 29.34 Show
37645 ncm-et-8 2018-05-14 18:59 00:30:42 2024100 207 104 9 94 +172.32 +/- 34.86 Show
58527 ncm-et-4 2018-08-21 14:17 01:15:24 1989559 500 229 17 254 +157.24 +/- 20.75 Show
58528 ncm-et-3 2018-08-21 14:17 01:14:53 1990191 500 239 8 253 +173.67 +/- 20.52 Show
58529 ncm-et-10 2018-08-21 14:17 01:15:25 1982008 500 233 15 252 +162.35 +/- 20.81 Show
58530 ncm-et-13 2018-08-21 14:17 01:18:00 1964697 500 243 14 243 +171.90 +/- 21.27 Show
58531 ncm-et-9 2018-08-21 14:17 01:17:20 1989558 500 233 16 251 +161.49 +/- 20.89 Show
58532 ncm-et-15 2018-08-21 14:17 01:15:51 1953329 500 257 13 230 +185.33 +/- 21.98 Show
58533 ncm-et-3 2018-08-21 15:33 01:16:56 1990508 500 234 17 249 +161.49 +/- 21.02 Show
58534 ncm-et-4 2018-08-21 15:34 01:15:56 1989401 500 235 14 251 +164.93 +/- 20.83 Show
58535 ncm-et-10 2018-08-21 15:34 01:17:01 1941759 500 242 16 242 +169.27 +/- 21.38 Show
58536 ncm-et-15 2018-08-21 15:34 01:18:52 1946476 500 232 16 252 +160.64 +/- 20.83 Show
58537 ncm-et-9 2018-08-21 15:36 01:16:53 1988296 500 242 8 250 +176.33 +/- 20.68 Show
58538 ncm-et-13 2018-08-21 15:36 01:20:08 1886979 500 212 14 274 +145.54 +/- 19.63 Show
58539 ncm-et-4 2018-08-21 16:51 01:16:37 1988769 500 235 21 244 +158.93 +/- 21.39 Show
58540 ncm-et-3 2018-08-21 16:51 01:15:00 1992088 500 240 12 248 +171.02 +/- 20.93 Show
58541 ncm-et-10 2018-08-21 16:52 01:16:12 1980911 500 254 14 232 +181.70 +/- 21.89 Show
58542 ncm-et-9 2018-08-21 16:54 01:15:41 1989401 500 233 17 250 +160.64 +/- 20.97 Show
58543 ncm-et-15 2018-08-21 16:54 01:16:01 1982165 500 235 13 252 +165.80 +/- 20.75 Show
58544 ncm-et-13 2018-08-21 16:57 01:17:45 1958613 500 256 18 226 +179.90 +/- 22.34 Show
58545 ncm-et-3 2018-08-21 18:07 00:29:50 1989402 190 82 4 104 +151.57 +/- 31.76 Show
58546 ncm-et-4 2018-08-21 18:08 00:28:46 1989401 186 85 1 100 +169.11 +/- 31.98 Show
58547 ncm-et-10 2018-08-21 18:09 00:28:00 1935020 167 83 4 80 +178.58 +/- 37.19 Show
58548 ncm-et-9 2018-08-21 18:10 00:26:28 1985776 179 82 6 91 +157.48 +/- 34.77 Show
58549 ncm-et-15 2018-08-21 18:11 00:25:48 1939641 157 70 6 81 +150.36 +/- 36.90 Show
58550 ncm-et-13 2018-08-21 18:16 00:20:37 1926985 121 58 6 57 +159.68 +/- 44.87 Show

Commit

Commit ID bf01bd07551dd4e2d68d82b305cc5d89a4c23bb0
Author Stéphane Nicolet
Date 2018-05-13 05:20:39 UTC
Commit Type Elo
Tweak kingAttackersCount and KingAttackWeights

Use the whole kingRing for pawn attackers instead of only the squares directly
around the king. This tends to give quite a lot more kingAttackersCount, so to
compensate and to avoid raising the  king danger too fast we lower the values
in the KingAttackWeights array a little bit.

STC:
LLR: 2.95 (-2.94,2.94) [0.00,4.00]
Total: 51892 W: 10723 L: 10369 D: 30800
http://tests.stockfishchess.org/tests/view/5af6d4dd0ebc5968e652428e

LTC:
LLR: 2.96 (-2.94,2.94) [0.00,4.00]
Total: 24536 W: 3737 L: 3515 D: 17284
http://tests.stockfishchess.org/tests/view/5af709890ebc5968e65242ac

Credits to user @xoroshiro for the idea of using the kingRing for pawn attackers.

How to continue? It seems that the KingAttackWeights[] array stores values
which are quite Elo-sensitive, yet they have not been tuned with SPSA recently.
There might be easy Elo points to get there.

Closes https://github.com/official-stockfish/Stockfish/pull/1597

Bench: 5282815