Dev Builds » 20170101-0956

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-06 20:24 7003:26:36 1986220 2461 746 102 1613 +93.08 +/- 7.73
ncm-et-4 2018-03-06 20:24 7003:26:26 1978276 2477 757 116 1604 +92.00 +/- 7.83
ncm-et-5 2018-03-06 20:24 01:46:40 2024264 716 208 27 481 +89.78 +/- 13.97
ncm-et-6 2018-03-06 20:24 01:46:30 2026803 724 195 37 492 +77.06 +/- 13.87
ncm-et-7 2018-03-06 20:24 01:46:28 1977447 721 229 27 465 +100.01 +/- 14.46
ncm-et-8 2018-03-06 20:24 01:46:38 1979507 703 213 36 454 +89.40 +/- 14.78
ncm-et-9 2018-03-06 20:24 7003:26:28 1984627 2487 761 103 1623 +94.16 +/- 7.72
ncm-et-10 2018-03-06 20:24 7003:26:38 1984898 2472 723 115 1634 +87.24 +/- 7.68
ncm-et-11 2018-03-06 20:24 01:46:28 2018965 718 204 28 486 +86.94 +/- 13.86
ncm-et-12 2018-03-06 20:24 01:46:01 1989095 699 195 42 462 +77.30 +/- 14.59
ncm-et-13 2018-03-06 20:24 7003:26:42 1994136 2514 761 104 1649 +92.95 +/- 7.65
ncm-et-14 2018-03-06 20:24 01:46:36 2018316 710 210 22 478 +94.24 +/- 13.91
ncm-et-15 2018-03-06 20:24 7003:26:39 1579331 1890 546 94 1250 +84.73 +/- 8.80
ncm-et-16 2018-03-06 20:24 01:45:57 2000549 708 213 30 465 +91.89 +/- 14.41
  20000 5961 883 13156 +90.19 +/- 2.71

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
5742 ncm-et-8 2018-03-06 20:24 01:14:05 2015714 500 161 31 308 +92.46 +/- 18.37 Show
5743 ncm-et-5 2018-03-06 20:24 01:13:04 2023772 500 140 22 338 +83.57 +/- 16.70 Show
5744 ncm-et-14 2018-03-06 20:24 01:14:02 2017749 500 152 14 334 +98.44 +/- 16.67 Show
5745 ncm-et-15 2018-03-06 20:24 01:13:39 2016447 500 127 22 351 +74.06 +/- 16.04 Show
5746 ncm-et-13 2018-03-06 20:24 01:12:02 2025245 500 149 21 330 +90.97 +/- 17.07 Show
5747 ncm-et-6 2018-03-06 20:24 01:13:03 2026227 500 140 23 337 +82.83 +/- 16.77 Show
5748 ncm-et-3 2018-03-06 20:24 01:13:21 2024427 500 158 18 324 +99.95 +/- 17.28 Show
5749 ncm-et-10 2018-03-06 20:24 01:13:56 2021325 500 133 22 345 +78.44 +/- 16.35 Show
5750 ncm-et-7 2018-03-06 20:24 01:12:48 2001412 500 150 20 330 +92.46 +/- 17.04 Show
5751 ncm-et-9 2018-03-06 20:24 01:13:36 2023773 500 150 24 326 +89.48 +/- 17.34 Show
5752 ncm-et-12 2018-03-06 20:24 01:14:08 1989406 500 141 23 336 +83.57 +/- 16.82 Show
5753 ncm-et-11 2018-03-06 20:24 01:12:45 2018721 500 138 21 341 +82.83 +/- 16.52 Show
5754 ncm-et-4 2018-03-06 20:24 01:12:56 2024590 500 135 26 339 +76.98 +/- 16.74 Show
5755 ncm-et-16 2018-03-06 20:24 01:13:18 2021652 500 147 20 333 +90.22 +/- 16.89 Show
5756 ncm-et-13 2018-03-06 21:37 00:33:04 2024263 230 73 8 149 +100.94 +/- 25.48 Show
5757 ncm-et-7 2018-03-06 21:38 00:32:16 1953482 221 79 7 135 +117.47 +/- 27.30 Show
5758 ncm-et-11 2018-03-06 21:38 00:32:19 2019209 218 66 7 145 +96.43 +/- 25.47 Show
5759 ncm-et-5 2018-03-06 21:38 00:32:13 2024755 216 68 5 143 +104.37 +/- 25.49 Show
5760 ncm-et-6 2018-03-06 21:38 00:32:04 2027379 224 55 14 155 +64.32 +/- 24.68 Show
5761 ncm-et-4 2018-03-06 21:38 00:32:10 2023936 221 91 11 119 +131.74 +/- 30.37 Show
5762 ncm-et-3 2018-03-06 21:39 00:31:44 2026226 213 72 5 136 +113.12 +/- 26.56 Show
5763 ncm-et-16 2018-03-06 21:39 00:31:16 1979446 208 66 10 132 +95.90 +/- 27.58 Show
5764 ncm-et-15 2018-03-06 21:39 00:31:22 2018070 213 66 16 131 +83.11 +/- 28.39 Show
5765 ncm-et-9 2018-03-06 21:39 00:31:30 2024263 217 58 10 149 +78.14 +/- 25.01 Show
5766 ncm-et-10 2018-03-06 21:39 00:31:10 2020021 207 51 8 148 +73.24 +/- 24.34 Show
5767 ncm-et-14 2018-03-06 21:39 00:31:10 2018883 210 58 8 144 +84.34 +/- 25.30 Show
5768 ncm-et-8 2018-03-06 21:39 00:31:08 1943300 203 52 5 146 +81.93 +/- 24.08 Show
5769 ncm-et-12 2018-03-06 21:40 00:30:28 1988783 199 54 19 126 +61.75 +/- 28.90 Show
121638 ncm-et-15 2018-12-23 11:24 -1:59:09 1559344 0 0 0 0 +NaN +/- NaN Show
121639 ncm-et-4 2018-12-23 11:24 01:14:27 1961689 500 145 22 333 +87.26 +/- 16.94 Show
121640 ncm-et-10 2018-12-23 11:24 01:15:39 1960019 500 148 30 322 +83.57 +/- 17.67 Show
121641 ncm-et-3 2018-12-23 11:24 01:17:38 1963382 500 142 23 335 +84.31 +/- 16.87 Show
121642 ncm-et-9 2018-12-23 11:24 01:13:53 1965232 500 156 15 329 +100.71 +/- 16.94 Show
121643 ncm-et-13 2018-12-23 11:24 01:13:59 1980443 500 158 16 326 +101.46 +/- 17.12 Show
121644 ncm-et-15 2018-12-23 11:25 -1:59:08 1558568 0 0 0 0 +NaN +/- NaN Show
121645 ncm-et-15 2018-12-23 11:26 -1:59:08 1559247 0 0 0 0 +NaN +/- NaN Show
121646 ncm-et-15 2018-12-23 11:27 -1:59:08 1557309 0 0 0 0 +NaN +/- NaN Show
121647 ncm-et-15 2018-12-23 11:28 -1:59:08 1554413 0 0 0 0 +NaN +/- NaN Show
121648 ncm-et-15 2018-12-23 11:29 -1:59:08 1559344 0 0 0 0 +NaN +/- NaN Show
121649 ncm-et-15 2018-12-23 11:30 -1:59:08 1557890 0 0 0 0 +NaN +/- NaN Show
121650 ncm-et-15 2018-12-23 11:31 -1:59:08 1563058 0 0 0 0 +NaN +/- NaN Show
121651 ncm-et-15 2018-12-23 11:33 -1:59:08 1557020 0 0 0 0 +NaN +/- NaN Show
121652 ncm-et-15 2018-12-23 11:34 -1:59:07 1555955 0 0 0 0 +NaN +/- NaN Show
121653 ncm-et-15 2018-12-23 11:35 -1:59:08 1557986 0 0 0 0 +NaN +/- NaN Show
121654 ncm-et-15 2018-12-23 11:36 -1:59:08 1556054 0 0 0 0 +NaN +/- NaN Show
121655 ncm-et-15 2018-12-23 11:37 -1:59:08 1558181 0 0 0 0 +NaN +/- NaN Show
121656 ncm-et-15 2018-12-23 11:38 -1:59:08 1556737 0 0 0 0 +NaN +/- NaN Show
121657 ncm-et-15 2018-12-23 11:39 -1:59:07 1553641 0 0 0 0 +NaN +/- NaN Show
121658 ncm-et-15 2018-12-23 11:41 -1:59:06 1557798 0 0 0 0 +NaN +/- NaN Show
121659 ncm-et-15 2018-12-23 11:42 -1:59:07 1555376 0 0 0 0 +NaN +/- NaN Show
121660 ncm-et-15 2018-12-23 11:43 -1:59:08 1563054 0 0 0 0 +NaN +/- NaN Show
121661 ncm-et-15 2018-12-23 11:44 -1:59:07 1557021 0 0 0 0 +NaN +/- NaN Show
121662 ncm-et-15 2018-12-23 11:45 -1:59:08 1555184 0 0 0 0 +NaN +/- NaN Show
121663 ncm-et-15 2018-12-23 11:46 -1:59:08 1558278 0 0 0 0 +NaN +/- NaN Show
121664 ncm-et-15 2018-12-23 11:47 -1:59:08 1573528 0 0 0 0 +NaN +/- NaN Show
121665 ncm-et-15 2018-12-23 11:48 -1:59:08 1558277 0 0 0 0 +NaN +/- NaN Show
121666 ncm-et-15 2018-12-23 11:50 -1:59:08 1557502 0 0 0 0 +NaN +/- NaN Show
121667 ncm-et-15 2018-12-23 11:51 -1:59:08 1556539 0 0 0 0 +NaN +/- NaN Show
121668 ncm-et-15 2018-12-23 11:52 -1:59:07 1554607 0 0 0 0 +NaN +/- NaN Show
121669 ncm-et-15 2018-12-23 11:53 -1:59:08 1559538 0 0 0 0 +NaN +/- NaN Show
121670 ncm-et-15 2018-12-23 11:54 -1:59:07 1556535 0 0 0 0 +NaN +/- NaN Show
121671 ncm-et-15 2018-12-23 11:55 -1:59:07 1555280 0 0 0 0 +NaN +/- NaN Show
121672 ncm-et-15 2018-12-23 11:56 -1:59:08 1557219 0 0 0 0 +NaN +/- NaN Show
121673 ncm-et-15 2018-12-23 11:57 -1:59:07 1555285 0 0 0 0 +NaN +/- NaN Show
121674 ncm-et-15 2018-12-23 11:59 -1:59:09 1619217 0 0 0 0 +NaN +/- NaN Show
121675 ncm-et-15 2018-12-23 12:00 -1:59:08 1559732 0 0 0 0 +NaN +/- NaN Show
121676 ncm-et-15 2018-12-23 12:01 -1:59:08 1556056 0 0 0 0 +NaN +/- NaN Show
121677 ncm-et-15 2018-12-23 12:02 -1:59:07 1555280 0 0 0 0 +NaN +/- NaN Show
121678 ncm-et-15 2018-12-23 12:03 -1:59:08 1555572 0 0 0 0 +NaN +/- NaN Show
121679 ncm-et-15 2018-12-23 12:04 -1:59:07 1554123 0 0 0 0 +NaN +/- NaN Show
121680 ncm-et-15 2018-12-23 12:05 -1:59:07 1553834 0 0 0 0 +NaN +/- NaN Show
121681 ncm-et-15 2018-12-23 12:06 -1:59:08 1554412 0 0 0 0 +NaN +/- NaN Show
121682 ncm-et-15 2018-12-23 12:08 -1:59:08 1558956 0 0 0 0 +NaN +/- NaN Show
121683 ncm-et-15 2018-12-23 12:09 -1:59:08 1555765 0 0 0 0 +NaN +/- NaN Show
121684 ncm-et-15 2018-12-23 12:10 -1:59:08 1553931 0 0 0 0 +NaN +/- NaN Show
121685 ncm-et-15 2018-12-23 12:11 -1:59:08 1556728 0 0 0 0 +NaN +/- NaN Show
121686 ncm-et-15 2018-12-23 12:12 -1:59:08 1557309 0 0 0 0 +NaN +/- NaN Show
121687 ncm-et-15 2018-12-23 12:13 -1:59:07 1554799 0 0 0 0 +NaN +/- NaN Show
121688 ncm-et-15 2018-12-23 12:14 -1:59:08 1559155 0 0 0 0 +NaN +/- NaN Show
121689 ncm-et-15 2018-12-23 12:15 -1:59:08 1558569 0 0 0 0 +NaN +/- NaN Show
121690 ncm-et-15 2018-12-23 12:17 -1:59:08 1556923 0 0 0 0 +NaN +/- NaN Show
121691 ncm-et-15 2018-12-23 12:18 -1:59:07 1551046 0 0 0 0 +NaN +/- NaN Show
121692 ncm-et-15 2018-12-23 12:19 -1:59:08 1552876 0 0 0 0 +NaN +/- NaN Show
121693 ncm-et-15 2018-12-23 12:20 -1:59:09 1558956 0 0 0 0 +NaN +/- NaN Show
121694 ncm-et-15 2018-12-23 12:21 -1:59:08 1557117 0 0 0 0 +NaN +/- NaN Show
121695 ncm-et-15 2018-12-23 12:22 -1:59:09 1560314 0 0 0 0 +NaN +/- NaN Show
121696 ncm-et-15 2018-12-23 12:23 -1:59:07 1557697 0 0 0 0 +NaN +/- NaN Show
121697 ncm-et-15 2018-12-23 12:24 -1:59:08 1554221 0 0 0 0 +NaN +/- NaN Show
121698 ncm-et-15 2018-12-23 12:26 01:17:43 1911212 500 161 28 311 +94.70 +/- 18.16 Show
121699 ncm-et-9 2018-12-23 12:39 01:14:56 1966017 500 159 23 318 +96.94 +/- 17.70 Show
121700 ncm-et-13 2018-12-23 12:39 01:13:32 1973897 500 153 23 324 +92.46 +/- 17.41 Show
121701 ncm-et-4 2018-12-23 12:39 01:13:25 1963686 500 156 21 323 +96.19 +/- 17.41 Show
121702 ncm-et-10 2018-12-23 12:40 01:13:16 1977689 500 147 25 328 +86.52 +/- 17.26 Show
121703 ncm-et-3 2018-12-23 12:42 01:14:32 1976217 500 149 25 326 +88.00 +/- 17.36 Show
121704 ncm-et-15 2018-12-23 13:44 01:31:30 1550662 500 148 19 333 +91.71 +/- 16.86 Show
121705 ncm-et-13 2018-12-23 13:54 01:13:18 1974684 500 152 26 322 +89.48 +/- 17.58 Show
121706 ncm-et-4 2018-12-23 13:54 01:16:16 1964917 500 148 25 327 +87.26 +/- 17.31 Show
121707 ncm-et-10 2018-12-23 13:55 01:14:03 1962787 500 151 23 326 +90.97 +/- 17.31 Show
121708 ncm-et-9 2018-12-23 13:55 01:14:51 1960462 500 150 21 329 +91.71 +/- 17.11 Show
121709 ncm-et-3 2018-12-23 13:58 01:14:27 1963688 500 142 22 336 +85.04 +/- 16.80 Show
121710 ncm-et-13 2018-12-23 15:08 00:42:37 1986282 284 76 10 198 +82.24 +/- 21.31 Show
121711 ncm-et-10 2018-12-23 15:10 00:40:46 1967547 265 93 7 165 +116.98 +/- 24.40 Show
121712 ncm-et-9 2018-12-23 15:11 00:39:51 1968016 270 88 10 172 +103.31 +/- 23.92 Show
121713 ncm-et-4 2018-12-23 15:11 00:39:27 1930839 256 82 11 163 +98.95 +/- 24.69 Show
121714 ncm-et-3 2018-12-23 15:14 00:36:58 1963378 248 83 9 156 +106.92 +/- 25.22 Show
121715 ncm-et-15 2018-12-23 15:17 00:33:26 1555087 177 44 9 124 +69.62 +/- 27.20 Show

Commit

Commit ID 881a9dfb0a8fec3b1472791e2d98415e4a9a182a
Author Sergei Antonov
Date 2017-01-01 09:56:46 UTC
Commit Type Simplification
Threefold repetition detection

Implement a threefold repetition detection. Below are the examples of
problems fixed by this change.

    Loosing move in a drawn position.
    position fen 8/k7/3p4/p2P1p2/P2P1P2/8/8/K7 w - - 0 1 moves a1a2 a7a8 a2a1
    The old code suggested a loosing move "bestmove a8a7", the new code suggests "bestmove a8b7" leading to a draw.

    Incorrect evaluation (happened in a real game in TCEC Season 9).
    position fen 4rbkr/1q3pp1/b3pn2/7p/1pN5/1P1BBP1P/P1R2QP1/3R2K1 w - - 5 31 moves e3d4 h8h6 d4e3
    The old code evaluated it as "cp 0", the new code evaluation is around "cp -50" which is adequate.

Brings 0.5-1 ELO gain. Passes [-3.00,1.00].

STC: http://tests.stockfishchess.org/tests/view/584ece040ebc5903140c5aea
LLR: 2.96 (-2.94,2.94) [-3.00,1.00]
Total: 47744 W: 8537 L: 8461 D: 30746

LTC: http://tests.stockfishchess.org/tests/view/584f134d0ebc5903140c5b37
LLR: 2.96 (-2.94,2.94) [-3.00,1.00]
Total: 36775 W: 4739 L: 4639 D: 27397

Patch has been rewritten into current form for simplification and
logic slightly changed so that return a draw score if the position
repeats once earlier but after or at the root, or repeats twice
strictly before the root. In its original form, repetition at root
was not returned as an immediate draw.

After retestimng testing both version with SPRT[-3, 1], both passed
succesfully, but this version was chosen becuase more natural. There is
an argument about MultiPV in which an extended draw at root may be sensible.
See discussion here:

   https://github.com/official-stockfish/Stockfish/pull/925

For documentation, current version passed both at STC and LTC:

STC
LLR: 2.96 (-2.94,2.94) [-3.00,1.00]
Total: 51562 W: 9314 L: 9245 D: 33003

LTC
LLR: 2.96 (-2.94,2.94) [-3.00,1.00]
Total: 115663 W: 14904 L: 14906 D: 85853

bench: 5468995

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4992 1403 156 3433 +88.67 +/- 5.13
ncm-et-4 5008 1429 147 3432 +90.96 +/- 5.13
  10000 2832 303 6865 +89.82 +/- 3.63