Dev Builds » 20171203-1124

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-13 13:50 4631:58:28 2001456 2421 938 87 1396 +127.57 +/- 8.64
ncm-et-4 2018-03-13 13:50 4631:58:18 1998657 2467 955 93 1419 +126.74 +/- 8.58
ncm-et-5 2018-03-13 13:50 09:50:11 2019624 766 318 23 425 +141.08 +/- 15.73
ncm-et-6 2018-03-13 13:50 09:50:07 2026555 769 298 32 439 +125.35 +/- 15.51
ncm-et-7 2018-03-13 13:50 09:50:20 2011198 766 308 23 435 +135.78 +/- 15.47
ncm-et-8 2018-03-13 13:50 09:50:10 1991037 779 310 33 436 +129.18 +/- 15.64
ncm-et-9 2018-03-13 13:50 4631:58:11 2001596 2469 926 72 1471 +125.34 +/- 8.29
ncm-et-10 2018-03-13 13:50 4631:58:15 1994955 2423 924 86 1413 +125.33 +/- 8.56
ncm-et-11 2018-03-13 13:50 09:50:25 1997649 764 304 23 437 +134.07 +/- 15.41
ncm-et-12 2018-03-13 13:50 09:50:20 2003583 768 334 24 410 +148.70 +/- 16.16
ncm-et-13 2018-03-13 13:50 4631:58:27 1986643 2438 943 77 1418 +129.03 +/- 8.52
ncm-et-14 2018-03-13 13:50 09:50:23 2018721 769 294 28 447 +125.35 +/- 15.25
ncm-et-15 2018-03-13 13:50 4631:58:28 1974165 2402 932 58 1412 +132.49 +/- 8.46
  20001 7784 659 11558 +129.44 +/- 2.99

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
8147 ncm-et-13 2018-03-13 13:50 01:12:09 2022303 500 206 16 278 +138.99 +/- 19.48 Show
8148 ncm-et-11 2018-03-13 13:50 01:13:16 1988716 500 202 16 282 +135.76 +/- 19.28 Show
8149 ncm-et-4 2018-03-13 13:50 01:15:21 2012405 500 182 19 299 +117.55 +/- 18.53 Show
8150 ncm-et-15 2018-03-13 13:50 01:13:13 2018721 500 198 12 290 +135.76 +/- 18.76 Show
8151 ncm-et-3 2018-03-13 13:50 01:13:49 2024920 500 193 28 279 +119.11 +/- 19.72 Show
8152 ncm-et-12 2018-03-13 13:50 01:14:14 2019371 500 220 18 262 +148.85 +/- 20.36 Show
8153 ncm-et-10 2018-03-13 13:50 01:12:56 2022793 500 200 19 281 +131.74 +/- 19.42 Show
8154 ncm-et-14 2018-03-13 13:50 01:14:32 2017420 500 195 14 291 +131.74 +/- 18.77 Show
8155 ncm-et-7 2018-03-13 13:50 01:14:34 2025245 500 206 16 278 +138.99 +/- 19.48 Show
8156 ncm-et-5 2018-03-13 13:50 01:12:12 2019225 500 204 16 280 +137.37 +/- 19.38 Show
8157 ncm-et-9 2018-03-13 13:50 01:15:03 2026718 500 206 13 281 +141.44 +/- 19.24 Show
8158 ncm-et-8 2018-03-13 13:50 01:15:59 1962213 500 200 18 282 +132.54 +/- 19.34 Show
8159 ncm-et-6 2018-03-13 13:50 01:13:54 2027211 500 206 22 272 +134.15 +/- 19.95 Show
8264 ncm-et-14 2018-03-13 23:01 00:40:03 2020021 269 99 14 156 +113.67 +/- 26.13 Show
8265 ncm-et-13 2018-03-13 23:01 00:39:53 2025247 272 114 7 151 +144.46 +/- 26.35 Show
8266 ncm-et-4 2018-03-13 23:01 00:39:44 2025245 264 103 7 154 +132.40 +/- 25.79 Show
8267 ncm-et-8 2018-03-13 23:01 00:39:53 2019860 279 110 15 154 +123.22 +/- 26.61 Show
8268 ncm-et-5 2018-03-13 23:01 00:39:49 2020022 266 114 7 145 +148.12 +/- 27.01 Show
8269 ncm-et-9 2018-03-13 23:01 00:39:48 2025572 270 100 5 165 +127.70 +/- 24.37 Show
8270 ncm-et-11 2018-03-13 23:01 00:39:53 2006581 264 102 7 155 +130.88 +/- 25.66 Show
8271 ncm-et-10 2018-03-13 23:01 00:39:54 2019370 267 107 10 150 +132.26 +/- 26.60 Show
8272 ncm-et-12 2018-03-13 23:01 00:39:50 1987794 268 114 6 148 +148.43 +/- 26.57 Show
8273 ncm-et-15 2018-03-13 23:01 00:39:52 2018720 279 122 11 146 +146.30 +/- 27.38 Show
8274 ncm-et-3 2018-03-13 23:01 00:39:52 2025735 267 104 7 156 +132.26 +/- 25.60 Show
8275 ncm-et-6 2018-03-13 23:01 00:39:46 2025899 269 92 10 167 +109.39 +/- 24.51 Show
8276 ncm-et-7 2018-03-13 23:01 00:39:44 1997151 266 102 7 157 +129.80 +/- 25.45 Show
62631 ncm-et-3 2018-09-22 09:35 01:15:54 1989560 500 193 17 290 +127.76 +/- 18.91 Show
62632 ncm-et-9 2018-09-22 09:35 01:15:02 1988296 500 192 12 296 +130.94 +/- 18.46 Show
62633 ncm-et-10 2018-09-22 09:35 01:16:40 1981227 500 184 15 301 +122.24 +/- 18.31 Show
62634 ncm-et-13 2018-09-22 09:35 01:13:46 1986569 500 169 11 320 +113.68 +/- 17.25 Show
62635 ncm-et-15 2018-09-22 09:35 01:18:34 1862462 500 174 13 313 +116.00 +/- 17.66 Show
62636 ncm-et-4 2018-09-22 09:35 01:14:07 1989718 500 193 23 284 +123.02 +/- 19.37 Show
62637 ncm-et-13 2018-09-22 10:50 01:16:50 1946836 500 198 22 280 +127.76 +/- 19.54 Show
62638 ncm-et-4 2018-09-22 10:50 01:12:29 1987193 500 190 15 295 +126.97 +/- 18.61 Show
62639 ncm-et-9 2018-09-22 10:51 01:13:27 1988927 500 169 12 319 +112.91 +/- 17.33 Show
62640 ncm-et-3 2018-09-22 10:52 01:16:23 1988454 500 194 17 289 +128.55 +/- 18.96 Show
62641 ncm-et-10 2018-09-22 10:52 01:15:05 1982166 500 181 18 301 +117.55 +/- 18.40 Show
62642 ncm-et-15 2018-09-22 10:54 01:16:28 1980598 500 204 10 286 +142.26 +/- 18.88 Show
62643 ncm-et-4 2018-09-22 12:04 01:14:18 1987035 500 208 21 271 +136.56 +/- 19.97 Show
62644 ncm-et-9 2018-09-22 12:05 01:12:41 1990822 500 185 21 294 +118.33 +/- 18.83 Show
62645 ncm-et-13 2018-09-22 12:07 01:15:08 1970822 500 193 16 291 +128.55 +/- 18.83 Show
62646 ncm-et-10 2018-09-22 12:09 01:15:03 1983262 500 185 16 299 +122.24 +/- 18.44 Show
62647 ncm-et-3 2018-09-22 12:09 01:14:45 1990032 500 197 14 289 +133.34 +/- 18.87 Show
62648 ncm-et-15 2018-09-22 12:12 01:16:36 1981852 500 198 9 293 +138.18 +/- 18.50 Show
62649 ncm-et-4 2018-09-22 13:19 00:29:27 1990348 203 79 8 116 +126.87 +/- 30.20 Show
62650 ncm-et-9 2018-09-22 13:19 00:29:25 1989243 199 74 9 116 +117.80 +/- 30.16 Show
62651 ncm-et-13 2018-09-22 13:24 00:24:54 1968081 166 63 5 98 +126.73 +/- 32.36 Show
62652 ncm-et-10 2018-09-22 13:25 00:23:44 1980914 156 67 8 81 +138.27 +/- 37.12 Show
62653 ncm-et-3 2018-09-22 13:25 00:23:44 1990033 154 57 4 93 +124.66 +/- 32.89 Show
62654 ncm-et-15 2018-09-22 13:30 00:18:59 1982635 123 36 3 84 +95.55 +/- 32.83 Show

Commit

Commit ID 8a5a64eac563ff755048d40f6a5046ea4dcf0154
Author syzygy
Date 2017-12-03 11:24:46 UTC
Commit Type Non Functional
Minor cleanup of search.cpp

Four very minor edits. Note that tte->save() uses posKey and
not pos.key() in other places.

Originally I also added a futility_move_counts() function to
make things more consistent with the futility_margin() and
reduction() functions. But then razor_margin[] should probably
also be turned into a function, etc. Maybe a good idea, maybe not.
So I did not include it.

Non functional change.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4991 1940 100 2951 +134.41 +/- 5.82
ncm-et-4 5009 1893 116 3000 +128.86 +/- 5.77
  10000 3833 216 5951 +131.62 +/- 4.10