Dev Builds » 20171203-1124

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-13 13:50 4631:58:28 2001456 2421 938 87 1396 +127.57 +/- 8.64
ncm-et-4 2018-03-13 13:50 4631:58:18 1998657 2467 955 93 1419 +126.74 +/- 8.58
ncm-et-5 2018-03-13 13:50 09:50:11 2019624 766 318 23 425 +141.08 +/- 15.73
ncm-et-6 2018-03-13 13:50 09:50:07 2026555 769 298 32 439 +125.35 +/- 15.51
ncm-et-7 2018-03-13 13:50 09:50:20 2011198 766 308 23 435 +135.78 +/- 15.47
ncm-et-8 2018-03-13 13:50 09:50:10 1991037 779 310 33 436 +129.18 +/- 15.64
ncm-et-9 2018-03-13 13:50 4631:58:11 2001596 2469 926 72 1471 +125.34 +/- 8.29
ncm-et-10 2018-03-13 13:50 4631:58:15 1994955 2423 924 86 1413 +125.33 +/- 8.56
ncm-et-11 2018-03-13 13:50 09:50:25 1997649 764 304 23 437 +134.07 +/- 15.41
ncm-et-12 2018-03-13 13:50 09:50:20 2003583 768 334 24 410 +148.70 +/- 16.16
ncm-et-13 2018-03-13 13:50 4631:58:27 1986643 2438 943 77 1418 +129.03 +/- 8.52
ncm-et-14 2018-03-13 13:50 09:50:23 2018721 769 294 28 447 +125.35 +/- 15.25
ncm-et-15 2018-03-13 13:50 4631:58:28 1974165 2402 932 58 1412 +132.49 +/- 8.46
  20001 7784 659 11558 +129.44 +/- 2.99

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
8147 ncm-et-13 2018-03-13 13:50 01:12:09 2022303 500 206 16 278 +138.99 +/- 19.48 Show
8148 ncm-et-11 2018-03-13 13:50 01:13:16 1988716 500 202 16 282 +135.76 +/- 19.28 Show
8149 ncm-et-4 2018-03-13 13:50 01:15:21 2012405 500 182 19 299 +117.55 +/- 18.53 Show
8150 ncm-et-15 2018-03-13 13:50 01:13:13 2018721 500 198 12 290 +135.76 +/- 18.76 Show
8151 ncm-et-3 2018-03-13 13:50 01:13:49 2024920 500 193 28 279 +119.11 +/- 19.72 Show
8152 ncm-et-12 2018-03-13 13:50 01:14:14 2019371 500 220 18 262 +148.85 +/- 20.36 Show
8153 ncm-et-10 2018-03-13 13:50 01:12:56 2022793 500 200 19 281 +131.74 +/- 19.42 Show
8154 ncm-et-14 2018-03-13 13:50 01:14:32 2017420 500 195 14 291 +131.74 +/- 18.77 Show
8155 ncm-et-7 2018-03-13 13:50 01:14:34 2025245 500 206 16 278 +138.99 +/- 19.48 Show
8156 ncm-et-5 2018-03-13 13:50 01:12:12 2019225 500 204 16 280 +137.37 +/- 19.38 Show
8157 ncm-et-9 2018-03-13 13:50 01:15:03 2026718 500 206 13 281 +141.44 +/- 19.24 Show
8158 ncm-et-8 2018-03-13 13:50 01:15:59 1962213 500 200 18 282 +132.54 +/- 19.34 Show
8159 ncm-et-6 2018-03-13 13:50 01:13:54 2027211 500 206 22 272 +134.15 +/- 19.95 Show
8264 ncm-et-14 2018-03-13 23:01 00:40:03 2020021 269 99 14 156 +113.67 +/- 26.13 Show
8265 ncm-et-13 2018-03-13 23:01 00:39:53 2025247 272 114 7 151 +144.46 +/- 26.35 Show
8266 ncm-et-4 2018-03-13 23:01 00:39:44 2025245 264 103 7 154 +132.40 +/- 25.79 Show
8267 ncm-et-8 2018-03-13 23:01 00:39:53 2019860 279 110 15 154 +123.22 +/- 26.61 Show
8268 ncm-et-5 2018-03-13 23:01 00:39:49 2020022 266 114 7 145 +148.12 +/- 27.01 Show
8269 ncm-et-9 2018-03-13 23:01 00:39:48 2025572 270 100 5 165 +127.70 +/- 24.37 Show
8270 ncm-et-11 2018-03-13 23:01 00:39:53 2006581 264 102 7 155 +130.88 +/- 25.66 Show
8271 ncm-et-10 2018-03-13 23:01 00:39:54 2019370 267 107 10 150 +132.26 +/- 26.60 Show
8272 ncm-et-12 2018-03-13 23:01 00:39:50 1987794 268 114 6 148 +148.43 +/- 26.57 Show
8273 ncm-et-15 2018-03-13 23:01 00:39:52 2018720 279 122 11 146 +146.30 +/- 27.38 Show
8274 ncm-et-3 2018-03-13 23:01 00:39:52 2025735 267 104 7 156 +132.26 +/- 25.60 Show
8275 ncm-et-6 2018-03-13 23:01 00:39:46 2025899 269 92 10 167 +109.39 +/- 24.51 Show
8276 ncm-et-7 2018-03-13 23:01 00:39:44 1997151 266 102 7 157 +129.80 +/- 25.45 Show
62631 ncm-et-3 2018-09-22 09:35 01:15:54 1989560 500 193 17 290 +127.76 +/- 18.91 Show
62632 ncm-et-9 2018-09-22 09:35 01:15:02 1988296 500 192 12 296 +130.94 +/- 18.46 Show
62633 ncm-et-10 2018-09-22 09:35 01:16:40 1981227 500 184 15 301 +122.24 +/- 18.31 Show
62634 ncm-et-13 2018-09-22 09:35 01:13:46 1986569 500 169 11 320 +113.68 +/- 17.25 Show
62635 ncm-et-15 2018-09-22 09:35 01:18:34 1862462 500 174 13 313 +116.00 +/- 17.66 Show
62636 ncm-et-4 2018-09-22 09:35 01:14:07 1989718 500 193 23 284 +123.02 +/- 19.37 Show
62637 ncm-et-13 2018-09-22 10:50 01:16:50 1946836 500 198 22 280 +127.76 +/- 19.54 Show
62638 ncm-et-4 2018-09-22 10:50 01:12:29 1987193 500 190 15 295 +126.97 +/- 18.61 Show
62639 ncm-et-9 2018-09-22 10:51 01:13:27 1988927 500 169 12 319 +112.91 +/- 17.33 Show
62640 ncm-et-3 2018-09-22 10:52 01:16:23 1988454 500 194 17 289 +128.55 +/- 18.96 Show
62641 ncm-et-10 2018-09-22 10:52 01:15:05 1982166 500 181 18 301 +117.55 +/- 18.40 Show
62642 ncm-et-15 2018-09-22 10:54 01:16:28 1980598 500 204 10 286 +142.26 +/- 18.88 Show
62643 ncm-et-4 2018-09-22 12:04 01:14:18 1987035 500 208 21 271 +136.56 +/- 19.97 Show
62644 ncm-et-9 2018-09-22 12:05 01:12:41 1990822 500 185 21 294 +118.33 +/- 18.83 Show
62645 ncm-et-13 2018-09-22 12:07 01:15:08 1970822 500 193 16 291 +128.55 +/- 18.83 Show
62646 ncm-et-10 2018-09-22 12:09 01:15:03 1983262 500 185 16 299 +122.24 +/- 18.44 Show
62647 ncm-et-3 2018-09-22 12:09 01:14:45 1990032 500 197 14 289 +133.34 +/- 18.87 Show
62648 ncm-et-15 2018-09-22 12:12 01:16:36 1981852 500 198 9 293 +138.18 +/- 18.50 Show
62649 ncm-et-4 2018-09-22 13:19 00:29:27 1990348 203 79 8 116 +126.87 +/- 30.20 Show
62650 ncm-et-9 2018-09-22 13:19 00:29:25 1989243 199 74 9 116 +117.80 +/- 30.16 Show
62651 ncm-et-13 2018-09-22 13:24 00:24:54 1968081 166 63 5 98 +126.73 +/- 32.36 Show
62652 ncm-et-10 2018-09-22 13:25 00:23:44 1980914 156 67 8 81 +138.27 +/- 37.12 Show
62653 ncm-et-3 2018-09-22 13:25 00:23:44 1990033 154 57 4 93 +124.66 +/- 32.89 Show
62654 ncm-et-15 2018-09-22 13:30 00:18:59 1982635 123 36 3 84 +95.55 +/- 32.83 Show

Commit

Commit ID 8a5a64eac563ff755048d40f6a5046ea4dcf0154
Author syzygy
Date 2017-12-03 11:24:46 UTC
Commit Type Non Functional
Minor cleanup of search.cpp

Four very minor edits. Note that tte->save() uses posKey and
not pos.key() in other places.

Originally I also added a futility_move_counts() function to
make things more consistent with the futility_margin() and
reduction() functions. But then razor_margin[] should probably
also be turned into a function, etc. Maybe a good idea, maybe not.
So I did not include it.

Non functional change.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4991 1940 100 2951 +134.41 +/- 5.82
ncm-et-4 5009 1893 116 3000 +128.86 +/- 5.77
  10000 3833 216 5951 +131.62 +/- 4.10