Dev Builds » 20170508-0357

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-04 22:20 5582:34:55 2002019 2543 826 124 1593 +98.46 +/- 7.96
ncm-et-4 2018-03-04 22:21 5582:34:31 2000916 2536 821 106 1609 +100.68 +/- 7.85
ncm-et-5 2018-03-04 22:21 02:04:01 2022549 843 294 40 509 +108.04 +/- 14.25
ncm-et-6 2018-03-04 22:21 02:03:44 2027703 843 275 31 537 +103.52 +/- 13.52
ncm-et-7 2018-03-04 22:20 02:04:00 2018802 836 292 35 509 +110.38 +/- 14.16
ncm-et-8 2018-03-04 22:21 02:03:35 1970543 807 274 42 491 +102.78 +/- 14.51
ncm-et-9 2018-03-04 22:21 5582:35:04 1951221 2401 831 161 1409 +99.59 +/- 8.72
ncm-et-10 2018-03-04 22:20 5582:35:05 1986225 2546 850 121 1575 +102.34 +/- 8.03
ncm-et-11 2018-03-04 22:20 02:03:51 1948958 806 280 22 504 +115.26 +/- 13.93
ncm-et-12 2018-03-04 22:21 02:03:36 2003096 831 269 29 533 +103.28 +/- 13.51
ncm-et-13 2018-03-04 22:21 5582:34:47 1973824 2502 827 98 1577 +104.25 +/- 7.93
ncm-et-14 2018-03-04 22:20 02:03:54 2020592 851 290 31 530 +109.20 +/- 13.71
ncm-et-15 2018-10-23 08:40 04:15:47 1935988 1656 600 73 983 +114.54 +/- 10.27
  20001 6729 913 12359 +104.03 +/- 2.86

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
5052 ncm-et-3 2018-03-04 22:20 01:14:07 2025899 500 157 29 314 +90.97 +/- 18.03 Show
5053 ncm-et-10 2018-03-04 22:20 01:13:12 2019860 500 161 26 313 +96.19 +/- 18.02 Show
5054 ncm-et-11 2018-03-04 22:20 01:13:28 2019208 500 174 12 314 +116.78 +/- 17.58 Show
5055 ncm-et-14 2018-03-04 22:20 01:12:36 2020673 500 173 21 306 +109.07 +/- 18.24 Show
5056 ncm-et-7 2018-03-04 22:20 01:13:49 2024918 500 171 22 307 +106.78 +/- 18.22 Show
5057 ncm-et-9 2018-03-04 22:21 01:12:37 2024921 500 171 19 310 +109.07 +/- 17.99 Show
5058 ncm-et-5 2018-03-04 22:21 01:14:10 2022958 500 172 31 297 +100.71 +/- 18.90 Show
5059 ncm-et-6 2018-03-04 22:21 01:12:53 2028195 500 174 21 305 +109.83 +/- 18.29 Show
5060 ncm-et-4 2018-03-04 22:21 01:13:02 2025244 500 156 21 323 +96.19 +/- 17.41 Show
5061 ncm-et-13 2018-03-04 22:21 01:14:09 2025573 500 175 17 308 +113.68 +/- 18.03 Show
5062 ncm-et-12 2018-03-04 22:21 01:13:40 2012104 500 161 21 318 +99.95 +/- 17.65 Show
5063 ncm-et-8 2018-03-04 22:21 01:15:23 1941870 500 176 31 293 +103.73 +/- 19.09 Show
5064 ncm-et-14 2018-03-04 23:34 00:49:57 2020510 351 117 10 224 +109.39 +/- 20.78 Show
5065 ncm-et-9 2018-03-04 23:34 00:50:00 2027049 341 107 18 216 +92.83 +/- 21.62 Show
5066 ncm-et-6 2018-03-04 23:35 00:49:31 2027210 343 101 10 232 +94.44 +/- 19.90 Show
5067 ncm-et-4 2018-03-04 23:35 00:49:34 2022957 341 100 16 225 +87.38 +/- 20.75 Show
5068 ncm-et-10 2018-03-04 23:35 00:49:33 2020022 342 126 18 198 +113.60 +/- 23.20 Show
5069 ncm-et-11 2018-03-04 23:35 00:49:01 1878707 306 106 10 190 +112.80 +/- 22.88 Show
5070 ncm-et-7 2018-03-04 23:36 00:48:49 2012685 336 121 13 202 +115.78 +/- 22.53 Show
5071 ncm-et-12 2018-03-04 23:36 00:48:35 1994087 331 108 8 215 +108.35 +/- 20.97 Show
5072 ncm-et-3 2018-03-04 23:36 00:48:21 2026554 328 121 12 195 +120.01 +/- 22.97 Show
5073 ncm-et-5 2018-03-04 23:36 00:48:29 2022140 343 122 9 212 +118.89 +/- 21.57 Show
5074 ncm-et-13 2018-03-04 23:36 00:48:21 2025899 331 105 7 219 +106.04 +/- 20.54 Show
5075 ncm-et-8 2018-03-04 23:38 00:46:50 1999215 307 98 11 198 +101.23 +/- 22.16 Show
65463 ncm-et-10 2018-10-23 08:40 01:13:23 1979035 500 169 19 312 +107.54 +/- 17.89 Show
65464 ncm-et-3 2018-10-23 08:40 01:12:35 1988612 500 175 30 295 +103.73 +/- 18.98 Show
65465 ncm-et-9 2018-10-23 08:40 01:17:20 1955875 500 175 43 282 +93.95 +/- 19.81 Show
65466 ncm-et-4 2018-10-23 08:40 01:13:22 1988299 500 173 19 308 +110.60 +/- 18.09 Show
65467 ncm-et-15 2018-10-23 08:40 01:15:30 1944297 500 174 29 297 +103.73 +/- 18.86 Show
65468 ncm-et-13 2018-10-23 08:40 01:12:48 1988927 500 156 22 322 +95.44 +/- 17.48 Show
65469 ncm-et-3 2018-10-23 09:53 01:13:58 1990665 500 167 23 310 +102.97 +/- 18.09 Show
65470 ncm-et-13 2018-10-23 09:54 01:15:51 1957812 500 154 16 330 +98.44 +/- 16.92 Show
65471 ncm-et-10 2018-10-23 09:54 01:15:58 1944956 500 158 20 322 +98.44 +/- 17.43 Show
65472 ncm-et-4 2018-10-23 09:54 01:13:52 1990507 500 156 20 324 +96.94 +/- 17.33 Show
65473 ncm-et-15 2018-10-23 09:56 01:18:12 1879897 500 176 17 307 +114.45 +/- 18.08 Show
65474 ncm-et-9 2018-10-23 09:58 01:20:58 1909980 500 180 37 283 +102.22 +/- 19.68 Show
65475 ncm-et-3 2018-10-23 11:08 01:14:33 1989559 500 141 20 339 +85.78 +/- 16.59 Show
65476 ncm-et-4 2018-10-23 11:09 01:15:41 1988455 500 168 22 310 +104.49 +/- 18.07 Show
65477 ncm-et-13 2018-10-23 11:11 01:16:52 1916569 500 168 29 303 +99.20 +/- 18.57 Show
65478 ncm-et-10 2018-10-23 11:11 01:12:59 1980135 500 161 26 313 +96.19 +/- 18.02 Show
65479 ncm-et-15 2018-10-23 11:16 01:15:59 1937906 500 201 20 279 +131.74 +/- 19.54 Show
65480 ncm-et-9 2018-10-23 11:20 01:24:09 1835455 500 181 36 283 +103.73 +/- 19.67 Show
65481 ncm-et-3 2018-10-23 12:24 00:31:19 1990823 215 65 10 140 +90.90 +/- 26.48 Show
65482 ncm-et-10 2018-10-23 12:25 00:30:15 1973343 204 75 12 117 +110.92 +/- 30.38 Show
65483 ncm-et-4 2018-10-23 12:26 00:29:12 1990034 195 68 8 119 +110.48 +/- 29.31 Show
65484 ncm-et-13 2018-10-23 12:29 00:26:47 1928166 171 69 7 95 +131.97 +/- 33.64 Show
65485 ncm-et-15 2018-10-23 12:33 00:22:50 1981852 156 49 7 100 +95.90 +/- 31.52 Show
65486 ncm-et-9 2018-10-23 12:46 00:09:59 1954045 60 17 8 35 +52.51 +/- 56.92 Show

Commit

Commit ID ae979416282d43793a49944ed007119673853555
Author IIvec
Date 2017-05-08 03:57:29 UTC
Commit Type Elo
King safety and rook mobility parameters tweak

STC:
LLR: 2.95 (-2.94,2.94) [0.00,4.00]
Total: 19280 W: 3595 L: 3373 D: 12312

LTC:
LLR: 2.95 (-2.94,2.94) [0.00,4.00]
Total: 221405 W: 28940 L: 28220 D: 164245

Bench: 6506664

Closes #1105

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5015 1756 128 3131 +117.02 +/- 5.58
ncm-et-4 4985 1704 142 3139 +112.65 +/- 5.57
  10000 3460 270 6270 +114.84 +/- 3.94