Dev Builds » 20160914-1343

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-23 10:57 01:54:16 2009880 767 208 47 512 +74.03 +/- 13.80
ncm-et-4 2018-03-23 10:57 01:54:01 1985456 769 199 42 528 +71.94 +/- 13.35
ncm-et-5 2018-03-23 10:57 01:54:12 2022304 783 201 51 531 +67.39 +/- 13.48
ncm-et-6 2018-03-23 10:57 01:54:22 2026391 783 202 47 534 +69.70 +/- 13.36
ncm-et-7 2018-03-23 10:57 01:54:15 1997179 766 193 42 531 +69.40 +/- 13.24
ncm-et-8 2018-03-23 10:57 01:54:12 1910267 742 183 41 518 +67.32 +/- 13.35
ncm-et-9 2018-03-23 10:57 01:54:19 2025000 765 202 41 522 +74.23 +/- 13.46
ncm-et-10 2018-03-23 10:57 01:54:25 2019454 773 218 39 516 +81.94 +/- 13.65
ncm-et-11 2018-03-23 10:57 01:54:21 2015719 772 205 38 529 +76.36 +/- 13.30
ncm-et-12 2018-03-23 10:57 01:53:57 2006524 768 200 36 532 +75.35 +/- 13.16
ncm-et-13 2018-03-23 10:57 01:54:18 2024999 754 206 38 510 +78.73 +/- 13.65
ncm-et-14 2018-03-23 10:57 01:54:17 2019616 776 206 31 539 +79.72 +/- 12.98
ncm-et-15 2018-03-23 10:57 01:54:18 2018640 782 210 47 525 +73.50 +/- 13.58
  10000 2633 540 6827 +73.81 +/- 3.72

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
11319 ncm-et-3 2018-03-23 10:57 01:13:39 2026718 500 151 29 320 +86.52 +/- 17.74 Show
11320 ncm-et-14 2018-03-23 10:57 01:11:50 2019860 500 131 22 347 +76.98 +/- 16.25 Show
11321 ncm-et-10 2018-03-23 10:57 01:13:21 2018723 500 149 26 325 +87.26 +/- 17.43 Show
11322 ncm-et-7 2018-03-23 10:57 01:12:57 1996277 500 132 26 342 +74.79 +/- 16.59 Show
11323 ncm-et-15 2018-03-23 10:57 01:10:53 2018072 500 140 24 336 +82.10 +/- 16.84 Show
11324 ncm-et-6 2018-03-23 10:57 01:12:09 2025244 500 129 31 340 +68.99 +/- 16.80 Show
11325 ncm-et-13 2018-03-23 10:57 01:14:55 2024590 500 143 26 331 +82.83 +/- 17.14 Show
11326 ncm-et-11 2018-03-23 10:57 01:12:20 2016450 500 124 25 351 +69.71 +/- 16.11 Show
11327 ncm-et-9 2018-03-23 10:57 01:14:11 2024754 500 131 32 337 +69.71 +/- 16.97 Show
11328 ncm-et-8 2018-03-23 10:57 01:15:14 1939149 500 121 34 345 +61.08 +/- 16.60 Show
11329 ncm-et-5 2018-03-23 10:57 01:12:31 2021488 500 136 33 331 +72.61 +/- 17.28 Show
11330 ncm-et-4 2018-03-23 10:57 01:12:47 1995772 500 121 36 343 +59.64 +/- 16.73 Show
11331 ncm-et-12 2018-03-23 10:57 01:12:49 2020673 500 124 25 351 +69.71 +/- 16.11 Show
11332 ncm-et-15 2018-03-23 12:09 00:41:41 2019208 282 70 23 189 +58.45 +/- 22.92 Show
11333 ncm-et-14 2018-03-23 12:10 00:40:44 2019371 276 75 9 192 +84.72 +/- 21.62 Show
11334 ncm-et-6 2018-03-23 12:11 00:40:30 2027538 283 73 16 194 +70.95 +/- 22.08 Show
11335 ncm-et-11 2018-03-23 12:11 00:40:16 2014988 272 81 13 178 +88.74 +/- 23.44 Show
11336 ncm-et-5 2018-03-23 12:11 00:39:57 2023119 283 65 18 200 +58.24 +/- 21.46 Show
11337 ncm-et-7 2018-03-23 12:11 00:39:35 1998080 266 61 16 189 +59.35 +/- 21.95 Show
11338 ncm-et-4 2018-03-23 12:11 00:39:30 1975139 269 78 6 185 +95.32 +/- 21.94 Show
11339 ncm-et-12 2018-03-23 12:12 00:39:24 1992375 268 76 11 181 +85.98 +/- 22.79 Show
11340 ncm-et-10 2018-03-23 12:12 00:39:21 2020184 273 69 13 191 +72.29 +/- 21.87 Show
11341 ncm-et-3 2018-03-23 12:12 00:38:53 1993041 267 57 18 192 +51.11 +/- 21.69 Show
11342 ncm-et-9 2018-03-23 12:13 00:38:24 2025245 265 71 9 185 +82.82 +/- 22.00 Show
11343 ncm-et-13 2018-03-23 12:13 00:37:40 2025408 254 63 12 179 +70.72 +/- 22.48 Show
11344 ncm-et-8 2018-03-23 12:14 00:37:13 1881385 242 62 7 173 +80.37 +/- 22.31 Show

Commit

Commit ID 01ee509a5c33e11d7d62d2f325f55720d8be9cfb
Author Marco Costalba
Date 2016-09-14 13:43:56 UTC
Commit Type Non Functional
Retire MovePicker::see_sign()

No more used after last patch.

No functional change.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5040 1106 199 3735 +63.21 +/- 4.71
ncm-et-4 4960 1118 198 3644 +65.20 +/- 4.81
  10000 2224 397 7379 +64.20 +/- 3.36