Dev Builds » 20170508-0351

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-17 21:12 5275:28:32 1999592 2270 766 100 1404 +105.02 +/- 8.49
ncm-et-4 2018-03-17 21:12 5275:28:42 2001136 2282 757 106 1419 +101.94 +/- 8.44
ncm-et-5 2018-03-17 21:13 01:54:50 2026230 763 250 38 475 +99.14 +/- 14.63
ncm-et-6 2018-03-17 21:12 01:55:10 2025490 761 246 24 491 +104.39 +/- 14.00
ncm-et-7 2018-03-17 21:13 01:55:00 2023618 788 253 28 507 +102.04 +/- 13.84
ncm-et-8 2018-03-17 21:12 01:54:59 1898993 722 246 27 449 +108.81 +/- 14.92
ncm-et-9 2018-03-17 21:12 5275:28:44 1980179 2212 732 176 1304 +89.24 +/- 9.10
ncm-et-10 2018-03-17 21:12 5275:29:14 1988659 2246 746 99 1401 +103.00 +/- 8.47
ncm-et-11 2018-03-17 21:12 01:54:48 1979123 771 258 32 481 +104.92 +/- 14.44
ncm-et-12 2018-03-17 21:12 01:55:16 2021329 776 264 44 468 +101.27 +/- 14.95
ncm-et-13 2018-03-17 21:12 5275:29:22 1996238 2259 729 85 1445 +101.87 +/- 8.23
ncm-et-14 2018-03-17 21:12 01:55:21 2018721 778 255 31 492 +102.94 +/- 14.19
ncm-et-15 2018-03-17 21:12 5275:29:26 1962116 2222 736 95 1391 +103.16 +/- 8.49
  18850 6238 885 11727 +101.45 +/- 2.94

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
9525 ncm-et-9 2018-03-17 21:12 01:12:36 2026718 500 161 22 317 +99.20 +/- 17.73 Show
9526 ncm-et-14 2018-03-17 21:12 01:12:41 2019696 500 160 18 322 +101.46 +/- 17.38 Show
9527 ncm-et-12 2018-03-17 21:12 01:13:37 2023611 500 177 27 296 +107.54 +/- 18.87 Show
9528 ncm-et-3 2018-03-17 21:12 01:13:13 1999554 500 163 25 312 +98.44 +/- 18.04 Show
9529 ncm-et-13 2018-03-17 21:12 01:14:05 2024426 500 173 20 307 +109.83 +/- 18.16 Show
9530 ncm-et-10 2018-03-17 21:12 01:13:37 2018882 500 165 22 313 +102.22 +/- 17.92 Show
9531 ncm-et-15 2018-03-17 21:12 01:14:21 2017421 500 173 25 302 +106.01 +/- 18.53 Show
9532 ncm-et-4 2018-03-17 21:12 01:14:11 2024099 500 161 22 317 +99.20 +/- 17.73 Show
9533 ncm-et-6 2018-03-17 21:12 01:13:48 2025899 500 166 18 316 +106.01 +/- 17.67 Show
9534 ncm-et-11 2018-03-17 21:12 01:13:26 1967522 500 157 19 324 +98.44 +/- 17.31 Show
9535 ncm-et-8 2018-03-17 21:12 01:20:07 1835336 500 177 18 305 +114.45 +/- 18.20 Show
9536 ncm-et-7 2018-03-17 21:13 01:11:36 2021491 500 168 16 316 +109.07 +/- 17.61 Show
9537 ncm-et-5 2018-03-17 21:13 01:14:25 2025084 500 168 25 307 +102.22 +/- 18.29 Show
9538 ncm-et-7 2018-03-17 22:26 00:41:47 2025744 288 85 12 191 +90.03 +/- 22.39 Show
9539 ncm-et-9 2018-03-17 22:26 00:41:03 2025413 286 82 14 190 +84.22 +/- 22.55 Show
9540 ncm-et-14 2018-03-17 22:26 00:41:03 2017745 278 95 13 170 +105.62 +/- 24.58 Show
9541 ncm-et-3 2018-03-17 22:27 00:40:34 2026882 275 102 10 163 +120.89 +/- 25.15 Show
9542 ncm-et-12 2018-03-17 22:27 00:40:03 2019046 276 87 17 172 +90.08 +/- 24.50 Show
9543 ncm-et-11 2018-03-17 22:27 00:39:45 1990723 271 101 13 157 +117.06 +/- 25.99 Show
9544 ncm-et-10 2018-03-17 22:27 00:40:01 2019859 274 92 13 169 +103.10 +/- 24.59 Show
9545 ncm-et-6 2018-03-17 22:28 00:39:45 2025081 261 80 6 175 +101.28 +/- 22.89 Show
9546 ncm-et-13 2018-03-17 22:28 00:39:41 2024921 264 83 5 176 +105.81 +/- 22.79 Show
9547 ncm-et-4 2018-03-17 22:28 00:39:31 2025899 274 90 13 171 +100.34 +/- 24.35 Show
9548 ncm-et-15 2018-03-17 22:28 00:39:08 2017907 268 83 10 175 +97.09 +/- 23.48 Show
9549 ncm-et-5 2018-03-17 22:29 00:38:48 2027375 263 82 13 168 +93.33 +/- 24.40 Show
9550 ncm-et-8 2018-03-17 22:34 00:33:14 1962650 222 69 9 144 +96.29 +/- 26.03 Show
65487 ncm-et-15 2018-10-23 12:57 01:16:50 1947568 500 175 20 305 +111.37 +/- 18.26 Show
65488 ncm-et-10 2018-10-23 12:57 01:16:37 1943669 500 159 19 322 +99.95 +/- 17.40 Show
65489 ncm-et-9 2018-10-23 12:57 01:16:59 1949945 500 175 53 272 +86.52 +/- 20.39 Show
65490 ncm-et-3 2018-10-23 12:57 01:14:05 1989401 500 178 19 303 +114.45 +/- 18.33 Show
65491 ncm-et-4 2018-10-23 12:57 01:15:00 1988139 500 165 23 312 +101.46 +/- 18.00 Show
65492 ncm-et-13 2018-10-23 12:57 01:13:29 1987510 500 149 18 333 +93.20 +/- 16.84 Show
65493 ncm-et-13 2018-10-23 14:11 01:14:31 1986406 500 157 23 320 +95.44 +/- 17.61 Show
65494 ncm-et-3 2018-10-23 14:12 01:13:38 1990982 500 176 18 306 +113.68 +/- 18.16 Show
65495 ncm-et-4 2018-10-23 14:13 01:11:28 1990666 500 161 26 313 +96.19 +/- 18.02 Show
65496 ncm-et-10 2018-10-23 14:14 01:15:24 1980911 500 163 23 314 +99.95 +/- 17.90 Show
65497 ncm-et-15 2018-10-23 14:15 01:15:49 1980287 500 145 26 329 +84.31 +/- 17.24 Show
65498 ncm-et-9 2018-10-23 14:15 01:18:36 1950241 500 169 57 274 +79.17 +/- 20.32 Show
65499 ncm-et-4 2018-10-23 15:25 01:12:28 1987508 500 177 22 301 +111.37 +/- 18.51 Show
65500 ncm-et-3 2018-10-23 15:27 01:14:09 1991139 495 147 28 320 +85.19 +/- 17.66 Show
65501 ncm-et-13 2018-10-23 15:27 01:14:37 1957928 495 167 19 309 +107.15 +/- 17.98 Show
65502 ncm-et-10 2018-10-23 15:31 01:10:38 1979972 472 167 22 283 +110.29 +/- 19.14 Show
65503 ncm-et-15 2018-10-23 15:32 01:10:10 1847395 454 160 14 280 +115.84 +/- 18.85 Show
65504 ncm-et-9 2018-10-23 15:35 01:06:20 1948578 426 145 30 251 +96.17 +/- 20.69 Show
65505 ncm-et-4 2018-10-23 16:39 00:02:02 1990506 8 3 0 5 +136.97 +/- 147.16 Show

Commit

Commit ID 69ec09bd4b5bdf61f3f49f12d88224e1d656020c
Author Stefan Geschwentner
Date 2017-05-08 03:51:52 UTC
Commit Type Elo
Bonus for pawn scrifice which create passed pawn

STC:
LLR: 2.95 (-2.94,2.94) [0.00,5.00]
Total: 16752 W: 3141 L: 2944 D: 10667

LTC:
LLR: 3.34 (-2.94,2.94) [0.00,5.00]
Total: 33928 W: 4544 L: 4300 D: 25084

Bench: 5639223

Closes #1092

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4995 1685 137 3173 +111.33 +/- 5.52
ncm-et-4 5005 1741 143 3121 +114.95 +/- 5.61
  10000 3426 280 6294 +113.14 +/- 3.93