Dev Builds » 20161101-0919

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded distro are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-01-15 17:06 8724:28:16 2011450 6660 1855 338 4467 +80.55 +/- 4.63
ncm-et-4 2018-01-15 17:06 8724:27:54 2004243 6654 1895 324 4435 +83.61 +/- 4.65
ncm-et-9 2019-01-14 01:26 04:08:39 1977417 1648 446 88 1114 +76.70 +/- 9.25
ncm-et-10 2019-01-14 01:26 04:08:39 1974912 1676 496 81 1099 +87.86 +/- 9.42
ncm-et-13 2019-01-14 01:26 04:08:41 1974719 1672 459 67 1146 +83.00 +/- 8.97
ncm-et-15 2019-01-14 01:26 04:08:44 1971776 1690 461 87 1142 +78.18 +/- 9.13
  20000 5612 985 13403 +81.86 +/- 2.67

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
22 ncm-et-3 2018-01-15 17:06 01:13:00 2027047 500 138 23 339 +81.37 +/- 16.67 Show
23 ncm-et-4 2018-01-15 17:06 01:14:28 2026228 500 134 30 336 +73.34 +/- 16.98 Show
24 ncm-et-3 2018-01-15 18:20 01:12:04 2026554 500 130 32 338 +68.99 +/- 16.92 Show
25 ncm-et-4 2018-01-15 18:21 01:12:46 2025245 500 131 30 339 +71.16 +/- 16.83 Show
26 ncm-et-3 2018-01-15 19:32 01:11:24 2029346 500 134 20 346 +80.63 +/- 16.24 Show
27 ncm-et-4 2018-01-15 19:34 01:12:30 2029015 500 145 33 322 +79.17 +/- 17.72 Show
28 ncm-et-3 2018-01-15 20:44 01:13:51 2025901 500 155 23 322 +93.95 +/- 17.51 Show
29 ncm-et-4 2018-01-15 20:47 01:13:58 2026063 500 136 23 341 +79.90 +/- 16.57 Show
30 ncm-et-3 2018-01-15 21:58 01:11:53 2026719 500 133 29 338 +73.34 +/- 16.86 Show
31 ncm-et-4 2018-01-15 22:01 01:12:21 2027702 500 138 26 336 +79.17 +/- 16.89 Show
32 ncm-et-3 2018-01-15 23:10 01:15:09 2026882 500 145 20 335 +88.74 +/- 16.79 Show
33 ncm-et-4 2018-01-15 23:14 01:12:56 2026556 500 154 22 324 +93.95 +/- 17.39 Show
34 ncm-et-3 2018-01-16 00:25 01:12:49 2026554 500 134 30 336 +73.34 +/- 16.98 Show
35 ncm-et-4 2018-01-16 00:27 01:12:13 2028030 500 145 19 336 +89.48 +/- 16.72 Show
36 ncm-et-3 2018-01-16 01:39 01:14:28 2027702 500 147 26 327 +85.78 +/- 17.33 Show
37 ncm-et-4 2018-01-16 01:40 01:14:53 2028523 500 149 22 329 +90.22 +/- 17.14 Show
38 ncm-et-3 2018-01-16 02:53 01:12:53 2027702 500 142 17 341 +88.74 +/- 16.41 Show
39 ncm-et-4 2018-01-16 02:55 01:12:40 2025737 500 134 22 344 +79.17 +/- 16.40 Show
40 ncm-et-3 2018-01-16 04:07 01:13:57 2027046 500 128 34 338 +66.10 +/- 16.95 Show
41 ncm-et-4 2018-01-16 04:08 01:12:31 2025737 500 156 22 322 +95.44 +/- 17.48 Show
127338 ncm-et-13 2019-01-14 01:26 01:11:50 1970794 500 145 16 339 +91.71 +/- 16.48 Show
127339 ncm-et-10 2019-01-14 01:26 01:13:01 1976093 500 161 24 315 +97.69 +/- 17.87 Show
127340 ncm-et-9 2019-01-14 01:26 01:15:58 1978409 500 140 27 333 +79.90 +/- 17.06 Show
127341 ncm-et-15 2019-01-14 01:26 01:13:17 1969269 500 136 29 335 +75.52 +/- 17.01 Show
127342 ncm-et-3 2019-01-14 01:26 01:13:40 1964304 500 122 22 356 +70.44 +/- 15.79 Show
127343 ncm-et-4 2019-01-14 01:26 01:12:48 1961536 500 146 24 330 +86.52 +/- 17.14 Show
127344 ncm-et-13 2019-01-14 02:39 01:14:09 1977005 500 134 18 348 +82.10 +/- 16.09 Show
127345 ncm-et-4 2019-01-14 02:40 01:15:01 1937190 500 141 23 336 +83.57 +/- 16.82 Show
127346 ncm-et-10 2019-01-14 02:40 01:13:25 1975314 500 142 22 336 +85.04 +/- 16.80 Show
127347 ncm-et-15 2019-01-14 02:40 01:10:49 1975301 500 134 20 346 +80.63 +/- 16.24 Show
127348 ncm-et-3 2019-01-14 02:41 01:15:42 1964149 500 151 25 324 +89.48 +/- 17.46 Show
127349 ncm-et-9 2019-01-14 02:43 01:13:45 1972812 500 128 26 346 +71.89 +/- 16.39 Show
127350 ncm-et-15 2019-01-14 03:52 01:13:14 1973445 500 135 30 335 +74.06 +/- 17.03 Show
127351 ncm-et-13 2019-01-14 03:54 01:13:30 1972661 500 136 25 339 +78.44 +/- 16.72 Show
127352 ncm-et-10 2019-01-14 03:54 01:12:51 1971487 500 134 26 340 +76.25 +/- 16.69 Show
127353 ncm-et-4 2019-01-14 03:56 01:13:56 1956815 500 144 21 335 +87.26 +/- 16.82 Show
127354 ncm-et-3 2019-01-14 03:57 01:12:02 1980324 500 148 30 322 +83.57 +/- 17.67 Show
127355 ncm-et-9 2019-01-14 03:58 01:13:14 1989947 500 134 25 341 +76.98 +/- 16.62 Show
127356 ncm-et-15 2019-01-14 05:06 00:28:13 1969088 190 56 8 126 +89.72 +/- 27.60 Show
127357 ncm-et-10 2019-01-14 05:08 00:26:10 1976753 176 59 9 108 +101.50 +/- 30.93 Show
127358 ncm-et-13 2019-01-14 05:09 00:26:00 1978416 172 44 8 120 +73.81 +/- 27.64 Show
127359 ncm-et-3 2019-01-14 05:11 00:24:01 1980071 160 48 7 105 +91.06 +/- 30.43 Show
127360 ncm-et-4 2019-01-14 05:11 00:23:21 1935030 154 42 7 105 +80.37 +/- 29.91 Show
127361 ncm-et-9 2019-01-14 05:12 00:22:32 1968499 148 44 10 94 +81.27 +/- 33.08 Show

Commit

Commit ID 369eff437cc081eb4b8ab5f519cf3f86b79e87d0
Author Marco Costalba
Date 2016-11-01 09:19:17 UTC
Commit Type Non Functional
Stockfish 8

Bench: 5926706

No functional change

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5032 1195 161 3676 +72.42 +/- 4.77
ncm-et-4 4968 1192 169 3607 +72.58 +/- 4.85
  10000 2387 330 7283 +72.50 +/- 3.40