Dev Builds » 20161101-0919

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-01-15 17:06 12:14:10 2027145 5000 1386 254 3360 +80.05 +/- 5.33
ncm-et-4 2018-01-15 17:06 12:14:01 2026884 5000 1422 249 3329 +83.06 +/- 5.38
  10000 2808 503 6689 +81.55 +/- 3.79

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
22 ncm-et-3 2018-01-15 17:06 01:13:00 2027047 500 138 23 339 +81.37 +/- 16.67 Show
23 ncm-et-4 2018-01-15 17:06 01:14:28 2026228 500 134 30 336 +73.34 +/- 16.98 Show
24 ncm-et-3 2018-01-15 18:20 01:12:04 2026554 500 130 32 338 +68.99 +/- 16.92 Show
25 ncm-et-4 2018-01-15 18:21 01:12:46 2025245 500 131 30 339 +71.16 +/- 16.83 Show
26 ncm-et-3 2018-01-15 19:32 01:11:24 2029346 500 134 20 346 +80.63 +/- 16.24 Show
27 ncm-et-4 2018-01-15 19:34 01:12:30 2029015 500 145 33 322 +79.17 +/- 17.72 Show
28 ncm-et-3 2018-01-15 20:44 01:13:51 2025901 500 155 23 322 +93.95 +/- 17.51 Show
29 ncm-et-4 2018-01-15 20:47 01:13:58 2026063 500 136 23 341 +79.90 +/- 16.57 Show
30 ncm-et-3 2018-01-15 21:58 01:11:53 2026719 500 133 29 338 +73.34 +/- 16.86 Show
31 ncm-et-4 2018-01-15 22:01 01:12:21 2027702 500 138 26 336 +79.17 +/- 16.89 Show
32 ncm-et-3 2018-01-15 23:10 01:15:09 2026882 500 145 20 335 +88.74 +/- 16.79 Show
33 ncm-et-4 2018-01-15 23:14 01:12:56 2026556 500 154 22 324 +93.95 +/- 17.39 Show
34 ncm-et-3 2018-01-16 00:25 01:12:49 2026554 500 134 30 336 +73.34 +/- 16.98 Show
35 ncm-et-4 2018-01-16 00:27 01:12:13 2028030 500 145 19 336 +89.48 +/- 16.72 Show
36 ncm-et-3 2018-01-16 01:39 01:14:28 2027702 500 147 26 327 +85.78 +/- 17.33 Show
37 ncm-et-4 2018-01-16 01:40 01:14:53 2028523 500 149 22 329 +90.22 +/- 17.14 Show
38 ncm-et-3 2018-01-16 02:53 01:12:53 2027702 500 142 17 341 +88.74 +/- 16.41 Show
39 ncm-et-4 2018-01-16 02:55 01:12:40 2025737 500 134 22 344 +79.17 +/- 16.40 Show
40 ncm-et-3 2018-01-16 04:07 01:13:57 2027046 500 128 34 338 +66.10 +/- 16.95 Show
41 ncm-et-4 2018-01-16 04:08 01:12:31 2025737 500 156 22 322 +95.44 +/- 17.48 Show

Commit

Commit ID 369eff437cc081eb4b8ab5f519cf3f86b79e87d0
Author Marco Costalba
Date 2016-11-01 09:19:17 UTC
Commit Type Non Functional
Stockfish 8

Bench: 5926706

No functional change

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5032 1195 161 3676 +72.42 +/- 4.77
ncm-et-4 4968 1192 169 3607 +72.58 +/- 4.85
  10000 2387 330 7283 +72.50 +/- 3.40