Dev Builds » 20170408-0002

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-01-23 01:05 12:20:45 2026749 5004 1560 251 3193 +93.05 +/- 5.59
ncm-et-4 2018-01-23 01:05 12:20:27 2027523 4996 1500 219 3277 +91.12 +/- 5.43
  10000 3060 470 6470 +92.08 +/- 3.90

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
318 ncm-et-3 2018-01-23 01:05 01:13:41 2028194 500 144 32 324 +79.17 +/- 17.61 Show
319 ncm-et-4 2018-01-23 01:05 01:12:46 2028358 500 156 25 319 +93.20 +/- 17.70 Show
320 ncm-et-4 2018-01-23 02:19 01:11:49 2028030 500 133 14 353 +84.31 +/- 15.72 Show
321 ncm-et-3 2018-01-23 02:19 01:12:25 2027866 500 164 21 315 +102.22 +/- 17.80 Show
322 ncm-et-4 2018-01-23 03:32 01:13:42 2028522 500 155 24 321 +93.20 +/- 17.58 Show
323 ncm-et-3 2018-01-23 03:33 01:12:27 2027210 500 157 25 318 +93.95 +/- 17.75 Show
324 ncm-et-4 2018-01-23 04:46 01:14:03 2027704 500 158 20 322 +98.44 +/- 17.43 Show
325 ncm-et-3 2018-01-23 04:46 01:12:59 2028030 500 151 27 322 +88.00 +/- 17.60 Show
326 ncm-et-3 2018-01-23 06:01 01:10:37 2027374 500 146 26 328 +85.04 +/- 17.29 Show
327 ncm-et-4 2018-01-23 06:02 01:12:54 2027374 500 134 27 339 +75.52 +/- 16.76 Show
328 ncm-et-3 2018-01-23 07:12 01:13:58 2026718 500 148 29 323 +84.31 +/- 17.60 Show
329 ncm-et-4 2018-01-23 07:16 01:13:47 2026230 500 174 24 302 +107.54 +/- 18.51 Show
330 ncm-et-3 2018-01-23 08:27 01:12:58 2026719 500 166 24 310 +101.46 +/- 18.12 Show
331 ncm-et-4 2018-01-23 08:30 01:12:29 2027538 500 140 26 334 +80.63 +/- 16.99 Show
332 ncm-et-3 2018-01-23 09:41 01:12:52 2024427 500 159 23 318 +96.94 +/- 17.70 Show
333 ncm-et-4 2018-01-23 09:44 01:13:55 2025899 500 149 22 329 +90.22 +/- 17.14 Show
334 ncm-et-3 2018-01-23 10:55 01:13:49 2025735 500 150 23 327 +90.22 +/- 17.26 Show
335 ncm-et-4 2018-01-23 10:59 01:12:42 2026227 500 138 22 340 +82.10 +/- 16.60 Show
336 ncm-et-3 2018-01-23 12:10 01:13:07 2024099 500 174 21 305 +109.83 +/- 18.29 Show
337 ncm-et-4 2018-01-23 12:13 01:12:27 2029343 496 163 15 318 +106.92 +/- 17.43 Show
338 ncm-et-3 2018-01-23 13:25 00:00:52 2027866 4 1 0 3 +88.74 +/- 172.51 Show

Commit

Commit ID 35b77b120ef5ca5d9db848e02e42642b1a93e982
Author VoyagerOne
Date 2017-04-08 00:02:31 UTC
Commit Type Simplification
Standardize stat penalty

STC:
LLR: 2.95 (-2.94,2.94) [-3.00,1.00]
Total: 90631 W: 16325 L: 16323 D: 57983

LTC:
LLR: 2.96 (-2.94,2.94) [-3.00,1.00]
Total: 97679 W: 12779 L: 12759 D: 72141

Bench: 6340591

Closes #1053

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5003 1582 134 3287 +103.51 +/- 5.34
ncm-et-4 4997 1665 141 3191 +109.44 +/- 5.50
  10000 3247 275 6478 +106.47 +/- 3.83