Dev Builds » 20161018-0700

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-25 10:03 24:37:27 2025137 992 257 56 679 +71.39 +/- 11.80
ncm-et-4 2018-02-25 10:04 24:37:03 2019009 981 257 43 681 +77.03 +/- 11.59
ncm-et-5 2018-02-25 10:03 24:37:17 2023394 990 273 50 667 +79.63 +/- 11.96
ncm-et-6 2018-02-25 10:03 24:37:11 2025572 978 259 57 662 +72.81 +/- 12.03
ncm-et-7 2018-02-25 10:04 24:36:57 2002987 995 283 45 667 +84.75 +/- 11.94
ncm-et-8 2018-02-25 10:03 24:37:01 1991246 961 244 32 685 +77.93 +/- 11.27
ncm-et-9 2018-02-25 10:04 24:37:10 2024432 980 267 42 671 +81.22 +/- 11.76
ncm-et-10 2018-02-25 10:03 24:37:12 2020131 985 260 56 669 +73.01 +/- 11.94
ncm-et-11 2018-02-25 10:03 24:37:19 2019642 1003 269 46 688 +78.56 +/- 11.62
ncm-et-12 2018-02-25 10:04 24:37:14 2018451 985 247 48 690 +71.17 +/- 11.49
ncm-et-13 2018-02-26 10:19 00:21:20 2025736 150 48 10 92 +89.98 +/- 33.82
  10000 2664 485 6851 +76.94 +/- 3.69

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
3062 ncm-et-3 2018-02-25 10:03 01:11:44 2024264 500 123 28 349 +66.82 +/- 16.28 Show
3063 ncm-et-11 2018-02-25 10:03 01:11:44 2018557 500 143 19 338 +88.00 +/- 16.62 Show
3064 ncm-et-8 2018-02-25 10:03 01:15:23 1947276 500 126 18 356 +76.25 +/- 15.68 Show
3065 ncm-et-6 2018-02-25 10:03 01:14:48 2025735 500 130 28 342 +71.89 +/- 16.64 Show
3066 ncm-et-5 2018-02-25 10:03 01:12:39 2023610 500 141 25 334 +82.10 +/- 16.97 Show
3067 ncm-et-10 2018-02-25 10:03 01:12:59 2020837 500 132 35 333 +68.27 +/- 17.22 Show
3068 ncm-et-12 2018-02-25 10:04 01:14:46 2016123 500 135 27 338 +76.25 +/- 16.81 Show
3069 ncm-et-9 2018-02-25 10:04 01:12:48 2025900 500 142 27 331 +81.37 +/- 17.16 Show
3070 ncm-et-7 2018-02-25 10:04 01:10:50 2024264 500 148 16 336 +93.95 +/- 16.63 Show
3071 ncm-et-4 2018-02-25 10:04 01:13:44 2022466 500 124 23 353 +71.16 +/- 15.97 Show
3073 ncm-et-7 2018-02-25 11:16 00:51:16 2026063 355 95 22 238 +72.48 +/- 20.22 Show
3074 ncm-et-3 2018-02-25 11:16 00:50:31 2027046 349 97 16 236 +82.13 +/- 20.01 Show
3075 ncm-et-11 2018-02-25 11:16 00:50:33 2020348 349 88 20 241 +68.57 +/- 19.74 Show
3076 ncm-et-5 2018-02-25 11:17 00:49:44 2024919 340 84 18 238 +68.31 +/- 19.65 Show
3077 ncm-et-9 2018-02-25 11:18 00:49:24 2026719 333 92 9 232 +88.46 +/- 19.54 Show
3078 ncm-et-10 2018-02-25 11:18 00:49:20 2019371 341 89 16 236 +75.55 +/- 19.78 Show
3079 ncm-et-4 2018-02-25 11:19 00:48:14 2027049 336 90 9 237 +85.44 +/- 19.18 Show
3080 ncm-et-12 2018-02-25 11:20 00:47:26 2019047 330 81 18 231 +67.15 +/- 19.97 Show
3081 ncm-et-6 2018-02-25 11:20 00:47:19 2025736 325 94 20 211 +80.52 +/- 21.78 Show
3082 ncm-et-8 2018-02-25 11:20 00:47:04 2004157 319 77 7 235 +77.50 +/- 18.57 Show
3375 ncm-et-11 2018-02-26 10:19 00:21:21 2020022 154 38 7 109 +70.91 +/- 28.72 Show
3376 ncm-et-6 2018-02-26 10:19 00:21:16 2025244 153 35 9 109 +59.62 +/- 28.86 Show
3377 ncm-et-4 2018-02-26 10:19 00:21:26 2007512 145 43 11 91 +77.96 +/- 33.90 Show
3378 ncm-et-5 2018-02-26 10:19 00:21:21 2021652 150 48 7 95 +97.44 +/- 32.54 Show
3379 ncm-et-3 2018-02-26 10:19 00:21:24 2024100 143 37 12 94 +61.37 +/- 32.88 Show
3380 ncm-et-13 2018-02-26 10:19 00:21:20 2025736 150 48 10 92 +89.98 +/- 33.82 Show
3381 ncm-et-10 2018-02-26 10:19 00:21:15 2020185 144 39 5 100 +83.61 +/- 30.08 Show
3382 ncm-et-7 2018-02-26 10:20 00:21:07 1958635 140 40 7 93 +83.46 +/- 32.32 Show
3383 ncm-et-12 2018-02-26 10:20 00:21:14 2020184 155 31 3 121 +63.46 +/- 24.44 Show
3384 ncm-et-8 2018-02-26 10:20 00:20:53 2022304 142 41 7 94 +84.84 +/- 32.18 Show
3385 ncm-et-9 2018-02-26 10:20 00:21:05 2020676 147 33 6 108 +64.55 +/- 28.00 Show

Commit

Commit ID 99f3ad6858889bbc40c016c96c9f7e53a773e49e
Author ajithcj
Date 2016-10-18 07:00:52 UTC
Commit Type Non Functional
Remove useless assignments to currentMove

We reference (ss-1)->currentMove, i.e. we peek
current move of the parent node, so currentMove
should be valid in the main move loop, when we
search() the subtree, but outside of main loop
it is useless.

No functional change.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4959 1120 180 3659 +66.66 +/- 4.76
ncm-et-4 5041 1205 167 3669 +72.58 +/- 4.79
  10000 2325 347 7328 +69.64 +/- 3.38