Dev Builds » 20161018-0700

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded distro are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-25 10:03 7815:02:06 1991913 2669 734 121 1814 +81.25 +/- 7.19
ncm-et-4 2018-02-25 10:04 7815:01:57 1988728 2657 718 127 1812 +78.59 +/- 7.19
ncm-et-5 2018-02-25 10:03 24:37:17 2023394 990 273 50 667 +79.63 +/- 11.96
ncm-et-6 2018-02-25 10:03 24:37:11 2025572 978 259 57 662 +72.81 +/- 12.03
ncm-et-7 2018-02-25 10:04 24:36:57 2002987 995 283 45 667 +84.75 +/- 11.94
ncm-et-8 2018-02-25 10:03 24:37:01 1991246 961 244 32 685 +77.93 +/- 11.27
ncm-et-9 2018-02-25 10:04 7815:02:02 1997265 2659 770 135 1754 +84.61 +/- 7.44
ncm-et-10 2018-02-25 10:03 7815:02:16 1991165 2628 742 150 1736 +79.63 +/- 7.51
ncm-et-11 2018-02-25 10:03 24:37:19 2019642 1003 269 46 688 +78.56 +/- 11.62
ncm-et-12 2018-02-25 10:04 24:37:14 2018451 985 247 48 690 +71.17 +/- 11.49
ncm-et-13 2018-02-26 10:19 7790:46:12 1980207 1821 496 106 1219 +75.58 +/- 8.91
ncm-et-15 2019-01-16 20:57 04:08:45 1965270 1654 450 67 1137 +81.94 +/- 8.99
  20000 5485 984 13531 +79.55 +/- 2.65

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
3062 ncm-et-3 2018-02-25 10:03 01:11:44 2024264 500 123 28 349 +66.82 +/- 16.28 Show
3063 ncm-et-11 2018-02-25 10:03 01:11:44 2018557 500 143 19 338 +88.00 +/- 16.62 Show
3064 ncm-et-8 2018-02-25 10:03 01:15:23 1947276 500 126 18 356 +76.25 +/- 15.68 Show
3065 ncm-et-6 2018-02-25 10:03 01:14:48 2025735 500 130 28 342 +71.89 +/- 16.64 Show
3066 ncm-et-5 2018-02-25 10:03 01:12:39 2023610 500 141 25 334 +82.10 +/- 16.97 Show
3067 ncm-et-10 2018-02-25 10:03 01:12:59 2020837 500 132 35 333 +68.27 +/- 17.22 Show
3068 ncm-et-12 2018-02-25 10:04 01:14:46 2016123 500 135 27 338 +76.25 +/- 16.81 Show
3069 ncm-et-9 2018-02-25 10:04 01:12:48 2025900 500 142 27 331 +81.37 +/- 17.16 Show
3070 ncm-et-7 2018-02-25 10:04 01:10:50 2024264 500 148 16 336 +93.95 +/- 16.63 Show
3071 ncm-et-4 2018-02-25 10:04 01:13:44 2022466 500 124 23 353 +71.16 +/- 15.97 Show
3073 ncm-et-7 2018-02-25 11:16 00:51:16 2026063 355 95 22 238 +72.48 +/- 20.22 Show
3074 ncm-et-3 2018-02-25 11:16 00:50:31 2027046 349 97 16 236 +82.13 +/- 20.01 Show
3075 ncm-et-11 2018-02-25 11:16 00:50:33 2020348 349 88 20 241 +68.57 +/- 19.74 Show
3076 ncm-et-5 2018-02-25 11:17 00:49:44 2024919 340 84 18 238 +68.31 +/- 19.65 Show
3077 ncm-et-9 2018-02-25 11:18 00:49:24 2026719 333 92 9 232 +88.46 +/- 19.54 Show
3078 ncm-et-10 2018-02-25 11:18 00:49:20 2019371 341 89 16 236 +75.55 +/- 19.78 Show
3079 ncm-et-4 2018-02-25 11:19 00:48:14 2027049 336 90 9 237 +85.44 +/- 19.18 Show
3080 ncm-et-12 2018-02-25 11:20 00:47:26 2019047 330 81 18 231 +67.15 +/- 19.97 Show
3081 ncm-et-6 2018-02-25 11:20 00:47:19 2025736 325 94 20 211 +80.52 +/- 21.78 Show
3082 ncm-et-8 2018-02-25 11:20 00:47:04 2004157 319 77 7 235 +77.50 +/- 18.57 Show
3375 ncm-et-11 2018-02-26 10:19 00:21:21 2020022 154 38 7 109 +70.91 +/- 28.72 Show
3376 ncm-et-6 2018-02-26 10:19 00:21:16 2025244 153 35 9 109 +59.62 +/- 28.86 Show
3377 ncm-et-4 2018-02-26 10:19 00:21:26 2007512 145 43 11 91 +77.96 +/- 33.90 Show
3378 ncm-et-5 2018-02-26 10:19 00:21:21 2021652 150 48 7 95 +97.44 +/- 32.54 Show
3379 ncm-et-3 2018-02-26 10:19 00:21:24 2024100 143 37 12 94 +61.37 +/- 32.88 Show
3380 ncm-et-13 2018-02-26 10:19 00:21:20 2025736 150 48 10 92 +89.98 +/- 33.82 Show
3381 ncm-et-10 2018-02-26 10:19 00:21:15 2020185 144 39 5 100 +83.61 +/- 30.08 Show
3382 ncm-et-7 2018-02-26 10:20 00:21:07 1958635 140 40 7 93 +83.46 +/- 32.32 Show
3383 ncm-et-12 2018-02-26 10:20 00:21:14 2020184 155 31 3 121 +63.46 +/- 24.44 Show
3384 ncm-et-8 2018-02-26 10:20 00:20:53 2022304 142 41 7 94 +84.84 +/- 32.18 Show
3385 ncm-et-9 2018-02-26 10:20 00:21:05 2020676 147 33 6 108 +64.55 +/- 28.00 Show
127704 ncm-et-3 2019-01-16 20:56 01:13:29 1961691 500 140 14 346 +89.48 +/- 16.07 Show
127705 ncm-et-4 2019-01-16 20:56 01:13:07 1973314 500 150 30 320 +85.04 +/- 17.76 Show
127706 ncm-et-9 2019-01-16 20:56 01:13:31 1981261 500 154 36 310 +83.57 +/- 18.36 Show
127707 ncm-et-13 2019-01-16 20:56 01:13:55 1967848 500 137 29 334 +76.25 +/- 17.05 Show
127708 ncm-et-10 2019-01-16 20:56 01:15:15 1973796 500 152 27 321 +88.74 +/- 17.65 Show
127709 ncm-et-15 2019-01-16 20:57 01:13:27 1966459 500 141 19 340 +86.52 +/- 16.52 Show
127710 ncm-et-4 2019-01-16 22:10 01:13:43 1961689 500 134 19 347 +81.37 +/- 16.17 Show
127711 ncm-et-3 2019-01-16 22:11 01:14:17 1961842 500 134 25 341 +76.98 +/- 16.62 Show
127712 ncm-et-9 2019-01-16 22:11 01:12:08 1973893 500 150 25 325 +88.74 +/- 17.41 Show
127713 ncm-et-13 2019-01-16 22:11 01:14:05 1971434 500 132 26 342 +74.79 +/- 16.59 Show
127714 ncm-et-15 2019-01-16 22:12 01:14:40 1964148 500 133 17 350 +82.10 +/- 15.96 Show
127715 ncm-et-10 2019-01-16 22:13 01:14:13 1983153 500 146 28 326 +83.57 +/- 17.43 Show
127716 ncm-et-9 2019-01-16 23:24 01:14:00 1980520 500 146 22 332 +88.00 +/- 16.99 Show
127717 ncm-et-4 2019-01-16 23:25 01:14:02 1964763 500 141 23 336 +83.57 +/- 16.82 Show
127718 ncm-et-3 2019-01-16 23:26 01:13:29 1966922 500 152 16 332 +96.94 +/- 16.83 Show
127719 ncm-et-13 2019-01-16 23:26 01:13:35 1967080 500 136 34 330 +71.89 +/- 17.35 Show
127720 ncm-et-15 2019-01-16 23:27 01:14:27 1962302 500 132 24 344 +76.25 +/- 16.45 Show
127721 ncm-et-10 2019-01-16 23:28 01:14:43 1960937 500 145 36 319 +76.98 +/- 17.92 Show
127722 ncm-et-9 2019-01-17 00:39 00:26:33 1971883 179 53 10 116 +85.13 +/- 29.34 Show
127723 ncm-et-4 2019-01-17 00:40 00:25:28 1964306 176 36 12 128 +47.67 +/- 26.38 Show
127724 ncm-et-3 2019-01-17 00:41 00:24:53 1977528 177 51 10 116 +81.97 +/- 29.21 Show
127725 ncm-et-13 2019-01-17 00:41 00:24:37 1968937 171 43 7 121 +74.25 +/- 27.16 Show
127726 ncm-et-15 2019-01-17 00:43 00:23:00 1968172 154 44 7 103 +85.14 +/- 30.50 Show
127727 ncm-et-10 2019-01-17 00:44 00:22:00 1959877 143 39 3 101 +89.39 +/- 29.22 Show

Commit

Commit ID 99f3ad6858889bbc40c016c96c9f7e53a773e49e
Author ajithcj
Date 2016-10-18 07:00:52 UTC
Commit Type Non Functional
Remove useless assignments to currentMove

We reference (ss-1)->currentMove, i.e. we peek
current move of the parent node, so currentMove
should be valid in the main move loop, when we
search() the subtree, but outside of main loop
it is useless.

No functional change.

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 4959 1120 180 3659 +66.66 +/- 4.76
ncm-et-4 5041 1205 167 3669 +72.58 +/- 4.79
  10000 2325 347 7328 +69.64 +/- 3.38