Dev Builds » 20180226-0201

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-27 05:28 4719:50:10 2002198 2611 1188 92 1331 +155.44 +/- 9.06
ncm-et-4 2018-02-27 05:28 4719:49:50 2000736 2586 1199 104 1283 +157.00 +/- 9.29
ncm-et-5 2018-02-27 05:28 02:20:47 2023446 907 395 31 481 +147.74 +/- 14.97
ncm-et-6 2018-02-27 05:28 02:21:08 2026145 917 405 42 470 +145.48 +/- 15.33
ncm-et-7 2018-02-27 05:28 02:21:13 2009012 904 421 44 439 +154.30 +/- 15.99
ncm-et-8 2018-02-27 05:28 02:21:18 2021897 901 417 40 444 +154.88 +/- 15.84
ncm-et-9 2018-02-27 05:28 4719:50:11 2000868 2610 1137 93 1380 +147.19 +/- 8.84
ncm-et-10 2018-02-27 05:28 4719:49:48 1965905 2558 1125 112 1321 +145.54 +/- 9.12
ncm-et-11 2018-02-27 05:28 02:21:07 2005932 909 404 37 468 +148.74 +/- 15.31
ncm-et-12 2018-02-27 05:28 02:20:57 1987855 884 385 34 465 +145.98 +/- 15.29
ncm-et-13 2018-02-27 05:28 4719:49:59 1975641 2569 1161 87 1321 +154.73 +/- 9.07
ncm-et-15 2018-09-11 16:53 04:25:32 1950594 1644 758 76 810 +153.37 +/- 11.73
  20000 8995 792 10213 +151.41 +/- 3.28

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
3595 ncm-et-9 2018-02-27 05:28 01:17:30 2024590 500 227 22 251 +151.35 +/- 21.03 Show
3596 ncm-et-8 2018-02-27 05:28 01:18:47 2021814 500 240 21 239 +163.21 +/- 21.67 Show
3597 ncm-et-7 2018-02-27 05:28 01:17:06 1993925 500 221 27 252 +142.26 +/- 21.08 Show
3598 ncm-et-13 2018-02-27 05:28 01:17:51 2024263 500 221 11 268 +155.54 +/- 19.83 Show
3599 ncm-et-3 2018-02-27 05:28 01:15:27 2025735 500 234 22 244 +157.24 +/- 21.41 Show
3600 ncm-et-10 2018-02-27 05:28 01:16:47 2020347 500 211 28 261 +133.34 +/- 20.63 Show
3601 ncm-et-6 2018-02-27 05:28 01:17:06 2026882 500 226 19 255 +153.02 +/- 20.75 Show
3602 ncm-et-4 2018-02-27 05:28 01:16:23 2025081 500 220 24 256 +143.89 +/- 20.81 Show
3603 ncm-et-12 2018-02-27 05:28 01:21:13 1955362 500 214 20 266 +142.26 +/- 20.20 Show
3604 ncm-et-11 2018-02-27 05:28 01:17:17 2013210 500 216 19 265 +144.72 +/- 20.23 Show
3605 ncm-et-5 2018-02-27 05:28 01:16:43 2022793 500 220 16 264 +150.51 +/- 20.20 Show
3606 ncm-et-3 2018-02-27 06:45 01:04:43 2025735 424 192 12 220 +157.46 +/- 22.14 Show
3607 ncm-et-4 2018-02-27 06:46 01:03:25 2023938 412 201 16 195 +167.98 +/- 23.99 Show
3608 ncm-et-10 2018-02-27 06:46 01:03:27 2021488 418 195 20 203 +154.98 +/- 23.54 Show
3609 ncm-et-5 2018-02-27 06:46 01:02:59 2024099 407 175 15 217 +144.35 +/- 22.32 Show
3610 ncm-et-7 2018-02-27 06:46 01:03:02 2024099 404 200 17 187 +169.70 +/- 24.59 Show
3611 ncm-et-6 2018-02-27 06:46 01:02:57 2025408 417 179 23 215 +136.61 +/- 22.77 Show
3612 ncm-et-9 2018-02-27 06:47 01:02:29 2024590 421 190 12 219 +156.73 +/- 22.19 Show
3613 ncm-et-11 2018-02-27 06:47 01:02:45 1998654 409 188 18 203 +153.71 +/- 23.43 Show
3614 ncm-et-13 2018-02-27 06:47 01:02:18 2024754 403 183 16 204 +153.19 +/- 23.26 Show
3615 ncm-et-8 2018-02-27 06:48 01:01:26 2021979 401 177 19 205 +144.72 +/- 23.27 Show
3616 ncm-et-12 2018-02-27 06:51 00:58:39 2020347 384 171 14 199 +150.87 +/- 23.42 Show
61215 ncm-et-4 2018-09-11 16:53 01:17:11 1987981 500 224 20 256 +150.51 +/- 20.72 Show
61216 ncm-et-9 2018-09-11 16:53 01:17:01 1987981 500 227 20 253 +153.02 +/- 20.88 Show
61217 ncm-et-15 2018-09-11 16:53 01:19:44 1955938 500 218 30 252 +137.37 +/- 21.13 Show
61218 ncm-et-3 2018-09-11 16:53 01:17:17 1987825 500 238 15 247 +166.66 +/- 21.08 Show
61219 ncm-et-13 2018-09-11 16:53 01:16:24 1975724 500 215 15 270 +147.19 +/- 19.86 Show
61220 ncm-et-10 2018-09-11 16:53 01:20:15 1941636 500 227 21 252 +152.18 +/- 20.96 Show
61221 ncm-et-13 2018-09-11 18:10 01:20:22 1896390 500 227 20 253 +153.02 +/- 20.88 Show
61222 ncm-et-9 2018-09-11 18:11 01:17:43 1989243 500 207 17 276 +138.99 +/- 19.61 Show
61223 ncm-et-4 2018-09-11 18:11 01:19:53 1987981 500 238 24 238 +158.93 +/- 21.78 Show
61224 ncm-et-3 2018-09-11 18:11 01:18:04 1992088 500 223 17 260 +152.18 +/- 20.44 Show
61225 ncm-et-15 2018-09-11 18:14 01:22:31 1880219 500 216 21 263 +143.07 +/- 20.38 Show
61226 ncm-et-10 2018-09-11 18:14 01:20:32 1956985 500 223 18 259 +151.35 +/- 20.52 Show
61227 ncm-et-9 2018-09-11 19:30 01:17:51 1990192 500 209 15 276 +142.26 +/- 19.55 Show
61228 ncm-et-3 2018-09-11 19:30 01:18:20 1990665 500 218 19 263 +146.36 +/- 20.33 Show
61229 ncm-et-13 2018-09-11 19:32 01:20:00 1955320 500 241 16 243 +168.40 +/- 21.33 Show
61230 ncm-et-4 2018-09-11 19:32 01:18:04 1989087 500 236 15 249 +164.93 +/- 20.97 Show
61231 ncm-et-10 2018-09-11 19:36 01:19:25 1945050 500 214 22 264 +140.62 +/- 20.35 Show
61232 ncm-et-15 2018-09-11 19:37 01:17:27 1983424 500 253 19 228 +176.33 +/- 22.25 Show
61233 ncm-et-9 2018-09-11 20:49 00:29:43 1988612 189 77 7 105 +135.10 +/- 31.90 Show
61234 ncm-et-3 2018-09-11 20:50 00:28:35 1991139 187 83 7 97 +149.85 +/- 33.65 Show
61235 ncm-et-4 2018-09-11 20:51 00:27:02 1990348 174 80 5 89 +160.23 +/- 35.02 Show
61236 ncm-et-13 2018-09-11 20:53 00:25:08 1977397 166 74 9 83 +143.72 +/- 36.90 Show
61237 ncm-et-15 2018-09-11 20:56 00:22:34 1982793 144 71 6 67 +169.01 +/- 41.25 Show
61238 ncm-et-10 2018-09-11 20:56 00:21:32 1909921 140 55 3 82 +135.53 +/- 35.21 Show

Commit

Commit ID 71cc01c2ef45bab91bdcd72c699f66e19dd518b3
Author AndyGrant
Date 2018-02-26 02:01:46 UTC
Commit Type Elo
Shallow search to verify probcut

Perform a preliminary shallow search to verify a probcut before doing
the normal "depth - 4 plies" search.

STC:
LLR: 4.73 (-2.94,2.94) [0.00,5.00]
Total: 36281 W: 8221 L: 7830 D: 20230
http://tests.stockfishchess.org/tests/view/5a921cb90ebc590297cc87f6

LTC:
LLR: 2.97 (-2.94,2.94) [0.00,5.00]
Total: 22907 W: 3954 L: 3738 D: 15215
http://tests.stockfishchess.org/tests/view/5a92672b0ebc590297cc8814

Happy to see something from Ethereal work for Stockfish :)

Bench: 5882274