Dev Builds » 20180226-0201

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-02-27 05:28 4719:50:10 2002198 2611 1188 92 1331 +155.44 +/- 9.06
ncm-et-4 2018-02-27 05:28 4719:49:50 2000736 2586 1199 104 1283 +157.00 +/- 9.29
ncm-et-5 2018-02-27 05:28 02:20:47 2023446 907 395 31 481 +147.74 +/- 14.97
ncm-et-6 2018-02-27 05:28 02:21:08 2026145 917 405 42 470 +145.48 +/- 15.33
ncm-et-7 2018-02-27 05:28 02:21:13 2009012 904 421 44 439 +154.30 +/- 15.99
ncm-et-8 2018-02-27 05:28 02:21:18 2021897 901 417 40 444 +154.88 +/- 15.84
ncm-et-9 2018-02-27 05:28 4719:50:11 2000868 2610 1137 93 1380 +147.19 +/- 8.84
ncm-et-10 2018-02-27 05:28 4719:49:48 1965905 2558 1125 112 1321 +145.54 +/- 9.12
ncm-et-11 2018-02-27 05:28 02:21:07 2005932 909 404 37 468 +148.74 +/- 15.31
ncm-et-12 2018-02-27 05:28 02:20:57 1987855 884 385 34 465 +145.98 +/- 15.29
ncm-et-13 2018-02-27 05:28 4719:49:59 1975641 2569 1161 87 1321 +154.73 +/- 9.07
ncm-et-15 2018-09-11 16:53 04:25:32 1950594 1644 758 76 810 +153.37 +/- 11.73
  20000 8995 792 10213 +151.41 +/- 3.28

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
3595 ncm-et-9 2018-02-27 05:28 01:17:30 2024590 500 227 22 251 +151.35 +/- 21.03 Show
3596 ncm-et-8 2018-02-27 05:28 01:18:47 2021814 500 240 21 239 +163.21 +/- 21.67 Show
3597 ncm-et-7 2018-02-27 05:28 01:17:06 1993925 500 221 27 252 +142.26 +/- 21.08 Show
3598 ncm-et-13 2018-02-27 05:28 01:17:51 2024263 500 221 11 268 +155.54 +/- 19.83 Show
3599 ncm-et-3 2018-02-27 05:28 01:15:27 2025735 500 234 22 244 +157.24 +/- 21.41 Show
3600 ncm-et-10 2018-02-27 05:28 01:16:47 2020347 500 211 28 261 +133.34 +/- 20.63 Show
3601 ncm-et-6 2018-02-27 05:28 01:17:06 2026882 500 226 19 255 +153.02 +/- 20.75 Show
3602 ncm-et-4 2018-02-27 05:28 01:16:23 2025081 500 220 24 256 +143.89 +/- 20.81 Show
3603 ncm-et-12 2018-02-27 05:28 01:21:13 1955362 500 214 20 266 +142.26 +/- 20.20 Show
3604 ncm-et-11 2018-02-27 05:28 01:17:17 2013210 500 216 19 265 +144.72 +/- 20.23 Show
3605 ncm-et-5 2018-02-27 05:28 01:16:43 2022793 500 220 16 264 +150.51 +/- 20.20 Show
3606 ncm-et-3 2018-02-27 06:45 01:04:43 2025735 424 192 12 220 +157.46 +/- 22.14 Show
3607 ncm-et-4 2018-02-27 06:46 01:03:25 2023938 412 201 16 195 +167.98 +/- 23.99 Show
3608 ncm-et-10 2018-02-27 06:46 01:03:27 2021488 418 195 20 203 +154.98 +/- 23.54 Show
3609 ncm-et-5 2018-02-27 06:46 01:02:59 2024099 407 175 15 217 +144.35 +/- 22.32 Show
3610 ncm-et-7 2018-02-27 06:46 01:03:02 2024099 404 200 17 187 +169.70 +/- 24.59 Show
3611 ncm-et-6 2018-02-27 06:46 01:02:57 2025408 417 179 23 215 +136.61 +/- 22.77 Show
3612 ncm-et-9 2018-02-27 06:47 01:02:29 2024590 421 190 12 219 +156.73 +/- 22.19 Show
3613 ncm-et-11 2018-02-27 06:47 01:02:45 1998654 409 188 18 203 +153.71 +/- 23.43 Show
3614 ncm-et-13 2018-02-27 06:47 01:02:18 2024754 403 183 16 204 +153.19 +/- 23.26 Show
3615 ncm-et-8 2018-02-27 06:48 01:01:26 2021979 401 177 19 205 +144.72 +/- 23.27 Show
3616 ncm-et-12 2018-02-27 06:51 00:58:39 2020347 384 171 14 199 +150.87 +/- 23.42 Show
61215 ncm-et-4 2018-09-11 16:53 01:17:11 1987981 500 224 20 256 +150.51 +/- 20.72 Show
61216 ncm-et-9 2018-09-11 16:53 01:17:01 1987981 500 227 20 253 +153.02 +/- 20.88 Show
61217 ncm-et-15 2018-09-11 16:53 01:19:44 1955938 500 218 30 252 +137.37 +/- 21.13 Show
61218 ncm-et-3 2018-09-11 16:53 01:17:17 1987825 500 238 15 247 +166.66 +/- 21.08 Show
61219 ncm-et-13 2018-09-11 16:53 01:16:24 1975724 500 215 15 270 +147.19 +/- 19.86 Show
61220 ncm-et-10 2018-09-11 16:53 01:20:15 1941636 500 227 21 252 +152.18 +/- 20.96 Show
61221 ncm-et-13 2018-09-11 18:10 01:20:22 1896390 500 227 20 253 +153.02 +/- 20.88 Show
61222 ncm-et-9 2018-09-11 18:11 01:17:43 1989243 500 207 17 276 +138.99 +/- 19.61 Show
61223 ncm-et-4 2018-09-11 18:11 01:19:53 1987981 500 238 24 238 +158.93 +/- 21.78 Show
61224 ncm-et-3 2018-09-11 18:11 01:18:04 1992088 500 223 17 260 +152.18 +/- 20.44 Show
61225 ncm-et-15 2018-09-11 18:14 01:22:31 1880219 500 216 21 263 +143.07 +/- 20.38 Show
61226 ncm-et-10 2018-09-11 18:14 01:20:32 1956985 500 223 18 259 +151.35 +/- 20.52 Show
61227 ncm-et-9 2018-09-11 19:30 01:17:51 1990192 500 209 15 276 +142.26 +/- 19.55 Show
61228 ncm-et-3 2018-09-11 19:30 01:18:20 1990665 500 218 19 263 +146.36 +/- 20.33 Show
61229 ncm-et-13 2018-09-11 19:32 01:20:00 1955320 500 241 16 243 +168.40 +/- 21.33 Show
61230 ncm-et-4 2018-09-11 19:32 01:18:04 1989087 500 236 15 249 +164.93 +/- 20.97 Show
61231 ncm-et-10 2018-09-11 19:36 01:19:25 1945050 500 214 22 264 +140.62 +/- 20.35 Show
61232 ncm-et-15 2018-09-11 19:37 01:17:27 1983424 500 253 19 228 +176.33 +/- 22.25 Show
61233 ncm-et-9 2018-09-11 20:49 00:29:43 1988612 189 77 7 105 +135.10 +/- 31.90 Show
61234 ncm-et-3 2018-09-11 20:50 00:28:35 1991139 187 83 7 97 +149.85 +/- 33.65 Show
61235 ncm-et-4 2018-09-11 20:51 00:27:02 1990348 174 80 5 89 +160.23 +/- 35.02 Show
61236 ncm-et-13 2018-09-11 20:53 00:25:08 1977397 166 74 9 83 +143.72 +/- 36.90 Show
61237 ncm-et-15 2018-09-11 20:56 00:22:34 1982793 144 71 6 67 +169.01 +/- 41.25 Show
61238 ncm-et-10 2018-09-11 20:56 00:21:32 1909921 140 55 3 82 +135.53 +/- 35.21 Show

Commit

Commit ID 71cc01c2ef45bab91bdcd72c699f66e19dd518b3
Author AndyGrant
Date 2018-02-26 02:01:46 UTC
Commit Type Elo
Shallow search to verify probcut

Perform a preliminary shallow search to verify a probcut before doing
the normal "depth - 4 plies" search.

STC:
LLR: 4.73 (-2.94,2.94) [0.00,5.00]
Total: 36281 W: 8221 L: 7830 D: 20230
http://tests.stockfishchess.org/tests/view/5a921cb90ebc590297cc87f6

LTC:
LLR: 2.97 (-2.94,2.94) [0.00,5.00]
Total: 22907 W: 3954 L: 3738 D: 15215
http://tests.stockfishchess.org/tests/view/5a92672b0ebc590297cc8814

Happy to see something from Ethereal work for Stockfish :)

Bench: 5882274