Dev Builds » 20180104-2131

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-01 17:17 4844:39:57 2002409 2620 1030 82 1508 +131.68 +/- 8.28
ncm-et-4 2018-03-01 17:17 4844:39:43 1997864 2581 991 77 1513 +128.60 +/- 8.22
ncm-et-5 2018-03-01 17:17 02:14:33 2021818 914 372 30 512 +136.64 +/- 14.33
ncm-et-6 2018-03-01 17:17 02:14:46 2025818 919 362 28 529 +132.32 +/- 13.98
ncm-et-7 2018-03-01 17:17 02:14:51 1999596 891 359 35 497 +132.40 +/- 14.63
ncm-et-8 2018-03-01 17:17 02:14:44 1976111 926 368 27 531 +134.25 +/- 13.95
ncm-et-9 2018-03-01 17:17 4844:40:03 1999998 2575 1030 72 1473 +135.77 +/- 8.37
ncm-et-10 2018-03-01 17:17 4844:39:51 1978650 2544 987 81 1476 +129.40 +/- 8.36
ncm-et-11 2018-03-01 17:17 02:14:48 2018559 903 391 28 484 +148.02 +/- 14.86
ncm-et-12 2018-03-01 17:17 02:14:49 2018969 917 362 42 513 +126.56 +/- 14.45
ncm-et-13 2018-03-01 17:17 4844:39:45 1978775 2545 1006 82 1457 +132.17 +/- 8.44
ncm-et-15 2018-09-19 09:46 04:10:54 1971868 1665 662 54 949 +133.01 +/- 10.48
  20000 7920 638 11442 +132.58 +/- 3.01

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
4179 ncm-et-9 2018-03-01 17:17 01:16:05 2024590 500 197 12 291 +134.95 +/- 18.71 Show
4180 ncm-et-7 2018-03-01 17:17 01:15:09 1975910 500 201 18 281 +133.34 +/- 19.39 Show
4181 ncm-et-12 2018-03-01 17:17 01:12:44 2021977 500 207 23 270 +134.15 +/- 20.07 Show
4182 ncm-et-11 2018-03-01 17:17 01:13:30 2017259 500 218 15 267 +149.68 +/- 20.02 Show
4183 ncm-et-13 2018-03-01 17:17 01:13:31 2022795 500 192 13 295 +130.15 +/- 18.54 Show
4184 ncm-et-6 2018-03-01 17:17 01:12:26 2025736 500 196 14 290 +132.54 +/- 18.82 Show
4185 ncm-et-10 2018-03-01 17:17 01:15:04 2018720 500 182 20 298 +116.78 +/- 18.60 Show
4186 ncm-et-3 2018-03-01 17:17 01:13:09 2024263 500 210 17 273 +141.44 +/- 19.77 Show
4187 ncm-et-8 2018-03-01 17:17 01:12:22 1960622 500 196 16 288 +130.94 +/- 18.98 Show
4188 ncm-et-5 2018-03-01 17:17 01:13:09 2019208 500 205 11 284 +142.26 +/- 19.02 Show
4189 ncm-et-4 2018-03-01 17:17 01:16:04 2003791 500 199 14 287 +134.95 +/- 18.97 Show
4190 ncm-et-8 2018-03-01 18:30 01:01:03 1991599 426 172 11 243 +138.16 +/- 20.62 Show
4191 ncm-et-6 2018-03-01 18:30 01:01:01 2025899 419 166 14 239 +132.05 +/- 20.92 Show
4192 ncm-et-12 2018-03-01 18:31 01:00:46 2015961 417 155 19 243 +117.61 +/- 20.81 Show
4193 ncm-et-3 2018-03-01 18:31 01:00:20 2027210 425 163 21 241 +120.72 +/- 21.08 Show
4194 ncm-et-5 2018-03-01 18:31 01:00:06 2024427 414 167 19 228 +129.94 +/- 21.76 Show
4195 ncm-et-13 2018-03-01 18:31 01:00:00 2026227 410 154 15 241 +122.64 +/- 20.72 Show
4196 ncm-et-11 2018-03-01 18:32 00:59:57 2019859 403 173 13 217 +145.96 +/- 22.21 Show
4197 ncm-et-10 2018-03-01 18:33 00:58:26 2020510 403 146 15 242 +117.19 +/- 20.56 Show
4198 ncm-et-7 2018-03-01 18:33 00:58:23 2023282 391 158 17 216 +131.19 +/- 22.32 Show
4199 ncm-et-9 2018-03-01 18:34 00:57:19 2023936 395 169 10 216 +148.24 +/- 22.07 Show
4200 ncm-et-4 2018-03-01 18:34 00:57:04 2027211 397 141 14 242 +115.19 +/- 20.44 Show
62223 ncm-et-13 2018-09-19 09:45 01:16:11 1942620 500 209 12 279 +144.72 +/- 19.31 Show
62224 ncm-et-3 2018-09-19 09:45 01:13:25 1990034 500 190 13 297 +128.55 +/- 18.44 Show
62225 ncm-et-10 2018-09-19 09:45 01:15:06 1981537 500 195 19 286 +127.76 +/- 19.17 Show
62226 ncm-et-4 2018-09-19 09:45 01:14:59 1989560 500 184 12 304 +124.60 +/- 18.07 Show
62227 ncm-et-9 2018-09-19 09:46 01:12:57 1989716 500 197 16 287 +131.74 +/- 19.03 Show
62228 ncm-et-15 2018-09-19 09:46 01:13:48 1982007 500 201 15 284 +135.76 +/- 19.15 Show
62229 ncm-et-9 2018-09-19 11:00 01:13:51 1985936 500 205 17 278 +137.37 +/- 19.51 Show
62230 ncm-et-3 2018-09-19 11:00 01:13:18 1992406 500 197 13 290 +134.15 +/- 18.79 Show
62231 ncm-et-15 2018-09-19 11:00 01:14:46 1943634 500 198 16 286 +132.54 +/- 19.08 Show
62232 ncm-et-4 2018-09-19 11:01 01:12:51 1987823 500 194 11 295 +133.34 +/- 18.47 Show
62233 ncm-et-10 2018-09-19 11:01 01:16:35 1914616 500 212 12 276 +147.19 +/- 19.46 Show
62234 ncm-et-13 2018-09-19 11:02 01:16:07 1965883 500 190 20 290 +123.02 +/- 19.00 Show
62235 ncm-et-3 2018-09-19 12:14 01:12:48 1990664 500 189 13 298 +127.76 +/- 18.39 Show
62236 ncm-et-9 2018-09-19 12:14 01:14:47 1987353 500 185 14 301 +123.81 +/- 18.28 Show
62237 ncm-et-4 2018-09-19 12:15 01:13:05 1988927 500 207 20 273 +136.56 +/- 19.85 Show
62238 ncm-et-15 2018-09-19 12:16 01:14:26 1980133 500 197 18 285 +130.15 +/- 19.19 Show
62239 ncm-et-10 2018-09-19 12:19 01:15:17 1952468 500 201 9 290 +140.62 +/- 18.65 Show
62240 ncm-et-13 2018-09-19 12:20 01:15:03 1987194 500 209 17 274 +140.62 +/- 19.71 Show
62241 ncm-et-3 2018-09-19 13:28 00:28:39 1989874 195 81 5 109 +142.97 +/- 30.99 Show
62242 ncm-et-4 2018-09-19 13:30 00:27:06 1989874 184 66 6 112 +117.59 +/- 30.04 Show
62243 ncm-et-9 2018-09-19 13:30 00:26:22 1988454 180 77 3 100 +151.81 +/- 32.15 Show
62244 ncm-et-15 2018-09-19 13:32 00:24:40 1981696 165 66 5 94 +134.83 +/- 33.37 Show
62245 ncm-et-10 2018-09-19 13:36 00:21:02 1984047 141 51 6 84 +114.90 +/- 35.22 Show
62246 ncm-et-13 2018-09-19 13:36 00:20:35 1927932 135 52 5 78 +126.24 +/- 36.72 Show

Commit

Commit ID 66ce8ad5fd0e67904ca96dd9ac58f2e512a1f380
Author hxim
Date 2018-01-04 21:31:30 UTC
Commit Type
Remove ThreatByHangingPawn bonus (#1356)

* no ThreatByHangingPawn

* bench: 4919682

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5004 1943 116 2945 +132.99 +/- 5.85
ncm-et-4 4996 1950 132 2914 +132.50 +/- 5.91
  10000 3893 248 5859 +132.74 +/- 4.16