Dev Builds » 20180104-2131

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Notice: NCM upgraded all servers to to Ubuntu 18.04 (from 16.04) on October 23rd. Binaries compiled on the upgraded disto are skewing measurements upwards. We are working on a fix.

Results

Host Started (UTC) Duration Base NPS (Avg) Games Wins Losses Draws Elo
ncm-et-3 2018-03-01 17:17 4844:39:57 2002409 2620 1030 82 1508 +131.68 +/- 8.28
ncm-et-4 2018-03-01 17:17 4844:39:43 1997864 2581 991 77 1513 +128.60 +/- 8.22
ncm-et-5 2018-03-01 17:17 02:14:33 2021818 914 372 30 512 +136.64 +/- 14.33
ncm-et-6 2018-03-01 17:17 02:14:46 2025818 919 362 28 529 +132.32 +/- 13.98
ncm-et-7 2018-03-01 17:17 02:14:51 1999596 891 359 35 497 +132.40 +/- 14.63
ncm-et-8 2018-03-01 17:17 02:14:44 1976111 926 368 27 531 +134.25 +/- 13.95
ncm-et-9 2018-03-01 17:17 4844:40:03 1999998 2575 1030 72 1473 +135.77 +/- 8.37
ncm-et-10 2018-03-01 17:17 4844:39:51 1978650 2544 987 81 1476 +129.40 +/- 8.36
ncm-et-11 2018-03-01 17:17 02:14:48 2018559 903 391 28 484 +148.02 +/- 14.86
ncm-et-12 2018-03-01 17:17 02:14:49 2018969 917 362 42 513 +126.56 +/- 14.45
ncm-et-13 2018-03-01 17:17 4844:39:45 1978775 2545 1006 82 1457 +132.17 +/- 8.44
ncm-et-15 2018-09-19 09:46 04:10:54 1971868 1665 662 54 949 +133.01 +/- 10.48
  20000 7920 638 11442 +132.58 +/- 3.01

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
4179 ncm-et-9 2018-03-01 17:17 01:16:05 2024590 500 197 12 291 +134.95 +/- 18.71 Show
4180 ncm-et-7 2018-03-01 17:17 01:15:09 1975910 500 201 18 281 +133.34 +/- 19.39 Show
4181 ncm-et-12 2018-03-01 17:17 01:12:44 2021977 500 207 23 270 +134.15 +/- 20.07 Show
4182 ncm-et-11 2018-03-01 17:17 01:13:30 2017259 500 218 15 267 +149.68 +/- 20.02 Show
4183 ncm-et-13 2018-03-01 17:17 01:13:31 2022795 500 192 13 295 +130.15 +/- 18.54 Show
4184 ncm-et-6 2018-03-01 17:17 01:12:26 2025736 500 196 14 290 +132.54 +/- 18.82 Show
4185 ncm-et-10 2018-03-01 17:17 01:15:04 2018720 500 182 20 298 +116.78 +/- 18.60 Show
4186 ncm-et-3 2018-03-01 17:17 01:13:09 2024263 500 210 17 273 +141.44 +/- 19.77 Show
4187 ncm-et-8 2018-03-01 17:17 01:12:22 1960622 500 196 16 288 +130.94 +/- 18.98 Show
4188 ncm-et-5 2018-03-01 17:17 01:13:09 2019208 500 205 11 284 +142.26 +/- 19.02 Show
4189 ncm-et-4 2018-03-01 17:17 01:16:04 2003791 500 199 14 287 +134.95 +/- 18.97 Show
4190 ncm-et-8 2018-03-01 18:30 01:01:03 1991599 426 172 11 243 +138.16 +/- 20.62 Show
4191 ncm-et-6 2018-03-01 18:30 01:01:01 2025899 419 166 14 239 +132.05 +/- 20.92 Show
4192 ncm-et-12 2018-03-01 18:31 01:00:46 2015961 417 155 19 243 +117.61 +/- 20.81 Show
4193 ncm-et-3 2018-03-01 18:31 01:00:20 2027210 425 163 21 241 +120.72 +/- 21.08 Show
4194 ncm-et-5 2018-03-01 18:31 01:00:06 2024427 414 167 19 228 +129.94 +/- 21.76 Show
4195 ncm-et-13 2018-03-01 18:31 01:00:00 2026227 410 154 15 241 +122.64 +/- 20.72 Show
4196 ncm-et-11 2018-03-01 18:32 00:59:57 2019859 403 173 13 217 +145.96 +/- 22.21 Show
4197 ncm-et-10 2018-03-01 18:33 00:58:26 2020510 403 146 15 242 +117.19 +/- 20.56 Show
4198 ncm-et-7 2018-03-01 18:33 00:58:23 2023282 391 158 17 216 +131.19 +/- 22.32 Show
4199 ncm-et-9 2018-03-01 18:34 00:57:19 2023936 395 169 10 216 +148.24 +/- 22.07 Show
4200 ncm-et-4 2018-03-01 18:34 00:57:04 2027211 397 141 14 242 +115.19 +/- 20.44 Show
62223 ncm-et-13 2018-09-19 09:45 01:16:11 1942620 500 209 12 279 +144.72 +/- 19.31 Show
62224 ncm-et-3 2018-09-19 09:45 01:13:25 1990034 500 190 13 297 +128.55 +/- 18.44 Show
62225 ncm-et-10 2018-09-19 09:45 01:15:06 1981537 500 195 19 286 +127.76 +/- 19.17 Show
62226 ncm-et-4 2018-09-19 09:45 01:14:59 1989560 500 184 12 304 +124.60 +/- 18.07 Show
62227 ncm-et-9 2018-09-19 09:46 01:12:57 1989716 500 197 16 287 +131.74 +/- 19.03 Show
62228 ncm-et-15 2018-09-19 09:46 01:13:48 1982007 500 201 15 284 +135.76 +/- 19.15 Show
62229 ncm-et-9 2018-09-19 11:00 01:13:51 1985936 500 205 17 278 +137.37 +/- 19.51 Show
62230 ncm-et-3 2018-09-19 11:00 01:13:18 1992406 500 197 13 290 +134.15 +/- 18.79 Show
62231 ncm-et-15 2018-09-19 11:00 01:14:46 1943634 500 198 16 286 +132.54 +/- 19.08 Show
62232 ncm-et-4 2018-09-19 11:01 01:12:51 1987823 500 194 11 295 +133.34 +/- 18.47 Show
62233 ncm-et-10 2018-09-19 11:01 01:16:35 1914616 500 212 12 276 +147.19 +/- 19.46 Show
62234 ncm-et-13 2018-09-19 11:02 01:16:07 1965883 500 190 20 290 +123.02 +/- 19.00 Show
62235 ncm-et-3 2018-09-19 12:14 01:12:48 1990664 500 189 13 298 +127.76 +/- 18.39 Show
62236 ncm-et-9 2018-09-19 12:14 01:14:47 1987353 500 185 14 301 +123.81 +/- 18.28 Show
62237 ncm-et-4 2018-09-19 12:15 01:13:05 1988927 500 207 20 273 +136.56 +/- 19.85 Show
62238 ncm-et-15 2018-09-19 12:16 01:14:26 1980133 500 197 18 285 +130.15 +/- 19.19 Show
62239 ncm-et-10 2018-09-19 12:19 01:15:17 1952468 500 201 9 290 +140.62 +/- 18.65 Show
62240 ncm-et-13 2018-09-19 12:20 01:15:03 1987194 500 209 17 274 +140.62 +/- 19.71 Show
62241 ncm-et-3 2018-09-19 13:28 00:28:39 1989874 195 81 5 109 +142.97 +/- 30.99 Show
62242 ncm-et-4 2018-09-19 13:30 00:27:06 1989874 184 66 6 112 +117.59 +/- 30.04 Show
62243 ncm-et-9 2018-09-19 13:30 00:26:22 1988454 180 77 3 100 +151.81 +/- 32.15 Show
62244 ncm-et-15 2018-09-19 13:32 00:24:40 1981696 165 66 5 94 +134.83 +/- 33.37 Show
62245 ncm-et-10 2018-09-19 13:36 00:21:02 1984047 141 51 6 84 +114.90 +/- 35.22 Show
62246 ncm-et-13 2018-09-19 13:36 00:20:35 1927932 135 52 5 78 +126.24 +/- 36.72 Show

Commit

Commit ID 66ce8ad5fd0e67904ca96dd9ac58f2e512a1f380
Author hxim
Date 2018-01-04 21:31:30 UTC
Commit Type
Remove ThreatByHangingPawn bonus (#1356)

* no ThreatByHangingPawn

* bench: 4919682

Tests From Startpos

Host Wins Losses Draws Elo
ncm-et-3 5004 1943 116 2945 +132.99 +/- 5.85
ncm-et-4 4996 1950 132 2914 +132.50 +/- 5.91
  10000 3893 248 5859 +132.74 +/- 4.16