Dev Builds » 20190405-1837

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 09:06:26 1961825 3310 1415 272 1623 +125.12 +/- 8.4
ncm-et-4 09:10:56 1941711 3309 1393 266 1650 +123.25 +/- 8.32
ncm-et-9 09:11:20 1969326 3361 1464 259 1638 +130.35 +/- 8.36
ncm-et-10 09:09:45 1968695 3324 1411 266 1647 +124.78 +/- 8.33
ncm-et-13 09:09:44 1976291 3354 1418 275 1661 +123.33 +/- 8.3
ncm-et-15 09:08:59 1971713 3342 1489 265 1588 +133.44 +/- 8.51
20000 8590 1603 9807 +126.71 +/- 3.41

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
76682 ncm-et-3 2019-04-06 06:09 00:53:27 1904813 310 121 24 165 +112.49 +/- 26.14
76681 ncm-et-4 2019-04-06 06:09 00:53:42 1901893 309 126 24 159 +119.15 +/- 26.75
76680 ncm-et-10 2019-04-06 06:08 00:54:21 1958928 324 153 30 141 +138.84 +/- 28.76
76679 ncm-et-15 2019-04-06 06:06 00:56:37 1969399 342 163 22 157 +152.3 +/- 27.1
76678 ncm-et-13 2019-04-06 06:04 00:58:26 1972186 354 140 34 180 +107.32 +/- 25.26
76677 ncm-et-9 2019-04-06 06:03 01:00:03 1964476 361 148 30 183 +117.89 +/- 25.0
76676 ncm-et-4 2019-04-06 04:47 01:21:28 1972531 500 199 41 260 +113.68 +/- 20.89
76675 ncm-et-3 2019-04-06 04:46 01:22:08 1984659 500 218 44 238 +126.18 +/- 22.03
76674 ncm-et-15 2019-04-06 04:44 01:21:26 1961860 500 223 34 243 +138.18 +/- 21.68
76673 ncm-et-10 2019-04-06 04:43 01:23:56 1956331 500 198 35 267 +117.55 +/- 20.47
76672 ncm-et-13 2019-04-06 04:41 01:21:52 1977785 500 193 40 267 +109.83 +/- 20.53
76671 ncm-et-9 2019-04-06 04:39 01:22:26 1965227 500 234 31 235 +149.68 +/- 22.08
76670 ncm-et-3 2019-04-06 03:24 01:21:23 1962149 500 204 37 259 +120.67 +/- 20.9
76669 ncm-et-15 2019-04-06 03:20 01:22:25 1968940 500 214 33 253 +131.74 +/- 21.15
76668 ncm-et-10 2019-04-06 03:20 01:22:39 1983292 500 211 40 249 +123.81 +/- 21.44
76667 ncm-et-13 2019-04-06 03:18 01:21:52 1968630 500 219 35 246 +134.15 +/- 21.54
76666 ncm-et-4 2019-04-06 03:17 01:28:27 1843770 500 211 35 254 +127.76 +/- 21.13
76665 ncm-et-9 2019-04-06 03:15 01:22:52 1968014 500 219 35 246 +134.15 +/- 21.54
76664 ncm-et-3 2019-04-06 02:01 01:21:19 1978927 500 220 48 232 +124.6 +/- 22.36
76663 ncm-et-15 2019-04-06 01:58 01:20:53 1968481 500 239 38 223 +148.02 +/- 22.8
76662 ncm-et-10 2019-04-06 01:56 01:22:22 1962765 500 213 40 247 +125.39 +/- 21.54
76661 ncm-et-13 2019-04-06 01:56 01:21:27 1974835 500 207 54 239 +109.83 +/- 22.03
76660 ncm-et-4 2019-04-06 01:54 01:22:13 1962614 500 218 41 241 +128.55 +/- 21.86
76659 ncm-et-9 2019-04-06 01:52 01:21:56 1974208 500 217 43 240 +126.18 +/- 21.92
76658 ncm-et-3 2019-04-06 00:37 01:23:12 1963227 500 204 46 250 +113.68 +/- 21.44
76657 ncm-et-15 2019-04-06 00:35 01:22:22 1968817 500 210 47 243 +117.55 +/- 21.8
76656 ncm-et-10 2019-04-06 00:33 01:22:06 1971563 500 209 40 251 +122.24 +/- 21.33
76655 ncm-et-13 2019-04-06 00:33 01:22:10 1993253 500 219 41 240 +129.35 +/- 21.91
76654 ncm-et-4 2019-04-06 00:31 01:21:18 1972846 500 216 43 241 +125.39 +/- 21.87
76653 ncm-et-9 2019-04-06 00:31 01:20:19 1969264 500 208 43 249 +119.11 +/- 21.46
76652 ncm-et-3 2019-04-05 23:13 01:22:47 1963840 500 229 44 227 +134.95 +/- 22.61
76651 ncm-et-15 2019-04-05 23:11 01:22:36 1972189 500 216 37 247 +130.15 +/- 21.51
76650 ncm-et-10 2019-04-05 23:11 01:21:25 1971665 500 208 46 246 +116.78 +/- 21.64
76649 ncm-et-13 2019-04-05 23:10 01:21:42 1974851 500 232 35 233 +144.72 +/- 22.23
76648 ncm-et-9 2019-04-05 23:07 01:22:38 1973443 500 224 36 240 +137.37 +/- 21.87
76647 ncm-et-4 2019-04-05 23:07 01:23:30 1961695 500 192 46 262 +104.49 +/- 20.84
76646 ncm-et-3 2019-04-05 21:50 01:22:10 1975166 500 219 29 252 +138.99 +/- 21.14
76645 ncm-et-15 2019-04-05 21:47 01:22:40 1992309 500 224 54 222 +123.02 +/- 22.9
76644 ncm-et-13 2019-04-05 21:47 01:22:15 1972499 500 208 36 256 +124.6 +/- 21.04
76643 ncm-et-10 2019-04-05 21:47 01:22:56 1976323 500 219 35 246 +134.15 +/- 21.54
76642 ncm-et-4 2019-04-05 21:46 01:20:18 1976633 500 231 36 233 +143.07 +/- 22.24
76641 ncm-et-9 2019-04-05 21:45 01:21:06 1970655 500 214 41 245 +125.39 +/- 21.65

Commit

Commit ID 1982fe25f817c29aef9dd156869a53e520ce3629
Author xoto10
Date 2019-04-05 18:37:16 UTC
Use average bestMoveChanges across all threads #2072 The current update only by main thread depends on the luck of whether main thread sees any/many changes to the best move or not. It then makes large, lumpy changes to the time to be used (1x, 2x, 3x, etc) depending on that sample of 1. Use the average across all threads to get a more reliable number with a smoother distribution. STC @ 5+0.05 th 4 : LLR: 2.95 (-2.94,2.94) [0.50,4.50] Total: 51899 W: 11446 L: 11029 D: 29424 http://tests.stockfishchess.org/tests/view/5ca32ff20ebc5925cf0016fb STC @ 5+0.05 th 8 : LLR: 2.96 (-2.94,2.94) [0.50,4.50] Total: 13851 W: 2843 L: 2620 D: 8388 http://tests.stockfishchess.org/tests/view/5ca35ae00ebc5925cf001adb LTC @ 20+0.2 th 8 : LLR: 2.95 (-2.94,2.94) [0.00,3.50] Total: 48527 W: 7941 L: 7635 D: 32951 http://tests.stockfishchess.org/tests/view/5ca37cb70ebc5925cf001cec Further work: Similar changes might be possible for the fallingEval and timeReduction calculations (and elsewhere?), using either the min, average or max values across all threads. Bench 3506898
Copyright 2011–2024 Next Chess Move LLC