Dev Builds » 20160827-0753

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 06:19:39 1989416 2568 603 141 1824 +63.19 +/- 7.05
ncm-et-4 06:19:50 1946454 2541 609 163 1769 +61.62 +/- 7.28
ncm-et-5 02:13:02 2010454 901 216 82 603 +52.06 +/- 12.89
ncm-et-6 02:13:05 2024591 925 197 67 661 +49.15 +/- 11.78
ncm-et-7 02:13:15 2023775 922 183 58 681 +47.4 +/- 11.27
ncm-et-8 02:13:00 1988853 894 214 58 622 +61.25 +/- 12.3
ncm-et-9 06:19:42 1993031 2587 622 171 1794 +61.19 +/- 7.26
ncm-et-10 06:19:50 1984493 2564 633 150 1781 +66.24 +/- 7.24
ncm-et-11 02:13:18 2009060 911 210 64 637 +56.17 +/- 12.15
ncm-et-12 02:13:12 2022793 920 216 71 633 +55.22 +/- 12.34
ncm-et-13 06:19:58 1991938 2576 675 174 1727 +68.44 +/- 7.53
ncm-et-15 04:07:02 1976036 1691 443 113 1135 +68.68 +/- 9.28
20000 4821 1312 13867 +61.59 +/- 2.61

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
67874 ncm-et-10 2019-01-28 16:56 00:23:54 1977052 161 33 10 118 +49.98 +/- 27.27
67873 ncm-et-4 2019-01-28 16:56 00:24:14 1790201 145 38 12 95 +62.98 +/- 32.78
67872 ncm-et-9 2019-01-28 16:55 00:24:22 1977785 165 46 12 107 +72.63 +/- 30.87
67871 ncm-et-3 2019-01-28 16:55 00:25:21 1964920 167 40 8 119 +67.41 +/- 27.45
67870 ncm-et-13 2019-01-28 16:54 00:25:27 1985975 171 35 11 125 +49.09 +/- 26.58
67869 ncm-et-15 2019-01-28 16:52 00:28:27 1967706 191 39 14 138 +45.74 +/- 25.63
67868 ncm-et-3 2019-01-28 15:40 01:13:45 1975240 500 115 24 361 +63.95 +/- 15.6
67867 ncm-et-9 2019-01-28 15:39 01:15:04 1973602 500 120 24 356 +67.55 +/- 15.86
67866 ncm-et-13 2019-01-28 15:39 01:14:33 1977795 500 135 36 329 +69.71 +/- 17.46
67865 ncm-et-10 2019-01-28 15:39 01:16:25 1958624 500 131 35 334 +67.55 +/- 17.19
67864 ncm-et-15 2019-01-28 15:38 01:12:52 1982575 500 151 28 321 +87.26 +/- 17.7
67863 ncm-et-4 2019-01-28 15:38 01:17:03 1911633 500 126 35 339 +63.95 +/- 16.94
67862 ncm-et-9 2019-01-28 14:25 01:13:06 1983306 500 123 31 346 +64.66 +/- 16.52
67861 ncm-et-3 2019-01-28 14:25 01:13:40 1967076 500 116 24 360 +64.66 +/- 15.65
67860 ncm-et-13 2019-01-28 14:25 01:12:51 1968964 500 137 39 324 +68.99 +/- 17.75
67859 ncm-et-15 2019-01-28 14:25 01:11:57 1977631 500 137 34 329 +72.61 +/- 17.42
67858 ncm-et-4 2019-01-28 14:24 01:12:24 1963240 500 112 30 358 +57.5 +/- 15.88
67857 ncm-et-10 2019-01-28 14:24 01:14:01 1963535 500 132 21 347 +78.44 +/- 16.24
67856 ncm-et-13 2019-01-28 13:10 01:13:52 1969717 500 123 26 351 +68.27 +/- 16.16
67855 ncm-et-10 2019-01-28 13:10 01:12:39 1969658 500 132 37 331 +66.82 +/- 17.38
67854 ncm-et-4 2019-01-28 13:10 01:13:03 1961689 500 123 36 341 +61.08 +/- 16.86
67853 ncm-et-3 2019-01-28 13:10 01:14:10 1976806 500 121 35 344 +60.36 +/- 16.69
67852 ncm-et-15 2019-01-28 13:10 01:13:46 1976233 500 116 37 347 +55.36 +/- 16.57
67851 ncm-et-9 2019-01-28 13:10 01:14:17 1972353 500 130 35 335 +66.82 +/- 17.14
3302 ncm-et-8 2018-02-26 13:30 00:56:46 2022793 394 90 22 282 +60.57 +/- 17.85
3301 ncm-et-4 2018-02-26 13:29 00:58:15 2025409 396 100 24 272 +67.52 +/- 18.7
3300 ncm-et-3 2018-02-26 13:28 00:58:30 2025572 401 104 23 274 +71.16 +/- 18.64
3299 ncm-et-13 2018-02-26 13:28 00:59:01 2023446 405 118 27 260 +79.42 +/- 19.79
3298 ncm-et-5 2018-02-26 13:28 00:59:09 1999909 401 90 34 277 +48.84 +/- 18.69
3297 ncm-et-10 2018-02-26 13:27 00:59:20 2020185 403 87 23 293 +55.65 +/- 17.34
3296 ncm-et-9 2018-02-26 13:27 00:59:45 2025081 422 97 27 298 +58.17 +/- 17.61
3295 ncm-et-7 2018-02-26 13:27 01:00:12 2025247 422 82 26 314 +46.38 +/- 16.49
3294 ncm-et-11 2018-02-26 13:26 01:00:43 2000051 411 106 30 275 +64.99 +/- 18.96
3293 ncm-et-12 2018-02-26 13:26 01:00:53 2022629 420 90 38 292 +43.24 +/- 18.17
3292 ncm-et-6 2018-02-26 13:25 01:01:20 2025082 425 101 33 291 +56.07 +/- 18.26
3291 ncm-et-3 2018-02-26 12:13 01:14:13 2026882 500 107 27 366 +56.07 +/- 15.4
3290 ncm-et-5 2018-02-26 12:13 01:13:53 2020999 500 126 48 326 +54.65 +/- 17.77
3289 ncm-et-8 2018-02-26 12:13 01:16:14 1954914 500 124 36 340 +61.79 +/- 16.91
3288 ncm-et-10 2018-02-26 12:13 01:13:31 2017908 500 118 24 358 +66.1 +/- 15.75
3287 ncm-et-4 2018-02-26 12:12 01:14:51 2026554 500 110 26 364 +58.93 +/- 15.48
3286 ncm-et-9 2018-02-26 12:12 01:13:08 2026063 500 106 42 352 +44.72 +/- 16.38
3285 ncm-et-12 2018-02-26 12:12 01:12:19 2022958 500 126 33 341 +65.38 +/- 16.81
3284 ncm-et-7 2018-02-26 12:12 01:13:03 2022304 500 101 32 367 +48.25 +/- 15.44
3283 ncm-et-13 2018-02-26 12:12 01:14:14 2025736 500 127 35 338 +64.66 +/- 16.99
3282 ncm-et-6 2018-02-26 12:12 01:11:45 2024100 500 96 34 370 +43.3 +/- 15.31
3281 ncm-et-11 2018-02-26 12:12 01:12:35 2018070 500 104 34 362 +48.96 +/- 15.74

Commit

Commit ID 805afcbf3d5db39c85b759232cfb99ab0a250311
Author Stéphane Nicolet
Date 2016-08-27 07:53:26 UTC
Move CheckInfo under StateInfo This greately simplifies usage because hides to the search the implementation specific CheckInfo. This is based on the work done by Marco in pull request #716, implementing on top of it the ideas in the discussion: caching the calls to slider_blockers() in the CheckInfo structure, and simplifying the slider_blockers() function by removing its first parameter. Compared to master, bench is identical but the number of calls to slider_blockers() during bench goes down from 22461515 to 18853422, hopefully being a little bit faster overall. archlinux, gcc-6 make profile-build ARCH=x86-64-bmi2 50 runs each bench: base = 2356320 +/- 981 test = 2403811 +/- 981 diff = 47490 +/- 1828 speedup = 0.0202 P(speedup > 0) = 1.0000 perft 6: base = 175498484 +/- 429925 test = 183997959 +/- 429925 diff = 8499474 +/- 469401 speedup = 0.0484 P(speedup > 0) = 1.0000 perft 7 (but only 10 runs): base = 185403228 +/- 468705 test = 188777591 +/- 468705 diff = 3374363 +/- 476687 speedup = 0.0182 P(speedup > 0) = 1.0000 $ ./pyshbench ../Stockfish/master ../Stockfish/test 20 run base test diff ... base = 2501728 +/- 182034 test = 2532997 +/- 182034 diff = 31268 +/- 5116 speedup = 0.0125 P(speedup > 0) = 1.0000 No functional change.
Copyright 2011–2024 Next Chess Move LLC