Dev Builds » 20200901-0725

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:36:06 1962655 3326 2435 40 851 +315.41 +/- 11.66
ncm-et-4 08:36:06 1962685 3336 2427 55 854 +308.96 +/- 11.65
ncm-et-9 08:36:17 1967473 3329 2471 35 823 +323.98 +/- 11.86
ncm-et-10 08:36:21 1961768 3308 2458 37 813 +324.06 +/- 11.93
ncm-et-13 08:36:05 1960509 3333 2500 32 801 +330.59 +/- 12.02
ncm-et-15 08:36:31 1969876 3368 2489 40 839 +320.55 +/- 11.75
20000 14780 239 4981 +320.49 +/- 4.82

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
137155 ncm-et-10 2020-09-03 23:31 00:48:20 1958324 308 217 3 88 +297.82 +/- 36.42
137154 ncm-et-3 2020-09-03 23:28 00:50:12 1962148 326 240 3 83 +320.45 +/- 37.63
137153 ncm-et-9 2020-09-03 23:27 00:51:13 1966927 329 242 5 82 +315.61 +/- 37.96
137152 ncm-et-13 2020-09-03 23:27 00:51:25 1960316 333 261 3 69 +358.61 +/- 41.51
137151 ncm-et-4 2020-09-03 23:25 00:53:26 1971723 336 249 8 79 +313.38 +/- 38.69
137150 ncm-et-15 2020-09-03 23:23 00:56:03 1972339 368 275 3 90 +329.56 +/- 36.12
137149 ncm-et-10 2020-09-03 22:12 01:17:17 1964793 500 376 3 121 +334.88 +/- 31.04
137148 ncm-et-9 2020-09-03 22:11 01:15:50 1974049 500 373 6 121 +325.67 +/- 31.13
137147 ncm-et-3 2020-09-03 22:09 01:18:16 1963538 500 364 5 131 +313.91 +/- 29.83
137146 ncm-et-13 2020-09-03 22:08 01:17:36 1960308 500 377 3 120 +336.46 +/- 31.18
137145 ncm-et-4 2020-09-03 22:07 01:17:14 1966945 500 361 8 131 +305.45 +/- 29.9
137144 ncm-et-15 2020-09-03 22:05 01:16:49 1969709 500 369 4 127 +322.67 +/- 30.3
137143 ncm-et-10 2020-09-03 20:54 01:17:12 1964615 500 374 4 122 +330.23 +/- 30.94
137142 ncm-et-9 2020-09-03 20:52 01:17:29 1962307 500 375 2 123 +334.88 +/- 30.73
137141 ncm-et-3 2020-09-03 20:51 01:17:09 1963839 500 372 3 125 +328.7 +/- 30.51
137140 ncm-et-13 2020-09-03 20:50 01:17:12 1959705 500 375 8 117 +325.67 +/- 31.7
137139 ncm-et-4 2020-09-03 20:50 01:15:52 1964307 500 355 8 137 +297.28 +/- 29.21
137138 ncm-et-15 2020-09-03 20:48 01:16:10 1968777 500 363 8 129 +308.24 +/- 30.14
137137 ncm-et-10 2020-09-03 19:36 01:16:34 1965228 500 363 6 131 +311.06 +/- 29.86
137136 ncm-et-9 2020-09-03 19:33 01:18:08 1974067 500 365 3 132 +318.25 +/- 29.64
137135 ncm-et-3 2020-09-03 19:33 01:17:13 1961383 500 373 5 122 +327.18 +/- 30.97
137134 ncm-et-13 2020-09-03 19:32 01:17:03 1959237 500 373 2 125 +331.77 +/- 30.47
137133 ncm-et-4 2020-09-03 19:31 01:17:59 1969563 500 377 5 118 +333.32 +/- 31.52
137132 ncm-et-15 2020-09-03 19:30 01:16:39 1969436 500 370 5 125 +322.67 +/- 30.58
137131 ncm-et-10 2020-09-03 18:16 01:18:56 1958318 500 372 12 116 +315.35 +/- 31.82
137130 ncm-et-3 2020-09-03 18:15 01:16:46 1961688 500 364 7 129 +311.06 +/- 30.13
137129 ncm-et-9 2020-09-03 18:14 01:17:16 1963549 500 365 4 131 +316.8 +/- 29.8
137128 ncm-et-4 2020-09-03 18:14 01:15:42 1973427 500 365 9 126 +309.64 +/- 30.52
137127 ncm-et-13 2020-09-03 18:14 01:17:21 1964609 500 380 4 116 +339.63 +/- 31.78
137126 ncm-et-15 2020-09-03 18:12 01:17:04 1974826 500 364 7 129 +311.06 +/- 30.13
137125 ncm-et-10 2020-09-03 16:57 01:18:20 1964920 500 379 5 116 +336.46 +/- 31.8
137124 ncm-et-3 2020-09-03 16:56 01:17:22 1964304 500 365 8 127 +311.06 +/- 30.39
137123 ncm-et-4 2020-09-03 16:56 01:17:27 1970025 500 369 8 123 +316.8 +/- 30.9
137122 ncm-et-9 2020-09-03 16:55 01:18:01 1970185 500 391 3 106 +359.68 +/- 33.28
137121 ncm-et-13 2020-09-03 16:55 01:18:02 1959388 500 362 5 133 +311.06 +/- 29.6
137120 ncm-et-15 2020-09-03 16:53 01:17:44 1962480 500 375 8 117 +325.67 +/- 31.7
137119 ncm-et-4 2020-09-03 15:36 01:18:26 1922810 500 351 9 140 +290.66 +/- 28.9
137118 ncm-et-10 2020-09-03 15:36 01:19:42 1956178 500 377 4 119 +334.88 +/- 31.35
137117 ncm-et-13 2020-09-03 15:36 01:17:26 1960003 500 372 7 121 +322.67 +/- 31.15
137116 ncm-et-3 2020-09-03 15:36 01:19:08 1961690 500 357 9 134 +298.62 +/- 29.56
137115 ncm-et-15 2020-09-03 15:36 01:16:02 1971569 500 373 5 122 +327.18 +/- 30.97
137114 ncm-et-9 2020-09-03 15:36 01:18:20 1961228 500 360 12 128 +298.62 +/- 30.28

Commit

Commit ID a0afe32d16554ff3b5c74f34ae56400f35759edf
Author mstembera
Date 2020-09-01 07:25:44 UTC
Use stable sort to make sure bench with TB yields same results everywhere. std::sort() is not stable so different implementations can produce different results: use the stable version instead. Observed for '8/6k1/5r2/8/8/8/1K6/Q7 w - - 0 1' yielding different bench results for gcc and MSVC and 3-4-5 syzygy TB prior to this patch. closes https://github.com/official-stockfish/Stockfish/pull/3083 No functional change.
Copyright 2011–2024 Next Chess Move LLC