Dev Builds » 20170724-0023

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:21:47 584944 4000 24 2893 1083 -313.37 ± 8.33 904 1062 33 1 0 -821.67 ± 61.6
ncm-dbt-02 06:21:24 587585 4000 24 2900 1076 -314.63 ± 8.24 903 1070 27 0 0 -867.09 ± 68.85
ncm-dbt-03 06:20:28 584675 4000 27 2919 1054 -317.52 ± 8.45 925 1042 33 0 0 -831.97 ± 61.68
ncm-dbt-04 06:20:15 568401 4000 24 2954 1022 -324.54 ± 8.6 955 1020 25 0 0 -880.54 ± 71.87
ncm-dbt-05 06:20:54 581088 4000 19 2904 1077 -316.25 ± 8.26 909 1067 24 0 0 -887.68 ± 73.53
20000 118 14570 5312 -317.23 ± 3.74 4596 5261 142 1 0 -855.81 ± 28.83

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
474331 ncm-dbt-03 585337 500 3 368 129 -322.66 ± 24.16 118 129 3 0 0 -887.58 ± 222.18
474330 ncm-dbt-02 588472 500 4 366 130 -318.24 ± 24.02 116 130 4 0 0 -837.28 ± 240.94
474329 ncm-dbt-05 581319 500 2 363 135 -316.79 ± 23.5 114 133 3 0 0 -887.58 ± 222.18
474328 ncm-dbt-04 568872 500 0 371 129 -331.76 ± 24.05 121 129 0 0 0 -1199.83 ± 0.0
474327 ncm-dbt-01 585421 500 2 360 138 -312.47 ± 24.03 114 130 6 0 0 -766.17 ± 188.02
474326 ncm-dbt-04 569709 500 3 372 125 -328.69 ± 24.84 122 125 3 0 0 -887.58 ± 222.18
474325 ncm-dbt-02 589112 500 2 361 137 -313.9 ± 22.83 111 137 2 0 0 -958.31 ± 196.57
474324 ncm-dbt-05 579702 500 2 349 149 -297.27 ± 21.63 101 145 4 0 0 -837.28 ± 240.94
474323 ncm-dbt-03 583405 500 1 385 114 -352.79 ± 27.17 136 112 2 0 0 -958.31 ± 196.57
474322 ncm-dbt-01 587494 500 6 356 138 -301.32 ± 22.74 106 138 6 0 0 -766.17 ± 188.02
474321 ncm-dbt-05 583028 500 6 369 125 -319.71 ± 24.87 119 125 6 0 0 -766.17 ± 188.02
474320 ncm-dbt-02 587240 500 5 356 139 -302.69 ± 22.58 106 139 5 0 0 -798.18 ± 231.48
474319 ncm-dbt-04 568474 500 5 367 128 -318.24 ± 24.36 117 128 5 0 0 -798.18 ± 231.48
474318 ncm-dbt-01 583740 500 3 360 137 -311.05 ± 22.86 110 137 3 0 0 -887.58 ± 222.18
474317 ncm-dbt-03 583740 500 4 351 145 -297.27 ± 21.63 101 145 4 0 0 -837.28 ± 240.94
474316 ncm-dbt-02 586901 500 2 369 129 -325.66 ± 24.14 119 129 2 0 0 -958.31 ± 196.57
474315 ncm-dbt-05 579702 500 2 361 137 -313.9 ± 23.18 112 135 3 0 0 -887.58 ± 222.18
474314 ncm-dbt-01 583363 500 1 362 137 -316.79 ± 23.15 113 135 2 0 0 -958.31 ± 196.57
474313 ncm-dbt-03 587962 500 2 362 136 -315.34 ± 22.99 112 136 2 0 0 -958.31 ± 196.57
474312 ncm-dbt-04 566691 500 4 377 119 -334.87 ± 25.91 127 119 4 0 0 -837.28 ± 240.94
474311 ncm-dbt-03 584327 500 8 367 125 -313.9 ± 25.81 120 119 11 0 0 -659.13 ± 116.77
474310 ncm-dbt-02 586223 500 2 357 141 -308.23 ± 22.54 108 139 3 0 0 -887.58 ± 222.18
474309 ncm-dbt-05 576864 500 1 363 136 -318.24 ± 23.31 114 134 2 0 0 -958.31 ± 196.57
474308 ncm-dbt-04 569989 500 3 363 134 -315.34 ± 23.69 114 132 4 0 0 -837.28 ± 240.94
474307 ncm-dbt-01 584411 500 3 366 131 -319.71 ± 24.18 117 129 4 0 0 -837.28 ± 240.94
474306 ncm-dbt-03 581444 500 5 363 132 -312.47 ± 23.7 113 132 5 0 0 -798.18 ± 231.48
474305 ncm-dbt-04 568196 500 2 372 126 -330.22 ± 24.64 122 126 2 0 0 -958.31 ± 196.57
474304 ncm-dbt-05 581652 500 3 364 133 -316.79 ± 23.5 114 133 3 0 0 -887.58 ± 222.18
474303 ncm-dbt-02 588089 500 3 360 137 -311.05 ± 22.86 110 137 3 0 0 -887.58 ± 222.18
474302 ncm-dbt-01 584748 500 3 366 131 -319.71 ± 25.21 119 126 4 1 0 -766.23 ± 273.11
474301 ncm-dbt-03 587197 500 1 354 145 -305.44 ± 21.89 105 143 2 0 0 -958.31 ± 196.57
474300 ncm-dbt-04 567205 500 4 365 131 -316.79 ± 23.85 115 131 4 0 0 -837.28 ± 240.94
474299 ncm-dbt-05 582110 500 2 370 128 -327.17 ± 24.3 120 128 2 0 0 -958.31 ± 196.57
474298 ncm-dbt-02 587749 500 2 371 127 -328.69 ± 24.84 122 125 3 0 0 -887.58 ± 222.18
474297 ncm-dbt-01 584958 500 5 364 131 -313.9 ± 24.53 116 127 7 0 0 -739.05 ± 163.27
474296 ncm-dbt-03 583992 500 3 369 128 -324.16 ± 24.69 120 126 4 0 0 -837.28 ± 240.94
474295 ncm-dbt-05 584327 500 1 365 134 -321.18 ± 23.28 115 134 1 0 0 -1078.89 ± 154.95
474294 ncm-dbt-04 568077 500 3 367 130 -321.18 ± 24.0 117 130 3 0 0 -887.58 ± 222.18
474293 ncm-dbt-02 586901 500 4 360 136 -309.64 ± 23.37 111 134 5 0 0 -798.18 ± 231.48
474292 ncm-dbt-01 585421 500 1 359 140 -312.47 ± 22.32 109 140 1 0 0 -1078.89 ± 154.95

Commit

Commit ID 272e4d1ac7f99a45e1635c37c052f75d560c749d
Author Joost VandeVondele
Date 2017-07-24 00:23:14 UTC
Faster travis checks in the last month a couple of timeouts have been seen in travis valgrind testing, leading to undesired false positives. The precise cause of this is unclear: a normal valgrind instrumented run is about 6min, the timeout is 10min. Either there are rare hangs (not reproduced locally), or maybe the actual runtime fluctuates on the travis infrastructure (which uses VMs on AWS as far as I know). This patch leads to roughly a 2x speedup of the instrumented testing by reducing the depth from 10 to 9. If timeouts persist, it needs further analysis. No functional change. Closes #1171
Copyright 2011–2026 Next Chess Move LLC