Dev Builds » 20181119-0902

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:32:29 584176 4024 36 2866 1122 -303.58 ± 8.06 864 1103 44 1 0 -774.76 ± 52.82
ncm-dbt-02 06:31:32 591358 4012 33 2846 1133 -302.11 ± 8.0 852 1110 43 1 0 -778.1 ± 53.47
ncm-dbt-03 06:31:04 586222 3962 29 2796 1137 -300.23 ± 7.92 826 1116 38 1 0 -796.58 ± 57.1
ncm-dbt-04 06:32:22 567579 4010 40 2849 1121 -301.67 ± 8.09 857 1095 53 0 0 -749.23 ± 47.9
ncm-dbt-05 06:32:36 583274 3992 44 2744 1204 -285.72 ± 7.52 762 1176 58 0 0 -732.56 ± 45.68
20000 182 14101 5717 -298.59 ± 3.54 4161 5600 236 3 0 -764.77 ± 22.28

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
476325 ncm-dbt-04 569989 16 0 15 1 -595.01 ± 398.59 7 1 0 0 0 -1199.83 ± 190.04
476324 ncm-dbt-03 586139 142 1 103 38 -314.1 ± 44.33 32 38 1 0 0 -859.34 ± 265.3
476323 ncm-dbt-02 592590 284 2 196 86 -290.06 ± 28.21 55 84 3 0 0 -788.52 ± 271.95
476322 ncm-dbt-01 582611 308 1 222 85 -313.56 ± 28.94 68 85 1 0 0 -994.51 ± 197.28
476321 ncm-dbt-05 580406 396 5 256 135 -259.81 ± 20.54 59 133 6 0 0 -725.11 ± 187.28
476320 ncm-dbt-02 594671 128 2 81 45 -250.29 ± 34.06 17 45 2 0 0 -719.56 ± 316.77
476319 ncm-dbt-04 567839 500 9 360 131 -302.69 ± 24.74 113 125 12 0 0 -643.67 ± 110.29
476318 ncm-dbt-04 567047 80 0 57 23 -309.93 ± 55.24 17 23 0 0 0 -1199.83 ± 49.65
476317 ncm-dbt-03 586520 500 4 358 138 -306.83 ± 23.05 109 136 5 0 0 -798.18 ± 231.48
476316 ncm-dbt-01 584874 500 5 349 146 -293.28 ± 22.12 101 142 7 0 0 -739.05 ± 163.27
476315 ncm-dbt-05 586858 500 4 350 146 -295.93 ± 22.43 103 140 7 0 0 -739.05 ± 163.27
476314 ncm-dbt-02 593023 500 4 367 129 -319.71 ± 24.18 117 129 4 0 0 -837.28 ± 240.94
476313 ncm-dbt-04 568673 500 5 356 139 -302.69 ± 23.22 108 135 7 0 0 -739.05 ± 163.27
476312 ncm-dbt-03 586689 500 5 348 147 -291.96 ± 22.27 101 141 8 0 0 -715.51 ± 146.53
476311 ncm-dbt-02 590524 342 3 224 115 -267.08 ± 23.11 55 111 5 0 0 -731.39 ± 229.34
476310 ncm-dbt-01 584327 500 7 355 138 -298.61 ± 23.66 108 132 10 0 0 -676.04 ± 124.55
476309 ncm-dbt-05 584579 500 10 347 143 -284.21 ± 22.22 98 141 11 0 0 -659.13 ± 116.77
476308 ncm-dbt-04 567482 500 5 356 139 -302.69 ± 23.22 108 135 7 0 0 -739.05 ± 163.27
476307 ncm-dbt-03 586223 500 3 363 134 -315.34 ± 23.69 114 132 4 0 0 -837.28 ± 240.94
476306 ncm-dbt-02 591857 446 2 317 127 -305.64 ± 23.7 95 125 3 0 0 -867.6 ± 232.21
476305 ncm-dbt-01 586012 500 5 358 137 -305.44 ± 23.54 110 133 7 0 0 -739.05 ± 163.27
476304 ncm-dbt-05 584495 500 2 347 151 -294.6 ± 21.33 99 147 4 0 0 -837.28 ± 240.94
476303 ncm-dbt-01 585169 216 3 154 59 -300.69 ± 37.29 47 58 2 1 0 -689.71 ± 324.93
476302 ncm-dbt-04 566612 500 9 358 133 -299.96 ± 24.12 110 129 11 0 0 -659.13 ± 116.77
476301 ncm-dbt-03 583656 500 3 349 148 -295.93 ± 21.16 99 148 3 0 0 -887.58 ± 222.18
476300 ncm-dbt-02 587707 500 6 367 127 -316.79 ± 25.19 118 126 5 1 0 -739.1 ± 208.89
476299 ncm-dbt-05 583112 340 2 230 108 -282.04 ± 23.74 60 108 2 0 0 -890.98 ± 230.37
476298 ncm-dbt-03 585464 124 1 83 40 -276.22 ± 38.87 21 40 1 0 0 -835.61 ± 277.28
476297 ncm-dbt-03 586646 130 2 92 36 -296.12 ± 44.91 27 36 2 0 0 -722.3 ± 315.38
476296 ncm-dbt-01 584243 500 6 356 138 -301.32 ± 23.06 107 136 7 0 0 -739.05 ± 163.27
476295 ncm-dbt-05 580613 256 0 178 78 -298.14 ± 29.52 51 76 1 0 0 -962.27 ± 213.48
476294 ncm-dbt-04 566099 500 5 353 142 -298.61 ± 22.11 103 142 5 0 0 -798.18 ± 231.48
476293 ncm-dbt-02 591512 500 4 357 139 -305.44 ± 23.22 109 135 6 0 0 -766.17 ± 188.02
476292 ncm-dbt-02 589539 134 0 95 39 -307.48 ± 44.31 29 37 1 0 0 -849.19 ± 270.42
476291 ncm-dbt-03 588387 500 2 352 146 -301.32 ± 21.77 103 144 3 0 0 -887.58 ± 222.18
476290 ncm-dbt-03 586435 24 0 17 7 -306.86 ± 104.92 5 7 0 0 0 -1199.83 ± 154.57
476289 ncm-dbt-01 584706 500 4 360 136 -309.64 ± 23.04 110 136 4 0 0 -837.28 ± 240.94
476288 ncm-dbt-05 585590 500 11 338 151 -271.78 ± 20.98 89 149 12 0 0 -643.67 ± 110.29
476287 ncm-dbt-04 568633 500 1 350 149 -299.96 ± 21.61 102 145 3 0 0 -887.58 ± 222.18
476286 ncm-dbt-02 590953 500 5 350 145 -294.6 ± 22.27 102 141 7 0 0 -739.05 ± 163.27
476285 ncm-dbt-03 585337 500 3 349 148 -295.94 ± 22.43 102 143 4 1 0 -766.23 ± 273.11
476284 ncm-dbt-02 589497 178 2 134 42 -331.42 ± 44.16 45 42 2 0 0 -777.62 ± 287.43
476283 ncm-dbt-04 567442 414 3 283 128 -285.69 ± 22.61 77 126 4 0 0 -804.2 ± 257.55
476282 ncm-dbt-05 583866 500 4 352 144 -298.61 ± 22.43 104 140 6 0 0 -766.17 ± 188.02
476281 ncm-dbt-01 581569 500 4 357 139 -305.44 ± 22.56 107 139 4 0 0 -837.28 ± 240.94
476280 ncm-dbt-03 585506 332 2 229 101 -290.48 ± 26.41 65 97 4 0 0 -765.44 ± 277.04
476279 ncm-dbt-03 587664 210 3 153 54 -311.24 ± 37.66 48 54 3 0 0 -735.42 ± 298.69
476278 ncm-dbt-02 593066 500 3 358 139 -308.23 ± 23.21 110 135 5 0 0 -798.18 ± 231.48
476277 ncm-dbt-04 565981 500 3 361 136 -312.47 ± 23.36 112 134 4 0 0 -837.28 ± 240.94
476276 ncm-dbt-01 584076 500 1 355 144 -306.83 ± 22.05 106 142 2 0 0 -958.31 ± 196.57
476275 ncm-dbt-05 579951 500 6 346 148 -288.06 ± 22.1 99 142 9 0 0 -694.7 ± 134.18

Commit

Commit ID 8a9c298deeee372251d95c867f877a7ac3a7c3fb
Author SFisGOD
Date 2018-11-19 09:02:31 UTC
Rook PSQT Tuned Failed STC (Yellow ) LLR: -2.96 (-2.94,2.94) [0.00,4.00] Total: 56302 W: 12007 L: 11953 D: 32342 http://tests.stockfishchess.org/tests/view/5be69d210ebc595e0ae3185b Passed 1st LTC (Green) LLR: 2.95 (-2.94,2.94) [0.00,4.00] Total: 8745 W: 1480 L: 1301 D: 5964 http://tests.stockfishchess.org/tests/view/5be682960ebc595e0ae31818 Failed 2nd LTC (Red) LLR: -2.96 (-2.94,2.94) [0.00,4.00] Total: 19398 W: 3040 L: 3133 D: 13225 http://tests.stockfishchess.org/tests/view/5be69b840ebc595e0ae31856 Passed 3rd LTC (Green) LLR: 2.96 (-2.94,2.94) [0.00,4.00] Total: 107516 W: 17342 L: 16858 D: 73316 http://tests.stockfishchess.org/tests/view/5bea879a0ebc595e0ae34d80 Closes https://github.com/official-stockfish/Stockfish/pull/1809 How to continue from there? The values in the rook table now look a bit strange for a human eye and are hard to explain, maybe it would be nice to simplify them by hand and see if we can pass another (clean) double green with a more regular array. Bench: 3188070
Copyright 2011–2026 Next Chess Move LLC