Dev Builds » 20230813-0959

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:56:05 1187837 3334 1418 317 1599 +119.2 +/- 5.47 0 50 514 1055 48 +258.56 +/- 15.03
ncm-dbt-02 09:51:06 1196858 3324 1424 302 1598 +122.06 +/- 5.37 2 31 522 1057 50 +267.1 +/- 14.88
ncm-dbt-03 09:57:23 1244583 3340 1413 264 1663 +124.6 +/- 5.29 0 43 474 1114 39 +278.34 +/- 15.66
ncm-dbt-04 09:56:44 1229244 3360 1426 283 1651 +123.09 +/- 5.22 0 37 503 1100 40 +273.33 +/- 15.18
ncm-dbt-05 09:51:25 1234611 3310 1421 299 1590 +122.62 +/- 5.32 0 42 488 1086 39 +272.01 +/- 15.43
ncm-dbt-06 09:55:00 1226017 3332 1394 287 1651 +119.98 +/- 5.39 1 45 507 1072 41 +263.69 +/- 15.13
20000 8496 1752 9752 +121.93 +/- 2.18 3 248 3008 6484 257 +268.77 +/- 6.2

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
199714 ncm-dbt-05 1231284 310 134 33 143 +117.47 +/- 18.28 0 6 46 99 4 +255.19 +/- 50.97
199713 ncm-dbt-02 1197294 324 142 31 151 +124.04 +/- 17.67 0 4 49 103 6 +268.25 +/- 49.33
199712 ncm-dbt-06 1218546 332 144 25 163 +130.32 +/- 16.27 0 3 45 114 4 +296.45 +/- 51.62
199711 ncm-dbt-01 1156601 334 141 35 158 +114.2 +/- 17.39 0 5 56 101 5 +243.44 +/- 45.98
199710 ncm-dbt-03 1231120 340 145 31 164 +121.18 +/- 18.29 0 9 43 113 5 +264.11 +/- 52.27
199709 ncm-dbt-04 1223011 360 155 28 177 +128.07 +/- 14.89 0 2 52 123 3 +293.87 +/- 47.7
199708 ncm-dbt-05 1215201 500 205 47 248 +113.68 +/- 13.55 0 5 88 151 6 +245.2 +/- 36.32
199707 ncm-dbt-02 1194327 500 216 50 234 +119.89 +/- 14.19 1 3 84 153 9 +258.75 +/- 37.2
199706 ncm-dbt-01 1204125 500 219 44 237 +126.97 +/- 13.76 0 6 70 167 7 +282.94 +/- 41.13
199705 ncm-dbt-06 1222639 500 197 39 264 +113.68 +/- 15.15 0 11 80 149 10 +236.51 +/- 38.38
199704 ncm-dbt-03 1251317 500 225 43 232 +132.54 +/- 13.1 0 2 72 168 8 +298.62 +/- 40.29
199703 ncm-dbt-04 1222412 500 211 41 248 +123.02 +/- 14.16 0 8 71 164 7 +270.57 +/- 40.83
199702 ncm-dbt-05 1247382 500 224 48 228 +127.76 +/- 14.44 0 7 70 163 10 +277.93 +/- 41.14
199701 ncm-dbt-02 1198466 500 218 47 235 +123.81 +/- 13.46 0 5 75 164 6 +275.45 +/- 39.63
199700 ncm-dbt-01 1195418 500 208 55 237 +109.83 +/- 14.84 0 11 83 148 8 +230.16 +/- 37.67
199699 ncm-dbt-06 1240515 500 207 49 244 +113.68 +/- 12.86 0 5 84 159 2 +254.16 +/- 37.27
199698 ncm-dbt-03 1248545 500 206 37 257 +122.24 +/- 13.3 0 6 73 167 4 +275.45 +/- 40.24
199697 ncm-dbt-04 1243790 500 206 33 261 +125.38 +/- 11.92 0 0 80 167 3 +288.06 +/- 37.72
199696 ncm-dbt-05 1251161 500 220 40 240 +130.94 +/- 13.51 0 7 61 177 5 +301.33 +/- 44.13
199695 ncm-dbt-02 1195305 500 206 45 249 +116.0 +/- 13.37 0 5 84 156 5 +254.16 +/- 37.27
199694 ncm-dbt-01 1189768 500 218 43 239 +126.97 +/- 13.94 0 5 74 162 9 +277.93 +/- 39.92
199693 ncm-dbt-06 1212234 500 215 48 237 +120.67 +/- 13.32 0 2 87 153 8 +261.07 +/- 36.27
199692 ncm-dbt-03 1251122 500 210 32 258 +129.35 +/- 13.17 0 5 67 173 5 +295.94 +/- 42.08
199691 ncm-dbt-04 1252673 500 218 50 232 +121.45 +/- 14.01 0 10 66 170 4 +273.0 +/- 42.27
199690 ncm-dbt-05 1237532 500 207 42 251 +119.11 +/- 13.69 0 5 82 156 7 +258.75 +/- 37.76
199689 ncm-dbt-01 1194946 500 217 47 236 +123.02 +/- 14.49 0 10 67 166 7 +270.57 +/- 41.96
199688 ncm-dbt-06 1226696 500 212 41 247 +123.81 +/- 14.32 1 6 71 165 7 +275.45 +/- 40.84
199687 ncm-dbt-02 1202732 500 216 49 235 +120.67 +/- 15.14 1 7 77 154 11 +256.44 +/- 39.15
199686 ncm-dbt-04 1208941 500 208 55 237 +109.83 +/- 13.89 0 7 89 148 6 +234.38 +/- 36.22
199685 ncm-dbt-03 1253023 500 210 42 248 +121.45 +/- 13.66 0 5 79 159 7 +265.78 +/- 38.54
199684 ncm-dbt-01 1196431 500 203 51 246 +109.07 +/- 13.89 0 7 90 147 6 +232.26 +/- 35.99
199683 ncm-dbt-05 1235580 500 214 46 240 +121.45 +/- 13.31 0 7 71 169 3 +275.45 +/- 40.84
199682 ncm-dbt-02 1192650 500 207 38 255 +122.24 +/- 12.94 0 4 77 165 4 +275.45 +/- 39.01
199681 ncm-dbt-06 1216371 500 216 43 241 +125.38 +/- 14.3 0 10 63 171 6 +280.42 +/- 43.24
199680 ncm-dbt-04 1242499 500 204 34 262 +123.02 +/- 13.82 0 6 75 162 7 +270.57 +/- 39.67
199679 ncm-dbt-03 1246879 500 215 39 246 +127.76 +/- 13.02 0 4 71 170 5 +290.66 +/- 40.76
199678 ncm-dbt-06 1245124 500 203 42 255 +116.0 +/- 13.71 0 8 77 161 4 +256.44 +/- 39.15
199677 ncm-dbt-02 1197233 500 219 42 239 +128.55 +/- 13.56 0 3 76 162 9 +282.94 +/- 39.21
199676 ncm-dbt-05 1224140 500 217 43 240 +126.17 +/- 13.06 0 5 70 171 4 +288.06 +/- 41.11
199675 ncm-dbt-04 1211386 500 224 42 234 +132.54 +/- 13.83 0 4 70 166 10 +293.29 +/- 41.07
199674 ncm-dbt-01 1177571 500 212 42 246 +123.02 +/- 13.65 0 6 74 164 6 +273.0 +/- 39.95
199673 ncm-dbt-03 1230079 500 202 40 258 +116.77 +/- 14.53 0 12 69 164 5 +256.44 +/- 41.25

Commit

Commit ID 9b80897657bde99cfb6568d8bd3386c3999f22c4
Author mstembera
Date 2023-08-13 09:59:06 UTC
Simplify material difference in evaluate STC: https://tests.stockfishchess.org/tests/view/64d166235b17f7c21c0ddc15 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 100032 W: 25698 L: 25547 D: 48787 Ptnml(0-2): 308, 11748, 25771, 11863, 326 LTC: https://tests.stockfishchess.org/tests/view/64d28c085b17f7c21c0df775 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 123870 W: 31463 L: 31348 D: 61059 Ptnml(0-2): 63, 13487, 34719, 13604, 62 Besides rebasing I replaced PawnValueMg w/ 126 explicitly to decouple from https://tests.stockfishchess.org/tests/view/64d212de5b17f7c21c0debbb by @peregrineshahin which also passed. #4734 closes https://github.com/official-stockfish/Stockfish/pull/4731 Bench: 1447866
Copyright 2011–2024 Next Chess Move LLC