Dev Builds » 20230503-1837

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:00:39 1147966 3366 1425 288 1653 +122.16 +/- 5.22 0 40 503 1103 37 +271.54 +/- 15.19
ncm-dbt-02 09:53:01 1178348 3326 1417 337 1572 +117.05 +/- 5.51 1 53 518 1047 44 +253.92 +/- 14.98
ncm-dbt-03 09:58:19 1190599 3336 1400 320 1616 +116.68 +/- 5.18 0 44 524 1076 24 +259.38 +/- 14.88
ncm-dbt-04 09:59:33 1185821 3340 1403 311 1626 +117.92 +/- 5.35 0 54 502 1082 32 +260.33 +/- 15.22
ncm-dbt-05 09:42:30 1233777 3274 1385 265 1624 +123.85 +/- 5.51 0 51 461 1079 46 +273.05 +/- 15.88
ncm-dbt-06 09:57:45 1176060 3358 1416 290 1652 +121.19 +/- 5.3 0 43 508 1087 41 +267.1 +/- 15.12
20000 8446 1811 9743 +119.79 +/- 2.18 1 285 3016 6474 224 +264.12 +/- 6.2

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
186565 ncm-dbt-02 1234319 248 102 24 122 +113.1 +/- 22.63 0 7 38 73 6 +230.5 +/- 56.04
186564 ncm-dbt-04 1234377 266 104 33 129 +95.03 +/- 19.73 0 7 50 74 2 +199.67 +/- 48.7
186563 ncm-dbt-05 1228347 274 115 23 136 +121.36 +/- 17.34 0 4 37 96 0 +282.65 +/- 57.16
186562 ncm-dbt-03 1220691 276 113 35 128 +100.93 +/- 20.44 0 7 51 75 5 +204.55 +/- 48.22
186561 ncm-dbt-01 1175507 276 124 25 127 +130.42 +/- 18.8 0 3 38 92 5 +288.81 +/- 56.37
186560 ncm-dbt-06 1245688 282 115 23 144 +117.64 +/- 16.23 0 0 51 88 2 +262.41 +/- 47.14
186559 ncm-dbt-02 1214685 500 205 46 249 +114.45 +/- 13.89 0 8 80 157 5 +249.64 +/- 38.38
186558 ncm-dbt-05 1218740 500 220 41 239 +130.14 +/- 12.78 0 3 70 172 5 +298.62 +/- 41.01
186557 ncm-dbt-03 1220192 500 215 48 237 +120.67 +/- 13.5 0 7 73 166 4 +270.57 +/- 40.25
186556 ncm-dbt-04 1254076 500 220 37 243 +133.34 +/- 13.99 0 6 64 171 9 +298.62 +/- 43.1
186555 ncm-dbt-01 1200645 500 205 30 265 +126.97 +/- 13.04 0 7 63 178 2 +295.94 +/- 43.42
186554 ncm-dbt-06 1236754 500 203 49 248 +110.6 +/- 14.06 0 10 80 156 4 +240.82 +/- 38.39
186547 ncm-dbt-02 1254015 500 208 53 239 +111.37 +/- 14.06 0 10 79 157 4 +243.0 +/- 38.64
186546 ncm-dbt-05 1245351 500 211 44 245 +120.67 +/- 14.83 0 12 66 165 7 +263.42 +/- 42.13
186545 ncm-dbt-03 1219878 500 203 41 256 +116.77 +/- 12.65 0 4 82 162 2 +263.42 +/- 37.69
186544 ncm-dbt-06 1239714 500 193 42 265 +108.3 +/- 13.23 0 7 87 154 2 +238.66 +/- 36.67
186543 ncm-dbt-04 1248121 500 185 48 267 +97.69 +/- 13.5 0 10 94 145 1 +211.87 +/- 35.26
186542 ncm-dbt-01 1199767 500 219 48 233 +123.81 +/- 13.63 0 5 76 162 7 +273.0 +/- 39.35
186445 ncm-dbt-01 1240416 500 204 44 252 +115.22 +/- 13.38 0 6 82 158 4 +254.16 +/- 37.82
186444 ncm-dbt-03 1259821 500 208 40 252 +121.45 +/- 13.49 0 8 69 170 3 +275.45 +/- 41.43
186443 ncm-dbt-02 1221858 500 219 42 239 +128.55 +/- 14.26 0 8 65 169 8 +285.49 +/- 42.7
186442 ncm-dbt-04 1236684 500 210 46 244 +118.33 +/- 14.03 0 10 70 166 4 +263.42 +/- 41.06
186441 ncm-dbt-06 1216496 500 226 52 222 +126.17 +/- 14.12 0 6 73 162 9 +275.45 +/- 40.24
186440 ncm-dbt-05 1239111 500 217 34 249 +133.34 +/- 14.68 0 7 65 166 12 +290.66 +/- 42.73
186433 ncm-dbt-01 1164165 500 210 39 251 +123.81 +/- 13.1 0 5 73 168 4 +280.42 +/- 40.21
186432 ncm-dbt-04 1238467 500 225 48 227 +128.55 +/- 13.38 0 5 69 170 6 +290.66 +/- 41.43
186431 ncm-dbt-02 1209799 500 208 54 238 +110.6 +/- 14.53 0 13 74 159 4 +240.82 +/- 39.83
186430 ncm-dbt-06 1240377 500 222 39 239 +133.34 +/- 13.45 0 5 64 174 7 +304.07 +/- 43.1
186429 ncm-dbt-03 1260161 500 201 54 245 +105.25 +/- 13.39 0 8 89 151 2 +230.16 +/- 36.26
186428 ncm-dbt-05 1221726 500 208 41 251 +120.67 +/- 14.35 0 7 78 156 9 +258.75 +/- 38.88
186425 ncm-dbt-02 813166 500 216 48 236 +121.45 +/- 13.66 0 3 85 153 9 +261.07 +/- 36.86
186424 ncm-dbt-06 780754 500 210 49 241 +116.0 +/- 14.05 0 6 85 151 8 +247.41 +/- 37.09
186423 ncm-dbt-03 848025 500 211 54 235 +112.91 +/- 12.86 0 5 85 158 2 +251.89 +/- 37.03
186422 ncm-dbt-01 800720 500 213 51 236 +116.77 +/- 14.85 0 10 77 154 9 +247.41 +/- 39.15
186421 ncm-dbt-04 825454 500 213 41 246 +124.6 +/- 13.62 0 8 66 172 4 +282.94 +/- 42.37
186416 ncm-dbt-03 1237732 60 28 4 28 +147.17 +/- 29.74 0 0 6 24 0 +381.64 +/- 169.97
186415 ncm-dbt-05 1256076 500 202 49 249 +109.83 +/- 14.69 0 12 79 153 6 +234.38 +/- 38.61
186414 ncm-dbt-06 1208071 76 35 6 35 +139.61 +/- 34.75 0 0 11 25 2 +308.58 +/- 109.67
186413 ncm-dbt-02 1235137 78 33 11 34 +100.71 +/- 35.12 0 1 16 21 1 +209.15 +/- 87.43
186412 ncm-dbt-04 1222675 74 33 7 34 +127.49 +/- 36.14 0 1 10 25 1 +285.28 +/- 117.47
186411 ncm-dbt-01 1194832 90 39 6 45 +133.6 +/- 36.02 0 1 13 28 3 +279.59 +/- 100.55
186404 ncm-dbt-03 1258298 500 221 44 235 +128.55 +/- 13.38 0 5 69 170 6 +290.66 +/- 41.43
186403 ncm-dbt-05 1227094 500 212 33 255 +130.14 +/- 13.7 0 6 66 171 7 +293.29 +/- 42.41
186402 ncm-dbt-06 1240627 500 212 30 258 +132.54 +/- 14.18 0 9 57 177 7 +301.33 +/- 45.48
186401 ncm-dbt-02 1243809 500 226 59 215 +120.67 +/- 13.84 1 3 81 158 7 +265.78 +/- 37.95
186400 ncm-dbt-01 1207676 500 211 45 244 +119.89 +/- 12.61 0 3 81 163 3 +270.57 +/- 37.86
186399 ncm-dbt-04 1226719 500 213 51 236 +116.77 +/- 13.71 0 7 79 159 5 +256.44 +/- 38.62

Commit

Commit ID 21d6b69f7c8d0c0a71fe627714913a59d39a3b57
Author Linmiao Xu
Date 2023-05-03 18:37:57 UTC
Update 7 eval and optimism params Params found using spsa at 30+0.3 with this tuning config: ``` // evaluate.cpp int nnueOptScaleBase = 1001; int nnueComplexityMult = 406; int nnueComplexityOptOffset = 424; int evalOptComplexityOffset = 272; int evalOptScaleOffset = 748; TUNE(SetRange(801, 1201), nnueOptScaleBase); TUNE(SetRange(306, 506), nnueComplexityMult); TUNE(SetRange(324, 524), nnueComplexityOptOffset); TUNE(SetRange(172, 372), evalOptComplexityOffset); TUNE(SetRange(648, 848), evalOptScaleOffset); // search.cpp int searchOptBase = 120; int searchOptDenom = 161; TUNE(SetRange(20, 220), searchOptBase); TUNE(SetRange(111, 211), searchOptDenom); ``` Passed STC: https://tests.stockfishchess.org/tests/view/644dda8accf5e93df5e50cbe LLR: 2.93 (-2.94,2.94) <0.00,2.00> Total: 136800 W: 36682 L: 36237 D: 63881 Ptnml(0-2): 353, 14910, 37492, 15229, 416 Passed LTC: https://tests.stockfishchess.org/tests/view/644eaedb3f31c3bbe4a3d345 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 64548 W: 17624 L: 17272 D: 29652 Ptnml(0-2): 33, 6112, 19631, 6466, 32 closes https://github.com/official-stockfish/Stockfish/pull/4550 bench 3670343
Copyright 2011–2024 Next Chess Move LLC