Dev Builds » 20220812-1230

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:04:54 1225118 3382 1346 398 1638 +100.07 +/- 5.78 1 100 579 972 39 +209.0 +/- 14.16
ncm-dbt-02 10:01:19 1262323 3362 1329 367 1666 +102.27 +/- 5.54 1 74 601 972 33 +216.47 +/- 13.9
ncm-dbt-03 10:07:26 1264249 3370 1350 412 1608 +99.32 +/- 5.65 1 89 599 963 33 +208.77 +/- 13.93
ncm-dbt-04 10:06:41 1258099 3376 1322 383 1671 +99.25 +/- 5.5 1 76 623 959 29 +209.75 +/- 13.64
ncm-dbt-05 10:01:43 1140077 3336 1316 367 1653 +101.64 +/- 5.62 1 78 595 959 35 +214.13 +/- 13.97
ncm-dbt-06 09:29:50 1226903 3174 1228 356 1590 +97.97 +/- 5.87 4 84 562 910 27 +207.45 +/- 14.38
20000 7891 2283 9826 +100.1 +/- 2.31 9 501 3559 5735 196 +210.94 +/- 5.71

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
185288 ncm-dbt-05 1241862 134 57 14 63 +115.57 +/- 31.87 0 4 20 39 4 +231.26 +/- 78.38
185287 ncm-dbt-02 1226416 164 64 18 82 +100.13 +/- 25.63 0 5 27 49 1 +214.24 +/- 66.97
185286 ncm-dbt-03 1224121 174 63 25 86 +77.11 +/- 26.5 0 8 35 42 2 +152.93 +/- 58.35
185285 ncm-dbt-04 1234954 176 71 16 89 +112.33 +/- 20.43 0 1 31 56 0 +254.73 +/- 61.79
185284 ncm-dbt-06 1229651 174 75 21 78 +111.5 +/- 25.49 0 5 25 55 2 +239.58 +/- 69.6
185283 ncm-dbt-01 1193473 178 73 18 87 +110.97 +/- 25.79 0 5 27 54 3 +232.41 +/- 66.97
185282 ncm-dbt-05 1215834 500 191 60 249 +93.2 +/- 14.81 0 16 91 139 4 +194.57 +/- 35.91
185281 ncm-dbt-02 1229940 500 204 59 237 +103.73 +/- 14.65 0 13 84 148 5 +219.87 +/- 37.42
185280 ncm-dbt-06 1222896 500 198 58 244 +99.95 +/- 14.0 0 11 91 145 3 +213.85 +/- 35.9
185279 ncm-dbt-04 1219484 500 187 59 254 +90.96 +/- 13.24 0 8 108 132 2 +192.71 +/- 32.52
185278 ncm-dbt-03 1224422 500 203 55 242 +106.01 +/- 14.36 0 11 85 149 5 +226.0 +/- 37.21
185277 ncm-dbt-01 1175423 500 196 57 247 +99.2 +/- 15.61 0 17 85 140 8 +202.15 +/- 37.11
185276 ncm-dbt-05 1216813 500 202 68 230 +95.44 +/- 15.27 0 17 88 139 6 +196.45 +/- 36.5
185275 ncm-dbt-02 1227483 500 197 53 250 +102.97 +/- 13.87 0 9 92 145 4 +219.87 +/- 35.65
185274 ncm-dbt-03 1232327 500 192 68 240 +88.0 +/- 15.27 1 17 93 135 4 +183.51 +/- 35.5
185273 ncm-dbt-04 1229151 500 190 55 255 +96.19 +/- 14.41 0 13 93 140 4 +202.15 +/- 35.52
185272 ncm-dbt-06 1223789 500 201 61 238 +99.95 +/- 14.46 0 12 91 142 5 +209.91 +/- 35.92
185271 ncm-dbt-01 1156362 500 198 57 245 +100.7 +/- 15.21 0 15 86 142 7 +207.95 +/- 36.95
185270 ncm-dbt-05 1241326 500 188 53 259 +96.19 +/- 14.41 0 12 96 137 5 +200.24 +/- 34.91
185269 ncm-dbt-02 1227203 500 201 68 231 +94.7 +/- 14.98 1 13 93 138 5 +198.34 +/- 35.52
185268 ncm-dbt-03 1232179 500 211 48 241 +117.55 +/- 14.37 0 9 76 158 7 +254.16 +/- 39.42
185267 ncm-dbt-06 1226932 500 192 51 257 +100.7 +/- 14.62 0 14 85 147 4 +213.85 +/- 37.18
185266 ncm-dbt-04 1211152 500 194 58 248 +96.94 +/- 14.12 0 10 99 136 5 +202.15 +/- 34.28
185265 ncm-dbt-01 1231497 500 189 73 238 +82.1 +/- 14.84 0 21 93 135 1 +172.78 +/- 35.45
185264 ncm-dbt-05 1236757 500 206 44 250 +116.77 +/- 13.01 0 6 78 164 2 +263.42 +/- 38.85
185263 ncm-dbt-02 1234583 500 194 51 255 +102.22 +/- 13.86 0 9 93 144 4 +217.85 +/- 35.44
185262 ncm-dbt-06 1227797 500 192 53 255 +99.2 +/- 13.99 0 10 95 141 4 +209.91 +/- 35.06
185261 ncm-dbt-01 1219064 500 210 57 233 +109.83 +/- 15.14 1 9 85 146 9 +230.16 +/- 37.2
185260 ncm-dbt-04 1229707 500 192 56 252 +96.94 +/- 14.27 0 14 88 146 2 +207.95 +/- 36.54
185259 ncm-dbt-03 1246419 500 198 61 241 +97.69 +/- 13.97 0 11 94 142 3 +207.95 +/- 35.29
185258 ncm-dbt-05 1218415 500 196 47 257 +106.77 +/- 14.21 0 11 83 152 4 +230.16 +/- 37.67
185257 ncm-dbt-02 1233388 500 197 52 251 +103.73 +/- 14.19 0 12 84 151 3 +223.94 +/- 37.43
185256 ncm-dbt-01 1173052 500 198 57 245 +100.7 +/- 14.32 0 12 89 145 4 +213.85 +/- 36.34
185255 ncm-dbt-04 1234178 500 203 49 248 +110.6 +/- 13.89 0 8 85 152 5 +238.66 +/- 37.17
185254 ncm-dbt-06 1222686 500 185 52 263 +94.7 +/- 15.82 3 14 84 145 4 +204.07 +/- 37.33
185253 ncm-dbt-03 1241914 500 201 58 241 +102.22 +/- 14.63 0 13 86 146 5 +215.85 +/- 36.98
185252 ncm-dbt-02 1238064 500 193 49 258 +102.97 +/- 14.79 0 10 95 136 9 +209.91 +/- 35.06
185251 ncm-dbt-01 1177138 500 199 54 247 +103.73 +/- 15.1 0 15 81 148 6 +217.85 +/- 38.05
185250 ncm-dbt-05 1246706 500 187 53 260 +95.44 +/- 14.55 0 12 98 134 6 +196.45 +/- 34.53
185249 ncm-dbt-06 1234570 500 185 60 255 +88.74 +/- 15.56 1 18 91 135 5 +183.51 +/- 35.86
185248 ncm-dbt-04 1232134 500 200 66 234 +95.44 +/- 15.83 0 19 86 137 8 +192.71 +/- 36.85
185247 ncm-dbt-03 1230636 500 201 67 232 +95.44 +/- 14.7 0 16 87 144 3 +202.15 +/- 36.72
177309 ncm-dbt-05 502909 202 89 28 85 +108.29 +/- 22.96 1 0 41 55 4 +227.17 +/- 52.77
177308 ncm-dbt-04 1474038 200 85 24 91 +109.45 +/- 24.32 1 3 33 60 3 +235.45 +/- 60.49
177307 ncm-dbt-01 1474939 204 83 25 96 +101.57 +/- 22.73 0 6 33 62 1 +219.27 +/- 60.32
177306 ncm-dbt-02 1481510 198 79 17 102 +112.57 +/- 22.0 0 3 33 61 2 +244.13 +/- 60.44
177305 ncm-dbt-03 1481976 196 81 30 85 +92.53 +/- 23.75 0 4 43 47 4 +181.52 +/- 52.07

Commit

Commit ID 1054a483ca0c560d30fb61617c0192cb4cd31528
Author Joost VandeVondele
Date 2022-08-12 12:30:33 UTC
Remove an unneeded randomization of evals. most of the effect comes from the randomization of 3-folds. passed STC: https://tests.stockfishchess.org/tests/view/62e697e97e84186e5d19af6f LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 572976 W: 153168 L: 153539 D: 266269 Ptnml(0-2): 2505, 64783, 152364, 64250, 2586 passed LTC: https://tests.stockfishchess.org/tests/view/62ee5977523c86dcd6957154 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 704808 W: 191212 L: 191680 D: 321916 Ptnml(0-2): 1340, 70579, 208972, 70235, 1278 closes https://github.com/official-stockfish/Stockfish/pull/4128 Bench: 5868987
Copyright 2011–2024 Next Chess Move LLC