Dev Builds » 20240326-1717

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:47:57 1200289 3336 1443 250 1643 +129.99 +/- 5.17 0 31 456 1138 43 +294.24 +/- 15.96
ncm-dbt-02 09:45:18 1230018 3330 1457 264 1609 +130.25 +/- 5.22 0 28 466 1121 50 +292.29 +/- 15.77
ncm-dbt-03 09:47:38 1235611 3342 1464 241 1637 +133.32 +/- 5.3 0 39 421 1160 51 +302.27 +/- 16.62
ncm-dbt-04 09:47:48 1227045 3334 1466 251 1617 +132.71 +/- 5.3 0 36 432 1147 52 +299.74 +/- 16.41
ncm-dbt-05 09:44:49 1229721 3328 1478 257 1593 +133.7 +/- 5.13 0 30 426 1165 43 +306.8 +/- 16.52
ncm-dbt-06 09:48:22 1225255 3330 1476 262 1592 +132.77 +/- 5.18 1 29 435 1155 45 +303.18 +/- 16.35
20000 8784 1525 9691 +132.12 +/- 2.13 1 193 2636 6886 284 +299.7 +/- 6.63

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
338921 ncm-dbt-02 1227367 330 146 18 166 +142.2 +/- 14.73 0 1 38 123 3 +344.14 +/- 56.37
338920 ncm-dbt-05 1231020 328 140 30 158 +121.2 +/- 16.92 0 6 44 112 2 +274.55 +/- 52.15
338919 ncm-dbt-04 1237871 334 142 27 165 +124.72 +/- 17.91 0 5 49 106 7 +267.39 +/- 49.38
338918 ncm-dbt-06 1226126 330 140 22 168 +129.97 +/- 16.0 0 4 41 118 2 +303.4 +/- 54.24
338917 ncm-dbt-01 1189891 336 149 21 166 +139.38 +/- 15.83 0 4 35 126 3 +333.36 +/- 58.89
338916 ncm-dbt-03 1225640 342 142 27 173 +121.55 +/- 16.77 0 6 47 115 3 +272.37 +/- 50.43
338915 ncm-dbt-05 1220269 500 220 31 249 +138.18 +/- 12.93 0 5 56 184 5 +327.18 +/- 46.19
338914 ncm-dbt-04 1211620 500 225 31 244 +142.25 +/- 12.58 0 2 59 182 7 +336.46 +/- 44.87
338913 ncm-dbt-01 1223055 500 213 40 247 +125.38 +/- 13.61 0 6 71 167 6 +280.42 +/- 40.83
338912 ncm-dbt-02 1238571 500 212 44 244 +121.45 +/- 13.14 0 5 76 165 4 +273.0 +/- 39.35
338911 ncm-dbt-06 1228622 500 226 38 236 +137.37 +/- 12.15 0 2 62 182 4 +327.18 +/- 43.69
338910 ncm-dbt-03 1236189 500 220 31 249 +138.18 +/- 12.53 0 3 60 182 5 +327.18 +/- 44.54
338909 ncm-dbt-05 1219290 500 217 43 240 +126.17 +/- 13.42 0 4 75 164 7 +280.42 +/- 39.57
338908 ncm-dbt-04 1224518 500 223 36 241 +136.56 +/- 14.27 0 10 50 183 7 +315.35 +/- 48.23
338907 ncm-dbt-01 1236560 500 218 38 244 +130.94 +/- 12.56 0 4 65 178 3 +306.84 +/- 42.73
338906 ncm-dbt-02 1230827 500 228 41 231 +136.56 +/- 13.73 0 3 68 168 11 +304.07 +/- 41.65
338905 ncm-dbt-03 1225112 500 210 36 254 +126.17 +/- 12.68 0 4 71 172 3 +290.66 +/- 40.76
338904 ncm-dbt-06 1232818 500 223 36 241 +136.56 +/- 12.98 0 2 67 173 8 +312.48 +/- 41.9
338903 ncm-dbt-04 1225524 500 210 40 250 +123.02 +/- 13.11 0 5 74 167 4 +277.93 +/- 39.92
338902 ncm-dbt-05 1245723 500 222 38 240 +134.15 +/- 12.47 0 3 64 179 4 +315.35 +/- 43.03
338901 ncm-dbt-01 1187379 500 216 35 249 +131.74 +/- 13.12 0 5 64 176 5 +304.07 +/- 43.1
338900 ncm-dbt-02 1232593 500 225 35 240 +138.99 +/- 13.48 0 3 64 173 10 +315.35 +/- 43.03
338899 ncm-dbt-03 1231044 500 223 36 241 +136.56 +/- 14.1 0 7 58 176 9 +309.64 +/- 45.27
338898 ncm-dbt-06 1225044 500 223 46 231 +128.55 +/- 13.38 0 5 69 170 6 +290.66 +/- 41.43
338897 ncm-dbt-02 1224768 500 229 36 235 +141.43 +/- 13.01 0 0 68 171 11 +321.18 +/- 41.27
338896 ncm-dbt-05 1234135 500 230 40 230 +138.99 +/- 13.67 0 5 59 177 9 +318.25 +/- 44.96
338895 ncm-dbt-04 1253064 500 222 35 243 +136.56 +/- 13.55 0 3 67 170 10 +306.84 +/- 41.99
338894 ncm-dbt-01 1182831 500 216 39 245 +128.55 +/- 13.73 0 3 77 160 10 +280.42 +/- 38.93
338893 ncm-dbt-03 1241306 500 218 35 247 +133.34 +/- 13.81 0 7 60 176 7 +304.07 +/- 44.5
338892 ncm-dbt-06 1230237 500 229 41 230 +137.37 +/- 13.34 0 3 65 173 9 +312.48 +/- 42.67
338891 ncm-dbt-02 1234612 500 212 47 241 +119.11 +/- 13.69 0 5 82 156 7 +258.75 +/- 37.76
338890 ncm-dbt-04 1227591 500 220 45 235 +126.97 +/- 14.11 0 8 66 169 7 +282.94 +/- 42.37
338889 ncm-dbt-05 1221047 500 225 36 239 +138.18 +/- 13.32 0 3 64 174 9 +315.35 +/- 43.03
338888 ncm-dbt-03 1241039 500 231 40 229 +139.81 +/- 15.23 0 9 55 172 14 +306.84 +/- 46.27
338887 ncm-dbt-01 1162232 500 212 35 253 +128.55 +/- 13.91 0 5 72 164 9 +282.94 +/- 40.5
338886 ncm-dbt-06 1203405 500 216 37 247 +130.14 +/- 14.23 0 7 66 168 9 +288.06 +/- 42.4
338885 ncm-dbt-04 1209127 500 224 37 239 +136.56 +/- 13.55 0 3 67 170 10 +306.84 +/- 41.99
338884 ncm-dbt-05 1236567 500 224 39 237 +134.95 +/- 13.22 0 4 64 175 7 +309.64 +/- 43.08
338883 ncm-dbt-03 1248950 500 220 36 244 +134.15 +/- 13.61 0 3 70 167 10 +298.62 +/- 41.01
338882 ncm-dbt-02 1221389 500 205 43 252 +116.77 +/- 14.21 0 11 70 165 4 +258.75 +/- 41.02
338881 ncm-dbt-01 1220080 500 219 42 239 +128.55 +/- 13.38 0 4 72 167 7 +288.06 +/- 40.46
338880 ncm-dbt-06 1230537 500 219 42 239 +128.55 +/- 14.25 1 6 65 171 7 +290.66 +/- 42.73

Commit

Commit ID ed24e3a0a6e6958b26fefc4c43078c0bb46f5376
Author Gahtan Nahdi
Date 2024-03-26 17:17:00 UTC
Remove material imbalance from nnue eval Passed non-reg STC: https://tests.stockfishchess.org/tests/view/65fdf11f0ec64f0526c52b57 LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 76480 W: 19893 L: 19712 D: 36875 Ptnml(0-2): 339, 9107, 19157, 9308, 329 Passed non-reg LTC: https://tests.stockfishchess.org/tests/view/65fee22e0ec64f0526c53885 LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 150948 W: 38078 L: 37988 D: 74882 Ptnml(0-2): 111, 16997, 41148, 17127, 91 closes https://github.com/official-stockfish/Stockfish/pull/5135 Bench: 2103324
Copyright 2011–2024 Next Chess Move LLC