Dev Builds » 20240209-1806

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 14:43:00 1151791 5000 2179 395 2426 +129.67 +/- 4.26 0 44 701 1682 73 +290.92 +/- 12.85
ncm-dbt-03 14:42:47 1200049 5000 2177 384 2439 +130.39 +/- 4.28 1 51 669 1712 67 +295.14 +/- 13.18
ncm-dbt-04 14:41:31 1194744 5000 2175 416 2409 +127.68 +/- 4.29 1 47 715 1666 71 +285.24 +/- 12.73
ncm-dbt-06 14:40:59 1189572 5000 2168 390 2442 +129.19 +/- 4.38 2 57 677 1689 75 +289.36 +/- 13.1
20000 8699 1585 9716 +129.23 +/- 2.15 4 199 2762 6749 286 +290.14 +/- 6.48

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
327385 ncm-dbt-01 1136305 500 220 51 229 +122.24 +/- 14.0 0 3 86 150 11 +258.75 +/- 36.62
327384 ncm-dbt-06 1187743 500 222 41 237 +131.74 +/- 14.37 0 6 68 165 11 +288.06 +/- 41.76
327383 ncm-dbt-03 1197729 500 202 29 269 +125.38 +/- 13.61 0 7 68 170 5 +282.94 +/- 41.76
327382 ncm-dbt-04 1183410 500 220 51 229 +122.24 +/- 13.66 0 5 78 160 7 +268.17 +/- 38.8
327381 ncm-dbt-03 1203034 500 213 36 251 +128.55 +/- 14.26 0 8 65 169 8 +285.49 +/- 42.7
327380 ncm-dbt-04 1187282 500 214 42 244 +124.6 +/- 13.09 0 4 75 166 5 +280.42 +/- 39.57
327379 ncm-dbt-06 1188880 500 210 33 257 +128.55 +/- 13.19 0 4 71 169 6 +290.66 +/- 40.76
327378 ncm-dbt-01 1137448 500 218 35 247 +133.34 +/- 13.26 0 4 66 173 7 +304.07 +/- 42.38
326780 ncm-dbt-03 1200934 500 223 43 234 +130.94 +/- 13.51 0 4 70 168 8 +293.29 +/- 41.07
326779 ncm-dbt-06 1190101 500 223 35 242 +137.37 +/- 12.76 0 3 62 179 6 +321.19 +/- 43.77
326778 ncm-dbt-04 1184008 500 220 43 237 +128.55 +/- 12.82 0 2 75 167 6 +290.66 +/- 39.4
326777 ncm-dbt-01 1160217 500 223 44 233 +130.14 +/- 13.34 0 6 64 175 5 +298.62 +/- 43.1
326776 ncm-dbt-03 1193663 500 219 52 229 +120.67 +/- 14.35 0 6 81 153 10 +256.44 +/- 38.07
326775 ncm-dbt-04 1227229 500 224 46 230 +129.35 +/- 13.9 0 6 68 168 8 +288.06 +/- 41.76
326774 ncm-dbt-06 1191861 500 212 41 247 +123.81 +/- 13.63 0 6 73 165 6 +275.45 +/- 40.24
326773 ncm-dbt-01 1161258 500 220 45 235 +126.97 +/- 13.76 0 5 73 164 8 +280.42 +/- 40.21
326772 ncm-dbt-03 1199744 500 217 36 247 +131.74 +/- 11.73 0 2 66 181 1 +315.35 +/- 42.24
326771 ncm-dbt-04 1183081 500 211 46 243 +119.11 +/- 14.03 1 7 72 166 4 +268.17 +/- 40.54
326770 ncm-dbt-06 1189131 500 223 35 242 +137.37 +/- 14.08 1 5 57 179 8 +318.25 +/- 45.73
326769 ncm-dbt-01 1158053 500 209 32 259 +128.55 +/- 13.73 0 8 62 175 5 +293.29 +/- 43.72
326768 ncm-dbt-04 1193494 500 222 38 240 +134.15 +/- 13.61 0 3 70 167 10 +298.62 +/- 41.01
326767 ncm-dbt-03 1202624 500 231 32 237 +146.36 +/- 13.41 0 5 50 186 9 +346.12 +/- 48.95
326766 ncm-dbt-06 1193580 500 212 46 242 +119.89 +/- 14.19 0 9 72 163 6 +263.42 +/- 40.52
326765 ncm-dbt-01 1138286 500 211 39 250 +124.6 +/- 14.31 0 6 76 158 10 +268.17 +/- 39.39
326764 ncm-dbt-04 1185533 500 212 36 252 +127.76 +/- 13.21 0 4 72 168 6 +288.06 +/- 40.46
326763 ncm-dbt-03 1198081 500 213 38 249 +126.97 +/- 13.58 0 7 66 172 5 +288.06 +/- 42.4
326762 ncm-dbt-06 1189503 500 215 39 246 +127.76 +/- 13.57 0 5 71 167 7 +285.49 +/- 40.81
326761 ncm-dbt-01 1159339 500 223 29 248 +142.25 +/- 12.16 0 3 54 189 4 +346.12 +/- 47.1
326760 ncm-dbt-04 1184934 500 222 39 239 +133.34 +/- 13.81 0 7 60 176 7 +304.07 +/- 44.5
326759 ncm-dbt-03 1195989 500 225 45 230 +130.94 +/- 14.21 1 3 71 165 10 +290.66 +/- 40.76
326758 ncm-dbt-06 1191377 500 216 36 248 +130.94 +/- 14.21 1 5 65 171 8 +295.94 +/- 42.75
326757 ncm-dbt-01 1157727 500 210 33 257 +128.55 +/- 13.19 0 3 74 166 7 +288.06 +/- 39.79
326756 ncm-dbt-03 1204596 500 216 32 252 +134.15 +/- 13.24 0 5 62 177 6 +309.64 +/- 43.82
326755 ncm-dbt-04 1183511 500 215 33 252 +132.54 +/- 14.36 0 7 64 169 10 +293.29 +/- 43.07
326754 ncm-dbt-06 1189613 500 225 46 229 +130.14 +/- 14.06 0 6 68 167 9 +288.06 +/- 41.76
326753 ncm-dbt-01 1154559 500 219 45 236 +126.17 +/- 12.3 0 2 75 170 3 +290.66 +/- 39.4
326752 ncm-dbt-03 1204097 500 218 41 241 +128.55 +/- 13.01 0 4 70 171 5 +293.29 +/- 41.07
326751 ncm-dbt-04 1234959 500 215 42 243 +125.38 +/- 13.25 0 2 81 159 8 +275.45 +/- 37.75
326750 ncm-dbt-06 1183938 500 210 38 252 +124.6 +/- 14.31 0 8 70 164 8 +273.0 +/- 41.13
326749 ncm-dbt-01 1154726 500 226 42 232 +134.15 +/- 14.33 0 4 71 162 13 +290.66 +/- 40.76

Commit

Commit ID a20726eb0b6c049e191ce0f04dac4f4f923efcee
Author Disservin
Date 2024-02-09 18:06:25 UTC
Refactor the CI workflows This refactors the CI workflows to group some logic and makes sure that all (pre)release binaries are actually tested. The screenshot below shows the execution logic of the reworked ci, https://github.com/Disservin/Stockfish/actions/runs/7773581379. You can also hover over the cards to see the execution flow. The `matrix.json` and `arm_matrix.json` define the binaries which will be uploaded to GitHub. Afterwards a matrix is created and each job compiles a profile guided build for that arch and uploads that as an artifact to GitHub. The Binaries/ARM_Binaries workflow's are called when the previous step has been completed, and uploads all artifacts to the (pre)release. This also fixes some indentations and renames the workflows, see https://github.com/official-stockfish/Stockfish/actions, where every workflow is called `Stockfish` vs https://github.com/Disservin/Stockfish/actions. It also increases the parallel compilation used for make from `-j2 to -j4`. It now also prevents the prerelease action from running on forks. A test release can be viewed here https://github.com/Disservin/Stockfish/releases. closes https://github.com/official-stockfish/Stockfish/pull/5035 No functional change
Copyright 2011–2024 Next Chess Move LLC