Dev Builds » 20240307-1858

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:31:18 1200027 4014 1786 310 1918 +134.03 +/- 4.59 0 26 531 1398 52 +307.9 +/- 14.77
ncm-dbt-02 11:29:14 1234273 3976 1730 250 1996 +135.85 +/- 4.68 0 34 494 1406 54 +313.41 +/- 15.34
ncm-dbt-03 11:32:39 1232900 4006 1775 315 1916 +132.72 +/- 4.71 0 30 544 1368 61 +300.28 +/- 14.59
ncm-dbt-05 11:30:05 1229650 3998 1758 296 1944 +133.22 +/- 4.62 0 33 518 1401 47 +306.74 +/- 14.97
ncm-dbt-06 11:33:36 1230225 4006 1772 322 1912 +131.73 +/- 4.9 1 49 513 1379 61 +297.25 +/- 15.05
20000 8821 1493 9686 +133.51 +/- 2.1 1 172 2600 6952 275 +305.04 +/- 6.68

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
339971 ncm-dbt-06 1233040 6 3 0 3 +190.46 +/- 18.51 0 0 0 3 0 +1199.83 +/- 276.48
339970 ncm-dbt-03 1219104 6 3 2 1 +58.33 +/- 98.71 0 0 2 1 0 +120.24 +/- 264.77
339969 ncm-dbt-01 1175152 14 7 0 7 +190.68 +/- 7.94 0 0 0 7 0 +1199.83 +/- 201.74
339968 ncm-dbt-02 1217214 476 212 29 235 +140.8 +/- 13.88 0 7 47 178 6 +333.09 +/- 50.24
339967 ncm-dbt-05 1235884 498 222 30 246 +141.25 +/- 12.85 0 4 55 184 6 +335.66 +/- 46.65
339966 ncm-dbt-06 1198961 500 217 39 244 +129.35 +/- 13.9 1 3 71 167 8 +290.66 +/- 40.76
339965 ncm-dbt-03 1223678 500 218 37 245 +131.74 +/- 13.12 0 3 70 170 7 +298.62 +/- 41.01
339964 ncm-dbt-01 1197586 500 216 40 244 +127.76 +/- 12.84 0 3 73 169 5 +290.66 +/- 40.08
339963 ncm-dbt-02 1253993 500 218 24 258 +142.25 +/- 12.78 0 3 57 183 7 +336.46 +/- 45.77
339962 ncm-dbt-05 1237365 500 228 42 230 +135.76 +/- 12.21 0 1 67 177 5 +318.25 +/- 41.77
339961 ncm-dbt-06 1227931 500 230 39 231 +139.81 +/- 13.64 0 6 55 181 8 +324.17 +/- 46.56
339960 ncm-dbt-03 1247940 500 219 45 236 +126.17 +/- 13.6 0 6 70 168 6 +282.94 +/- 41.13
339959 ncm-dbt-01 1201652 500 221 34 245 +136.56 +/- 12.79 0 2 66 175 7 +315.35 +/- 42.24
339958 ncm-dbt-02 1241146 500 218 35 247 +133.34 +/- 13.26 0 3 69 170 8 +301.33 +/- 41.33
339957 ncm-dbt-05 1234059 500 211 34 255 +128.55 +/- 13.01 0 4 70 171 5 +293.29 +/- 41.07
339956 ncm-dbt-01 1227794 500 232 41 227 +139.81 +/- 13.07 0 2 64 175 9 +321.19 +/- 42.95
339955 ncm-dbt-06 1228170 500 234 45 221 +138.18 +/- 14.41 0 6 61 171 12 +306.84 +/- 44.17
339954 ncm-dbt-03 1228467 500 222 44 234 +129.35 +/- 12.61 0 3 70 173 4 +298.62 +/- 41.01
339953 ncm-dbt-02 1239079 500 203 32 265 +123.81 +/- 14.32 0 7 74 160 9 +268.17 +/- 39.97
339952 ncm-dbt-01 1201901 500 225 41 234 +134.15 +/- 13.61 0 3 70 167 10 +298.62 +/- 41.01
339951 ncm-dbt-05 1266655 500 224 36 240 +137.37 +/- 13.71 0 4 64 172 10 +309.64 +/- 43.08
339950 ncm-dbt-06 1241718 500 217 31 252 +135.76 +/- 13.2 0 5 60 179 6 +315.35 +/- 44.57
339949 ncm-dbt-03 1227801 500 218 48 234 +123.02 +/- 12.74 0 4 75 168 3 +280.42 +/- 39.57
339948 ncm-dbt-02 1215393 500 220 40 240 +130.94 +/- 13.87 0 5 69 167 9 +290.66 +/- 41.43
339947 ncm-dbt-06 1249336 500 213 45 242 +121.45 +/- 13.84 0 5 80 157 8 +263.42 +/- 38.27
339946 ncm-dbt-03 1246577 500 227 42 231 +134.95 +/- 13.59 0 4 66 171 9 +304.07 +/- 42.38
339945 ncm-dbt-05 1205564 500 216 37 247 +130.14 +/- 12.97 0 7 59 182 2 +306.84 +/- 44.88
339944 ncm-dbt-01 1175960 500 216 31 253 +134.95 +/- 13.22 0 5 61 178 6 +312.48 +/- 44.19
339943 ncm-dbt-02 1238619 500 218 36 246 +132.54 +/- 13.47 0 6 62 176 6 +304.07 +/- 43.81
339942 ncm-dbt-06 1211892 500 212 40 248 +124.6 +/- 13.97 0 8 68 168 6 +277.93 +/- 41.74
339941 ncm-dbt-03 1244014 500 231 31 238 +147.19 +/- 14.33 0 4 57 174 15 +330.23 +/- 45.79
339940 ncm-dbt-05 1219871 500 221 38 241 +133.34 +/- 12.69 0 2 69 173 6 +306.84 +/- 41.23
339939 ncm-dbt-01 1207799 500 229 53 218 +127.76 +/- 13.21 0 5 69 171 5 +290.66 +/- 41.43
339938 ncm-dbt-02 1228477 500 213 26 261 +136.56 +/- 11.76 0 2 61 185 2 +330.23 +/- 44.08
339937 ncm-dbt-06 1224480 500 219 39 242 +130.94 +/- 13.69 0 6 65 172 7 +295.94 +/- 42.75
339936 ncm-dbt-05 1203617 500 214 42 244 +124.6 +/- 13.8 0 6 73 164 7 +275.45 +/- 40.24
339935 ncm-dbt-03 1238130 500 213 28 259 +134.95 +/- 12.64 0 2 67 175 6 +312.48 +/- 41.9
339934 ncm-dbt-01 1202878 500 222 35 243 +136.56 +/- 12.79 0 3 63 178 6 +318.25 +/- 43.39
339933 ncm-dbt-01 1209525 500 218 35 247 +133.34 +/- 12.49 0 3 65 178 4 +312.48 +/- 42.67
339932 ncm-dbt-02 1240269 500 228 28 244 +147.19 +/- 12.14 0 1 55 187 7 +356.21 +/- 46.49
339931 ncm-dbt-05 1234191 500 222 37 241 +134.95 +/- 13.22 0 5 61 178 6 +312.48 +/- 44.19
339930 ncm-dbt-03 1220392 500 224 38 238 +135.76 +/- 13.94 0 4 67 168 11 +301.33 +/- 42.04
339929 ncm-dbt-06 1256498 500 227 44 229 +133.34 +/- 14.17 0 10 53 181 6 +306.84 +/- 46.95

Commit

Commit ID 748791f80dbc29793e473e3e9eda83ffa0afcfaa
Author Shahin M. Shahin
Date 2024-03-07 18:58:33 UTC
Fix `go mate x` in multithreading Fixes two issues with master for go mate x: - when running go mate x in losing positions, master always goes to the maximal depth, arguably against what the UCI protocol demands - when running go mate x in winning positions with multiple threads, master may return non-mate scores from the search (this issue is present in stockfish since at least sf16) The issues are fixed by (a) also checking if score is mate -x and by (b) only letting mainthread stop the search for go mate x commands, and by not looking for a best thread but using mainthread as per the default. Related: niklasf/python-chess#1070 More diagnostics can be found here peregrineshahin#6 (comment) closes https://github.com/official-stockfish/Stockfish/pull/5094 No functional change Co-Authored-By: Robert Nürnberg <28635489+robertnurnberg@users.noreply.github.com>
Copyright 2011–2024 Next Chess Move LLC