Dev Builds » 20240501-1217

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:41:30 1209121 4000 1781 284 1935 +136.67 +/- 4.77 0 38 491 1407 64 +312.84 +/- 15.39
ncm-dbt-02 11:39:15 1236977 3988 1748 266 1974 +135.6 +/- 4.61 1 32 490 1426 45 +316.19 +/- 15.4
ncm-dbt-03 11:43:03 1232696 4014 1785 289 1940 +136.04 +/- 4.81 0 39 501 1399 68 +309.3 +/- 15.24
ncm-dbt-05 11:40:33 1200701 3998 1781 288 1929 +136.34 +/- 4.78 2 34 495 1405 63 +312.74 +/- 15.33
ncm-dbt-06 11:46:10 1231542 4000 1788 267 1945 +139.1 +/- 4.63 0 29 481 1430 60 +323.05 +/- 15.54
20000 8883 1394 9723 +136.75 +/- 2.11 3 172 2458 7067 300 +314.77 +/- 6.87

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
360466 ncm-dbt-03 1248033 14 6 1 7 +129.74 +/- 107.96 0 1 0 6 0 +311.19 +/- 565.46
360465 ncm-dbt-02 1242808 488 210 38 240 +127.94 +/- 13.79 0 5 69 163 7 +285.64 +/- 41.41
360464 ncm-dbt-05 1201092 498 221 39 238 +133.13 +/- 12.92 0 4 64 176 5 +308.83 +/- 43.08
360463 ncm-dbt-06 1227049 500 223 32 245 +139.81 +/- 12.47 0 1 64 178 7 +327.18 +/- 42.83
360462 ncm-dbt-01 1201431 500 220 34 246 +135.76 +/- 13.01 0 3 65 175 7 +312.48 +/- 42.67
360461 ncm-dbt-03 1230770 500 220 35 245 +134.95 +/- 12.24 0 5 56 188 1 +327.18 +/- 46.19
360460 ncm-dbt-02 1236435 500 206 29 265 +128.55 +/- 13.01 0 6 64 177 3 +298.62 +/- 43.1
360459 ncm-dbt-06 1234909 500 230 42 228 +137.37 +/- 14.78 0 10 52 178 10 +309.64 +/- 47.37
360458 ncm-dbt-05 1223480 500 231 47 222 +134.15 +/- 15.81 2 6 62 166 14 +293.29 +/- 43.72
360457 ncm-dbt-01 1188452 500 210 38 252 +124.6 +/- 12.9 0 4 74 168 4 +282.94 +/- 39.86
360456 ncm-dbt-03 1238732 500 214 34 252 +130.94 +/- 14.56 0 8 64 168 10 +288.06 +/- 43.03
360455 ncm-dbt-02 1238168 500 219 33 248 +135.76 +/- 13.01 0 4 62 178 6 +315.35 +/- 43.81
360454 ncm-dbt-05 1192092 500 224 37 239 +136.56 +/- 14.27 0 7 59 174 10 +306.84 +/- 44.88
360453 ncm-dbt-06 1226812 500 221 36 243 +134.95 +/- 13.78 0 6 61 175 8 +306.84 +/- 44.17
360452 ncm-dbt-03 1219555 500 225 41 234 +134.15 +/- 13.97 0 5 66 169 10 +298.62 +/- 42.41
360451 ncm-dbt-01 1220736 500 217 35 248 +132.54 +/- 14.36 0 11 52 181 6 +304.07 +/- 47.2
360450 ncm-dbt-05 1192159 500 225 42 233 +133.34 +/- 12.89 0 2 70 171 7 +304.07 +/- 40.91
360449 ncm-dbt-02 1243518 500 218 37 245 +131.74 +/- 14.2 0 6 67 167 10 +290.66 +/- 42.08
360448 ncm-dbt-06 1233421 500 227 29 244 +145.54 +/- 12.22 0 1 57 185 7 +349.43 +/- 45.6
360447 ncm-dbt-01 1241585 500 232 42 226 +138.99 +/- 14.21 0 5 62 171 12 +309.64 +/- 43.82
360446 ncm-dbt-03 1245986 500 225 35 240 +138.99 +/- 13.29 0 2 66 172 10 +315.35 +/- 42.24
360445 ncm-dbt-05 1193882 500 230 30 240 +147.19 +/- 12.98 0 5 47 191 7 +356.21 +/- 50.52
360444 ncm-dbt-02 1239255 500 221 31 248 +138.99 +/- 13.29 0 3 63 175 9 +318.25 +/- 43.39
360443 ncm-dbt-01 1222364 500 233 32 235 +148.02 +/- 14.12 0 4 55 177 14 +336.46 +/- 46.65
360442 ncm-dbt-06 1222660 500 219 39 242 +130.94 +/- 12.95 0 2 73 168 7 +295.94 +/- 39.99
360441 ncm-dbt-03 1245739 500 219 32 249 +136.56 +/- 13.17 0 3 65 174 8 +312.48 +/- 42.67
360440 ncm-dbt-02 1233395 500 224 33 243 +139.81 +/- 12.47 0 4 55 187 4 +336.46 +/- 46.65
360439 ncm-dbt-05 1217306 500 216 34 250 +132.54 +/- 12.32 0 3 65 179 3 +312.48 +/- 42.67
360438 ncm-dbt-01 1215444 500 227 23 250 +150.51 +/- 12.62 0 2 51 188 9 +363.2 +/- 48.51
360437 ncm-dbt-06 1236043 500 220 28 252 +140.62 +/- 13.04 0 4 57 182 7 +330.23 +/- 45.79
360436 ncm-dbt-03 1228418 500 215 30 255 +134.95 +/- 13.22 0 4 64 175 7 +309.64 +/- 43.08
360435 ncm-dbt-02 1232322 500 228 32 240 +143.89 +/- 11.19 0 1 54 193 2 +359.68 +/- 46.95
360434 ncm-dbt-05 1198086 500 213 28 259 +134.95 +/- 12.64 0 4 61 181 4 +318.25 +/- 44.18
360433 ncm-dbt-01 1199559 500 221 44 235 +128.55 +/- 13.91 0 5 72 164 9 +282.94 +/- 40.5
360432 ncm-dbt-03 1220974 500 234 43 223 +139.81 +/- 14.01 0 6 57 177 10 +318.25 +/- 45.73
360431 ncm-dbt-06 1228817 500 227 30 243 +144.71 +/- 12.47 0 1 59 182 8 +342.85 +/- 44.76
360430 ncm-dbt-02 1229920 500 222 33 245 +138.18 +/- 12.93 1 3 56 186 4 +333.32 +/- 46.21
360429 ncm-dbt-01 1183402 500 221 36 243 +134.95 +/- 12.44 0 4 60 183 3 +321.19 +/- 44.57
360428 ncm-dbt-05 1187517 500 221 31 248 +138.99 +/- 14.03 0 3 67 167 13 +306.84 +/- 41.99
360427 ncm-dbt-03 1216063 500 227 38 235 +138.18 +/- 14.23 0 5 63 170 12 +306.84 +/- 43.45
360426 ncm-dbt-06 1242631 500 221 31 248 +138.99 +/- 12.9 0 4 58 182 6 +327.18 +/- 45.37

Commit

Commit ID be142337d843ef3afc675e27628ab8e896c32cce
Author mstembera
Date 2024-05-01 12:17:32 UTC
Accumulator cache bugfix and cleanup STC: https://tests.stockfishchess.org/tests/view/663068913a05f1bf7a511dc2 LLR: 2.98 (-2.94,2.94) <-1.75,0.25> Total: 70304 W: 18211 L: 18026 D: 34067 Ptnml(0-2): 232, 7966, 18582, 8129, 243 1) Fixes a bug introduced in https://github.com/official-stockfish/Stockfish/pull/5194. Only one psqtOnly flag was used for two perspectives which was causing wrong entries to be cleared and marked. 2) The finny caches should be cleared like histories and not at the start of every search. closes https://github.com/official-stockfish/Stockfish/pull/5203 No functional change
Copyright 2011–2024 Next Chess Move LLC