Dev Builds » 20230811-1727

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:56:53 1197654 3348 1435 282 1631 +124.75 +/- 5.23 0 37 487 1110 40 +278.47 +/- 15.44
ncm-dbt-02 09:44:19 1199259 3276 1421 286 1569 +125.57 +/- 5.27 0 37 467 1096 38 +281.5 +/- 15.77
ncm-dbt-03 09:58:52 1237657 3338 1380 296 1662 +117.07 +/- 5.3 0 51 512 1077 29 +258.82 +/- 15.06
ncm-dbt-04 10:00:37 1224378 3370 1441 296 1633 +122.93 +/- 5.46 2 46 492 1095 50 +269.99 +/- 15.37
ncm-dbt-05 09:54:53 1232178 3322 1412 282 1628 +123.09 +/- 5.33 1 43 480 1099 38 +274.25 +/- 15.56
ncm-dbt-06 09:54:35 1223041 3346 1411 283 1652 +121.89 +/- 5.33 0 50 481 1106 36 +271.01 +/- 15.55
20000 8500 1725 9775 +122.53 +/- 2.17 3 264 2919 6583 231 +272.21 +/- 6.3

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
199570 ncm-dbt-02 1198849 276 123 26 127 +127.54 +/- 18.01 0 3 38 94 3 +288.81 +/- 56.37
199569 ncm-dbt-05 1236891 322 142 32 148 +123.66 +/- 17.75 0 4 49 102 6 +266.95 +/- 49.33
199568 ncm-dbt-03 1246852 338 133 25 180 +115.04 +/- 16.35 0 6 50 112 1 +259.41 +/- 48.85
199567 ncm-dbt-06 1244957 346 147 28 171 +124.57 +/- 15.66 0 3 51 116 3 +282.01 +/- 48.28
199566 ncm-dbt-01 1181186 348 152 29 167 +128.33 +/- 15.52 0 3 48 120 3 +294.38 +/- 49.9
199565 ncm-dbt-04 1210143 370 160 32 178 +125.36 +/- 16.13 0 3 58 117 7 +271.82 +/- 45.07
199564 ncm-dbt-02 1193395 500 219 35 246 +134.15 +/- 13.24 0 3 68 171 8 +304.07 +/- 41.65
199563 ncm-dbt-05 1226601 500 212 39 249 +125.38 +/- 12.51 0 4 71 173 2 +290.66 +/- 40.76
199562 ncm-dbt-06 1218504 500 212 43 245 +122.24 +/- 14.33 0 10 67 167 6 +270.57 +/- 41.96
199561 ncm-dbt-03 1240376 500 216 42 242 +126.17 +/- 13.24 0 4 74 166 6 +282.94 +/- 39.86
199560 ncm-dbt-01 1204116 500 217 44 239 +125.38 +/- 13.61 0 5 74 164 7 +277.93 +/- 39.92
199559 ncm-dbt-04 1209122 500 202 52 246 +107.54 +/- 14.68 0 11 85 147 7 +226.0 +/- 37.21
199558 ncm-dbt-02 1196215 500 218 44 238 +126.17 +/- 13.77 0 7 68 169 6 +282.94 +/- 41.76
199557 ncm-dbt-05 1226494 500 213 43 244 +123.02 +/- 13.47 0 6 73 166 5 +275.45 +/- 40.24
199556 ncm-dbt-06 1214337 500 208 48 244 +115.22 +/- 14.05 0 8 80 156 6 +249.64 +/- 38.38
199555 ncm-dbt-01 1207237 500 212 39 249 +125.38 +/- 13.07 0 3 77 164 6 +280.42 +/- 38.93
199554 ncm-dbt-03 1235514 500 213 48 239 +119.11 +/- 13.86 0 8 74 163 5 +263.42 +/- 39.97
199553 ncm-dbt-04 1245410 500 228 41 231 +136.56 +/- 14.45 0 5 66 166 13 +298.62 +/- 42.41
199552 ncm-dbt-02 1194366 500 220 45 235 +126.97 +/- 12.47 0 1 78 166 5 +288.06 +/- 38.42
199551 ncm-dbt-06 1205430 500 214 35 251 +130.14 +/- 13.16 0 7 60 180 3 +304.07 +/- 44.5
199550 ncm-dbt-05 1246453 500 211 43 246 +121.46 +/- 14.17 1 7 70 167 5 +273.0 +/- 41.13
199549 ncm-dbt-01 1197708 500 221 42 237 +130.14 +/- 13.7 0 4 72 165 9 +288.06 +/- 40.46
199548 ncm-dbt-03 1213051 500 216 44 240 +124.6 +/- 13.45 0 5 74 165 6 +277.93 +/- 39.92
199547 ncm-dbt-04 1249574 500 213 52 235 +116.0 +/- 15.61 1 12 71 157 9 +247.41 +/- 40.63
199546 ncm-dbt-02 1197520 500 206 43 251 +117.55 +/- 13.7 0 9 72 166 3 +263.42 +/- 40.52
199545 ncm-dbt-06 1217455 500 207 35 258 +124.6 +/- 13.62 0 6 72 166 6 +277.93 +/- 40.53
199544 ncm-dbt-03 1246171 500 203 45 252 +113.68 +/- 14.69 0 13 71 161 5 +247.41 +/- 40.63
199543 ncm-dbt-05 1221534 500 211 35 254 +127.76 +/- 13.21 0 6 66 174 4 +293.29 +/- 42.41
199542 ncm-dbt-01 1208730 500 208 39 253 +122.24 +/- 13.66 0 8 69 169 4 +275.45 +/- 41.43
199541 ncm-dbt-04 1201349 500 226 47 227 +130.14 +/- 13.16 0 6 63 177 4 +301.33 +/- 43.45
199540 ncm-dbt-02 1201208 500 221 46 233 +126.97 +/- 13.22 0 5 70 170 5 +288.06 +/- 41.11
199539 ncm-dbt-06 1240050 500 213 54 233 +114.45 +/- 14.38 0 9 80 154 7 +245.2 +/- 38.39
199538 ncm-dbt-03 1247490 500 191 49 260 +101.46 +/- 13.37 0 8 94 146 2 +219.87 +/- 35.19
199537 ncm-dbt-05 1230286 500 214 51 235 +117.55 +/- 15.0 0 11 74 156 9 +249.64 +/- 39.91
199536 ncm-dbt-04 1220131 500 199 43 258 +112.14 +/- 14.06 1 6 84 154 5 +245.2 +/- 37.37
199535 ncm-dbt-01 1193388 500 211 38 251 +125.38 +/- 13.25 0 5 72 168 5 +282.94 +/- 40.5
199534 ncm-dbt-02 1213262 500 214 47 239 +120.67 +/- 14.51 0 9 73 160 8 +261.07 +/- 40.24
199533 ncm-dbt-06 1220556 500 210 40 250 +123.02 +/- 13.65 0 7 71 167 5 +275.45 +/- 40.84
199532 ncm-dbt-01 1191215 500 214 51 235 +117.55 +/- 14.2 0 9 75 160 6 +256.44 +/- 39.69
199531 ncm-dbt-05 1236988 500 209 39 252 +123.02 +/- 13.65 0 5 77 161 7 +270.57 +/- 39.07
199530 ncm-dbt-03 1234150 500 208 43 249 +119.11 +/- 13.52 0 7 75 164 4 +265.78 +/- 39.69
199529 ncm-dbt-04 1234918 500 213 29 258 +134.15 +/- 12.67 0 3 65 177 5 +312.48 +/- 42.67

Commit

Commit ID 8192945870967fb9c8801247d0b040b2bc657443
Author Joost VandeVondele
Date 2023-08-11 17:27:46 UTC
Improve testing coverage, remove unused code a) Add further tests to CI to cover most features. This uncovered a potential race in case setoption was sent between two searches. As the UCI protocol requires this sent to be went the engine is not searching, setoption now ensures that this is the case. b) Remove some unused code closes https://github.com/official-stockfish/Stockfish/pull/4730 No functional change
Copyright 2011–2024 Next Chess Move LLC