Dev Builds » 20240107-1237

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:46:38 1202657 3360 1477 252 1631 +132.78 +/- 5.3 0 36 438 1151 55 +298.91 +/- 16.3
ncm-dbt-02 09:42:10 1231281 3292 1418 241 1633 +129.96 +/- 5.43 0 40 443 1109 54 +289.53 +/- 16.2
ncm-dbt-03 09:46:45 1236074 3338 1459 250 1629 +131.82 +/- 5.31 0 35 444 1136 54 +295.96 +/- 16.18
ncm-dbt-04 09:47:02 1231825 3348 1451 228 1669 +133.06 +/- 5.12 0 30 434 1167 43 +304.69 +/- 16.37
ncm-dbt-05 09:42:27 1227153 3330 1465 268 1597 +130.73 +/- 5.29 1 28 463 1119 54 +292.69 +/- 15.83
ncm-dbt-06 09:46:59 1229465 3332 1450 260 1622 +129.8 +/- 5.44 1 46 432 1136 51 +290.84 +/- 16.41
20000 8720 1499 9781 +131.36 +/- 2.17 2 215 2654 6818 311 +295.41 +/- 6.61

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
244505 ncm-dbt-02 1239347 292 125 22 145 +128.05 +/- 17.76 0 4 38 101 3 +291.27 +/- 56.39
244504 ncm-dbt-05 1209202 330 154 28 148 +139.73 +/- 17.74 0 3 42 111 9 +307.6 +/- 53.57
244503 ncm-dbt-03 1223207 338 144 27 167 +125.44 +/- 16.52 0 5 45 116 3 +284.57 +/- 51.63
244502 ncm-dbt-06 1227937 332 129 28 175 +109.15 +/- 17.17 0 5 59 98 4 +232.44 +/- 44.68
244501 ncm-dbt-04 1240343 348 154 23 171 +137.55 +/- 15.87 0 3 42 124 5 +318.35 +/- 53.61
244500 ncm-dbt-01 1194901 360 154 21 185 +134.73 +/- 15.92 0 5 41 130 4 +312.96 +/- 54.16
244499 ncm-dbt-02 1244797 500 210 42 248 +121.45 +/- 14.17 0 8 73 162 7 +265.78 +/- 40.25
244498 ncm-dbt-05 1219208 500 217 33 250 +134.15 +/- 13.61 0 6 61 176 7 +306.84 +/- 44.17
244497 ncm-dbt-03 1220670 500 223 43 234 +130.94 +/- 13.14 0 3 71 169 7 +295.94 +/- 40.69
244496 ncm-dbt-06 1235631 500 223 33 244 +138.99 +/- 14.03 0 6 58 176 10 +315.35 +/- 45.33
244495 ncm-dbt-01 1204037 500 223 43 234 +130.94 +/- 13.69 0 8 59 178 5 +301.33 +/- 44.81
244494 ncm-dbt-04 1224568 500 216 35 249 +131.74 +/- 13.67 0 7 61 176 6 +301.33 +/- 44.13
244493 ncm-dbt-02 1208317 500 230 30 240 +147.19 +/- 13.18 0 2 57 180 11 +342.85 +/- 45.71
244492 ncm-dbt-03 1246523 500 223 34 243 +138.18 +/- 13.87 0 5 61 174 10 +312.48 +/- 44.19
244491 ncm-dbt-05 1242649 500 226 40 234 +135.75 +/- 12.81 0 0 73 168 9 +306.84 +/- 39.69
244490 ncm-dbt-06 1215308 500 222 28 250 +142.25 +/- 13.75 0 6 53 182 9 +330.23 +/- 47.44
244489 ncm-dbt-01 1194418 500 226 28 246 +145.54 +/- 13.83 0 4 56 178 12 +333.32 +/- 46.21
244488 ncm-dbt-04 1218814 500 211 28 261 +133.34 +/- 12.29 0 3 64 180 3 +315.35 +/- 43.03
244487 ncm-dbt-02 1225227 500 209 40 251 +122.24 +/- 14.66 0 9 72 160 9 +263.42 +/- 40.52
244486 ncm-dbt-03 1238842 500 212 39 249 +125.38 +/- 14.13 0 8 68 167 7 +277.93 +/- 41.74
244485 ncm-dbt-06 1231447 500 218 46 236 +124.6 +/- 14.8 1 9 64 169 7 +277.93 +/- 42.91
244484 ncm-dbt-01 1203694 500 221 37 242 +134.15 +/- 14.15 0 5 67 167 11 +295.94 +/- 42.08
244483 ncm-dbt-05 1234688 500 209 41 250 +121.45 +/- 13.84 0 5 80 157 8 +263.42 +/- 38.27
244482 ncm-dbt-04 1233808 500 232 35 233 +144.71 +/- 13.48 0 3 58 178 11 +333.32 +/- 45.35
244481 ncm-dbt-02 1241932 500 207 40 253 +120.67 +/- 14.35 0 8 75 159 8 +261.07 +/- 39.69
244480 ncm-dbt-06 1224446 500 218 38 244 +130.94 +/- 12.76 0 3 69 173 5 +301.33 +/- 41.33
244479 ncm-dbt-01 1182726 500 220 38 242 +132.54 +/- 14.36 0 9 58 175 8 +298.62 +/- 45.1
244478 ncm-dbt-05 1227816 500 222 32 246 +138.99 +/- 11.44 0 1 60 187 2 +339.63 +/- 44.35
244477 ncm-dbt-03 1234267 500 227 40 233 +136.56 +/- 14.27 0 4 68 165 13 +298.62 +/- 41.71
244476 ncm-dbt-04 1223672 500 214 29 257 +134.95 +/- 13.22 0 5 61 178 6 +312.48 +/- 44.19
244475 ncm-dbt-02 1215929 500 214 30 256 +134.15 +/- 12.67 0 2 68 174 6 +309.64 +/- 41.56
244474 ncm-dbt-03 1257186 500 214 34 252 +130.94 +/- 13.51 0 5 67 171 7 +295.94 +/- 42.08
244473 ncm-dbt-01 1210940 500 208 48 244 +115.22 +/- 12.85 0 3 88 155 4 +254.16 +/- 36.15
244472 ncm-dbt-05 1213219 500 216 45 239 +123.81 +/- 14.48 0 8 72 161 9 +268.17 +/- 40.54
244471 ncm-dbt-06 1261714 500 220 33 247 +136.56 +/- 13.17 0 5 59 180 6 +318.25 +/- 44.96
244470 ncm-dbt-04 1243719 500 215 39 246 +127.76 +/- 13.57 0 4 74 164 8 +282.94 +/- 39.86
244469 ncm-dbt-02 1243424 500 223 37 240 +135.76 +/- 14.29 0 7 60 173 10 +304.07 +/- 44.5
244468 ncm-dbt-05 1243294 500 221 49 230 +124.6 +/- 14.64 1 5 75 159 10 +270.57 +/- 39.67
244467 ncm-dbt-01 1227885 500 225 37 238 +137.37 +/- 13.53 0 2 69 168 11 +306.84 +/- 41.23
244466 ncm-dbt-04 1237857 500 209 39 252 +123.02 +/- 13.11 0 5 74 167 4 +277.93 +/- 39.92
244465 ncm-dbt-03 1231825 500 216 33 251 +133.34 +/- 13.45 0 5 64 174 7 +304.07 +/- 43.1
244464 ncm-dbt-06 1209777 500 220 54 226 +119.89 +/- 15.3 0 12 70 158 10 +254.16 +/- 40.96

Commit

Commit ID 6f9071c64354a34970e7b5669701d0ad15b7a694
Author Michael Chaly
Date 2024-01-07 12:37:28 UTC
Tweak usage of correction history Instead of using linear formula use quadratic one. Maximum impact of correction history is doubled this way, it breaks even with previous formula on half of maximum value. Passed STC: https://tests.stockfishchess.org/tests/view/659591e579aa8af82b95d7e8 LLR: 2.93 (-2.94,2.94) <0.00,2.00> Total: 225216 W: 57616 L: 57019 D: 110581 Ptnml(0-2): 747, 26677, 57201, 27198, 785 Passed LTC: https://tests.stockfishchess.org/tests/view/6596ee0b79aa8af82b95f08a LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 73314 W: 18524 L: 18125 D: 36665 Ptnml(0-2): 41, 8159, 19875, 8524, 58 closes https://github.com/official-stockfish/Stockfish/pull/4967 Bench: 1464785
Copyright 2011–2024 Next Chess Move LLC