Dev Builds » 20240121-1142

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 14:45:54 1129971 4996 2153 370 2473 +129.7 +/- 4.37 0 66 654 1707 71 +291.54 +/- 13.33
ncm-dbt-03 14:47:13 1167662 5004 2181 343 2480 +133.87 +/- 4.02 0 32 651 1768 51 +311.22 +/- 13.34
ncm-dbt-04 14:46:37 1170320 4998 2175 362 2461 +132.04 +/- 4.22 1 48 649 1739 62 +302.07 +/- 13.38
ncm-dbt-06 14:46:43 1158072 5002 2209 373 2420 +133.77 +/- 4.23 0 50 632 1752 67 +306.37 +/- 13.56
20000 8718 1448 9834 +132.34 +/- 2.11 1 196 2586 6966 251 +302.7 +/- 6.7

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
326559 ncm-dbt-04 1197355 376 161 31 184 +125.28 +/- 14.57 0 2 57 126 3 +285.19 +/- 45.4
326558 ncm-dbt-01 1154768 386 168 34 184 +125.84 +/- 15.68 0 7 48 135 3 +287.26 +/- 49.8
326557 ncm-dbt-03 1198073 382 170 22 190 +142.02 +/- 14.13 0 1 46 139 5 +337.0 +/- 50.93
326556 ncm-dbt-06 1200085 392 164 32 196 +121.74 +/- 14.29 0 2 63 128 3 +274.32 +/- 43.01
326555 ncm-dbt-01 1170405 500 211 36 253 +126.97 +/- 13.76 0 8 64 173 5 +288.06 +/- 43.03
326554 ncm-dbt-04 1197661 500 211 34 255 +128.55 +/- 13.56 0 8 61 177 4 +295.94 +/- 44.08
326553 ncm-dbt-03 1196993 500 224 36 240 +137.37 +/- 13.71 0 6 58 178 8 +315.35 +/- 45.33
326552 ncm-dbt-06 1186285 500 220 35 245 +134.95 +/- 12.84 0 6 56 185 3 +321.19 +/- 46.14
326551 ncm-dbt-03 1200332 500 207 23 270 +134.15 +/- 12.27 0 4 60 184 2 +321.19 +/- 44.57
326550 ncm-dbt-06 1197398 500 223 29 248 +142.25 +/- 13.18 0 3 59 179 9 +330.23 +/- 44.94
326549 ncm-dbt-01 1162494 500 215 41 244 +126.17 +/- 14.29 0 7 71 163 9 +275.45 +/- 40.84
326548 ncm-dbt-04 1218392 500 213 42 245 +123.81 +/- 13.63 0 8 67 171 4 +280.42 +/- 42.05
326547 ncm-dbt-06 808040 500 220 45 235 +126.97 +/- 14.11 0 6 72 163 9 +277.93 +/- 40.53
326546 ncm-dbt-04 798882 500 223 32 245 +139.81 +/- 14.72 1 6 55 177 11 +318.25 +/- 46.48
326545 ncm-dbt-03 848428 500 219 31 250 +137.37 +/- 13.15 0 2 67 172 9 +312.48 +/- 41.9
326544 ncm-dbt-01 811215 500 209 38 253 +123.81 +/- 15.13 0 10 70 159 11 +263.42 +/- 41.06
326543 ncm-dbt-06 1189692 110 51 9 50 +139.72 +/- 32.49 0 2 12 38 3 +307.6 +/- 105.04
326542 ncm-dbt-01 1156286 110 47 12 51 +114.51 +/- 34.4 0 4 14 35 2 +240.82 +/- 93.59
326541 ncm-dbt-03 1197972 122 61 9 52 +158.16 +/- 27.09 0 0 13 44 4 +369.37 +/- 101.35
326540 ncm-dbt-04 1221818 122 53 8 61 +134.48 +/- 24.06 0 0 17 43 1 +316.28 +/- 85.74
326539 ncm-dbt-06 1198450 500 230 36 234 +142.25 +/- 11.95 0 2 56 188 4 +346.12 +/- 46.15
326538 ncm-dbt-01 1165020 500 220 29 251 +139.81 +/- 13.26 0 3 62 176 9 +321.19 +/- 43.77
326537 ncm-dbt-04 1186645 500 226 44 230 +132.54 +/- 13.47 0 4 68 170 8 +298.62 +/- 41.71
326536 ncm-dbt-03 1203704 500 220 41 239 +130.14 +/- 12.78 0 3 70 172 5 +298.62 +/- 41.01
326535 ncm-dbt-06 1198748 500 221 36 243 +134.95 +/- 14.13 0 7 60 174 9 +304.07 +/- 44.5
326534 ncm-dbt-04 1213778 500 227 36 237 +139.81 +/- 13.45 0 7 51 186 6 +330.23 +/- 48.25
326533 ncm-dbt-01 1162960 500 218 36 246 +132.54 +/- 14.7 0 8 63 168 11 +290.66 +/- 43.37
326532 ncm-dbt-03 1200785 500 214 37 249 +128.55 +/- 12.63 0 4 68 175 3 +298.62 +/- 41.71
326531 ncm-dbt-04 1229703 500 212 31 257 +131.74 +/- 13.67 0 5 67 170 8 +295.94 +/- 42.08
326530 ncm-dbt-01 1164286 500 220 34 246 +135.76 +/- 13.01 0 5 59 181 5 +318.25 +/- 44.96
326529 ncm-dbt-06 1188671 500 215 26 259 +138.18 +/- 12.53 0 4 57 185 4 +330.23 +/- 45.79
326528 ncm-dbt-03 1199460 500 218 45 237 +125.38 +/- 13.43 0 5 73 166 6 +280.42 +/- 40.21
326527 ncm-dbt-04 1192162 500 213 39 248 +126.17 +/- 12.68 0 3 74 169 4 +288.06 +/- 39.79
326526 ncm-dbt-06 1193247 500 222 36 242 +135.76 +/- 13.2 0 6 57 182 5 +318.25 +/- 45.73
326525 ncm-dbt-01 1154428 500 210 40 250 +123.02 +/- 13.29 0 5 75 165 5 +275.45 +/- 39.63
326524 ncm-dbt-03 1200238 500 214 28 258 +135.76 +/- 11.58 0 1 64 183 2 +327.18 +/- 42.83
326523 ncm-dbt-06 1188528 500 220 43 237 +128.55 +/- 13.73 0 6 68 169 7 +288.06 +/- 41.76
326522 ncm-dbt-04 1207965 500 217 31 252 +135.76 +/- 12.42 0 1 68 175 6 +315.35 +/- 41.44
326521 ncm-dbt-03 1198172 500 218 33 249 +134.95 +/- 12.44 0 4 60 183 3 +321.19 +/- 44.57
326520 ncm-dbt-01 1163714 500 216 34 250 +132.54 +/- 12.91 0 5 62 179 4 +309.64 +/- 43.82
326519 ncm-dbt-01 1164113 500 219 36 245 +133.34 +/- 13.26 0 4 66 173 7 +304.07 +/- 42.38
326518 ncm-dbt-04 1209168 500 219 34 247 +134.95 +/- 13.22 0 4 64 175 7 +309.64 +/- 43.08
326517 ncm-dbt-06 1189653 500 223 46 231 +128.55 +/- 14.42 0 6 72 161 11 +277.93 +/- 40.53
326516 ncm-dbt-03 1200129 500 216 38 246 +129.35 +/- 12.41 0 2 72 172 4 +298.62 +/- 40.29

Commit

Commit ID e860f620aa3eb42f8a6be78c030c75855d0c9ff0
Author rn5f107s2
Date 2024-01-21 11:42:07 UTC
Reduce futility_margin further when improving The idea of this is to unroll the futility_margin calculation to allow for the improving flag to have a greater effect on the futility margin. The current factor is 1.5 instead of the previous 1 resulting in a deduction of an extra margin/2 from futilit_margin if improving. The chosen value was not tuned, meaning that there is room for tweaking it. This patch is partially inspired by @Vizvezdenec, who, although quite different in execution, tested another idea where the futility_margin is lowered further when improving [1]. [1]: (first take) https://tests.stockfishchess.org/tests/view/65a56b1879aa8af82b97164b Passed STC: https://tests.stockfishchess.org/tests/live_elo/65a8bfc179aa8af82b974e3c LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 161152 W: 41321 L: 40816 D: 79015 Ptnml(0-2): 559, 19030, 40921, 19479, 587 Passed rebased LTC: https://tests.stockfishchess.org/tests/live_elo/65a8b9ef79aa8af82b974dc0 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 96024 W: 24172 L: 23728 D: 48124 Ptnml(0-2): 56, 10598, 26275, 11012, 71 closes https://github.com/official-stockfish/Stockfish/pull/5000 Bench: 1281703
Copyright 2011–2024 Next Chess Move LLC