Dev Builds » 20211105-2122

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:30:47 1964771 3400 2887 8 505 +432.42 +/- 15.16
ncm-et-4 08:30:40 1964968 3384 2937 18 429 +452.84 +/- 16.48
ncm-et-9 08:30:54 1965222 3405 2900 10 495 +434.88 +/- 15.32
ncm-et-10 07:51:35 1956010 3063 2574 9 480 +421.25 +/- 15.55
ncm-et-13 08:30:36 1960339 3379 2854 3 522 +428.74 +/- 14.89
ncm-et-15 08:30:36 1959168 3369 2846 5 518 +428.18 +/- 14.96
20000 16998 53 2949 +433.02 +/- 6.27

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
153334 ncm-et-10 2021-11-06 05:49 00:53:55 1957272 354 295 0 59 +416.55 +/- 44.9
153333 ncm-et-15 2021-11-06 05:47 00:55:36 1961389 369 315 0 54 +441.06 +/- 47.09
153332 ncm-et-4 2021-11-06 05:44 00:58:04 1968333 384 349 0 35 +528.4 +/- 59.43
153331 ncm-et-13 2021-11-06 05:44 00:58:45 1957415 379 320 0 59 +429.44 +/- 44.94
153330 ncm-et-3 2021-11-06 05:42 01:00:50 1961405 400 344 0 56 +449.35 +/- 46.23
153329 ncm-et-9 2021-11-06 05:42 01:01:07 1959722 405 349 0 56 +451.67 +/- 46.24
153328 ncm-et-15 2021-11-06 04:31 01:14:56 1961409 500 421 2 77 +421.93 +/- 39.29
153327 ncm-et-10 2021-11-06 04:31 01:16:50 1953890 500 422 0 78 +429.05 +/- 38.92
153326 ncm-et-4 2021-11-06 04:29 01:14:57 1969258 500 418 5 77 +408.38 +/- 39.29
153325 ncm-et-13 2021-11-06 04:28 01:15:01 1962460 500 424 1 75 +431.48 +/- 39.8
153324 ncm-et-3 2021-11-06 04:26 01:14:57 1967387 500 418 0 82 +419.61 +/- 37.91
153323 ncm-et-9 2021-11-06 04:26 01:15:10 1960011 500 421 2 77 +421.93 +/- 39.29
153322 ncm-et-15 2021-11-06 03:14 01:16:25 1956635 500 426 0 74 +438.95 +/- 40.01
153321 ncm-et-10 2021-11-06 03:13 01:17:21 1954812 500 419 2 79 +417.32 +/- 38.77
153320 ncm-et-4 2021-11-06 03:13 01:15:34 1965725 500 438 2 60 +466.04 +/- 44.75
153319 ncm-et-13 2021-11-06 03:13 01:14:55 1960309 500 409 0 91 +399.81 +/- 35.89
153318 ncm-et-9 2021-11-06 03:10 01:15:15 1969091 500 431 1 68 +449.35 +/- 41.89
153317 ncm-et-3 2021-11-06 03:10 01:15:43 1957032 500 422 1 77 +426.65 +/- 39.25
153316 ncm-et-10 2021-11-06 02:59 00:10:54 1951343 71 60 0 11 +430.32 +/- 113.68
153315 ncm-et-10 2021-11-06 02:46 00:09:10 1953738 56 45 0 11 +385.14 +/- 112.49
153314 ncm-et-15 2021-11-06 01:58 01:15:53 1966460 500 427 0 73 +441.5 +/- 40.29
153313 ncm-et-4 2021-11-06 01:57 01:14:41 1960615 500 428 2 70 +438.95 +/- 41.29
153312 ncm-et-13 2021-11-06 01:56 01:16:20 1957247 500 431 1 68 +449.35 +/- 41.89
153311 ncm-et-9 2021-11-06 01:55 01:14:39 1968164 500 430 0 70 +449.35 +/- 41.19
153310 ncm-et-3 2021-11-06 01:54 01:14:58 1970501 500 423 2 75 +426.65 +/- 39.83
153309 ncm-et-10 2021-11-06 01:29 01:16:51 1957897 500 423 0 77 +431.48 +/- 39.18
153308 ncm-et-15 2021-11-06 00:40 01:16:45 1942560 500 420 1 79 +421.93 +/- 38.73
153307 ncm-et-13 2021-11-06 00:40 01:14:48 1961234 500 419 0 81 +421.93 +/- 38.15
153306 ncm-et-4 2021-11-06 00:40 01:16:52 1955121 500 439 1 60 +471.92 +/- 44.73
153305 ncm-et-9 2021-11-06 00:39 01:15:15 1967077 500 420 2 78 +419.61 +/- 39.03
153304 ncm-et-3 2021-11-06 00:39 01:15:12 1964918 500 421 1 78 +424.28 +/- 38.99
153303 ncm-et-10 2021-11-06 00:13 01:14:48 1963533 500 421 4 75 +417.32 +/- 39.84
153302 ncm-et-15 2021-11-05 23:25 01:15:14 1961272 500 419 1 80 +419.61 +/- 38.47
153301 ncm-et-4 2021-11-05 23:24 01:15:20 1971874 500 434 4 62 +449.35 +/- 43.93
153300 ncm-et-13 2021-11-05 23:24 01:15:45 1957711 500 436 0 64 +466.03 +/- 43.18
153299 ncm-et-9 2021-11-05 23:24 01:14:43 1967238 500 419 1 80 +419.61 +/- 38.47
153298 ncm-et-3 2021-11-05 23:23 01:14:30 1965541 500 425 0 75 +436.43 +/- 39.73
153297 ncm-et-10 2021-11-05 22:57 01:15:25 1970662 500 420 3 77 +417.32 +/- 39.31
153296 ncm-et-10 2021-11-05 22:51 00:02:44 1963547 17 15 0 2 +481.47 +/- 438.97
153295 ncm-et-10 2021-11-05 22:45 00:02:02 1960308 9 8 0 1 +491.83 +/- 454.92
153294 ncm-et-10 2021-11-05 22:40 00:02:08 1958641 10 8 0 2 +381.52 +/- 492.07
153293 ncm-et-10 2021-11-05 22:34 00:01:56 1960621 10 8 0 2 +381.52 +/- 492.07
153292 ncm-et-10 2021-11-05 22:29 00:01:38 1941000 8 8 0 0 +1199.83 +/- 190.04
153291 ncm-et-10 2021-11-05 22:24 00:01:33 1939384 8 5 0 3 +254.61 +/- 287.37
153290 ncm-et-10 2021-11-05 22:19 00:01:47 1957706 8 6 0 2 +337.87 +/- 515.83
153289 ncm-et-10 2021-11-05 22:13 00:01:30 1947665 8 8 0 0 +1199.83 +/- 190.04
153288 ncm-et-13 2021-11-05 22:08 01:15:02 1966001 500 415 1 84 +410.58 +/- 37.5
153287 ncm-et-15 2021-11-05 22:08 01:15:47 1964456 500 418 1 81 +417.32 +/- 38.22
153286 ncm-et-3 2021-11-05 22:08 01:14:37 1966615 500 434 4 62 +449.35 +/- 43.93
153285 ncm-et-9 2021-11-05 22:08 01:14:45 1965257 500 430 4 66 +438.95 +/- 42.55
153284 ncm-et-10 2021-11-05 22:08 00:01:03 1960156 4 3 0 1 +337.69 +/- 541.44
153283 ncm-et-4 2021-11-05 22:08 01:15:12 1963853 500 431 4 65 +441.5 +/- 42.88

Commit

Commit ID a0259d8ab9661b7f625474d2cbe18481ef69bbf2
Author Stefan Geschwentner
Date 2021-11-05 21:22:30 UTC
Tweak initial aspiration window. Maintain for each root move an exponential average of the search value with a weight ratio of 2:1 (new value vs old values). Then the average score is used as the center of the initial aspiration window instead of the previous score. Stats indicate (see PR) that the deviation for previous score is in general greater than using average score, so later seems a better estimation of the next search value. This is probably the reason this patch succeded besides smoothing the sometimes wild swings in search score. An additional observation is that at higher depth previous score is above but average score below zero. So for average score more/less fail/low highs should be occur than previous score. STC: LLR: 2.97 (-2.94,2.94) <0.00,2.50> Total: 59792 W: 15106 L: 14792 D: 29894 Ptnml(0-2): 144, 6718, 15869, 7010, 155 https://tests.stockfishchess.org/tests/view/61841612d7a085ad008eef06 LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 46448 W: 11835 L: 11537 D: 23076 Ptnml(0-2): 21, 4756, 13374, 5050, 23 https://tests.stockfishchess.org/tests/view/618463abd7a085ad008eef3e closes https://github.com/official-stockfish/Stockfish/pull/3776 Bench: 6719976
Copyright 2011–2024 Next Chess Move LLC