Dev Builds » 20211201-1722

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:26:14 1106712 3174 1058 527 1589 +58.68 +/- 6.03 3 169 728 668 19 +116.98 +/- 12.62
ncm-dbt-02 09:20:50 1233507 3148 1080 512 1556 +63.38 +/- 5.89 3 141 730 685 15 +128.25 +/- 12.59
ncm-dbt-03 10:32:36 1344790 3498 1187 561 1750 +62.85 +/- 5.7 2 178 777 776 16 +126.93 +/- 12.22
ncm-dbt-04 10:32:49 1334457 3530 1260 556 1714 +70.23 +/- 5.38 1 122 836 784 22 +141.83 +/- 11.71
ncm-dbt-05 10:29:05 1339422 3478 1164 537 1777 +63.33 +/- 5.58 1 160 805 757 16 +127.73 +/- 11.99
ncm-dbt-06 09:26:14 1223813 3172 1095 522 1555 +63.46 +/- 6.01 0 168 693 709 16 +127.44 +/- 12.94
20000 6844 3215 9941 +63.75 +/- 2.35 10 938 4569 4379 104 +128.36 +/- 5.03

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
191478 ncm-dbt-05 1217956 144 51 17 76 +83.6 +/- 28.38 0 4 33 32 3 +160.02 +/- 59.71
191477 ncm-dbt-02 1238742 148 51 32 65 +44.85 +/- 26.57 0 8 40 25 1 +86.24 +/- 53.73
191476 ncm-dbt-03 1255226 172 55 31 86 +48.79 +/- 27.24 0 13 37 35 1 +95.23 +/- 56.42
191475 ncm-dbt-06 1212188 172 67 30 75 +75.92 +/- 24.64 0 6 38 41 1 +154.96 +/- 55.82
191474 ncm-dbt-01 1091084 174 67 24 83 +87.67 +/- 25.67 0 7 31 48 1 +182.95 +/- 62.11
191473 ncm-dbt-04 1211309 190 64 26 100 +70.44 +/- 24.47 1 6 43 44 1 +147.19 +/- 52.35
191472 ncm-dbt-02 1222742 500 176 86 238 +63.23 +/- 15.01 0 25 113 109 3 +126.18 +/- 32.14
191471 ncm-dbt-05 1223394 500 171 75 254 +67.54 +/- 14.65 0 22 112 114 2 +137.37 +/- 32.27
191470 ncm-dbt-01 1105287 500 167 86 247 +56.78 +/- 15.51 1 30 107 111 1 +116.78 +/- 33.01
191469 ncm-dbt-06 1230402 500 166 88 246 +54.64 +/- 14.63 0 25 125 97 3 +107.54 +/- 30.4
191468 ncm-dbt-03 1228549 500 169 75 256 +66.1 +/- 14.59 0 22 114 112 2 +134.15 +/- 31.97
191467 ncm-dbt-04 1214912 500 180 90 230 +63.23 +/- 14.75 0 21 123 101 5 +123.02 +/- 30.61
191466 ncm-dbt-05 1218567 500 162 79 259 +58.21 +/- 14.53 0 24 121 103 2 +116.78 +/- 30.96
191465 ncm-dbt-02 1243834 500 174 77 249 +68.27 +/- 15.21 2 19 112 114 3 +140.62 +/- 32.26
191464 ncm-dbt-01 1106889 500 160 88 252 +50.38 +/- 15.7 0 33 117 95 5 +95.44 +/- 31.58
191463 ncm-dbt-06 1207255 500 173 92 235 +56.78 +/- 16.01 0 34 105 107 4 +110.6 +/- 33.27
191462 ncm-dbt-03 1215748 500 176 91 233 +59.64 +/- 14.04 1 19 124 106 0 +124.6 +/- 30.44
191461 ncm-dbt-04 1221966 500 176 75 249 +71.16 +/- 14.22 0 18 115 115 2 +145.54 +/- 31.75
191460 ncm-dbt-05 1244817 500 172 79 249 +65.38 +/- 13.86 0 16 128 103 3 +130.94 +/- 29.72
191459 ncm-dbt-01 1105684 500 176 82 242 +66.1 +/- 14.73 0 23 112 113 2 +134.15 +/- 32.28
191458 ncm-dbt-02 1230302 500 174 72 254 +71.88 +/- 13.96 0 16 118 114 2 +147.19 +/- 31.23
191457 ncm-dbt-03 1226853 500 173 80 247 +65.38 +/- 15.75 1 24 112 107 6 +127.76 +/- 32.29
191456 ncm-dbt-06 1221329 500 183 73 244 +77.7 +/- 14.72 0 20 102 126 2 +160.64 +/- 33.88
191455 ncm-dbt-04 1220007 500 176 78 246 +68.99 +/- 14.0 0 16 123 108 3 +138.99 +/- 30.46
191454 ncm-dbt-05 1226699 500 163 73 264 +63.23 +/- 14.75 0 25 111 113 1 +129.35 +/- 32.44
191453 ncm-dbt-01 1108623 500 166 93 241 +51.09 +/- 15.23 1 28 121 97 3 +101.46 +/- 31.01
191452 ncm-dbt-06 1210354 500 172 69 259 +72.61 +/- 15.37 0 24 103 119 4 +145.54 +/- 33.69
191451 ncm-dbt-02 1234650 500 171 90 239 +56.78 +/- 14.73 1 23 122 102 2 +115.23 +/- 30.81
191450 ncm-dbt-03 1215517 500 165 71 264 +66.1 +/- 15.13 0 25 109 113 3 +132.54 +/- 32.75
191449 ncm-dbt-04 1238625 500 178 67 255 +78.43 +/- 14.17 0 16 109 123 2 +162.35 +/- 32.67
191448 ncm-dbt-05 1219922 500 165 80 255 +59.64 +/- 15.38 1 27 110 110 2 +121.46 +/- 32.59
191447 ncm-dbt-06 1239445 500 162 78 260 +58.93 +/- 14.96 0 29 108 113 0 +121.46 +/- 32.88
191446 ncm-dbt-02 1228886 500 171 75 254 +67.54 +/- 14.37 0 19 119 109 3 +135.76 +/- 31.16
191445 ncm-dbt-01 1111312 500 155 76 269 +55.36 +/- 14.53 0 25 123 100 2 +110.6 +/- 30.69
191444 ncm-dbt-04 1211939 500 186 76 238 +77.7 +/- 13.25 0 10 122 116 2 +160.64 +/- 30.32
191443 ncm-dbt-03 1249447 500 166 79 255 +61.07 +/- 15.7 0 30 107 109 4 +119.89 +/- 33.02
191442 ncm-dbt-02 1235399 500 163 80 257 +58.21 +/- 15.32 0 31 106 112 1 +118.33 +/- 33.16
191441 ncm-dbt-05 1220334 500 162 85 253 +53.93 +/- 14.46 0 27 119 104 0 +110.6 +/- 31.28
191440 ncm-dbt-01 1118108 500 167 78 255 +62.51 +/- 15.37 1 23 117 104 5 +123.02 +/- 31.54
191439 ncm-dbt-03 1229766 500 175 79 246 +67.55 +/- 14.78 0 25 104 121 0 +140.62 +/- 33.53
191438 ncm-dbt-06 1245724 500 172 92 236 +56.07 +/- 15.22 0 30 112 106 2 +112.14 +/- 32.29
191437 ncm-dbt-04 1229403 500 177 87 236 +63.23 +/- 15.14 0 25 114 107 4 +124.6 +/- 31.99
174862 ncm-dbt-03 1461684 26 9 3 14 +81.63 +/- 64.15 0 1 5 7 0 +173.46 +/- 173.59
174860 ncm-dbt-05 1457071 34 12 6 16 +61.95 +/- 50.55 0 1 9 7 0 +128.13 +/- 116.78
174859 ncm-dbt-04 1450867 40 15 9 16 +52.51 +/- 50.26 0 2 10 8 0 +107.54 +/- 111.88
174857 ncm-dbt-03 1461086 50 15 5 30 +70.43 +/- 49.53 0 3 9 13 0 +147.19 +/- 118.91
174856 ncm-dbt-05 1448859 50 16 6 28 +70.43 +/- 40.35 0 1 13 11 0 +147.19 +/- 95.14
174855 ncm-dbt-04 1448078 50 19 10 21 +63.21 +/- 44.24 0 1 15 8 1 +115.23 +/- 84.94
174854 ncm-dbt-03 1458409 50 14 8 28 +41.89 +/- 49.33 0 4 11 10 0 +85.04 +/- 106.19
174853 ncm-dbt-05 1455737 50 11 7 32 +27.85 +/- 46.49 0 4 13 8 0 +56.07 +/- 96.84
174852 ncm-dbt-04 1443991 50 17 8 25 +63.22 +/- 44.25 0 2 12 11 0 +130.94 +/- 101.68
174851 ncm-dbt-03 1459151 50 18 10 22 +56.07 +/- 47.61 0 3 11 11 0 +115.23 +/- 106.91
174850 ncm-dbt-05 1449703 50 19 8 23 +77.7 +/- 45.94 0 2 10 13 0 +164.07 +/- 113.84
174849 ncm-dbt-04 1447352 50 16 8 26 +56.05 +/- 47.6 0 2 14 8 1 +99.95 +/- 91.41
174848 ncm-dbt-03 1453394 50 17 10 23 +48.96 +/- 42.0 0 2 14 9 0 +99.95 +/- 91.41
174847 ncm-dbt-05 1457369 50 19 7 24 +85.02 +/- 55.08 0 3 8 13 1 +164.07 +/- 126.09
174846 ncm-dbt-04 1445602 50 20 7 23 +92.44 +/- 47.1 0 1 11 12 1 +181.7 +/- 107.11
174845 ncm-dbt-03 1456925 50 19 9 22 +70.43 +/- 49.53 0 3 9 13 0 +147.19 +/- 118.91
174844 ncm-dbt-05 1455902 50 21 5 24 +115.21 +/- 52.56 0 2 6 16 1 +240.82 +/- 153.02
174843 ncm-dbt-04 1449545 50 21 7 22 +99.93 +/- 36.88 0 0 11 14 0 +219.84 +/- 104.3
174842 ncm-dbt-03 1455306 50 16 10 24 +41.89 +/- 49.33 0 4 11 10 0 +85.04 +/- 106.19
174841 ncm-dbt-04 1448813 50 15 8 27 +48.96 +/- 42.0 0 2 14 9 0 +99.95 +/- 91.41
174840 ncm-dbt-05 1455589 50 20 10 20 +70.42 +/- 49.53 0 2 12 10 1 +130.94 +/- 101.68

Commit

Commit ID c1f9a359e8e319d832ee5a55277dab996dd29d25
Author bmc4
Date 2021-12-01 17:22:44 UTC
Correctly reset bestMoveChanges for searches not using time management (e.g. analysis, fixed node game play etc), bestMoveChanges was not reset during search iterations. As LMR uses this quantity, search was somewhat weaker. Tested using fixed node playing games: ``` ./c-chess-cli -each nodes=10000 option.Hash=16 -engine cmd=../Stockfish/src/fix -engine cmd=../Stockfish/src/master -concurrency 6 -openings file=../books/UHO_XXL_+0.90_+1.19.epd -games 10000 Score of Stockfish Fix vs Stockfish Master: 3187 - 3028 - 3785 [0.508] 10000 ./c-chess-cli -each nodes=30000 option.Hash=16 -engine cmd=../Stockfish/src/fix -engine cmd=../Stockfish/src/master -concurrency 6 -openings file=../books/UHO_XXL_+0.90_+1.19.epd -games 10000 Score of Stockfish Fix vs Stockfish Master: 2946 - 2834 - 4220 [0.506] 10000 ``` closes https://github.com/official-stockfish/Stockfish/pull/3818 bench: 5061979
Copyright 2011–2024 Next Chess Move LLC