Dev Builds » 20211221-1247

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:29:46 1099939 3182 1110 473 1599 +70.5 +/- 6.02 1 138 707 713 32 +139.36 +/- 12.8
ncm-dbt-02 09:25:49 1232469 3136 1113 482 1541 +70.87 +/- 6.07 0 143 679 718 28 +140.85 +/- 13.07
ncm-dbt-03 10:38:15 1347794 3516 1193 552 1771 +64.06 +/- 5.56 0 160 819 757 22 +127.8 +/- 11.88
ncm-dbt-04 10:37:56 1333655 3506 1202 525 1779 +67.94 +/- 5.68 2 155 788 780 28 +135.5 +/- 12.12
ncm-dbt-05 10:33:21 1341517 3482 1211 547 1724 +67.08 +/- 5.69 0 162 779 774 26 +133.53 +/- 12.2
ncm-dbt-06 09:30:45 1221326 3178 1123 489 1566 +70.25 +/- 6.03 1 148 680 736 24 +140.83 +/- 13.07
20000 6952 3068 9980 +68.34 +/- 2.38 4 906 4452 4478 160 +136.08 +/- 5.1

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
190592 ncm-dbt-02 1222518 136 56 18 62 +99.72 +/- 28.18 0 4 23 40 1 +211.93 +/- 72.92
190591 ncm-dbt-05 1221344 148 53 25 70 +66.53 +/- 28.47 0 7 34 31 2 +127.5 +/- 59.1
190590 ncm-dbt-04 1217714 176 67 24 85 +86.63 +/- 22.57 0 3 40 44 1 +180.47 +/- 53.69
190589 ncm-dbt-06 1215534 178 68 24 86 +87.69 +/- 25.25 0 5 38 43 3 +173.08 +/- 55.82
190588 ncm-dbt-03 1233682 180 67 26 87 +80.55 +/- 25.39 0 7 37 44 2 +161.21 +/- 56.75
190587 ncm-dbt-01 1106028 182 52 28 102 +46.08 +/- 24.02 0 10 48 32 1 +89.76 +/- 49.13
190586 ncm-dbt-02 1232034 500 175 72 253 +72.61 +/- 15.37 0 25 100 122 3 +147.19 +/- 34.17
190585 ncm-dbt-05 1236081 500 188 91 221 +68.27 +/- 15.21 0 24 109 113 4 +135.76 +/- 32.75
190584 ncm-dbt-06 1217719 500 180 83 237 +68.27 +/- 14.94 0 23 110 114 3 +137.37 +/- 32.59
190583 ncm-dbt-03 1230988 500 157 93 250 +44.72 +/- 14.64 0 30 128 90 2 +88.0 +/- 30.06
190582 ncm-dbt-04 1230004 500 162 77 261 +59.64 +/- 14.86 0 26 115 107 2 +119.89 +/- 31.85
190581 ncm-dbt-01 1094793 500 168 75 257 +65.38 +/- 15.23 0 25 111 110 4 +129.35 +/- 32.44
190580 ncm-dbt-02 1244768 500 180 96 224 +58.93 +/- 16.1 0 32 108 104 6 +112.14 +/- 32.86
190579 ncm-dbt-05 1245825 500 161 79 260 +57.5 +/- 14.63 0 24 123 100 3 +113.68 +/- 30.67
190578 ncm-dbt-03 1227747 500 183 79 238 +73.33 +/- 14.72 0 18 115 112 5 +145.54 +/- 31.75
190577 ncm-dbt-06 1244905 500 172 76 252 +67.54 +/- 15.45 0 27 103 117 3 +135.76 +/- 33.67
190576 ncm-dbt-04 1223788 500 182 74 244 +76.25 +/- 15.62 0 19 114 107 10 +143.89 +/- 31.92
190575 ncm-dbt-01 1105903 500 175 69 256 +74.79 +/- 14.63 0 19 109 119 3 +152.18 +/- 32.72
190574 ncm-dbt-02 1233761 500 168 69 263 +69.71 +/- 14.86 0 21 113 112 4 +138.99 +/- 32.11
190573 ncm-dbt-05 1208203 500 177 70 253 +75.52 +/- 14.65 0 20 105 123 2 +155.54 +/- 33.38
190572 ncm-dbt-03 1233981 500 165 73 262 +64.66 +/- 14.67 0 24 111 114 1 +132.54 +/- 32.44
190571 ncm-dbt-04 1202008 500 162 76 262 +60.36 +/- 15.28 1 26 111 110 2 +123.02 +/- 32.44
190570 ncm-dbt-06 1199227 500 179 82 239 +68.27 +/- 15.08 0 23 111 112 4 +135.76 +/- 32.43
190569 ncm-dbt-01 1102599 500 190 73 237 +82.83 +/- 16.2 0 23 96 122 9 +160.64 +/- 34.88
190568 ncm-dbt-02 1230565 500 175 73 252 +71.88 +/- 14.94 0 20 113 112 5 +142.26 +/- 32.1
190567 ncm-dbt-05 1229609 500 183 62 255 +85.78 +/- 14.79 0 17 99 130 4 +176.33 +/- 34.4
190566 ncm-dbt-06 1223540 500 175 80 245 +66.82 +/- 16.05 1 27 103 114 5 +132.54 +/- 33.65
190565 ncm-dbt-04 1218225 500 174 80 246 +66.1 +/- 15.52 0 25 112 107 6 +127.76 +/- 32.29
190564 ncm-dbt-03 1232913 500 174 83 243 +63.94 +/- 14.5 0 22 117 109 2 +129.35 +/- 31.52
190563 ncm-dbt-01 1083930 500 175 80 245 +66.82 +/- 15.02 0 22 116 107 5 +130.94 +/- 31.66
190562 ncm-dbt-02 1233665 500 181 81 238 +70.43 +/- 14.75 0 21 111 115 3 +142.26 +/- 32.42
190561 ncm-dbt-01 1104745 500 171 82 247 +62.51 +/- 14.85 1 20 122 103 4 +124.6 +/- 30.76
190560 ncm-dbt-05 1232623 500 169 85 246 +58.93 +/- 14.83 0 23 125 97 5 +113.68 +/- 30.37
190559 ncm-dbt-06 1232552 500 169 79 252 +63.23 +/- 14.88 0 25 112 111 2 +127.76 +/- 32.29
190558 ncm-dbt-03 1258524 500 169 72 259 +68.27 +/- 15.08 0 24 108 115 3 +137.37 +/- 32.9
190557 ncm-dbt-04 1224980 500 174 62 264 +79.17 +/- 13.9 0 14 112 122 2 +164.07 +/- 32.12
190556 ncm-dbt-02 1229977 500 178 73 249 +74.06 +/- 15.15 0 20 111 113 6 +145.54 +/- 32.41
190555 ncm-dbt-05 1220724 500 168 80 252 +61.79 +/- 15.47 0 29 107 111 3 +123.02 +/- 33.03
190554 ncm-dbt-01 1101581 500 179 66 255 +79.9 +/- 15.2 0 19 105 120 6 +158.93 +/- 33.37
190553 ncm-dbt-06 1215807 500 180 65 255 +81.36 +/- 14.82 0 18 103 125 4 +165.8 +/- 33.7
190552 ncm-dbt-04 1232837 500 174 75 251 +69.71 +/- 15.0 1 20 111 115 3 +142.26 +/- 32.42
190551 ncm-dbt-03 1246059 500 164 75 261 +62.51 +/- 14.98 0 23 120 102 5 +121.46 +/- 31.09
174785 ncm-dbt-04 1448375 30 7 4 19 +34.86 +/- 67.33 0 3 6 6 0 +70.44 +/- 146.12
174784 ncm-dbt-05 1449140 34 14 4 16 +105.27 +/- 63.36 0 1 6 9 1 +204.75 +/- 156.74
174783 ncm-dbt-03 1458258 36 15 6 15 +88.71 +/- 66.34 0 2 6 9 1 +165.99 +/- 151.05
174782 ncm-dbt-04 1447204 50 16 10 24 +41.89 +/- 45.18 0 3 13 9 0 +85.04 +/- 96.78
174781 ncm-dbt-05 1456626 50 17 9 24 +56.05 +/- 58.98 0 5 8 11 1 +99.95 +/- 120.32
174780 ncm-dbt-03 1460939 50 17 7 26 +70.43 +/- 45.16 0 2 11 12 0 +147.19 +/- 107.43
174779 ncm-dbt-05 1454703 50 14 9 27 +34.86 +/- 39.1 0 2 16 7 0 +70.44 +/- 81.92
174778 ncm-dbt-04 1447808 50 19 8 23 +77.69 +/- 58.16 0 3 10 10 2 +130.94 +/- 112.59
174777 ncm-dbt-03 1457370 50 15 4 31 +77.69 +/- 35.69 0 0 14 11 0 +164.04 +/- 86.61
174776 ncm-dbt-05 1455591 50 14 7 29 +48.95 +/- 54.34 0 4 11 9 1 +85.04 +/- 106.19
174775 ncm-dbt-04 1444138 50 18 11 21 +48.96 +/- 50.55 0 4 10 11 0 +99.95 +/- 111.26
174774 ncm-dbt-03 1458718 50 17 4 29 +92.45 +/- 42.2 0 1 10 14 0 +200.24 +/- 114.26
174773 ncm-dbt-05 1454998 50 16 11 23 +34.86 +/- 43.75 0 3 14 8 0 +70.44 +/- 92.08
174772 ncm-dbt-04 1443579 50 16 12 22 +27.85 +/- 46.49 0 4 13 8 0 +56.07 +/- 96.84
174771 ncm-dbt-03 1454282 50 16 8 26 +56.07 +/- 47.61 0 3 11 11 0 +115.23 +/- 106.91
174764 ncm-dbt-05 1456034 50 18 8 24 +70.43 +/- 45.16 0 2 11 12 0 +147.19 +/- 107.43
174763 ncm-dbt-04 1447201 50 14 4 32 +70.43 +/- 45.16 0 2 11 12 0 +147.19 +/- 107.43
174762 ncm-dbt-03 1458854 50 16 9 25 +48.95 +/- 46.46 0 2 15 7 1 +85.04 +/- 86.62
174761 ncm-dbt-05 1459745 50 19 7 24 +85.04 +/- 41.74 0 1 11 13 0 +181.7 +/- 107.11
174760 ncm-dbt-03 1456803 50 18 13 19 +34.86 +/- 39.1 0 2 16 7 0 +70.44 +/- 81.92
174759 ncm-dbt-04 1443310 50 17 8 25 +63.22 +/- 48.63 0 3 10 12 0 +130.94 +/- 112.59

Commit

Commit ID 88f17a814d80cdb32ccf9efb7b56bb36d7bf052b
Author bmc4
Date 2021-12-21 12:47:57 UTC
Update Elo estimates for terms in search This updates estimates from 2yr ago #2401, and adds missing terms. All tests run at 10+0.1 (STC), 20000 games, error bars +- 1.8 Elo, book 8moves_v3.png. A table of Elo values with the links to the corresponding tests can be found at the PR closes https://github.com/official-stockfish/Stockfish/pull/3868 Non-functional Change
Copyright 2011–2024 Next Chess Move LLC