Dev Builds » 20211023-1021

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:04:21 1275838 3342 1062 576 1704 +50.89 +/- 5.76 0 191 822 639 19 +99.75 +/- 11.85
ncm-dbt-02 09:59:09 1299879 3316 1056 587 1673 +49.47 +/- 5.73 4 181 828 632 13 +98.99 +/- 11.8
ncm-dbt-03 10:02:21 1328102 3348 1032 583 1733 +46.88 +/- 6.0 2 238 754 669 11 +93.52 +/- 12.4
ncm-dbt-04 10:02:38 1316896 3358 1086 589 1683 +51.8 +/- 5.76 0 190 823 645 21 +101.27 +/- 11.85
ncm-dbt-05 09:58:37 967518 3302 1019 564 1719 +48.18 +/- 5.95 4 203 798 626 20 +94.66 +/- 12.05
ncm-dbt-06 10:02:50 1320103 3334 1090 546 1698 +57.2 +/- 5.89 2 189 755 705 16 +114.43 +/- 12.4
20000 6345 3445 10210 +50.74 +/- 2.39 12 1192 4780 3916 100 +100.4 +/- 4.92

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
200296 ncm-dbt-05 1229088 144 48 28 68 +48.56 +/- 30.75 0 10 35 24 3 +83.61 +/- 58.15
200295 ncm-dbt-02 1192508 152 46 27 79 +43.66 +/- 25.08 1 5 44 26 0 +93.63 +/- 50.2
200294 ncm-dbt-06 1212627 168 55 33 80 +45.76 +/- 25.55 0 10 43 30 1 +88.74 +/- 52.16
200293 ncm-dbt-01 1159917 168 45 34 89 +22.78 +/- 24.99 0 13 48 22 1 +41.56 +/- 48.85
200292 ncm-dbt-03 1207853 178 62 35 81 +53.11 +/- 27.42 0 15 32 42 0 +108.83 +/- 59.61
200291 ncm-dbt-04 1225938 190 57 24 109 +60.96 +/- 25.53 0 11 42 40 2 +117.68 +/- 53.07
200290 ncm-dbt-02 1191448 500 162 85 253 +53.93 +/- 14.05 1 20 131 97 1 +110.6 +/- 29.47
200289 ncm-dbt-05 1250287 500 156 77 267 +55.36 +/- 14.12 0 24 123 103 0 +113.68 +/- 30.67
200288 ncm-dbt-06 1214432 500 162 72 266 +63.23 +/- 15.27 1 24 112 110 3 +127.76 +/- 32.29
200287 ncm-dbt-01 1142946 500 165 77 258 +61.79 +/- 14.41 0 20 126 100 4 +121.46 +/- 30.15
200286 ncm-dbt-03 1243117 500 155 72 273 +58.21 +/- 15.45 0 32 104 113 1 +118.33 +/- 33.45
200285 ncm-dbt-04 1215026 500 169 90 241 +55.36 +/- 15.82 0 31 115 98 6 +104.49 +/- 31.86
200284 ncm-dbt-05 1212158 500 146 92 262 +37.67 +/- 14.61 1 31 132 85 1 +76.25 +/- 29.54
200283 ncm-dbt-02 1195548 500 163 93 244 +48.96 +/- 15.38 0 31 123 91 5 +92.46 +/- 30.75
200282 ncm-dbt-06 1252572 500 164 72 264 +64.66 +/- 15.07 0 24 114 108 4 +127.76 +/- 31.99
200281 ncm-dbt-01 1156046 500 162 83 255 +55.36 +/- 15.19 0 29 116 102 3 +109.07 +/- 31.72
200280 ncm-dbt-03 1249481 500 153 73 274 +56.07 +/- 15.47 0 32 108 108 2 +112.14 +/- 32.86
200279 ncm-dbt-04 1214446 500 155 93 252 +43.3 +/- 14.95 0 33 124 91 2 +85.04 +/- 30.63
200278 ncm-dbt-02 1195911 500 167 83 250 +58.93 +/- 14.56 0 23 123 101 3 +116.78 +/- 30.65
200277 ncm-dbt-05 1245208 500 154 88 258 +46.13 +/- 15.23 0 33 121 93 3 +89.48 +/- 31.03
200276 ncm-dbt-06 1228305 500 165 74 261 +63.94 +/- 15.94 0 29 107 108 6 +123.02 +/- 33.03
200275 ncm-dbt-03 1244598 500 151 85 264 +46.13 +/- 15.48 0 37 111 101 1 +92.46 +/- 32.39
200274 ncm-dbt-04 1214165 500 178 86 236 +64.66 +/- 14.94 0 22 119 104 5 +126.18 +/- 31.22
200273 ncm-dbt-01 1167679 500 159 82 259 +53.93 +/- 15.12 0 29 118 100 3 +106.01 +/- 31.43
200272 ncm-dbt-02 1194064 500 158 87 255 +49.67 +/- 15.29 1 30 118 99 2 +99.95 +/- 31.44
200271 ncm-dbt-05 1245784 500 141 81 278 +41.89 +/- 15.37 0 37 118 93 2 +82.1 +/- 31.44
200270 ncm-dbt-04 1254898 500 152 91 257 +42.6 +/- 14.78 0 33 124 92 1 +85.04 +/- 30.63
200269 ncm-dbt-03 1236787 500 139 86 275 +36.97 +/- 15.7 1 38 121 87 3 +71.89 +/- 31.04
200268 ncm-dbt-06 1209179 500 169 88 243 +56.78 +/- 15.63 1 31 105 112 1 +116.78 +/- 33.3
200267 ncm-dbt-01 1135893 500 158 90 252 +47.54 +/- 14.13 0 25 134 89 2 +93.95 +/- 29.15
200266 ncm-dbt-05 1221316 500 164 85 251 +55.36 +/- 15.31 1 26 120 99 4 +109.07 +/- 31.14
200265 ncm-dbt-02 1198444 500 158 92 250 +46.13 +/- 14.72 0 31 123 95 1 +92.46 +/- 30.75
200264 ncm-dbt-03 1250017 500 163 101 236 +43.3 +/- 14.82 0 33 123 93 1 +86.52 +/- 30.76
200263 ncm-dbt-04 1222387 500 162 102 236 +41.89 +/- 14.48 0 28 138 80 4 +79.17 +/- 28.67
200262 ncm-dbt-06 1246065 500 168 98 234 +48.96 +/- 15.25 0 34 113 102 1 +98.44 +/- 32.13
200261 ncm-dbt-01 1166588 500 159 104 237 +38.37 +/- 15.54 0 38 123 85 4 +71.89 +/- 30.78
199672 ncm-dbt-06 1235116 500 159 84 257 +52.51 +/- 14.66 0 29 117 104 0 +107.54 +/- 31.57
199671 ncm-dbt-02 1188865 500 153 91 256 +43.3 +/- 15.33 1 34 118 96 1 +88.0 +/- 31.44
199670 ncm-dbt-05 1224588 500 156 85 259 +49.67 +/- 16.39 1 35 112 96 6 +93.95 +/- 32.26
199669 ncm-dbt-03 1235634 500 152 100 248 +36.26 +/- 15.78 0 43 114 91 2 +70.44 +/- 31.95
199668 ncm-dbt-01 1184143 500 159 77 264 +57.5 +/- 14.89 0 27 116 105 2 +115.23 +/- 31.71
199667 ncm-dbt-04 1246982 500 159 82 259 +53.93 +/- 14.46 0 26 122 101 1 +109.07 +/- 30.84
176787 ncm-dbt-05 503263 8 2 0 6 +88.62 +/- 93.84 0 0 2 2 0 +190.67 +/- 458.56
176786 ncm-dbt-02 1483354 14 5 3 6 +49.93 +/- 60.15 0 0 5 2 0 +102.04 +/- 134.61
176785 ncm-dbt-04 1474049 18 6 2 10 +78.47 +/- 60.12 0 0 5 4 0 +165.92 +/- 155.98
176784 ncm-dbt-06 1480442 16 3 3 10 0.0 +/- 86.96 0 2 4 2 0 -0.0 +/- 186.24
176783 ncm-dbt-03 1487835 20 5 3 12 +34.85 +/- 83.02 0 2 4 4 0 +70.44 +/- 185.84
176782 ncm-dbt-01 1478598 24 8 2 14 +88.72 +/- 68.77 0 1 4 7 0 +190.85 +/- 204.66
176776 ncm-dbt-06 1478758 50 14 4 32 +70.43 +/- 40.35 0 1 13 11 0 +147.19 +/- 95.14
176775 ncm-dbt-05 504149 50 18 12 20 +41.91 +/- 56.76 1 3 10 11 0 +99.95 +/- 111.26
176774 ncm-dbt-04 1463499 50 15 6 29 +63.22 +/- 44.25 0 2 12 11 0 +130.94 +/- 101.68
176773 ncm-dbt-02 1486431 50 13 8 29 +34.86 +/- 43.75 0 3 14 8 0 +70.44 +/- 92.08
176771 ncm-dbt-03 1480432 50 15 8 27 +48.97 +/- 50.54 1 1 13 10 0 +115.23 +/- 96.38
176770 ncm-dbt-01 1479219 50 14 8 28 +41.89 +/- 45.18 0 3 13 9 0 +85.04 +/- 96.78
176769 ncm-dbt-06 1482136 50 13 10 27 +20.87 +/- 44.85 0 4 14 7 0 +41.89 +/- 92.36
176768 ncm-dbt-04 1475262 50 17 8 25 +63.22 +/- 48.63 0 3 10 12 0 +130.94 +/- 112.59
176767 ncm-dbt-05 503192 50 16 8 26 +56.05 +/- 47.6 0 2 14 8 1 +99.95 +/- 91.41
176766 ncm-dbt-02 1486909 50 14 10 26 +27.85 +/- 46.49 0 4 13 8 0 +56.07 +/- 96.84
176765 ncm-dbt-01 1480154 50 17 9 24 +56.07 +/- 51.66 0 4 9 12 0 +115.23 +/- 116.78
176764 ncm-dbt-03 1487700 50 17 10 23 +48.96 +/- 46.46 0 3 12 10 0 +99.95 +/- 101.68
176763 ncm-dbt-04 1479214 50 16 5 29 +77.7 +/- 41.12 0 1 12 12 0 +164.07 +/- 100.82
176762 ncm-dbt-05 503670 50 18 8 24 +70.43 +/- 45.16 0 2 11 12 0 +147.19 +/- 107.43
176761 ncm-dbt-06 1481511 50 18 8 24 +70.43 +/- 40.35 0 1 13 11 0 +147.19 +/- 95.14
176760 ncm-dbt-02 1485197 50 17 8 25 +63.21 +/- 33.92 0 0 16 9 0 +130.92 +/- 76.82
176759 ncm-dbt-01 1483038 50 16 10 24 +41.89 +/- 40.64 0 2 15 8 0 +85.04 +/- 86.62
176758 ncm-dbt-03 1485668 50 20 10 20 +70.42 +/- 49.53 0 2 12 10 1 +130.94 +/- 101.68

Commit

Commit ID 644f6d47909f3cf2bd3e70485db792789ccad89e
Author mstembera
Date 2021-10-23 10:21:17 UTC
Simplify away ValueListInserter plus minor cleanups STC: https://tests.stockfishchess.org/tests/view/616f059b40f619782fd4f73f LLR: 2.94 (-2.94,2.94) <-2.50,0.50> Total: 84992 W: 21244 L: 21197 D: 42551 Ptnml(0-2): 279, 9005, 23868, 9078, 266 closes https://github.com/official-stockfish/Stockfish/pull/3749 No functional change
Copyright 2011–2024 Next Chess Move LLC