Dev Builds » 20211014-0758

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:04:16 1272350 3340 1054 582 1704 +49.43 +/- 5.68 0 190 832 634 14 +97.79 +/- 11.77
ncm-dbt-02 09:59:59 1300310 3326 1054 638 1634 +43.68 +/- 5.94 3 228 797 620 15 +86.13 +/- 12.06
ncm-dbt-03 10:03:51 1323380 3330 1038 622 1670 +43.63 +/- 5.87 2 222 814 612 15 +85.8 +/- 11.93
ncm-dbt-04 10:02:12 1317916 3344 1069 597 1678 +49.37 +/- 5.92 0 211 803 633 25 +95.2 +/- 12.01
ncm-dbt-05 09:57:45 963947 3302 1066 603 1633 +49.04 +/- 5.8 0 198 808 629 16 +96.47 +/- 11.96
ncm-dbt-06 10:03:34 1324420 3358 1044 621 1693 +44.0 +/- 5.91 4 223 816 618 18 +86.37 +/- 11.92
20000 6325 3663 10012 +46.52 +/- 2.39 9 1272 4870 3746 103 +91.26 +/- 4.87

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
200380 ncm-dbt-05 1238096 144 53 15 76 +93.9 +/- 25.95 0 3 29 39 1 +197.34 +/- 64.23
200379 ncm-dbt-02 1197948 160 49 22 89 +59.19 +/- 28.42 0 10 35 33 2 +112.33 +/- 58.22
200378 ncm-dbt-03 1219029 164 50 38 76 +25.47 +/- 28.45 0 18 34 30 0 +51.21 +/- 58.28
200377 ncm-dbt-04 1238138 168 53 32 83 +43.66 +/- 26.01 0 12 39 33 0 +88.74 +/- 55.06
200376 ncm-dbt-01 1144352 176 44 29 103 +29.68 +/- 23.57 0 12 49 27 0 +59.81 +/- 48.45
200375 ncm-dbt-06 1241077 188 57 28 103 +54.02 +/- 24.67 0 12 41 41 0 +110.8 +/- 53.68
200374 ncm-dbt-05 1224943 500 154 86 260 +47.55 +/- 15.05 0 34 114 102 0 +96.94 +/- 32.0
200373 ncm-dbt-02 1195917 500 161 93 246 +47.54 +/- 14.4 0 28 127 94 1 +95.44 +/- 30.17
200372 ncm-dbt-04 1232773 500 160 73 267 +61.07 +/- 15.05 0 27 111 110 2 +123.02 +/- 32.44
200371 ncm-dbt-03 1230494 500 162 90 248 +50.38 +/- 15.33 0 33 114 101 2 +99.95 +/- 32.0
200370 ncm-dbt-06 1259088 500 156 88 256 +47.54 +/- 14.79 0 28 130 88 4 +90.97 +/- 29.76
200369 ncm-dbt-01 1159909 500 154 77 269 +53.93 +/- 14.99 0 29 117 102 2 +107.54 +/- 31.57
200368 ncm-dbt-05 1231759 500 154 97 249 +39.78 +/- 15.38 0 36 125 85 4 +74.79 +/- 30.51
200367 ncm-dbt-02 1195670 500 163 89 248 +51.8 +/- 15.4 2 27 118 101 2 +106.01 +/- 31.43
200366 ncm-dbt-03 1242382 500 159 92 249 +46.84 +/- 14.36 0 27 131 90 2 +92.46 +/- 29.6
200365 ncm-dbt-04 1245163 500 144 99 257 +31.35 +/- 14.85 0 39 128 82 1 +61.79 +/- 30.13
200364 ncm-dbt-01 1157628 500 162 96 242 +46.13 +/- 14.32 0 28 129 92 1 +92.46 +/- 29.89
200363 ncm-dbt-06 1242682 500 149 93 258 +39.08 +/- 15.46 1 37 118 93 1 +79.17 +/- 31.44
200362 ncm-dbt-02 1194190 500 146 115 239 +21.57 +/- 15.06 0 45 131 72 2 +40.48 +/- 29.77
200361 ncm-dbt-05 1236709 500 166 95 239 +49.67 +/- 15.67 0 34 115 97 4 +95.44 +/- 31.86
200360 ncm-dbt-03 1217773 500 170 95 235 +52.51 +/- 14.52 0 26 125 97 2 +104.49 +/- 30.42
200359 ncm-dbt-04 1211897 500 165 82 253 +58.21 +/- 14.79 0 26 117 105 2 +116.78 +/- 31.56
200358 ncm-dbt-06 1225295 500 154 104 242 +34.86 +/- 14.95 0 35 134 77 4 +64.66 +/- 29.31
200357 ncm-dbt-01 1146415 500 146 91 263 +38.37 +/- 14.53 0 34 127 89 0 +77.71 +/- 30.23
200356 ncm-dbt-05 1236556 500 161 91 248 +48.96 +/- 14.47 0 28 125 96 1 +98.44 +/- 30.45
200355 ncm-dbt-02 1195483 500 155 103 242 +36.26 +/- 16.02 1 42 113 92 2 +71.89 +/- 32.08
200354 ncm-dbt-03 1237638 500 154 84 262 +48.96 +/- 16.24 1 35 112 97 5 +93.95 +/- 32.26
200353 ncm-dbt-04 1217755 500 169 97 234 +50.38 +/- 15.45 0 30 124 90 6 +93.95 +/- 30.6
200352 ncm-dbt-06 1234209 500 162 82 256 +56.07 +/- 15.73 1 28 116 100 5 +109.07 +/- 31.72
200351 ncm-dbt-01 1165346 500 174 81 245 +65.38 +/- 14.56 0 21 118 108 3 +130.94 +/- 31.35
200350 ncm-dbt-05 1221488 500 171 105 224 +46.13 +/- 14.58 0 28 131 88 3 +89.48 +/- 29.62
200349 ncm-dbt-04 1217164 500 152 94 254 +40.48 +/- 15.04 0 33 130 83 4 +76.25 +/- 29.82
200348 ncm-dbt-02 1193337 500 157 90 253 +46.84 +/- 15.39 0 35 115 98 2 +92.46 +/- 31.85
200347 ncm-dbt-03 1224263 500 153 97 250 +39.08 +/- 15.82 1 37 121 87 4 +74.79 +/- 31.04
200346 ncm-dbt-01 1149093 500 160 91 249 +48.25 +/- 13.75 0 23 136 90 1 +96.94 +/- 28.83
200345 ncm-dbt-06 1228721 500 158 93 249 +45.42 +/- 15.81 0 39 109 100 2 +89.48 +/- 32.65
200344 ncm-dbt-04 1246186 500 166 94 240 +50.38 +/- 15.82 0 32 121 90 7 +92.46 +/- 31.03
200343 ncm-dbt-02 1196926 500 172 99 229 +51.09 +/- 15.36 0 33 113 102 2 +101.46 +/- 32.14
200342 ncm-dbt-05 1203264 500 154 84 262 +48.96 +/- 14.61 0 28 126 94 2 +96.94 +/- 30.31
200341 ncm-dbt-01 1183453 500 161 89 250 +50.38 +/- 15.58 0 31 122 91 6 +93.95 +/- 30.89
200340 ncm-dbt-03 1232717 500 148 99 253 +34.16 +/- 14.13 0 33 135 82 0 +68.99 +/- 29.16
200339 ncm-dbt-06 1222628 500 157 103 240 +37.67 +/- 15.13 1 34 127 86 2 +74.79 +/- 30.24
176835 ncm-dbt-05 503493 8 3 2 3 +43.64 +/- 153.21 0 1 1 2 0 +88.74 +/- 710.5
176834 ncm-dbt-01 1472971 14 4 3 7 +24.85 +/- 111.54 0 2 2 3 0 +49.98 +/- 262.59
176833 ncm-dbt-03 1490010 16 2 2 12 0.0 +/- 86.96 0 2 4 2 0 -0.0 +/- 186.24
176832 ncm-dbt-06 1478751 20 3 3 14 0.0 +/- 48.55 0 1 8 1 0 -0.0 +/- 98.89
176831 ncm-dbt-02 1484327 16 6 2 8 +88.72 +/- 93.48 0 1 2 5 0 +190.85 +/- 457.95
176830 ncm-dbt-04 1472671 26 9 7 10 +26.75 +/- 74.22 0 2 8 2 1 +26.78 +/- 121.76
176829 ncm-dbt-05 501463 50 14 8 28 +41.88 +/- 53.16 0 4 12 8 1 +70.44 +/- 101.42
176828 ncm-dbt-03 1491077 50 16 5 29 +77.7 +/- 41.12 0 1 12 12 0 +164.07 +/- 100.82
176827 ncm-dbt-02 1484452 50 16 9 25 +48.95 +/- 46.46 0 2 15 7 1 +85.04 +/- 86.62
176826 ncm-dbt-06 1484903 50 17 10 23 +48.96 +/- 42.0 0 2 14 9 0 +99.95 +/- 91.41
176825 ncm-dbt-04 1477993 50 17 5 28 +85.02 +/- 58.9 0 4 6 14 1 +164.07 +/- 137.85
176824 ncm-dbt-01 1473578 50 16 7 27 +63.22 +/- 56.43 0 5 6 14 0 +130.94 +/- 132.75
176823 ncm-dbt-03 1490296 50 11 13 26 -13.9 +/- 54.75 0 9 9 7 0 -27.85 +/- 113.01
176822 ncm-dbt-05 502454 50 19 9 22 +70.42 +/- 34.91 0 0 15 10 0 +147.17 +/- 81.61
176821 ncm-dbt-04 1467990 50 16 6 28 +70.43 +/- 49.53 0 3 9 13 0 +147.19 +/- 118.91
176820 ncm-dbt-06 1473123 50 13 10 27 +20.87 +/- 48.93 0 5 12 8 0 +41.89 +/- 101.14
176819 ncm-dbt-02 1480896 50 9 8 33 +6.95 +/- 40.99 0 4 16 5 0 +13.9 +/- 83.23
176818 ncm-dbt-01 1473285 50 15 9 26 +41.89 +/- 45.18 0 3 13 9 0 +85.04 +/- 96.78
176817 ncm-dbt-05 503192 50 17 11 22 +41.89 +/- 40.64 0 2 15 8 0 +85.04 +/- 86.62
176816 ncm-dbt-03 1481504 50 13 7 30 +41.89 +/- 35.54 0 1 17 7 0 +85.04 +/- 75.39
176815 ncm-dbt-06 1478148 50 18 7 25 +77.72 +/- 58.15 1 2 7 15 0 +181.7 +/- 134.48
176814 ncm-dbt-04 1469350 50 18 8 24 +70.42 +/- 53.56 0 3 10 11 1 +130.94 +/- 112.59
176813 ncm-dbt-02 1484270 50 20 8 22 +85.02 +/- 46.58 0 1 12 11 1 +164.07 +/- 100.82
176812 ncm-dbt-01 1469830 50 18 9 23 +63.21 +/- 48.62 0 2 13 9 1 +115.23 +/- 96.38

Commit

Commit ID 580698e5e57f40dcba52b92a7f0c7a0e9ab09437
Author Joost VandeVondele
Date 2021-10-14 07:58:03 UTC
Compute ttCapture earlier Compute ttCapture earlier, and reuse. passed STC: LLR: 2.93 (-2.94,2.94) <-2.50,0.50> Total: 74128 W: 18640 L: 18578 D: 36910 Ptnml(0-2): 224, 7970, 20649, 7962, 259 https://tests.stockfishchess.org/tests/view/615dd9fa1a32f4036ac7fc4d closes https://github.com/official-stockfish/Stockfish/pull/3734 No functional change
Copyright 2011–2024 Next Chess Move LLC