Dev Builds » 20210415-1045

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:35:55 1179220 3966 718 1366 1882 -57.28 +/- 5.64 44 802 902 228 7 -110.65 +/- 11.34
ncm-dbt-02 11:31:44 1266119 3968 707 1352 1909 -56.98 +/- 5.51 38 794 934 211 7 -111.17 +/- 11.14
ncm-dbt-03 11:37:19 1270237 3988 673 1375 1940 -61.8 +/- 5.53 38 848 891 212 5 -121.26 +/- 11.41
ncm-dbt-04 00:30:29 1478141 168 27 54 87 -56.32 +/- 24.42 1 32 44 7 0 -111.19 +/- 51.15
ncm-dbt-05 11:32:00 1256137 3952 710 1308 1934 -52.98 +/- 5.54 37 768 931 236 4 -102.19 +/- 11.16
ncm-dbt-06 11:35:43 1261014 3958 694 1333 1931 -56.59 +/- 5.58 36 810 894 235 4 -110.11 +/- 11.39
20000 3529 6788 9683 -57.12 +/- 2.47 194 4054 4596 1129 27 -111.06 +/- 5.02

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
210523 ncm-dbt-05 1222064 284 49 91 144 -51.76 +/- 20.77 2 57 64 19 0 -100.59 +/- 42.82
210522 ncm-dbt-06 1257915 292 44 94 154 -60.08 +/- 19.96 2 62 66 16 0 -118.63 +/- 42.18
210521 ncm-dbt-02 1250701 304 59 100 145 -47.14 +/- 18.55 2 53 81 16 0 -91.18 +/- 37.63
210520 ncm-dbt-01 1146088 300 57 110 133 -62.03 +/- 20.22 3 63 69 14 1 -123.02 +/- 41.21
210519 ncm-dbt-03 1241648 320 51 115 154 -70.43 +/- 18.88 1 78 65 16 0 -144.61 +/- 42.51
210518 ncm-dbt-05 1227979 500 99 177 224 -54.64 +/- 17.09 12 90 112 36 0 -93.95 +/- 32.26
210517 ncm-dbt-01 1131668 500 84 174 242 -63.23 +/- 15.27 7 99 121 23 0 -119.89 +/- 30.94
210516 ncm-dbt-06 1246489 500 89 166 245 -53.93 +/- 16.12 5 102 108 35 0 -102.97 +/- 32.83
210515 ncm-dbt-02 1229976 500 87 177 236 -63.23 +/- 15.66 7 102 115 26 0 -119.89 +/- 31.85
210514 ncm-dbt-03 1251364 500 74 174 252 -70.43 +/- 15.68 7 110 109 24 0 -135.76 +/- 32.75
210513 ncm-dbt-05 1244442 500 79 181 240 -71.89 +/- 15.86 8 109 111 21 1 -138.99 +/- 32.43
210512 ncm-dbt-01 1130015 500 95 171 234 -53.22 +/- 17.37 7 103 102 35 3 -102.97 +/- 33.64
210511 ncm-dbt-02 1229578 500 85 159 256 -51.8 +/- 15.52 2 102 116 28 2 -106.01 +/- 31.72
210510 ncm-dbt-06 1230953 500 95 160 245 -45.42 +/- 14.81 3 89 128 30 0 -88.0 +/- 30.06
210509 ncm-dbt-03 1238595 500 82 162 256 -56.07 +/- 15.09 3 102 117 28 0 -110.6 +/- 31.57
210508 ncm-dbt-05 1220473 500 86 158 256 -50.38 +/- 14.55 2 95 126 27 0 -99.95 +/- 30.29
210507 ncm-dbt-01 1135849 500 86 168 246 -57.5 +/- 16.04 7 97 119 25 2 -110.6 +/- 31.28
210506 ncm-dbt-06 1231210 500 83 181 236 -68.99 +/- 15.5 2 121 101 25 1 -142.26 +/- 34.0
210505 ncm-dbt-02 1253106 500 93 161 246 -47.54 +/- 14.92 3 92 125 30 0 -92.46 +/- 30.47
210504 ncm-dbt-03 1224691 500 77 174 249 -68.27 +/- 15.6 5 113 106 26 0 -134.15 +/- 33.21
210503 ncm-dbt-05 1224298 500 89 171 240 -57.5 +/- 16.28 5 107 103 35 0 -110.6 +/- 33.55
210502 ncm-dbt-06 1218644 500 83 156 261 -51.09 +/- 16.58 5 102 105 37 1 -98.44 +/- 33.21
210501 ncm-dbt-01 1135698 500 87 174 239 -61.07 +/- 15.18 2 111 109 28 0 -123.02 +/- 32.74
210500 ncm-dbt-02 1230416 500 88 170 242 -57.5 +/- 15.28 2 106 116 24 2 -118.33 +/- 31.7
210499 ncm-dbt-03 1217993 500 91 169 240 -54.65 +/- 16.03 5 99 118 25 3 -109.07 +/- 31.43
210498 ncm-dbt-05 1229387 500 98 161 241 -44.01 +/- 15.24 0 99 116 34 1 -90.97 +/- 31.72
210497 ncm-dbt-01 1160316 500 85 171 244 -60.36 +/- 15.41 5 103 115 27 0 -116.78 +/- 31.85
210496 ncm-dbt-06 1225132 500 96 172 232 -53.22 +/- 15.21 3 99 120 27 1 -106.01 +/- 31.14
210495 ncm-dbt-03 1254236 500 76 163 261 -61.08 +/- 15.57 5 104 115 25 1 -119.89 +/- 31.85
210494 ncm-dbt-02 1246444 500 84 174 242 -63.23 +/- 15.79 3 113 107 25 2 -129.35 +/- 33.05
210493 ncm-dbt-05 1228547 500 89 157 254 -47.55 +/- 14.92 3 91 128 27 1 -93.95 +/- 30.03
210492 ncm-dbt-02 1222529 500 98 171 231 -51.09 +/- 15.98 6 94 118 31 1 -96.94 +/- 31.44
210491 ncm-dbt-06 1227449 500 90 173 237 -58.21 +/- 16.07 7 99 115 28 1 -110.6 +/- 31.86
210490 ncm-dbt-01 1141298 500 88 174 238 -60.36 +/- 15.67 6 102 114 28 0 -115.23 +/- 32.0
210489 ncm-dbt-03 1251514 500 103 170 227 -46.84 +/- 16.37 3 102 105 39 1 -92.46 +/- 33.18
210488 ncm-dbt-06 1219798 500 84 168 248 -58.93 +/- 15.48 5 102 115 28 0 -113.68 +/- 31.86
210487 ncm-dbt-05 1218056 500 90 163 247 -51.09 +/- 15.36 5 93 122 30 0 -96.94 +/- 30.88
210486 ncm-dbt-02 1234854 500 85 184 231 -69.71 +/- 16.16 11 101 114 24 0 -127.76 +/- 31.99
210485 ncm-dbt-03 1243406 500 89 185 226 -67.54 +/- 15.45 5 111 109 25 0 -132.54 +/- 32.75
210484 ncm-dbt-01 1145150 500 105 167 228 -43.3 +/- 16.42 5 93 112 39 1 -82.1 +/- 32.23
178168 ncm-dbt-01 1486898 166 31 57 78 -54.86 +/- 26.61 2 31 41 9 0 -103.41 +/- 53.54
178167 ncm-dbt-03 1508687 168 30 63 75 -69.14 +/- 25.36 4 29 47 4 0 -125.09 +/- 48.23
178166 ncm-dbt-04 1478141 168 27 54 87 -56.32 +/- 24.42 1 32 44 7 0 -111.19 +/- 51.15
178165 ncm-dbt-02 1497475 164 28 56 80 -59.9 +/- 25.87 2 31 42 7 0 -114.09 +/- 52.55
178164 ncm-dbt-05 1489995 168 31 49 88 -37.37 +/- 24.0 0 27 49 7 1 -79.97 +/- 47.68
178163 ncm-dbt-06 1491542 166 30 63 73 -70.0 +/- 29.01 4 34 36 9 0 -126.73 +/- 57.45

Commit

Commit ID a7ab92ec25c91e8413630c52cfc2db6b4ecacf0c
Author dsmsgms
Date 2021-04-15 10:45:39 UTC
Use classical eval for Bishop vs Pawns NNUE evaluation is incapable of recognizing trivially drawn bishop endgames (the wrong-colored rook pawn), which are in fact ubiquitous and stock standard in chess analysis. Switching off NNUE evaluation in KBPs vs KPs endgames is a measure that stops Stockfish from trading down to a drawn version of these endings when we presumably have advantage. The patch is able to edge over master in endgame positions. Patch tested for Elo gain with the "endgame.epd" book, and verified for non-regression with our usual book (see the pull request for details). STC: LLR: 2.93 (-2.94,2.94) {-0.20,1.10} Total: 33232 W: 6655 L: 6497 D: 20080 Ptnml(0-2): 4, 2342, 11769, 2494, 7 https://tests.stockfishchess.org/tests/view/6074a52981417533789605b8 LTC: LLR: 2.93 (-2.94,2.94) {0.20,0.90} Total: 159056 W: 29799 L: 29378 D: 99879 Ptnml(0-2): 7, 9004, 61085, 9425, 7 https://tests.stockfishchess.org/tests/view/6074c39a81417533789605ca Closes https://github.com/official-stockfish/Stockfish/pull/3427 Bench: 4503918 blah
Copyright 2011–2024 Next Chess Move LLC