Dev Builds » 20211208-1616

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:21:06 1183851 3166 1097 487 1582 +67.79 +/- 5.98 4 140 700 720 19 +137.32 +/- 12.87
ncm-dbt-02 09:23:35 1195960 3166 1095 490 1581 +67.22 +/- 6.1 1 156 690 709 27 +133.25 +/- 12.97
ncm-dbt-03 11:00:03 1355185 3682 1281 588 1813 +66.18 +/- 5.42 1 157 854 806 23 +132.73 +/- 11.63
ncm-dbt-04 09:23:02 1233302 3172 1068 479 1625 +65.27 +/- 5.98 0 153 715 694 24 +129.45 +/- 12.73
ncm-dbt-05 11:02:39 1350565 3642 1253 586 1803 +64.36 +/- 5.42 2 155 858 786 20 +129.51 +/- 11.59
ncm-dbt-06 09:24:08 1226352 3172 1109 493 1570 +68.34 +/- 5.92 4 133 711 719 19 +138.57 +/- 12.76
20000 6903 3123 9974 +66.46 +/- 2.36 12 894 4528 4434 132 +133.34 +/- 5.06

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
199330 ncm-dbt-05 1227476 160 58 23 79 +77.24 +/- 26.0 0 5 37 36 2 +152.39 +/- 56.34
199329 ncm-dbt-02 1199398 166 59 26 81 +70.0 +/- 26.34 0 7 38 36 2 +136.36 +/- 55.79
199328 ncm-dbt-03 1214673 164 58 17 89 +88.73 +/- 23.69 0 3 36 42 1 +185.24 +/- 56.95
199327 ncm-dbt-01 1217133 166 61 26 79 +74.36 +/- 29.27 0 10 31 39 3 +141.25 +/- 61.61
199326 ncm-dbt-04 1247619 172 57 27 88 +61.22 +/- 24.39 0 8 40 38 0 +126.51 +/- 54.34
199325 ncm-dbt-06 1223252 172 65 23 84 +86.58 +/- 25.84 0 7 31 47 1 +180.24 +/- 62.11
199282 ncm-dbt-02 1185874 500 178 78 244 +70.43 +/- 15.68 0 28 97 122 3 +142.26 +/- 34.61
199281 ncm-dbt-05 1248536 500 161 81 258 +56.07 +/- 14.7 0 26 120 102 2 +112.14 +/- 31.13
199280 ncm-dbt-01 1192734 500 178 78 244 +70.44 +/- 15.94 1 27 96 123 3 +143.89 +/- 34.77
199279 ncm-dbt-04 1231678 500 156 87 257 +48.25 +/- 16.32 0 36 117 89 8 +86.52 +/- 31.58
199278 ncm-dbt-06 1213845 500 170 68 262 +71.89 +/- 14.67 1 18 111 118 2 +148.85 +/- 32.4
199277 ncm-dbt-03 1239590 500 186 75 239 +78.43 +/- 14.6 0 15 115 114 6 +155.54 +/- 31.67
199276 ncm-dbt-02 1200053 500 176 87 237 +62.51 +/- 14.98 0 25 114 108 3 +124.6 +/- 31.99
199275 ncm-dbt-05 1227809 500 161 80 259 +56.78 +/- 14.6 0 26 118 105 1 +115.23 +/- 31.41
199274 ncm-dbt-01 1175109 500 168 81 251 +61.08 +/- 15.31 2 24 110 113 1 +127.76 +/- 32.59
199273 ncm-dbt-04 1236052 500 172 86 242 +60.36 +/- 15.41 0 25 121 97 7 +113.68 +/- 30.97
199272 ncm-dbt-06 1235004 500 174 82 244 +64.66 +/- 14.26 0 19 123 105 3 +129.35 +/- 30.56
199271 ncm-dbt-03 1233950 500 159 80 261 +55.36 +/- 15.44 0 31 112 104 3 +109.07 +/- 32.29
199270 ncm-dbt-02 1199843 500 165 67 268 +68.99 +/- 14.97 0 24 106 118 2 +140.62 +/- 33.22
199269 ncm-dbt-05 1229540 500 171 77 252 +66.1 +/- 14.31 0 20 118 110 2 +134.15 +/- 31.33
199268 ncm-dbt-01 1155262 500 179 90 231 +62.51 +/- 14.98 1 23 114 110 2 +127.76 +/- 31.99
199267 ncm-dbt-04 1228238 500 181 76 243 +74.06 +/- 13.74 0 16 113 121 0 +155.54 +/- 32.01
199266 ncm-dbt-06 1219838 500 175 76 249 +69.71 +/- 14.86 0 24 104 121 1 +143.89 +/- 33.53
199265 ncm-dbt-03 1217446 500 165 77 258 +61.79 +/- 13.99 0 19 126 103 2 +124.6 +/- 30.12
199264 ncm-dbt-02 1190587 500 174 84 242 +63.23 +/- 15.4 0 25 116 103 6 +121.46 +/- 31.7
199263 ncm-dbt-05 1218826 500 178 81 241 +68.27 +/- 14.12 0 18 119 111 2 +138.99 +/- 31.13
199262 ncm-dbt-01 1191212 500 167 75 258 +64.66 +/- 13.97 0 19 121 109 1 +132.54 +/- 30.86
199261 ncm-dbt-04 1245182 500 169 63 268 +74.79 +/- 15.04 0 21 106 119 4 +150.51 +/- 33.22
199260 ncm-dbt-06 1226255 500 179 85 236 +66.1 +/- 14.45 0 18 125 102 5 +129.35 +/- 30.24
199259 ncm-dbt-03 1231285 500 173 78 249 +66.82 +/- 15.29 1 24 106 117 2 +137.37 +/- 33.21
199258 ncm-dbt-01 1182012 500 165 61 274 +73.33 +/- 14.3 0 17 115 115 3 +148.85 +/- 31.72
199257 ncm-dbt-02 1187157 500 174 77 249 +68.27 +/- 15.34 0 24 110 111 5 +134.15 +/- 32.59
199256 ncm-dbt-04 1242885 500 159 67 274 +64.66 +/- 14.8 0 24 112 112 2 +130.94 +/- 32.29
199255 ncm-dbt-06 1238032 500 178 94 228 +58.93 +/- 15.98 3 24 113 106 4 +119.89 +/- 32.15
199254 ncm-dbt-05 1231450 500 176 79 245 +68.27 +/- 15.6 1 23 109 112 5 +135.76 +/- 32.75
199253 ncm-dbt-03 1223415 500 165 80 255 +59.64 +/- 14.59 0 24 119 105 2 +119.89 +/- 31.25
199252 ncm-dbt-01 1173496 500 179 76 245 +72.61 +/- 15.1 0 20 113 111 6 +142.26 +/- 32.1
199251 ncm-dbt-02 1208809 500 169 71 260 +68.99 +/- 15.76 1 23 109 111 6 +135.76 +/- 32.75
199250 ncm-dbt-05 1233416 500 181 98 221 +58.21 +/- 13.83 1 16 134 97 2 +118.33 +/- 28.9
199249 ncm-dbt-06 1228240 500 168 65 267 +72.61 +/- 15.1 0 23 104 120 3 +147.19 +/- 33.54
199248 ncm-dbt-04 1201460 500 174 73 253 +71.16 +/- 15.05 0 23 106 118 3 +143.89 +/- 33.22
199247 ncm-dbt-03 1237733 500 187 93 220 +66.1 +/- 14.17 0 20 117 112 1 +135.76 +/- 31.48
176460 ncm-dbt-03 1440358 18 6 2 10 +78.47 +/- 60.12 0 0 5 4 0 +165.92 +/- 155.98
176459 ncm-dbt-05 1431157 32 13 5 14 +88.71 +/- 80.31 0 3 3 9 1 +162.99 +/- 193.99
176458 ncm-dbt-03 1431724 50 22 12 16 +70.42 +/- 53.56 0 2 13 8 2 +115.23 +/- 96.38
176457 ncm-dbt-05 1435497 50 14 11 25 +20.87 +/- 44.85 0 4 14 7 0 +41.89 +/- 92.36
176456 ncm-dbt-03 1437895 50 17 10 23 +48.96 +/- 54.35 0 5 8 12 0 +99.95 +/- 120.32
176455 ncm-dbt-05 1436324 50 20 5 25 +107.53 +/- 42.62 0 1 8 16 0 +240.82 +/- 132.75
176448 ncm-dbt-03 1435876 50 17 5 28 +85.04 +/- 46.59 0 2 9 14 0 +181.7 +/- 121.14
176447 ncm-dbt-05 1431008 50 19 8 23 +77.69 +/- 35.69 0 0 14 11 0 +164.04 +/- 86.61
176446 ncm-dbt-03 1438620 50 19 7 24 +85.04 +/- 41.74 0 1 11 13 0 +181.7 +/- 107.11
176445 ncm-dbt-05 1434876 50 18 6 26 +85.02 +/- 55.08 0 2 11 10 2 +147.19 +/- 107.43
176444 ncm-dbt-03 1440363 50 17 9 24 +56.07 +/- 43.2 0 2 13 10 0 +115.23 +/- 96.38
176443 ncm-dbt-05 1434310 50 19 6 25 +92.45 +/- 42.2 0 1 10 14 0 +200.24 +/- 114.26
176442 ncm-dbt-03 1433183 50 20 7 23 +92.44 +/- 47.1 0 1 11 12 1 +181.7 +/- 107.11
176441 ncm-dbt-05 1433006 50 17 8 25 +63.22 +/- 52.66 0 4 8 13 0 +130.94 +/- 122.89
176440 ncm-dbt-03 1429428 50 16 10 24 +41.88 +/- 29.61 0 0 19 6 0 +85.02 +/- 62.51
176439 ncm-dbt-05 1438184 50 16 6 28 +70.43 +/- 49.53 0 3 9 13 0 +147.19 +/- 118.91
176437 ncm-dbt-03 1438765 50 21 13 16 +56.05 +/- 58.98 0 3 14 5 3 +70.44 +/- 92.08
176431 ncm-dbt-05 1439777 50 14 7 29 +48.96 +/- 37.02 0 1 16 8 0 +99.95 +/- 80.14
176430 ncm-dbt-03 1437760 50 19 9 22 +70.43 +/- 45.16 0 2 11 12 0 +147.19 +/- 107.43
176429 ncm-dbt-05 1428425 50 17 5 28 +85.02 +/- 51.0 0 2 10 12 1 +164.07 +/- 113.84
176428 ncm-dbt-03 1431283 50 14 4 32 +70.43 +/- 49.53 0 3 9 13 0 +147.19 +/- 118.91

Commit

Commit ID 94514199123874c0029afb6e00634f26741d90db
Author Stefan Geschwentner
Date 2021-12-08 16:16:17 UTC
Improve transposition table remplacement strategy Increase chance that PV node replaces old entry in transposition table. STC: LLR: 2.93 (-2.94,2.94) <0.00,2.50> Total: 46744 W: 12108 L: 11816 D: 22820 Ptnml(0-2): 156, 5221, 12344, 5477, 174 https://tests.stockfishchess.org/tests/view/61ae068356fcf33bce7d99d0 LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 88464 W: 22912 L: 22513 D: 43039 Ptnml(0-2): 84, 9133, 25393, 9544, 78 https://tests.stockfishchess.org/tests/view/61ae973656fcf33bce7db3e1 closes https://github.com/official-stockfish/Stockfish/pull/3839 Bench: 5292488
Copyright 2011–2024 Next Chess Move LLC