Dev Builds » 20211213-0617

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:54:06 1148667 3340 1143 526 1671 +64.93 +/- 5.89 3 164 738 743 22 +130.18 +/- 12.54
ncm-dbt-02 09:51:43 1263345 3312 1150 488 1674 +70.39 +/- 5.71 0 132 755 744 25 +140.89 +/- 12.37
ncm-dbt-03 09:55:26 1270734 3330 1196 501 1633 +73.59 +/- 5.66 0 131 725 792 17 +150.18 +/- 12.64
ncm-dbt-04 09:55:33 1256412 3348 1148 498 1702 +68.32 +/- 5.72 4 144 735 780 11 +140.67 +/- 12.56
ncm-dbt-05 09:51:29 1271202 3312 1136 496 1680 +67.99 +/- 5.9 2 153 730 745 26 +135.75 +/- 12.61
ncm-dbt-06 09:55:47 1255045 3358 1182 474 1702 +74.37 +/- 5.76 3 126 739 782 29 +149.76 +/- 12.51
20000 6955 2983 10062 +69.93 +/- 2.36 12 850 4422 4586 130 +141.19 +/- 5.12

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
206322 ncm-dbt-05 1249950 144 53 25 66 +68.42 +/- 30.02 0 8 30 32 2 +131.39 +/- 63.06
206321 ncm-dbt-02 1209038 150 55 22 73 +77.7 +/- 28.08 0 6 32 35 2 +152.74 +/- 61.11
206320 ncm-dbt-03 1224386 166 57 20 89 +78.76 +/- 25.41 0 6 35 41 1 +161.38 +/- 58.36
206319 ncm-dbt-01 1082551 172 58 21 93 +75.92 +/- 24.64 0 6 38 41 1 +154.96 +/- 55.82
206318 ncm-dbt-04 1224080 180 64 24 92 +78.51 +/- 24.65 0 7 37 45 1 +161.21 +/- 56.75
206317 ncm-dbt-06 1202626 188 72 18 98 +102.68 +/- 23.39 0 3 37 51 3 +211.16 +/- 56.53
206316 ncm-dbt-05 1237583 500 173 72 255 +71.16 +/- 15.84 1 23 106 114 6 +140.62 +/- 33.22
206315 ncm-dbt-02 1241265 500 185 84 231 +71.16 +/- 14.78 0 23 104 122 1 +147.19 +/- 33.54
206314 ncm-dbt-01 1102190 500 168 88 244 +56.07 +/- 15.35 1 27 116 103 3 +112.14 +/- 31.71
206313 ncm-dbt-03 1249006 500 187 76 237 +78.43 +/- 13.73 0 12 118 117 3 +160.64 +/- 31.07
206312 ncm-dbt-04 1216797 500 164 70 266 +66.1 +/- 14.45 1 19 116 113 1 +137.37 +/- 31.63
206311 ncm-dbt-06 1210893 500 175 58 267 +82.83 +/- 15.28 2 14 104 125 5 +171.02 +/- 33.51
206310 ncm-dbt-05 1222799 500 161 82 257 +55.36 +/- 14.93 1 23 126 96 4 +109.07 +/- 30.24
206309 ncm-dbt-01 1097202 500 177 70 253 +75.52 +/- 15.6 0 21 109 112 8 +145.54 +/- 32.74
206308 ncm-dbt-02 1238757 500 177 70 253 +75.52 +/- 15.6 0 21 109 112 8 +145.54 +/- 32.74
206307 ncm-dbt-03 1240274 500 179 73 248 +74.79 +/- 14.63 0 21 103 125 1 +155.54 +/- 33.71
206306 ncm-dbt-04 1236232 500 166 73 261 +65.38 +/- 14.83 1 22 111 115 1 +135.76 +/- 32.43
206305 ncm-dbt-06 1221396 500 168 79 253 +62.51 +/- 14.85 0 26 110 113 1 +127.76 +/- 32.59
206304 ncm-dbt-05 1233132 500 153 67 280 +60.36 +/- 15.15 0 27 113 107 3 +119.89 +/- 32.15
206303 ncm-dbt-02 1238972 500 173 73 254 +70.43 +/- 14.2 0 16 122 108 4 +140.62 +/- 30.61
206302 ncm-dbt-01 1103722 500 166 83 251 +58.21 +/- 14.79 0 26 117 105 2 +116.78 +/- 31.56
206301 ncm-dbt-04 1216372 500 169 76 255 +65.38 +/- 14.97 0 26 106 117 1 +134.15 +/- 33.21
206300 ncm-dbt-03 1241602 500 179 76 245 +72.61 +/- 13.99 0 16 117 115 2 +148.85 +/- 31.38
206299 ncm-dbt-06 1217999 500 181 70 249 +78.43 +/- 14.88 0 18 108 119 5 +157.24 +/- 32.87
206298 ncm-dbt-01 1110642 500 175 80 245 +66.82 +/- 15.16 0 26 105 117 2 +135.76 +/- 33.36
206297 ncm-dbt-04 1228541 500 170 87 243 +58.21 +/- 15.06 2 23 116 108 1 +121.46 +/- 31.7
206296 ncm-dbt-02 1226075 500 172 76 252 +67.54 +/- 14.51 0 20 117 110 3 +135.76 +/- 31.48
206295 ncm-dbt-05 1247284 500 183 73 244 +77.7 +/- 14.58 0 17 110 119 4 +157.24 +/- 32.52
206294 ncm-dbt-03 1240548 500 171 73 256 +68.99 +/- 14.97 0 23 109 115 3 +138.99 +/- 32.74
206293 ncm-dbt-06 1222949 500 168 73 259 +66.82 +/- 15.29 1 22 112 111 4 +134.15 +/- 32.28
206292 ncm-dbt-02 1227299 500 159 71 270 +61.79 +/- 14.55 0 21 124 101 4 +121.46 +/- 30.47
206291 ncm-dbt-01 1101812 500 179 73 248 +74.79 +/- 14.9 0 22 102 124 2 +153.86 +/- 33.87
206290 ncm-dbt-05 1240276 500 173 70 257 +72.61 +/- 15.63 0 27 96 124 3 +147.19 +/- 34.79
206289 ncm-dbt-03 1237828 500 187 87 226 +70.43 +/- 15.02 0 23 107 117 3 +142.26 +/- 33.06
206288 ncm-dbt-04 1223119 500 175 76 249 +69.71 +/- 14.31 0 19 115 114 2 +142.26 +/- 31.77
206287 ncm-dbt-06 1244990 500 183 84 233 +69.71 +/- 14.86 0 20 116 109 5 +137.37 +/- 31.63
206286 ncm-dbt-01 1099272 500 161 83 256 +54.65 +/- 16.15 1 34 104 108 3 +109.07 +/- 33.4
206285 ncm-dbt-02 1231797 500 173 75 252 +68.99 +/- 14.7 0 21 113 113 3 +138.99 +/- 32.11
206284 ncm-dbt-05 1244099 500 174 72 254 +71.88 +/- 15.21 0 24 103 120 3 +145.54 +/- 33.69
206283 ncm-dbt-04 1225693 500 184 61 255 +87.26 +/- 14.4 0 15 100 132 3 +181.7 +/- 34.21
206282 ncm-dbt-03 1231741 500 177 70 253 +75.52 +/- 15.46 0 24 99 123 4 +152.18 +/- 34.35
206281 ncm-dbt-06 1225320 500 180 69 251 +78.43 +/- 14.31 0 15 113 118 4 +158.93 +/- 31.99
177649 ncm-dbt-05 1494498 168 66 35 67 +64.85 +/- 22.85 0 4 46 33 1 +129.8 +/- 48.98
177648 ncm-dbt-04 1480466 168 56 31 81 +52.08 +/- 28.04 0 13 34 36 1 +102.11 +/- 58.67
177647 ncm-dbt-03 1500489 164 59 26 79 +70.88 +/- 24.42 0 6 37 39 0 +148.2 +/- 56.54
177646 ncm-dbt-02 1493562 162 56 17 89 +85.31 +/- 23.75 0 4 34 43 0 +182.37 +/- 59.09
177645 ncm-dbt-06 1494193 170 55 23 92 +66.18 +/- 26.31 0 8 39 36 2 +128.13 +/- 55.09
177644 ncm-dbt-01 1491952 168 59 28 81 +64.85 +/- 23.61 1 2 47 33 1 +134.57 +/- 47.87

Commit

Commit ID ea1ddb6aef8bb6ee3056988af7cfd32b2f52f960
Author Joost VandeVondele
Date 2021-12-13 06:17:25 UTC
Update default net to nn-d93927199b3d.nnue Using the same dataset as before but slightly reduced initial LR as in https://github.com/vondele/nnue-pytorch/tree/tweakLR1 passed STC: LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 51368 W: 13492 L: 13191 D: 24685 Ptnml(0-2): 168, 5767, 13526, 6042, 181 https://tests.stockfishchess.org/tests/view/61b61f43dffbe89a3580b529 passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 45128 W: 11763 L: 11469 D: 21896 Ptnml(0-2): 24, 4583, 13063, 4863, 31 https://tests.stockfishchess.org/tests/view/61b6612edffbe89a3580c447 closes https://github.com/official-stockfish/Stockfish/pull/3848 Bench: 5121336
Copyright 2011–2024 Next Chess Move LLC