Dev Builds » 20211207-1140

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:55:51 1144271 3344 1180 517 1647 +69.81 +/- 5.8 1 145 742 758 26 +139.64 +/- 12.5
ncm-dbt-02 09:52:26 1257184 3304 1124 527 1653 +63.48 +/- 5.67 2 140 787 705 18 +127.64 +/- 12.1
ncm-dbt-03 09:57:02 1268938 3346 1169 509 1668 +69.44 +/- 5.81 4 146 727 778 18 +141.49 +/- 12.63
ncm-dbt-04 09:56:43 1260153 3342 1157 519 1666 +67.15 +/- 5.82 6 138 765 736 26 +134.89 +/- 12.29
ncm-dbt-05 09:52:43 1259486 3326 1145 528 1653 +65.21 +/- 5.93 0 174 721 745 23 +129.82 +/- 12.69
ncm-dbt-06 09:56:33 1260371 3338 1107 489 1742 +65.07 +/- 5.61 1 137 792 721 18 +130.98 +/- 12.06
20000 6882 3089 10029 +66.7 +/- 2.36 14 880 4534 4443 129 +134.07 +/- 5.05

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
206448 ncm-dbt-02 1227772 146 55 26 65 +69.94 +/- 23.57 0 3 38 32 0 +146.06 +/- 54.32
206447 ncm-dbt-05 1219681 156 53 26 77 +60.74 +/- 29.12 0 11 30 36 1 +120.41 +/- 62.49
206446 ncm-dbt-06 1214693 172 57 20 95 +75.92 +/- 23.18 0 4 42 39 1 +154.96 +/- 52.23
206445 ncm-dbt-01 1105146 172 64 22 86 +86.58 +/- 28.47 0 8 32 42 4 +164.87 +/- 61.0
206444 ncm-dbt-04 1232683 176 57 29 90 +55.75 +/- 23.56 0 8 44 36 0 +114.52 +/- 51.49
206443 ncm-dbt-03 1238492 178 58 27 93 +61.13 +/- 26.29 0 10 40 37 2 +117.49 +/- 54.42
206442 ncm-dbt-02 1219700 500 163 67 270 +67.54 +/- 15.45 0 26 106 114 4 +134.15 +/- 33.21
206441 ncm-dbt-05 1213469 500 170 76 254 +66.1 +/- 14.73 0 23 112 113 2 +134.15 +/- 32.28
206440 ncm-dbt-01 1098269 500 181 77 242 +73.33 +/- 15.52 0 24 103 118 5 +145.54 +/- 33.69
206439 ncm-dbt-06 1229220 500 161 71 268 +63.23 +/- 13.91 0 19 123 107 1 +129.35 +/- 30.56
206438 ncm-dbt-04 1215260 500 168 68 264 +70.43 +/- 15.29 0 19 121 101 9 +132.54 +/- 30.86
206437 ncm-dbt-03 1226086 500 187 87 226 +70.44 +/- 16.31 2 23 105 113 7 +138.99 +/- 33.37
206436 ncm-dbt-05 1220264 500 171 71 258 +70.43 +/- 15.16 0 21 114 109 6 +137.37 +/- 31.96
206435 ncm-dbt-02 1219481 500 166 86 248 +56.07 +/- 14.83 0 25 124 97 4 +109.07 +/- 30.54
206434 ncm-dbt-04 1236612 500 180 83 237 +68.27 +/- 15.73 2 22 107 115 4 +138.99 +/- 33.06
206433 ncm-dbt-06 1229707 500 167 85 248 +57.5 +/- 15.03 1 22 126 96 5 +112.14 +/- 30.22
206432 ncm-dbt-01 1102864 500 173 77 250 +67.54 +/- 14.23 0 18 121 108 3 +135.76 +/- 30.83
206431 ncm-dbt-03 1225892 500 168 71 261 +68.27 +/- 13.97 0 18 118 113 1 +140.62 +/- 31.28
206430 ncm-dbt-05 1227537 500 172 83 245 +62.51 +/- 15.76 0 30 105 111 4 +123.02 +/- 33.32
206429 ncm-dbt-02 1235132 500 163 78 259 +59.64 +/- 14.18 0 22 122 105 1 +121.46 +/- 30.78
206428 ncm-dbt-06 1222095 500 178 65 257 +79.9 +/- 14.78 0 18 105 123 4 +162.35 +/- 33.37
206427 ncm-dbt-04 1230498 500 162 82 256 +56.07 +/- 14.96 1 25 119 103 2 +113.68 +/- 31.27
206426 ncm-dbt-01 1098872 500 185 87 228 +68.99 +/- 14.7 0 22 110 116 2 +140.62 +/- 32.58
206425 ncm-dbt-03 1237703 500 167 74 259 +65.38 +/- 15.23 0 26 108 113 3 +130.94 +/- 32.9
206424 ncm-dbt-05 1230764 500 167 86 247 +56.78 +/- 14.99 0 28 115 105 2 +113.68 +/- 31.86
206423 ncm-dbt-01 1091972 500 163 65 272 +68.99 +/- 14.84 0 20 117 108 5 +135.76 +/- 31.48
206422 ncm-dbt-06 1235912 500 162 76 262 +60.36 +/- 14.35 0 23 119 107 1 +123.02 +/- 31.23
206421 ncm-dbt-02 1226986 500 179 75 246 +73.33 +/- 13.72 0 15 117 117 1 +152.18 +/- 31.35
206420 ncm-dbt-04 1233819 500 164 78 258 +60.36 +/- 15.28 1 27 108 113 1 +124.6 +/- 32.89
206419 ncm-dbt-03 1252389 500 177 80 243 +68.27 +/- 14.94 2 18 113 115 2 +142.26 +/- 32.1
206418 ncm-dbt-05 1239181 500 175 78 247 +68.27 +/- 15.73 0 27 104 114 5 +134.15 +/- 33.51
206417 ncm-dbt-06 1237882 500 162 68 270 +66.1 +/- 14.45 0 19 122 105 4 +130.94 +/- 30.71
206416 ncm-dbt-04 1228651 500 186 76 238 +77.7 +/- 14.29 0 14 117 114 5 +155.54 +/- 31.31
206415 ncm-dbt-02 1208975 500 178 82 240 +67.55 +/- 15.18 2 18 116 110 4 +137.37 +/- 31.63
206414 ncm-dbt-01 1091190 500 183 82 235 +71.16 +/- 14.64 1 17 115 114 3 +145.54 +/- 31.75
206413 ncm-dbt-03 1227415 500 178 65 257 +79.9 +/- 14.5 0 18 103 127 2 +165.8 +/- 33.7
206412 ncm-dbt-04 1216185 500 181 83 236 +68.99 +/- 15.37 2 19 112 113 4 +140.62 +/- 32.26
206411 ncm-dbt-05 1229397 500 179 80 241 +69.71 +/- 14.86 0 22 110 115 3 +140.62 +/- 32.58
206410 ncm-dbt-06 1215343 500 168 77 255 +63.94 +/- 14.5 0 23 114 112 1 +130.94 +/- 31.98
206409 ncm-dbt-01 1069149 500 170 81 249 +62.51 +/- 15.5 0 30 103 115 2 +126.18 +/- 33.63
206408 ncm-dbt-02 1227421 500 169 85 246 +58.93 +/- 14.83 0 24 122 100 4 +115.23 +/- 30.81
206407 ncm-dbt-03 1243079 500 176 70 254 +74.79 +/- 14.34 0 20 104 126 0 +157.24 +/- 33.54
177673 ncm-dbt-02 1492008 158 51 28 79 +50.94 +/- 24.28 0 7 42 30 0 +104.16 +/- 52.34
177672 ncm-dbt-05 1495595 170 58 28 84 +61.96 +/- 27.3 0 12 31 42 0 +128.13 +/- 61.15
177671 ncm-dbt-06 1498123 166 52 27 87 +52.72 +/- 25.74 0 9 41 32 1 +103.41 +/- 53.54
177670 ncm-dbt-04 1487521 166 59 20 87 +83.17 +/- 24.09 0 4 37 41 1 +171.83 +/- 56.31
177669 ncm-dbt-03 1500452 168 58 35 75 +47.86 +/- 27.68 0 13 36 34 1 +93.17 +/- 57.18
177668 ncm-dbt-01 1496706 172 61 26 85 +71.69 +/- 25.09 0 6 41 37 2 +140.51 +/- 53.4

Commit

Commit ID b82d93ece484f833c994b40d9eddd959ba20ef92
Author Joost VandeVondele
Date 2021-12-07 11:40:48 UTC
Update default net to nn-63376713ba63.nnue. same data set as previous trained nets, tuned the wdl model slightly for training. https://github.com/vondele/nnue-pytorch/tree/wdlTweak1 passed STC: https://tests.stockfishchess.org/tests/view/61abe9e456fcf33bce7d2834 LLR: 2.93 (-2.94,2.94) <0.00,2.50> Total: 31720 W: 8385 L: 8119 D: 15216 Ptnml(0-2): 117, 3534, 8273, 3838, 98 passed LTC: https://tests.stockfishchess.org/tests/view/61ac293756fcf33bce7d36cf LLR: 2.96 (-2.94,2.94) <0.50,3.00> Total: 136136 W: 35255 L: 34741 D: 66140 Ptnml(0-2): 114, 14217, 38894, 14727, 116 closes https://github.com/official-stockfish/Stockfish/pull/3836 Bench: 4667742
Copyright 2011–2024 Next Chess Move LLC