Dev Builds » 20220713-1601

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:05:26 1235254 3392 1332 407 1653 +97.21 +/- 5.73 1 100 604 955 36 +202.52 +/- 13.87
ncm-dbt-02 10:00:37 1267630 3340 1315 418 1607 +95.65 +/- 5.58 1 80 642 915 32 +199.56 +/- 13.43
ncm-dbt-03 10:04:38 1262992 3388 1318 423 1647 +94.01 +/- 5.56 0 87 658 916 33 +194.98 +/- 13.27
ncm-dbt-04 10:05:37 1255058 3390 1365 388 1637 +103.05 +/- 5.52 1 69 616 970 39 +216.84 +/- 13.72
ncm-dbt-05 10:01:09 1142814 3336 1292 420 1624 +92.97 +/- 5.58 2 85 645 911 25 +195.04 +/- 13.41
ncm-dbt-06 09:26:55 1229499 3154 1243 329 1582 +103.65 +/- 5.58 1 59 568 923 26 +221.76 +/- 14.28
20000 7865 2385 9750 +97.69 +/- 2.29 6 480 3733 5590 191 +204.8 +/- 5.57

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
187338 ncm-dbt-05 1238131 136 52 24 60 +72.56 +/- 26.96 0 3 36 27 2 +139.95 +/- 55.77
187337 ncm-dbt-02 1231638 142 58 14 70 +111.31 +/- 26.45 0 2 25 42 2 +236.27 +/- 69.74
187336 ncm-dbt-06 1229792 154 67 12 75 +129.8 +/- 23.67 0 2 19 55 1 +302.22 +/- 81.65
187335 ncm-dbt-03 1226913 186 77 19 90 +112.07 +/- 23.64 0 3 32 55 3 +236.19 +/- 61.37
187334 ncm-dbt-01 1156476 192 72 21 99 +94.55 +/- 25.34 0 8 31 55 2 +195.71 +/- 61.8
187333 ncm-dbt-04 1236387 190 70 19 101 +95.6 +/- 23.09 1 3 35 56 0 +213.54 +/- 58.51
187332 ncm-dbt-05 1226067 500 206 54 240 +109.07 +/- 13.73 0 8 86 152 4 +236.51 +/- 36.93
187331 ncm-dbt-02 1243544 500 193 51 256 +101.46 +/- 14.01 0 9 95 141 5 +213.85 +/- 35.03
187330 ncm-dbt-06 1228997 500 191 56 253 +96.19 +/- 14.41 0 13 93 140 4 +202.15 +/- 35.52
187329 ncm-dbt-03 1229331 500 197 73 230 +88.0 +/- 14.12 0 13 103 131 3 +183.51 +/- 33.63
187328 ncm-dbt-04 1205295 500 201 55 244 +104.49 +/- 14.5 0 11 88 145 6 +219.87 +/- 36.54
187327 ncm-dbt-01 1207783 500 197 59 244 +98.44 +/- 14.89 0 15 87 143 5 +206.01 +/- 36.74
187326 ncm-dbt-02 1242966 500 190 63 247 +90.22 +/- 15.45 1 18 88 139 4 +189.0 +/- 36.45
187325 ncm-dbt-06 1244570 500 195 49 256 +104.49 +/- 14.04 0 9 91 145 5 +221.9 +/- 35.86
187324 ncm-dbt-05 1232098 500 197 54 249 +102.22 +/- 14.93 0 15 82 148 5 +215.85 +/- 37.82
187323 ncm-dbt-04 1238021 500 203 59 238 +102.97 +/- 13.71 0 9 91 147 3 +221.9 +/- 35.86
187322 ncm-dbt-01 1212535 500 205 64 231 +100.71 +/- 14.32 1 10 89 147 3 +217.85 +/- 36.33
187321 ncm-dbt-03 1227736 500 202 57 241 +103.73 +/- 14.5 0 11 89 144 6 +217.85 +/- 36.33
187320 ncm-dbt-02 1231584 500 199 65 236 +95.44 +/- 14.1 0 10 101 134 5 +198.34 +/- 33.9
187319 ncm-dbt-05 1223945 500 186 70 244 +82.1 +/- 14.27 0 15 107 125 3 +169.27 +/- 32.98
187318 ncm-dbt-06 1210801 500 194 47 259 +105.25 +/- 13.56 0 8 90 149 3 +228.08 +/- 36.04
187317 ncm-dbt-04 1205701 500 191 56 253 +96.19 +/- 14.41 0 13 93 140 4 +202.15 +/- 35.52
187316 ncm-dbt-01 1194645 500 196 62 242 +95.44 +/- 15.69 0 19 85 139 7 +194.57 +/- 37.05
187315 ncm-dbt-03 1243317 500 192 65 243 +90.22 +/- 14.46 0 12 105 127 6 +183.51 +/- 33.24
187314 ncm-dbt-05 1220744 500 193 66 241 +90.22 +/- 14.31 1 11 101 134 3 +190.85 +/- 33.97
187313 ncm-dbt-06 1248893 500 196 58 246 +98.44 +/- 13.34 0 8 98 142 2 +211.87 +/- 34.38
187312 ncm-dbt-02 1227689 500 189 63 248 +89.48 +/- 14.0 0 13 100 135 2 +189.0 +/- 34.18
187311 ncm-dbt-03 1222207 500 187 62 251 +88.74 +/- 15.42 0 18 96 129 7 +178.11 +/- 34.94
187310 ncm-dbt-01 1190797 500 200 74 226 +89.48 +/- 14.0 0 12 103 132 3 +187.16 +/- 33.6
187309 ncm-dbt-04 1234615 500 200 60 240 +99.95 +/- 15.48 0 12 98 128 12 +196.45 +/- 34.53
187308 ncm-dbt-06 1221944 500 206 51 243 +111.37 +/- 14.22 0 9 83 152 6 +238.66 +/- 37.66
187307 ncm-dbt-05 1250937 500 186 63 251 +87.26 +/- 14.4 1 13 100 134 2 +185.33 +/- 34.19
187306 ncm-dbt-02 1242976 500 206 67 227 +99.2 +/- 14.3 0 11 94 140 5 +207.95 +/- 35.29
187305 ncm-dbt-01 1229830 500 192 58 250 +95.44 +/- 15.13 0 16 90 138 6 +196.45 +/- 36.11
187304 ncm-dbt-03 1242270 500 192 58 250 +95.44 +/- 13.79 0 9 102 135 4 +200.24 +/- 33.67
187303 ncm-dbt-04 1201459 500 206 48 246 +113.68 +/- 13.55 0 6 85 154 5 +247.41 +/- 37.09
187302 ncm-dbt-06 1221497 500 194 56 250 +98.44 +/- 14.59 1 10 94 140 5 +207.95 +/- 35.29
187301 ncm-dbt-02 1231095 500 197 75 228 +86.52 +/- 14.81 0 14 107 122 7 +172.78 +/- 32.96
187300 ncm-dbt-05 1246196 500 187 60 253 +90.22 +/- 14.31 0 15 95 138 2 +190.85 +/- 35.14
187299 ncm-dbt-01 1211046 500 198 51 251 +105.25 +/- 15.69 0 16 80 145 9 +215.85 +/- 38.24
187298 ncm-dbt-03 1230965 500 189 63 248 +89.48 +/- 14.59 0 16 95 136 3 +187.16 +/- 35.14
187297 ncm-dbt-04 1246475 500 210 56 234 +110.6 +/- 14.99 0 12 80 150 8 +232.26 +/- 38.36
177336 ncm-dbt-05 504397 200 85 29 86 +99.95 +/- 24.17 0 5 38 53 4 +200.24 +/- 56.06
177335 ncm-dbt-02 1489551 198 83 20 95 +114.52 +/- 21.99 0 3 32 62 2 +249.73 +/- 61.48
177334 ncm-dbt-04 1472511 200 84 35 81 +86.88 +/- 20.84 0 3 46 50 1 +181.7 +/- 49.81
177333 ncm-dbt-03 1481198 202 82 26 94 +98.9 +/- 22.24 0 5 36 59 1 +212.15 +/- 57.73
177332 ncm-dbt-01 1478922 200 72 18 110 +96.19 +/- 21.71 0 4 39 56 1 +205.04 +/- 55.17

Commit

Commit ID 4b4b7d1209259811537634c68555d2a8f4af197c
Author Joost VandeVondele
Date 2022-07-13 16:01:20 UTC
Update default net to nn-ad9b42354671.nnue using trainer branch https://github.com/glinscott/nnue-pytorch/pull/208 with a slightly tweaked loss function (power 2.5 instead of 2.6), otherwise same training as in the previous net update https://github.com/official-stockfish/Stockfish/pull/4100 passed STC: LLR: 2.97 (-2.94,2.94) <0.00,2.50> Total: 367536 W: 99465 L: 98573 D: 169498 Ptnml(0-2): 1820, 40994, 97117, 42148, 1689 https://tests.stockfishchess.org/tests/view/62cc43fe50dcbecf5fc1c5b8 passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 25032 W: 6802 L: 6553 D: 11677 Ptnml(0-2): 40, 2424, 7341, 2669, 42 https://tests.stockfishchess.org/tests/view/62ce5f421dacb46e4d5fd277 closes https://github.com/official-stockfish/Stockfish/pull/4107 Bench: 5905619
Copyright 2011–2024 Next Chess Move LLC