Dev Builds » 20220225-0737

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:33:25 1099767 3168 1155 437 1576 +80.13 +/- 6.01 5 116 643 796 24 +164.63 +/- 13.44
ncm-dbt-02 09:37:46 1258217 3180 1161 428 1591 +81.55 +/- 5.82 0 107 670 786 27 +165.81 +/- 13.15
ncm-dbt-03 10:38:13 1343766 3502 1276 504 1722 +77.87 +/- 5.7 5 124 750 838 34 +157.37 +/- 12.43
ncm-dbt-04 10:37:01 1336165 3494 1291 501 1702 +79.94 +/- 5.7 4 127 720 867 29 +163.16 +/- 12.7
ncm-dbt-05 10:34:58 1339635 3484 1308 494 1682 +82.7 +/- 5.65 1 130 689 898 24 +170.18 +/- 12.98
ncm-dbt-06 09:33:55 1234600 3172 1171 435 1566 +82.11 +/- 5.85 2 104 661 794 25 +168.21 +/- 13.24
20000 7362 2799 9839 +80.69 +/- 2.36 17 708 4133 4979 163 +164.8 +/- 5.29

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
190382 ncm-dbt-02 1232152 138 43 16 79 +68.86 +/- 25.42 0 3 37 28 1 +137.7 +/- 54.84
190381 ncm-dbt-05 1226150 160 57 21 82 +79.53 +/- 24.52 0 4 37 38 1 +162.99 +/- 56.15
190380 ncm-dbt-01 1104107 168 60 28 80 +67.0 +/- 28.54 1 9 32 41 1 +139.38 +/- 60.71
190379 ncm-dbt-06 1212429 172 61 25 86 +73.8 +/- 24.52 0 6 39 40 1 +150.09 +/- 54.99
190378 ncm-dbt-04 1235532 178 69 19 90 +100.29 +/- 21.18 0 2 35 52 0 +220.78 +/- 57.94
190377 ncm-dbt-03 1246820 184 63 26 95 +70.83 +/- 23.22 0 7 41 44 0 +148.09 +/- 53.7
190376 ncm-dbt-02 1225066 500 194 68 238 +89.48 +/- 14.0 0 11 106 129 4 +185.33 +/- 33.03
190375 ncm-dbt-05 1218478 500 193 63 244 +92.45 +/- 14.65 0 15 94 137 4 +192.71 +/- 35.33
190374 ncm-dbt-06 1230458 500 177 80 243 +68.27 +/- 15.21 1 18 121 103 7 +132.54 +/- 30.86
190373 ncm-dbt-01 1097678 500 186 72 242 +80.63 +/- 14.8 1 17 101 129 2 +169.27 +/- 34.05
190372 ncm-dbt-04 1214840 500 168 75 257 +65.38 +/- 15.1 0 23 116 106 5 +127.76 +/- 31.68
190371 ncm-dbt-03 1231278 500 180 74 246 +74.79 +/- 15.31 1 19 108 117 5 +150.51 +/- 32.89
190370 ncm-dbt-02 1217090 500 174 66 260 +76.25 +/- 14.25 0 18 107 124 1 +158.93 +/- 33.03
190369 ncm-dbt-05 1224275 500 179 72 249 +75.52 +/- 14.51 0 21 101 128 0 +158.93 +/- 34.05
190368 ncm-dbt-06 1249238 500 192 62 246 +92.45 +/- 14.79 0 14 98 132 6 +189.0 +/- 34.56
190367 ncm-dbt-04 1216233 500 190 78 232 +79.17 +/- 15.71 1 20 101 122 6 +158.93 +/- 34.05
190366 ncm-dbt-01 1099546 500 171 68 261 +72.61 +/- 16.01 1 25 99 120 5 +145.54 +/- 34.32
190365 ncm-dbt-03 1216419 500 188 77 235 +78.44 +/- 15.95 2 19 101 122 6 +158.93 +/- 34.05
190364 ncm-dbt-02 1221210 500 183 71 246 +79.17 +/- 15.17 0 17 112 113 8 +153.86 +/- 32.2
190363 ncm-dbt-05 1211680 500 182 73 245 +76.97 +/- 14.7 0 18 109 119 4 +155.54 +/- 32.7
190362 ncm-dbt-04 1235757 500 190 60 250 +92.45 +/- 13.9 0 11 101 135 3 +194.57 +/- 33.94
190361 ncm-dbt-06 1226000 500 188 66 246 +86.52 +/- 14.38 1 12 104 130 3 +181.7 +/- 33.45
190360 ncm-dbt-03 1224934 500 175 63 262 +79.17 +/- 13.9 0 11 121 113 5 +158.93 +/- 30.54
190359 ncm-dbt-01 1101174 500 178 71 251 +75.52 +/- 14.65 1 15 114 116 4 +153.86 +/- 31.85
190358 ncm-dbt-02 1228001 500 189 71 240 +83.57 +/- 14.45 0 17 100 131 2 +174.55 +/- 34.22
190357 ncm-dbt-05 1242600 500 192 63 245 +91.71 +/- 15.21 0 18 90 137 5 +189.0 +/- 36.08
190356 ncm-dbt-04 1251110 500 182 68 250 +80.63 +/- 15.35 2 18 96 132 2 +171.02 +/- 34.92
190355 ncm-dbt-03 1223953 500 186 63 251 +87.26 +/- 15.11 0 17 99 128 6 +176.33 +/- 34.4
190354 ncm-dbt-06 1236099 500 186 63 251 +87.26 +/- 14.83 0 19 91 138 2 +183.51 +/- 35.86
190353 ncm-dbt-01 1093347 500 190 65 245 +88.74 +/- 14.57 1 11 105 128 5 +183.51 +/- 33.24
190352 ncm-dbt-02 1244507 500 172 67 261 +74.06 +/- 15.68 0 23 106 114 7 +143.89 +/- 33.22
190351 ncm-dbt-04 1209936 500 189 68 243 +85.78 +/- 14.94 1 14 103 127 5 +176.33 +/- 33.67
190350 ncm-dbt-06 1242764 500 189 75 236 +80.63 +/- 14.52 0 17 105 125 3 +165.8 +/- 33.35
190349 ncm-dbt-05 1227058 500 198 66 236 +93.95 +/- 14.53 0 14 94 138 4 +196.45 +/- 35.33
190348 ncm-dbt-01 1102081 500 192 68 240 +88.0 +/- 14.7 0 16 98 132 4 +181.7 +/- 34.58
190347 ncm-dbt-03 1222595 500 184 75 241 +76.97 +/- 14.56 0 16 114 115 5 +153.86 +/- 31.85
190346 ncm-dbt-02 1234088 500 191 64 245 +90.22 +/- 14.75 0 16 95 135 4 +187.16 +/- 35.14
190345 ncm-dbt-05 1226100 500 185 81 234 +73.34 +/- 15.26 1 23 98 127 1 +153.86 +/- 34.52
190344 ncm-dbt-04 1226759 500 186 74 240 +79.17 +/- 15.58 0 23 97 125 5 +158.93 +/- 34.71
190343 ncm-dbt-06 1245217 500 178 64 258 +80.63 +/- 14.66 0 18 103 126 3 +165.8 +/- 33.7
190342 ncm-dbt-03 1242953 500 188 77 235 +78.44 +/- 15.15 2 15 107 122 4 +162.35 +/- 33.02
190341 ncm-dbt-01 1100438 500 178 65 257 +79.9 +/- 15.33 0 23 94 130 3 +164.07 +/- 35.23
174655 ncm-dbt-04 1442538 16 6 3 7 +65.87 +/- 110.97 0 1 4 2 1 +88.74 +/- 190.27
174654 ncm-dbt-03 1457532 18 5 1 12 +78.47 +/- 102.62 0 1 4 3 1 +120.41 +/- 194.59
174653 ncm-dbt-05 1455450 24 9 2 13 +104.35 +/- 69.98 0 1 3 8 0 +231.91 +/- 271.45
174652 ncm-dbt-04 1447200 50 20 5 25 +107.52 +/- 56.64 0 2 8 13 2 +200.24 +/- 129.69
174651 ncm-dbt-03 1454259 50 18 12 20 +41.88 +/- 56.76 0 5 10 9 1 +70.44 +/- 110.15
174650 ncm-dbt-05 1456334 50 19 8 23 +77.7 +/- 50.32 0 3 8 14 0 +164.07 +/- 126.09
174645 ncm-dbt-04 1443698 50 17 6 27 +77.7 +/- 45.94 0 2 10 13 0 +164.07 +/- 113.84
174642 ncm-dbt-03 1455614 50 16 6 28 +70.43 +/- 53.56 0 4 7 14 0 +147.19 +/- 129.82
174641 ncm-dbt-05 1455449 50 21 7 22 +99.93 +/- 56.22 0 3 6 15 1 +200.24 +/- 144.55
174640 ncm-dbt-04 1446771 50 23 10 17 +92.45 +/- 42.2 0 1 10 14 0 +200.24 +/- 114.26
174639 ncm-dbt-03 1460939 50 16 9 25 +48.96 +/- 50.55 0 4 10 11 0 +99.95 +/- 111.26
174638 ncm-dbt-05 1448246 50 17 10 23 +48.95 +/- 50.55 0 3 13 8 1 +85.04 +/- 96.78
174637 ncm-dbt-03 1452359 50 21 8 21 +92.45 +/- 42.2 0 1 10 14 0 +200.24 +/- 114.26
174636 ncm-dbt-04 1444579 50 17 13 20 +27.85 +/- 42.16 0 3 15 7 0 +56.07 +/- 87.47
174635 ncm-dbt-05 1454711 50 23 13 14 +70.42 +/- 45.16 0 1 14 9 1 +130.94 +/- 89.9
174634 ncm-dbt-03 1461095 50 19 4 27 +107.51 +/- 42.62 0 0 11 13 1 +219.84 +/- 104.3
174633 ncm-dbt-04 1443417 50 15 11 24 +27.85 +/- 54.17 0 6 9 10 0 +56.07 +/- 113.77
174632 ncm-dbt-05 1454258 50 15 9 26 +41.89 +/- 49.33 0 4 11 10 0 +85.04 +/- 106.19
174631 ncm-dbt-02 1463627 42 15 5 22 +84.33 +/- 52.73 0 2 7 12 0 +179.99 +/- 139.14
174630 ncm-dbt-04 1447946 50 19 11 20 +56.07 +/- 38.31 0 1 15 9 0 +115.23 +/- 84.94
174629 ncm-dbt-03 1461983 50 17 9 24 +56.07 +/- 55.43 0 5 7 13 0 +115.23 +/- 126.16
174628 ncm-dbt-05 1454111 50 18 6 26 +85.02 +/- 55.08 0 2 11 10 2 +147.19 +/- 107.43

Commit

Commit ID 5f781d366e0f4369ec12e36c9978ad63ffa32235
Author mstembera
Date 2022-02-25 07:37:57 UTC
Clean up and simplify some nnue code. Remove some unnecessary code and it's execution during inference. Also the change on line 49 in nnue_architecture.h results in a more efficient SIMD code path through ClippedReLU::propagate(). passed STC: https://tests.stockfishchess.org/tests/view/6217d3bfda649bba32ef25d5 LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 12056 W: 3281 L: 3092 D: 5683 Ptnml(0-2): 55, 1213, 3312, 1384, 64 passed STC SMP: https://tests.stockfishchess.org/tests/view/6217f344da649bba32ef295e LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 27376 W: 7295 L: 7137 D: 12944 Ptnml(0-2): 52, 2859, 7715, 3003, 59 closes https://github.com/official-stockfish/Stockfish/pull/3944 No functional change bench: 6820724
Copyright 2011–2024 Next Chess Move LLC