Dev Builds » 20211219-1444

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:26:00 1187690 3166 1129 487 1550 +71.44 +/- 6.12 3 142 678 730 30 +142.46 +/- 13.08
ncm-dbt-02 09:27:50 1205983 3160 1098 485 1577 +68.26 +/- 6.01 2 144 696 715 23 +136.84 +/- 12.91
ncm-dbt-03 11:14:24 1361280 3686 1323 563 1800 +72.68 +/- 5.67 0 174 770 864 35 +144.46 +/- 12.28
ncm-dbt-04 09:28:53 1224607 3178 1134 501 1543 +70.14 +/- 6.02 1 141 700 718 29 +139.3 +/- 12.87
ncm-dbt-05 11:07:45 1347313 3642 1296 544 1802 +72.78 +/- 5.54 2 138 825 818 38 +144.38 +/- 11.83
ncm-dbt-06 09:28:57 1230992 3168 1116 482 1570 +70.48 +/- 5.81 0 131 704 733 16 +143.14 +/- 12.83
20000 7096 3062 9842 +71.05 +/- 2.39 8 870 4373 4578 171 +141.89 +/- 5.15

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
199162 ncm-dbt-05 1226210 156 58 26 72 +72.29 +/- 27.74 0 7 34 35 2 +140.87 +/- 59.19
199161 ncm-dbt-02 1213317 160 54 30 76 +52.51 +/- 27.18 0 10 37 32 1 +102.78 +/- 56.59
199160 ncm-dbt-06 1221642 168 50 30 88 +41.56 +/- 25.81 0 12 40 32 0 +84.34 +/- 54.35
199159 ncm-dbt-01 1193611 166 61 23 82 +80.96 +/- 26.96 0 6 36 38 3 +156.26 +/- 57.46
199158 ncm-dbt-03 1251207 172 59 28 85 +63.31 +/- 27.15 0 11 34 40 1 +126.51 +/- 58.86
199157 ncm-dbt-04 1246746 178 66 28 84 +75.33 +/- 25.96 0 8 37 42 2 +149.05 +/- 56.72
199156 ncm-dbt-05 1216825 500 167 69 264 +68.99 +/- 14.84 1 18 117 110 4 +138.99 +/- 31.46
199155 ncm-dbt-06 1253514 500 181 69 250 +79.17 +/- 14.05 0 16 107 126 1 +165.8 +/- 33.0
199154 ncm-dbt-01 1209709 500 183 71 246 +79.17 +/- 14.62 1 16 105 126 2 +165.8 +/- 33.35
199153 ncm-dbt-02 1235840 500 169 86 245 +58.21 +/- 15.19 0 30 108 111 1 +118.33 +/- 32.88
199152 ncm-dbt-03 1262492 500 191 72 237 +84.3 +/- 15.31 0 19 99 126 6 +169.27 +/- 34.4
199151 ncm-dbt-04 1227760 500 188 79 233 +76.97 +/- 14.97 0 18 111 115 6 +152.18 +/- 32.38
198897 ncm-dbt-02 1199433 500 185 70 245 +81.36 +/- 14.25 0 15 108 124 3 +167.53 +/- 32.81
198896 ncm-dbt-05 1228536 500 179 69 252 +77.71 +/- 15.79 1 20 104 118 7 +153.86 +/- 33.54
198895 ncm-dbt-03 1237194 500 178 76 246 +71.88 +/- 15.99 0 27 100 117 6 +140.62 +/- 34.14
198894 ncm-dbt-06 1221761 500 177 75 248 +71.88 +/- 15.21 0 22 109 114 5 +142.26 +/- 32.74
198893 ncm-dbt-04 1219914 500 169 79 252 +63.23 +/- 14.88 0 22 121 102 5 +123.02 +/- 30.92
198892 ncm-dbt-01 1215955 500 169 70 261 +69.71 +/- 15.0 1 17 120 106 6 +137.37 +/- 30.98
198891 ncm-dbt-02 1200481 500 182 80 238 +71.89 +/- 15.73 1 24 101 120 4 +145.54 +/- 34.01
198890 ncm-dbt-06 1226674 500 173 80 247 +65.38 +/- 14.83 0 24 111 113 2 +132.54 +/- 32.44
198889 ncm-dbt-05 1231945 500 181 90 229 +63.94 +/- 14.37 0 20 122 105 3 +127.76 +/- 30.73
198888 ncm-dbt-04 1212143 500 179 74 247 +74.06 +/- 14.03 0 16 115 117 2 +152.18 +/- 31.7
198887 ncm-dbt-03 1228335 500 175 76 249 +69.71 +/- 15.91 0 26 106 111 7 +134.15 +/- 33.21
198886 ncm-dbt-01 1175934 500 162 84 254 +54.65 +/- 16.63 1 35 105 103 6 +104.49 +/- 33.24
198885 ncm-dbt-02 1199426 500 166 81 253 +59.64 +/- 14.59 0 22 125 99 4 +116.78 +/- 30.34
198884 ncm-dbt-05 1228560 500 180 71 249 +76.97 +/- 14.41 0 15 116 114 5 +153.86 +/- 31.51
198883 ncm-dbt-06 1232237 500 172 75 253 +68.27 +/- 14.12 0 19 116 114 1 +140.62 +/- 31.61
198882 ncm-dbt-04 1235088 500 174 77 249 +68.27 +/- 15.73 1 25 104 116 4 +137.37 +/- 33.52
198881 ncm-dbt-01 1157796 500 189 80 231 +76.97 +/- 15.9 0 24 100 119 7 +150.51 +/- 34.19
198880 ncm-dbt-03 1243814 500 173 73 254 +70.43 +/- 15.02 0 22 110 114 4 +140.62 +/- 32.58
198879 ncm-dbt-02 1193759 500 180 71 249 +76.98 +/- 15.24 1 16 113 113 7 +152.18 +/- 32.04
198878 ncm-dbt-01 1189504 500 183 73 244 +77.7 +/- 15.13 0 20 105 120 5 +155.54 +/- 33.38
198877 ncm-dbt-06 1246175 500 172 69 259 +72.61 +/- 14.83 0 21 108 118 3 +147.19 +/- 32.89
198876 ncm-dbt-05 1219313 500 186 76 238 +77.7 +/- 14.86 0 19 106 121 4 +157.24 +/- 33.21
198875 ncm-dbt-03 1227851 500 184 78 238 +74.79 +/- 15.31 0 24 99 124 3 +152.18 +/- 34.35
198874 ncm-dbt-04 1212103 500 179 89 232 +63.23 +/- 15.79 0 29 107 109 5 +123.02 +/- 33.03
198873 ncm-dbt-02 1199628 500 162 67 271 +66.82 +/- 15.42 0 27 104 116 3 +134.15 +/- 33.51
198872 ncm-dbt-01 1171321 500 182 86 232 +67.54 +/- 14.78 0 24 107 118 1 +138.99 +/- 33.06
198871 ncm-dbt-05 1229064 500 185 68 247 +82.83 +/- 15.28 0 16 110 115 9 +160.64 +/- 32.5
198870 ncm-dbt-04 1218495 500 179 75 246 +73.33 +/- 15.39 0 23 105 117 5 +145.54 +/- 33.38
198869 ncm-dbt-06 1214943 500 191 84 225 +75.52 +/- 14.51 0 17 113 116 4 +152.18 +/- 32.04
198868 ncm-dbt-03 1228706 500 183 70 247 +79.9 +/- 15.73 0 22 100 121 7 +157.24 +/- 34.21
176373 ncm-dbt-03 1440943 14 5 1 8 +102.04 +/- 70.73 0 0 3 4 0 +225.59 +/- 263.0
176372 ncm-dbt-05 1432142 36 11 8 17 +29.02 +/- 56.04 0 3 9 6 0 +58.45 +/- 118.18
176371 ncm-dbt-03 1439196 50 21 9 20 +85.04 +/- 46.59 0 2 9 14 0 +181.7 +/- 121.14
176370 ncm-dbt-05 1436597 50 11 5 34 +41.89 +/- 35.54 0 1 17 7 0 +85.04 +/- 75.39
176367 ncm-dbt-03 1439495 50 17 2 31 +107.52 +/- 47.72 0 1 9 14 1 +219.87 +/- 122.63
176362 ncm-dbt-05 1434868 50 14 5 31 +63.22 +/- 48.63 0 3 10 12 0 +130.94 +/- 112.59
176361 ncm-dbt-03 1442387 50 18 8 24 +70.43 +/- 40.35 0 1 13 11 0 +147.19 +/- 95.14
176360 ncm-dbt-05 1426873 50 18 8 24 +70.42 +/- 60.89 0 4 9 10 2 +115.23 +/- 116.78
176359 ncm-dbt-03 1437609 50 18 8 24 +70.43 +/- 40.35 0 1 13 11 0 +147.19 +/- 95.14
176358 ncm-dbt-05 1432155 50 17 11 22 +41.89 +/- 40.64 0 2 15 8 0 +85.04 +/- 86.62
176357 ncm-dbt-03 1439777 50 19 6 25 +92.44 +/- 36.68 0 0 12 13 0 +200.21 +/- 97.77
176356 ncm-dbt-05 1431177 50 18 11 21 +48.96 +/- 42.0 0 2 14 9 0 +99.95 +/- 91.41
176355 ncm-dbt-03 1436610 50 19 11 20 +56.07 +/- 47.61 0 3 11 11 0 +115.23 +/- 106.91
176354 ncm-dbt-05 1434436 50 18 9 23 +63.21 +/- 48.62 0 2 13 9 1 +115.23 +/- 96.38
176353 ncm-dbt-03 1434009 50 16 10 24 +41.89 +/- 40.64 0 2 15 8 0 +85.04 +/- 86.62
176352 ncm-dbt-05 1430567 50 18 7 25 +77.69 +/- 54.37 0 3 9 12 1 +147.19 +/- 118.91
176351 ncm-dbt-03 1437175 50 21 14 15 +48.96 +/- 42.0 0 2 14 9 0 +99.95 +/- 91.41
176350 ncm-dbt-05 1428574 50 18 6 26 +85.04 +/- 46.59 0 2 9 14 0 +181.7 +/- 121.14
176349 ncm-dbt-03 1434005 50 15 10 25 +34.86 +/- 43.75 0 3 14 8 0 +70.44 +/- 92.08
176348 ncm-dbt-05 1436491 50 17 5 28 +85.04 +/- 41.74 0 1 11 13 0 +181.7 +/- 107.11
176347 ncm-dbt-03 1442243 50 11 11 28 -0.0 +/- 54.94 0 8 9 8 0 -0.0 +/- 112.75

Commit

Commit ID 74776dbcd57a1bdf2d5328e5750cc1d00244e17d
Author Stéphane Nicolet
Date 2021-12-19 14:44:01 UTC
Simplification in evaluate_nnue.cpp Removes the test on non-pawn-material before applying the positional/materialistic bonus. Passed STC: LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 46904 W: 12197 L: 12059 D: 22648 Ptnml(0-2): 170, 5243, 12479, 5399, 161 https://tests.stockfishchess.org/tests/view/61be57cf57a0d0f327c3999d Passed LTC: LLR: 2.95 (-2.94,2.94) <-2.25,0.25> Total: 18760 W: 4958 L: 4790 D: 9012 Ptnml(0-2): 14, 1942, 5301, 2108, 15 https://tests.stockfishchess.org/tests/view/61bed1fb57a0d0f327c3afa9 closes https://github.com/official-stockfish/Stockfish/pull/3866 Bench: 4826206
Copyright 2011–2024 Next Chess Move LLC