Dev Builds » 20211031-2143

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:25:22 1133216 3164 981 569 1614 +45.5 +/- 6.03 0 204 785 570 23 +87.22 +/- 12.14
ncm-dbt-02 10:17:38 1330367 3402 1035 574 1793 +47.37 +/- 5.7 0 209 836 642 14 +93.49 +/- 11.76
ncm-dbt-03 10:22:28 1338348 3426 1060 572 1794 +49.83 +/- 5.79 4 205 818 671 15 +99.37 +/- 11.9
ncm-dbt-04 10:18:41 1329167 3418 1085 609 1724 +48.7 +/- 5.77 2 209 825 657 16 +96.32 +/- 11.85
ncm-dbt-05 10:18:43 1332230 3416 1092 617 1707 +48.63 +/- 5.72 0 209 830 654 15 +95.94 +/- 11.81
ncm-dbt-06 09:29:01 1224242 3174 1006 561 1607 +49.03 +/- 5.98 0 190 785 589 23 +94.66 +/- 12.13
20000 6259 3502 10239 +48.2 +/- 2.38 6 1226 4879 3783 106 +94.58 +/- 4.87

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
188724 ncm-dbt-02 1243034 158 51 34 73 +37.52 +/- 26.7 0 10 44 23 2 +66.78 +/- 51.11
188723 ncm-dbt-04 1238408 168 48 33 87 +31.1 +/- 26.0 0 14 41 29 0 +62.71 +/- 53.64
188722 ncm-dbt-03 1241943 170 64 29 77 +72.57 +/- 23.18 0 5 40 40 0 +152.08 +/- 54.0
188721 ncm-dbt-05 1222929 166 52 32 82 +42.06 +/- 26.11 0 12 39 32 0 +85.4 +/- 55.06
188720 ncm-dbt-01 1117990 164 48 31 85 +36.14 +/- 27.09 0 13 40 28 1 +68.67 +/- 54.32
188719 ncm-dbt-06 1207756 174 51 33 90 +36.07 +/- 23.87 0 11 47 29 0 +72.94 +/- 49.63
188718 ncm-dbt-02 1229236 500 159 79 262 +56.07 +/- 15.09 0 28 117 102 3 +110.6 +/- 31.57
188717 ncm-dbt-05 1213394 500 169 95 236 +51.8 +/- 14.62 0 28 121 100 1 +104.49 +/- 31.0
188716 ncm-dbt-04 1224564 500 154 91 255 +44.01 +/- 15.61 1 34 119 93 3 +86.52 +/- 31.31
188715 ncm-dbt-03 1238648 500 149 82 269 +46.84 +/- 15.39 0 35 115 98 2 +92.46 +/- 31.85
188714 ncm-dbt-01 1116023 500 157 93 250 +44.72 +/- 15.53 0 32 129 82 7 +80.63 +/- 29.95
188713 ncm-dbt-06 1241454 500 167 82 251 +59.64 +/- 14.86 0 24 121 101 4 +116.78 +/- 30.96
188208 ncm-dbt-02 1235529 500 146 88 266 +40.48 +/- 14.78 0 34 125 90 1 +80.63 +/- 30.5
188207 ncm-dbt-05 1224140 500 155 94 251 +42.6 +/- 14.38 0 28 136 83 3 +82.1 +/- 28.94
188206 ncm-dbt-03 1220549 500 156 80 264 +53.22 +/- 15.34 1 31 109 109 0 +110.6 +/- 32.71
188205 ncm-dbt-06 1214535 500 171 105 224 +46.13 +/- 15.61 0 33 124 87 6 +85.04 +/- 30.63
188204 ncm-dbt-04 1225003 500 152 85 263 +46.84 +/- 15.27 0 34 117 97 2 +92.46 +/- 31.58
188203 ncm-dbt-01 1134907 500 157 85 258 +50.38 +/- 15.2 0 30 122 94 4 +96.94 +/- 30.88
188202 ncm-dbt-02 1240761 500 144 89 267 +38.37 +/- 15.04 0 38 119 93 0 +77.71 +/- 31.31
188201 ncm-dbt-03 1222526 500 160 83 257 +53.93 +/- 15.12 1 24 127 93 5 +104.49 +/- 30.12
188200 ncm-dbt-05 1244054 500 153 90 257 +44.01 +/- 15.49 0 37 115 96 2 +86.52 +/- 31.85
188199 ncm-dbt-06 1206599 500 143 83 274 +41.89 +/- 16.22 0 41 113 91 5 +77.71 +/- 32.09
188198 ncm-dbt-04 1238544 500 165 85 250 +56.07 +/- 14.96 0 28 116 104 2 +112.14 +/- 31.71
188197 ncm-dbt-01 1141679 500 151 104 245 +32.75 +/- 15.32 0 42 120 87 1 +64.66 +/- 31.17
188196 ncm-dbt-02 1236947 500 164 88 248 +53.22 +/- 14.95 0 29 118 101 2 +106.01 +/- 31.43
188195 ncm-dbt-03 1239877 500 164 84 252 +56.07 +/- 15.47 0 32 108 108 2 +112.14 +/- 32.86
188194 ncm-dbt-06 1250342 500 165 86 249 +55.36 +/- 15.31 0 28 120 97 5 +106.01 +/- 31.14
188193 ncm-dbt-05 1219294 500 163 91 246 +50.38 +/- 14.94 0 30 120 98 2 +99.95 +/- 31.16
188192 ncm-dbt-04 1222858 500 157 95 248 +43.3 +/- 15.08 0 34 122 92 2 +85.04 +/- 30.9
188191 ncm-dbt-01 1143527 500 159 90 251 +48.25 +/- 15.09 0 32 119 97 2 +95.44 +/- 31.3
188190 ncm-dbt-06 1239952 500 152 81 267 +49.67 +/- 14.1 0 25 130 94 1 +99.95 +/- 29.7
188189 ncm-dbt-02 1226920 500 155 74 271 +56.78 +/- 14.73 0 25 122 100 3 +112.14 +/- 30.83
188188 ncm-dbt-03 1222151 500 150 88 262 +43.3 +/- 14.82 0 29 135 81 5 +80.63 +/- 29.1
188187 ncm-dbt-05 1237680 500 161 81 258 +56.07 +/- 14.83 0 29 112 109 0 +115.23 +/- 32.29
188186 ncm-dbt-01 1140582 500 155 76 269 +55.36 +/- 14.93 0 26 123 97 4 +107.54 +/- 30.7
188185 ncm-dbt-04 1226081 500 169 88 243 +56.78 +/- 14.86 0 23 129 92 6 +107.54 +/- 29.8
188184 ncm-dbt-05 1228159 500 161 95 244 +46.13 +/- 15.1 0 30 129 86 5 +86.52 +/- 29.92
188183 ncm-dbt-02 1244568 500 143 80 277 +44.01 +/- 14.33 0 28 133 87 2 +86.52 +/- 29.35
188182 ncm-dbt-01 1137807 500 154 90 256 +44.72 +/- 14.77 0 29 132 85 4 +85.04 +/- 29.5
188181 ncm-dbt-04 1232689 500 160 88 252 +50.38 +/- 14.55 1 25 126 97 1 +102.97 +/- 30.28
188180 ncm-dbt-03 1251374 500 143 78 279 +45.42 +/- 15.44 2 31 118 98 1 +93.95 +/- 31.44
188179 ncm-dbt-06 1209058 500 157 91 252 +46.13 +/- 14.45 0 28 130 90 2 +90.97 +/- 29.76
174360 ncm-dbt-05 1452512 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
174359 ncm-dbt-04 1446624 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
174358 ncm-dbt-03 1461238 6 2 1 3 +58.33 +/- 98.71 0 0 2 1 0 +120.24 +/- 264.77
174357 ncm-dbt-02 1461397 44 14 7 23 +55.74 +/- 52.56 0 3 9 10 0 +114.52 +/- 118.84
174356 ncm-dbt-05 1452198 50 16 8 26 +56.07 +/- 38.31 0 1 15 9 0 +115.23 +/- 84.94
174355 ncm-dbt-04 1451308 50 18 9 23 +63.22 +/- 48.63 0 3 10 12 0 +130.94 +/- 112.59
174354 ncm-dbt-03 1461089 50 15 14 21 +6.95 +/- 36.09 0 3 18 4 0 +13.9 +/- 73.04
174353 ncm-dbt-02 1459757 50 14 7 29 +48.96 +/- 46.46 0 3 12 10 0 +99.95 +/- 101.68
174352 ncm-dbt-05 1459895 50 13 12 25 +6.95 +/- 53.12 0 7 10 8 0 +13.9 +/- 108.98
174351 ncm-dbt-04 1442685 50 14 8 28 +41.89 +/- 45.18 0 3 13 9 0 +85.04 +/- 96.78
174350 ncm-dbt-03 1461389 50 15 7 28 +56.07 +/- 51.66 0 4 9 12 0 +115.23 +/- 116.78
174349 ncm-dbt-02 1463479 50 14 6 30 +56.05 +/- 43.19 0 1 16 7 1 +99.95 +/- 80.14
174348 ncm-dbt-05 1456033 50 13 5 32 +56.07 +/- 51.66 0 4 9 12 0 +115.23 +/- 116.78
174347 ncm-dbt-04 1442270 50 17 9 24 +56.07 +/- 47.61 0 3 11 11 0 +115.23 +/- 106.91
174346 ncm-dbt-03 1458853 50 14 14 22 0.0 +/- 51.34 0 7 11 7 0 -0.0 +/- 105.0
174345 ncm-dbt-02 1459598 50 12 12 26 0.0 +/- 51.34 0 7 11 7 0 -0.0 +/- 105.0
174344 ncm-dbt-04 1444299 50 19 8 23 +77.7 +/- 41.12 0 1 12 12 0 +164.07 +/- 100.82
174343 ncm-dbt-05 1453261 50 16 7 27 +63.21 +/- 48.62 0 2 13 9 1 +115.23 +/- 96.38
174342 ncm-dbt-03 1459597 50 15 7 28 +56.07 +/- 43.2 0 2 13 10 0 +115.23 +/- 96.38
174341 ncm-dbt-02 1463179 50 19 10 21 +63.22 +/- 48.63 0 3 10 12 0 +130.94 +/- 112.59
174340 ncm-dbt-04 1443841 50 12 10 28 +13.9 +/- 54.75 0 7 9 9 0 +27.85 +/- 113.01
174339 ncm-dbt-05 1455445 50 20 7 23 +92.44 +/- 47.1 0 1 11 12 1 +181.7 +/- 107.11
174338 ncm-dbt-03 1459300 50 13 5 32 +56.07 +/- 43.2 0 2 13 10 0 +115.23 +/- 96.38

Commit

Commit ID ef4822aa8d5945d490acca674eb1db8c3c38e9d5
Author xefoci7612
Date 2021-10-31 21:43:38 UTC
Simplify Skill implementation Currently we handle the UCI_Elo with a double randomization. This seems not necessary and a bit involuted. This patch removes the first randomization and unifies the 2 cases. closes https://github.com/official-stockfish/Stockfish/pull/3769 No functional change.
Copyright 2011–2024 Next Chess Move LLC