Dev Builds » 20220102-1649

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:53:18 1147688 3342 1237 503 1602 +77.57 +/- 5.81 2 121 724 789 35 +155.34 +/- 12.65
ncm-dbt-02 09:50:33 1260159 3328 1199 506 1623 +73.42 +/- 5.91 2 143 710 778 31 +146.79 +/- 12.79
ncm-dbt-03 09:55:45 1273206 3318 1182 475 1661 +75.18 +/- 5.91 1 132 725 761 40 +148.29 +/- 12.64
ncm-dbt-04 09:55:43 1257120 3344 1230 534 1580 +73.39 +/- 5.95 1 142 732 754 43 +143.54 +/- 12.59
ncm-dbt-05 09:49:58 1220333 3310 1205 528 1577 +72.08 +/- 5.96 2 144 719 755 35 +142.72 +/- 12.7
ncm-dbt-06 09:55:43 1259924 3358 1194 481 1683 +74.91 +/- 5.82 1 134 728 783 33 +149.51 +/- 12.62
20000 7247 3027 9726 +74.43 +/- 2.41 9 816 4338 4620 217 +147.69 +/- 5.17

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
205978 ncm-dbt-03 1222253 156 51 26 79 +56.16 +/- 30.13 1 8 37 29 3 +105.58 +/- 56.56
205977 ncm-dbt-02 1239650 162 51 32 79 +40.94 +/- 25.1 0 10 42 29 0 +83.04 +/- 52.76
205976 ncm-dbt-01 1102311 172 58 24 90 +69.6 +/- 26.94 1 5 42 35 3 +135.8 +/- 52.63
205975 ncm-dbt-04 1213748 176 62 26 88 +72.08 +/- 26.62 0 10 33 44 1 +146.25 +/- 59.78
205974 ncm-dbt-06 1215437 188 66 29 93 +69.28 +/- 25.17 1 6 44 41 2 +140.21 +/- 51.63
205973 ncm-dbt-05 1241598 368 142 57 169 +81.72 +/- 17.69 0 12 81 85 6 +159.51 +/- 37.94
205972 ncm-dbt-03 1232074 500 178 68 254 +77.7 +/- 16.05 0 23 103 115 9 +148.85 +/- 33.7
205971 ncm-dbt-02 1229258 500 185 80 235 +74.06 +/- 15.15 0 22 105 119 4 +148.85 +/- 33.38
205970 ncm-dbt-01 1101258 500 168 76 256 +64.66 +/- 14.94 0 24 113 110 3 +129.35 +/- 32.14
205969 ncm-dbt-04 1226095 500 180 87 233 +65.38 +/- 15.1 0 23 116 106 5 +127.76 +/- 31.68
205968 ncm-dbt-06 1230426 500 184 68 248 +82.1 +/- 15.66 0 22 96 126 6 +164.07 +/- 34.9
205967 ncm-dbt-05 1235271 500 183 81 236 +71.88 +/- 14.53 0 19 113 115 3 +145.54 +/- 32.08
205966 ncm-dbt-03 1250960 500 181 67 252 +80.63 +/- 14.09 0 12 117 116 5 +162.35 +/- 31.23
205965 ncm-dbt-02 1232316 500 164 75 261 +62.51 +/- 14.85 0 24 116 107 3 +124.6 +/- 31.69
205964 ncm-dbt-01 1096505 500 187 69 244 +83.57 +/- 14.74 1 15 102 129 3 +174.55 +/- 33.86
205963 ncm-dbt-06 1227037 500 174 71 255 +72.61 +/- 15.37 0 23 106 116 5 +143.89 +/- 33.22
205962 ncm-dbt-04 1228214 500 195 77 228 +83.57 +/- 15.3 1 11 118 109 11 +160.64 +/- 31.07
205961 ncm-dbt-05 1247194 500 196 84 220 +79.17 +/- 16.23 0 20 111 106 13 +145.54 +/- 32.41
205960 ncm-dbt-01 1094015 500 188 93 219 +66.82 +/- 16.05 0 29 103 112 6 +129.35 +/- 33.64
205959 ncm-dbt-03 1253211 500 182 76 242 +74.79 +/- 15.57 0 25 98 123 4 +150.51 +/- 34.5
205958 ncm-dbt-02 1241020 500 178 79 243 +69.71 +/- 15.53 1 22 109 113 5 +138.99 +/- 32.74
205957 ncm-dbt-06 1226549 500 181 77 242 +73.33 +/- 14.85 0 17 119 107 7 +142.26 +/- 31.1
205956 ncm-dbt-04 1218305 500 170 85 245 +59.64 +/- 15.76 0 31 107 108 4 +116.78 +/- 33.01
205955 ncm-dbt-05 1256393 500 182 79 239 +72.61 +/- 14.97 0 24 100 125 1 +150.51 +/- 34.19
205954 ncm-dbt-01 1099616 500 189 72 239 +82.83 +/- 14.86 0 15 110 118 7 +164.07 +/- 32.48
205953 ncm-dbt-02 1216043 500 181 74 245 +75.52 +/- 15.33 0 21 107 116 6 +148.85 +/- 33.05
205952 ncm-dbt-03 1254457 500 175 73 252 +71.88 +/- 14.8 0 19 115 111 5 +142.26 +/- 31.77
205951 ncm-dbt-06 1229402 500 184 77 239 +75.52 +/- 14.93 0 20 107 119 4 +152.18 +/- 33.05
205950 ncm-dbt-04 1224015 500 183 80 237 +72.61 +/- 14.83 0 20 111 115 4 +145.54 +/- 32.41
205949 ncm-dbt-05 1222078 500 180 84 236 +67.55 +/- 14.78 1 20 113 114 2 +138.99 +/- 32.11
205948 ncm-dbt-02 1220430 500 186 64 250 +86.52 +/- 14.81 0 14 107 122 7 +172.78 +/- 32.96
205947 ncm-dbt-01 1099965 500 189 74 237 +81.36 +/- 14.54 0 15 110 120 5 +164.07 +/- 32.48
205946 ncm-dbt-06 1229385 500 173 60 267 +79.9 +/- 14.5 0 15 112 118 5 +160.64 +/- 32.15
205945 ncm-dbt-03 1241451 500 173 65 262 +76.25 +/- 15.35 0 22 103 120 5 +152.18 +/- 33.71
205944 ncm-dbt-04 1222104 500 184 86 230 +68.99 +/- 14.97 0 18 124 100 8 +130.94 +/- 30.38
205943 ncm-dbt-05 842284 500 172 77 251 +66.82 +/- 15.8 1 25 107 112 5 +132.54 +/- 33.05
205942 ncm-dbt-01 1087540 500 195 73 232 +86.52 +/- 14.95 0 15 105 123 7 +172.78 +/- 33.32
205941 ncm-dbt-05 1212974 278 91 40 147 +64.46 +/- 20.98 0 15 61 60 3 +125.12 +/- 43.91
205940 ncm-dbt-02 1198947 500 197 79 224 +83.57 +/- 15.96 1 21 93 129 6 +169.27 +/- 35.43
205939 ncm-dbt-06 1214541 500 172 73 255 +69.71 +/- 14.86 0 22 110 115 3 +140.62 +/- 32.58
205938 ncm-dbt-03 1233139 500 180 78 242 +71.88 +/- 15.47 0 21 114 107 8 +137.37 +/- 31.96
205937 ncm-dbt-04 1235573 500 186 73 241 +79.9 +/- 15.73 0 23 97 124 6 +158.93 +/- 34.71
177589 ncm-dbt-05 1504872 164 59 26 79 +70.87 +/- 28.02 0 9 33 38 2 +138.2 +/- 60.0
177588 ncm-dbt-03 1498107 162 62 22 78 +87.59 +/- 22.98 0 2 38 40 1 +182.37 +/- 54.62
177587 ncm-dbt-02 1503611 166 57 23 86 +72.18 +/- 26.48 0 9 31 43 0 +151.2 +/- 61.8
177586 ncm-dbt-01 1500298 170 63 22 85 +85.47 +/- 23.03 0 3 39 42 1 +177.48 +/- 54.37
177585 ncm-dbt-04 1488907 168 70 20 78 +106.62 +/- 28.29 0 6 26 48 4 +213.66 +/- 67.94
177584 ncm-dbt-06 1506619 170 60 26 84 +70.43 +/- 26.58 0 9 34 41 1 +142.35 +/- 59.11

Commit

Commit ID 0b41887527f1d7264ee5644dfa53e00ab64441b1
Author lonfom169
Date 2022-01-02 16:49:44 UTC
Simplify away rangeReduction Remove rangeReduction, introduced in [#3717](https://github.com/official-stockfish/Stockfish/pull/3717), as it seemingly doesn't bring enough ELO anymore. It might be interesting to add new forms of reduction or tune the reduction formula in the future. STC: LLR: 2.95 (-2.94,2.94) <-2.25,0.25> Total: 45008 W: 12114 L: 11972 D: 20922 Ptnml(0-2): 174, 5031, 11952, 5173, 174 https://tests.stockfishchess.org/tests/view/61d08b7b069ca917749c9f6f LTC: LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 30792 W: 8235 L: 8086 D: 14471 Ptnml(0-2): 24, 3162, 8882, 3297, 31 https://tests.stockfishchess.org/tests/view/61d0a6ad069ca917749ca420 closes https://github.com/official-stockfish/Stockfish/pull/3878 Bench: 4048312
Copyright 2011–2024 Next Chess Move LLC