Dev Builds » 20220108-0744

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:43:43 1264419 3258 1152 475 1631 +73.26 +/- 6.05 1 150 681 765 32 +145.77 +/- 13.06
ncm-dbt-02 10:00:10 1311927 3322 1178 496 1648 +72.36 +/- 5.82 1 136 734 760 30 +144.36 +/- 12.56
ncm-dbt-03 10:06:57 1316201 3376 1203 494 1679 +74.07 +/- 5.87 5 129 743 774 37 +147.63 +/- 12.48
ncm-dbt-04 10:06:12 1308791 3350 1231 498 1621 +77.27 +/- 5.82 2 130 706 807 30 +155.92 +/- 12.82
ncm-dbt-05 10:02:21 1308491 3328 1185 538 1605 +68.42 +/- 5.79 2 145 743 752 22 +137.7 +/- 12.49
ncm-dbt-06 10:06:08 1310992 3366 1209 482 1675 +76.24 +/- 5.88 1 131 734 774 43 +150.1 +/- 12.56
20000 7158 2983 9859 +73.61 +/- 2.4 12 821 4341 4632 194 +146.9 +/- 5.17

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
187842 ncm-dbt-02 1218121 144 50 20 74 +73.45 +/- 29.54 0 8 27 36 1 +148.34 +/- 66.35
187841 ncm-dbt-05 1218633 152 52 31 69 +48.3 +/- 29.39 0 12 32 31 1 +93.63 +/- 60.65
187840 ncm-dbt-01 1224494 158 61 25 72 +80.57 +/- 27.94 0 6 34 36 3 +154.58 +/- 59.2
187839 ncm-dbt-04 1232673 174 62 26 86 +72.93 +/- 24.95 0 7 38 41 1 +148.14 +/- 55.89
187838 ncm-dbt-06 1232952 184 76 29 79 +90.76 +/- 26.62 1 4 38 45 4 +180.92 +/- 55.9
187837 ncm-dbt-03 1230247 188 53 22 113 +57.81 +/- 20.68 0 4 56 33 1 +114.9 +/- 43.29
187836 ncm-dbt-01 1189287 500 178 76 246 +71.88 +/- 15.47 0 23 108 113 6 +140.62 +/- 32.9
187835 ncm-dbt-05 1237316 500 187 80 233 +75.52 +/- 15.98 2 21 100 122 5 +153.86 +/- 34.2
187834 ncm-dbt-02 1221658 500 173 77 250 +67.54 +/- 14.51 0 19 120 107 4 +134.15 +/- 31.01
187833 ncm-dbt-04 1222323 500 177 71 252 +74.79 +/- 15.04 1 19 106 121 3 +153.86 +/- 33.21
187832 ncm-dbt-06 1199153 500 175 65 260 +77.7 +/- 15.66 0 22 103 118 7 +152.18 +/- 33.71
187831 ncm-dbt-03 1238062 500 175 84 241 +63.94 +/- 15.3 0 28 105 115 2 +129.35 +/- 33.34
187830 ncm-dbt-01 1193177 500 190 72 238 +83.57 +/- 14.88 0 17 103 125 5 +169.27 +/- 33.7
187829 ncm-dbt-05 1234652 500 184 79 237 +74.06 +/- 15.01 0 20 110 115 5 +147.19 +/- 32.57
187828 ncm-dbt-02 1229770 500 179 66 255 +79.9 +/- 14.92 0 16 112 115 7 +157.24 +/- 32.18
187827 ncm-dbt-04 1241407 500 169 78 253 +63.94 +/- 15.43 0 28 106 113 3 +127.76 +/- 33.19
187826 ncm-dbt-06 1233278 500 174 78 248 +67.54 +/- 14.92 0 22 114 110 4 +134.15 +/- 31.97
187825 ncm-dbt-03 1241945 500 176 71 253 +74.06 +/- 16.56 2 26 92 125 5 +150.51 +/- 35.44
187824 ncm-dbt-01 1150158 500 174 70 256 +73.33 +/- 15.78 0 25 102 117 6 +143.89 +/- 33.85
187823 ncm-dbt-05 1218668 500 177 78 245 +69.71 +/- 15.0 0 25 102 122 1 +143.89 +/- 33.85
187822 ncm-dbt-02 1218738 500 178 71 251 +75.52 +/- 14.51 0 16 116 113 5 +150.51 +/- 31.54
187821 ncm-dbt-04 1235091 500 199 76 225 +87.26 +/- 14.1 0 10 113 121 6 +176.33 +/- 31.78
187820 ncm-dbt-06 1236584 500 188 70 242 +83.57 +/- 14.6 0 15 107 123 5 +169.27 +/- 32.98
187819 ncm-dbt-03 1225607 500 181 66 253 +81.36 +/- 14.4 0 16 106 125 3 +167.53 +/- 33.17
187818 ncm-dbt-01 1182075 500 166 76 258 +63.23 +/- 15.66 0 30 103 114 3 +126.18 +/- 33.63
187817 ncm-dbt-05 1222046 500 174 94 232 +56.07 +/- 14.56 0 24 125 98 3 +110.6 +/- 30.39
187816 ncm-dbt-02 1232643 500 181 85 234 +67.54 +/- 15.83 0 27 106 111 6 +130.94 +/- 33.2
187815 ncm-dbt-04 1217044 500 180 75 245 +74.06 +/- 15.28 0 22 106 117 5 +147.19 +/- 33.22
187814 ncm-dbt-06 1224351 500 174 73 253 +71.16 +/- 15.84 0 26 103 115 6 +138.99 +/- 33.68
187813 ncm-dbt-03 1245183 500 185 73 242 +79.17 +/- 15.84 2 17 105 119 7 +158.93 +/- 33.37
187812 ncm-dbt-01 1175638 500 176 72 252 +73.33 +/- 15.78 0 26 99 120 5 +145.54 +/- 34.32
187811 ncm-dbt-02 1231186 500 172 72 256 +70.44 +/- 15.16 1 22 105 120 2 +145.54 +/- 33.38
187810 ncm-dbt-05 1230322 500 164 74 262 +63.23 +/- 14.34 0 20 123 104 3 +126.18 +/- 30.59
187809 ncm-dbt-04 1256639 500 183 67 250 +82.1 +/- 14.84 0 16 108 120 6 +164.07 +/- 32.83
187808 ncm-dbt-06 1241687 500 170 78 252 +64.66 +/- 14.53 0 18 128 98 6 +124.6 +/- 29.8
187807 ncm-dbt-03 1228203 500 181 80 239 +71.16 +/- 15.58 0 19 122 98 11 +130.94 +/- 30.71
187806 ncm-dbt-01 1185853 500 172 70 258 +71.88 +/- 14.8 0 21 109 117 3 +145.54 +/- 32.74
187805 ncm-dbt-05 1205256 500 179 76 245 +72.61 +/- 14.55 0 18 115 113 4 +145.54 +/- 31.75
187804 ncm-dbt-02 1247253 500 180 75 245 +74.06 +/- 14.88 0 20 109 117 4 +148.85 +/- 32.73
187803 ncm-dbt-04 1203581 500 194 80 226 +80.63 +/- 15.35 1 19 99 127 4 +165.8 +/- 34.39
187802 ncm-dbt-03 1234267 500 179 69 252 +77.71 +/- 14.72 1 13 117 113 6 +155.54 +/- 31.31
187801 ncm-dbt-06 1228889 500 189 67 244 +86.52 +/- 16.04 0 20 98 122 10 +167.53 +/- 34.57
174125 ncm-dbt-04 1446615 26 12 4 10 +110.42 +/- 66.25 0 0 6 6 1 +209.09 +/- 147.9
174124 ncm-dbt-02 1452803 28 12 4 12 +102.07 +/- 73.55 0 1 5 7 1 +190.85 +/- 175.35
174123 ncm-dbt-05 1456478 26 11 4 11 +95.87 +/- 51.28 0 0 6 7 0 +209.09 +/- 147.9
174122 ncm-dbt-06 1451612 32 13 5 14 +88.71 +/- 65.11 0 1 7 7 1 +162.99 +/- 139.28
174121 ncm-dbt-03 1460196 38 20 8 10 +113.56 +/- 58.5 0 0 9 8 2 +203.22 +/- 115.24
174120 ncm-dbt-04 1445746 50 17 9 24 +56.07 +/- 47.61 0 3 11 11 0 +115.23 +/- 106.91
174119 ncm-dbt-02 1452968 50 20 7 23 +92.45 +/- 47.1 0 2 8 15 0 +200.24 +/- 129.69
174118 ncm-dbt-06 1456480 50 16 8 26 +56.07 +/- 47.61 0 3 11 11 0 +115.23 +/- 106.91
174117 ncm-dbt-01 1445055 0 0 0 0 -0.0 +/- 1199.83 0 0 0 0 0 -0.0 +/- 1199.83
174116 ncm-dbt-05 1454708 50 18 8 24 +70.43 +/- 45.16 0 2 11 12 0 +147.19 +/- 107.43
174115 ncm-dbt-03 1458704 50 18 5 27 +92.45 +/- 42.2 0 1 10 14 0 +200.24 +/- 114.26
174114 ncm-dbt-02 1464227 50 15 8 27 +48.96 +/- 42.0 0 2 14 9 0 +99.95 +/- 91.41
174113 ncm-dbt-01 1456486 50 16 8 26 +56.08 +/- 55.43 1 2 10 12 0 +130.94 +/- 112.59
174112 ncm-dbt-06 1455443 50 17 5 28 +85.03 +/- 36.28 0 0 13 12 0 +181.68 +/- 91.94
174111 ncm-dbt-05 1458705 50 21 7 22 +99.93 +/- 36.88 0 0 11 14 0 +219.84 +/- 104.3
174110 ncm-dbt-03 1460937 50 19 9 22 +70.43 +/- 49.53 0 3 9 13 0 +147.19 +/- 118.91
174109 ncm-dbt-04 1448530 50 19 6 25 +92.45 +/- 51.57 0 3 6 16 0 +200.24 +/- 144.55
174102 ncm-dbt-02 1461833 50 18 11 21 +48.96 +/- 46.46 0 3 12 10 0 +99.95 +/- 101.68
174101 ncm-dbt-05 1456626 50 18 7 25 +77.7 +/- 50.32 0 3 8 14 0 +164.07 +/- 126.09
174100 ncm-dbt-06 1460490 50 17 4 29 +92.44 +/- 36.68 0 0 12 13 0 +200.21 +/- 97.77
174099 ncm-dbt-04 1447055 50 19 6 25 +92.44 +/- 55.7 0 3 7 14 1 +181.7 +/- 134.48
174098 ncm-dbt-03 1454861 50 16 7 27 +63.22 +/- 44.25 0 2 12 11 0 +130.94 +/- 101.68
174097 ncm-dbt-01 1441968 50 19 6 25 +92.43 +/- 42.19 0 0 13 11 1 +181.68 +/- 91.94

Commit

Commit ID 9ad0ea73825bf463e842fb1fd41b5acaa8a1cfe1
Author Joost VandeVondele
Date 2022-01-08 07:44:49 UTC
Tune a few parameters related to evaluation based on a SPSA tune (using Autoselect) https://tests.stockfishchess.org/tests/view/61d5aa63a314fed318a57046 passed STC: LLR: 2.93 (-2.94,2.94) <0.00,2.50> Total: 61960 W: 16640 L: 16316 D: 29004 Ptnml(0-2): 278, 6934, 16204, 7314, 250 https://tests.stockfishchess.org/tests/view/61d7fe4af5fd40f357469a8d passed LTC: LLR: 2.97 (-2.94,2.94) <0.50,3.00> Total: 79408 W: 21994 L: 21618 D: 35796 Ptnml(0-2): 106, 7887, 23331, 8285, 95 https://tests.stockfishchess.org/tests/view/61d836b7f5fd40f35746a3d5 closes https://github.com/official-stockfish/Stockfish/pull/3883 Bench: 4266621
Copyright 2011–2024 Next Chess Move LLC