Dev Builds » 20220108-0744

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:55:44 584730 3990 909 1165 1916 -22.32 ± 5.23 4 596 1049 344 2 -44.48 ± 10.49
ncm-dbt-02 06:55:17 587149 4020 954 1191 1875 -20.51 ± 5.24 6 586 1061 353 4 -40.81 ± 10.43
ncm-dbt-03 06:55:52 586569 3990 882 1112 1996 -20.05 ± 5.22 8 566 1072 346 3 -39.35 ± 10.36
ncm-dbt-04 06:53:42 570697 4000 892 1156 1952 -22.96 ± 5.28 5 610 1030 354 1 -45.42 ± 10.6
ncm-dbt-05 06:55:19 584104 4000 963 1203 1834 -20.87 ± 5.25 7 577 1074 333 9 -42.25 ± 10.35
20000 4600 5827 9573 -21.34 ± 2.35 30 2935 5286 1730 19 -42.46 ± 4.67

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
399603 ncm-dbt-02 590567 20 7 7 6 0.0 ± 48.55 0 1 8 1 0 -0.0 ± 98.89
399602 ncm-dbt-03 587579 490 116 134 240 -12.77 ± 15.3 0 69 126 49 1 -27.0 ± 30.39
399601 ncm-dbt-01 585211 490 117 145 228 -19.87 ± 15.71 1 76 118 50 0 -38.44 ± 31.42
399600 ncm-dbt-05 578342 500 120 152 228 -22.27 ± 14.34 1 69 142 37 1 -44.72 ± 28.29
399599 ncm-dbt-04 568077 500 111 155 234 -30.65 ± 14.94 2 79 130 39 0 -58.93 ± 29.87
399598 ncm-dbt-02 587409 500 109 139 252 -20.87 ± 15.74 3 74 123 50 0 -37.67 ± 30.78
399597 ncm-dbt-03 587792 500 97 139 264 -29.25 ± 14.59 1 78 133 38 0 -57.5 ± 29.47
399596 ncm-dbt-05 587325 500 128 150 222 -15.3 ± 14.96 0 69 137 41 3 -34.86 ± 28.99
399595 ncm-dbt-01 583447 500 102 140 258 -26.45 ± 15.03 1 79 127 43 0 -51.8 ± 30.27
399594 ncm-dbt-04 571230 500 111 148 241 -25.76 ± 14.86 0 80 127 43 0 -51.8 ± 30.27
399593 ncm-dbt-02 586774 500 123 147 230 -16.69 ± 15.19 0 74 127 48 1 -34.86 ± 30.28
399592 ncm-dbt-03 587070 500 101 144 255 -29.95 ± 16.22 1 92 106 51 0 -58.93 ± 32.91
399591 ncm-dbt-01 585464 500 128 135 237 -4.86 ± 14.35 1 55 145 48 1 -9.73 ± 27.97
399590 ncm-dbt-05 587622 500 119 141 240 -15.3 ± 14.84 0 70 133 46 1 -32.05 ± 29.52
399589 ncm-dbt-04 571994 500 125 146 229 -14.6 ± 14.53 0 68 135 47 0 -29.25 ± 29.26
399588 ncm-dbt-02 586985 500 124 156 220 -22.27 ± 15.6 2 76 125 46 1 -43.3 ± 30.53
399587 ncm-dbt-03 584453 500 117 137 246 -13.9 ± 15.22 4 60 139 46 1 -23.66 ± 28.75
399586 ncm-dbt-01 586604 500 101 141 258 -27.85 ± 15.37 0 86 118 46 0 -56.07 ± 31.42
399585 ncm-dbt-05 584201 500 120 152 228 -22.26 ± 14.48 2 68 140 40 0 -41.89 ± 28.57
399584 ncm-dbt-04 571752 500 110 145 245 -24.36 ± 15.13 0 80 126 43 1 -50.38 ± 30.4
399583 ncm-dbt-02 586689 500 122 145 233 -15.99 ± 13.16 0 59 155 36 0 -32.05 ± 26.53
399582 ncm-dbt-03 586858 500 117 135 248 -12.51 ± 14.99 1 67 131 51 0 -23.66 ± 29.78
399581 ncm-dbt-01 584706 500 123 147 230 -16.69 ± 14.44 0 68 139 42 1 -34.86 ± 28.73
399580 ncm-dbt-05 583405 500 118 159 223 -28.55 ± 14.28 2 72 141 35 0 -54.65 ± 28.39
399579 ncm-dbt-02 583656 500 119 148 233 -20.18 ± 15.08 0 76 128 45 1 -41.89 ± 30.15
399578 ncm-dbt-04 570348 500 101 142 257 -28.55 ± 15.66 2 83 119 46 0 -54.65 ± 31.29
399577 ncm-dbt-03 584495 500 119 148 233 -20.17 ± 14.19 0 70 139 41 0 -40.48 ± 28.71
399576 ncm-dbt-01 586350 500 112 157 231 -31.35 ± 14.07 0 79 137 34 0 -63.23 ± 28.9
399575 ncm-dbt-05 580779 500 127 138 235 -7.64 ± 16.16 1 70 121 55 3 -18.08 ± 31.02
399574 ncm-dbt-02 584453 500 123 143 234 -13.9 ± 14.47 1 64 139 46 0 -26.46 ± 28.74
399573 ncm-dbt-04 568792 500 114 136 250 -15.3 ± 14.71 1 67 135 47 0 -29.25 ± 29.26
399572 ncm-dbt-01 582110 500 118 151 231 -22.96 ± 14.4 0 74 135 41 0 -46.13 ± 29.23
399571 ncm-dbt-05 582903 500 106 160 234 -37.67 ± 14.35 0 87 130 33 0 -76.25 ± 29.82
399570 ncm-dbt-03 587919 500 103 139 258 -25.06 ± 13.48 1 66 151 32 0 -48.96 ± 27.01
399569 ncm-dbt-02 586985 500 106 156 238 -34.86 ± 15.08 0 89 123 37 1 -71.89 ± 30.78
399568 ncm-dbt-04 571351 500 109 145 246 -25.06 ± 14.29 0 75 136 39 0 -50.38 ± 29.09
399567 ncm-dbt-03 586393 500 112 136 252 -16.69 ± 13.91 0 64 147 38 1 -34.86 ± 27.64
399566 ncm-dbt-02 590825 500 121 150 229 -20.17 ± 14.58 0 73 133 44 0 -40.48 ± 29.51
399565 ncm-dbt-05 588260 500 125 151 224 -18.08 ± 15.17 1 72 130 46 1 -36.26 ± 29.9
399564 ncm-dbt-01 583950 500 108 149 243 -28.55 ± 14.79 1 79 130 40 0 -56.07 ± 29.87
399563 ncm-dbt-04 572034 500 111 139 250 -19.48 ± 15.28 0 78 122 50 0 -39.08 ± 30.91

Commit

Commit ID 9ad0ea73825bf463e842fb1fd41b5acaa8a1cfe1
Author Joost VandeVondele
Date 2022-01-08 07:44:49 UTC
Tune a few parameters related to evaluation based on a SPSA tune (using Autoselect) https://tests.stockfishchess.org/tests/view/61d5aa63a314fed318a57046 passed STC: LLR: 2.93 (-2.94,2.94) <0.00,2.50> Total: 61960 W: 16640 L: 16316 D: 29004 Ptnml(0-2): 278, 6934, 16204, 7314, 250 https://tests.stockfishchess.org/tests/view/61d7fe4af5fd40f357469a8d passed LTC: LLR: 2.97 (-2.94,2.94) <0.50,3.00> Total: 79408 W: 21994 L: 21618 D: 35796 Ptnml(0-2): 106, 7887, 23331, 8285, 95 https://tests.stockfishchess.org/tests/view/61d836b7f5fd40f35746a3d5 closes https://github.com/official-stockfish/Stockfish/pull/3883 Bench: 4266621
Copyright 2011–2025 Next Chess Move LLC