Dev Builds » 20211129-1156

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:55:17 1149580 3320 1138 535 1647 +63.81 +/- 5.87 3 165 735 740 17 +128.88 +/- 12.57
ncm-dbt-02 09:51:38 1265349 3318 1115 535 1668 +61.36 +/- 5.74 1 164 760 722 12 +124.2 +/- 12.35
ncm-dbt-03 09:55:18 1271663 3354 1157 550 1647 +63.58 +/- 5.81 0 167 759 728 23 +126.27 +/- 12.36
ncm-dbt-04 09:55:26 1257629 3342 1154 536 1652 +65.0 +/- 5.81 2 158 751 740 20 +130.57 +/- 12.43
ncm-dbt-05 09:52:55 1264574 3316 1127 525 1664 +63.78 +/- 5.56 0 143 778 729 8 +130.25 +/- 12.18
ncm-dbt-06 09:56:07 1259898 3350 1147 524 1679 +65.37 +/- 5.79 4 142 785 715 29 +129.75 +/- 12.13
20000 6838 3205 9957 +63.82 +/- 2.35 10 939 4568 4374 109 +128.32 +/- 5.03

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
206700 ncm-dbt-05 1243067 146 47 25 74 +52.75 +/- 25.92 0 7 37 29 0 +108.06 +/- 56.22
206699 ncm-dbt-02 1233970 150 50 24 76 +60.83 +/- 28.54 0 9 32 33 1 +120.41 +/- 60.97
206698 ncm-dbt-01 1102596 154 48 29 77 +43.08 +/- 25.57 0 7 46 22 2 +77.99 +/- 48.9
206697 ncm-dbt-04 1220859 178 54 38 86 +31.31 +/- 25.37 0 15 43 31 0 +63.15 +/- 52.35
206696 ncm-dbt-06 1233773 182 70 23 89 +91.8 +/- 25.0 0 6 34 49 2 +188.31 +/- 59.38
206695 ncm-dbt-03 1247793 190 62 26 102 +66.63 +/- 24.81 0 10 40 44 1 +134.32 +/- 54.44
206694 ncm-dbt-05 1206853 500 165 80 255 +59.64 +/- 13.17 0 14 139 95 2 +119.89 +/- 28.04
206693 ncm-dbt-02 1240325 500 159 75 266 +58.93 +/- 14.56 0 24 120 104 2 +118.33 +/- 31.1
206692 ncm-dbt-01 1099754 500 172 89 239 +58.21 +/- 14.93 1 24 118 105 2 +118.33 +/- 31.4
206691 ncm-dbt-04 1225927 500 180 74 246 +74.79 +/- 14.49 0 17 114 115 4 +150.51 +/- 31.88
206690 ncm-dbt-06 1203454 500 148 81 271 +46.84 +/- 15.01 0 31 124 92 3 +90.97 +/- 30.61
206689 ncm-dbt-03 1239385 500 173 74 253 +69.71 +/- 15.13 0 24 106 117 3 +140.62 +/- 33.22
206688 ncm-dbt-05 1225000 500 161 77 262 +58.93 +/- 14.69 0 26 115 108 1 +119.89 +/- 31.85
206687 ncm-dbt-02 1237698 500 178 83 239 +66.82 +/- 15.16 0 24 111 111 4 +132.54 +/- 32.44
206686 ncm-dbt-01 1095435 500 168 84 248 +58.93 +/- 15.6 0 33 101 115 1 +119.89 +/- 33.88
206685 ncm-dbt-04 1218309 500 158 79 263 +55.36 +/- 15.94 1 32 107 107 3 +110.6 +/- 32.99
206684 ncm-dbt-06 1228682 500 187 73 240 +80.63 +/- 15.08 1 15 109 119 6 +162.35 +/- 32.67
206683 ncm-dbt-03 1231562 500 174 87 239 +61.07 +/- 14.92 0 26 113 109 2 +123.02 +/- 32.15
206682 ncm-dbt-02 1234947 500 164 87 249 +53.94 +/- 14.05 1 21 128 100 0 +112.14 +/- 29.92
206681 ncm-dbt-05 1259542 500 182 64 254 +83.57 +/- 13.41 0 12 108 130 0 +178.11 +/- 32.72
206680 ncm-dbt-01 1090914 500 176 67 257 +76.97 +/- 14.27 0 18 106 125 1 +160.64 +/- 33.2
206679 ncm-dbt-04 1218590 500 175 86 239 +62.51 +/- 15.37 0 29 105 114 2 +126.18 +/- 33.33
206678 ncm-dbt-06 1249100 500 164 78 258 +60.36 +/- 14.21 0 19 130 97 4 +118.33 +/- 29.54
206677 ncm-dbt-03 1223597 500 174 80 246 +66.1 +/- 13.89 0 17 124 107 2 +134.15 +/- 30.35
206676 ncm-dbt-05 1233717 500 164 95 241 +48.25 +/- 14.7 0 30 122 97 1 +96.94 +/- 30.88
206675 ncm-dbt-02 1238454 500 171 71 258 +70.43 +/- 15.16 0 25 102 121 2 +143.89 +/- 33.85
206674 ncm-dbt-01 1101146 500 175 84 241 +63.94 +/- 15.56 0 26 113 105 6 +123.02 +/- 32.15
206673 ncm-dbt-04 1234028 500 173 80 247 +65.38 +/- 14.28 1 18 119 111 1 +135.76 +/- 31.16
206672 ncm-dbt-06 1240104 500 168 87 245 +56.78 +/- 14.73 1 24 119 105 1 +116.78 +/- 31.26
206671 ncm-dbt-03 1230339 500 191 94 215 +68.27 +/- 15.86 0 25 111 106 8 +129.35 +/- 32.44
206670 ncm-dbt-02 1223396 500 165 86 249 +55.36 +/- 15.19 0 32 107 111 0 +113.68 +/- 33.0
206669 ncm-dbt-01 1109483 500 168 82 250 +60.36 +/- 15.54 0 30 107 110 3 +119.89 +/- 33.02
206668 ncm-dbt-05 1227004 500 182 69 249 +79.9 +/- 15.06 0 21 98 128 3 +164.07 +/- 34.56
206667 ncm-dbt-04 1228747 500 185 81 234 +73.33 +/- 15.91 0 25 103 115 7 +142.26 +/- 33.69
206666 ncm-dbt-03 1238188 500 167 77 256 +63.23 +/- 14.88 0 23 118 105 4 +124.6 +/- 31.38
206665 ncm-dbt-06 1213587 500 188 70 242 +83.57 +/- 14.88 0 15 109 119 7 +165.8 +/- 32.64
206664 ncm-dbt-02 1227882 500 177 88 235 +62.51 +/- 14.17 0 19 126 102 3 +124.6 +/- 30.12
206663 ncm-dbt-05 1234465 500 165 87 248 +54.64 +/- 14.76 0 28 117 104 1 +110.6 +/- 31.57
206662 ncm-dbt-04 1231377 500 175 76 249 +69.71 +/- 14.03 0 18 116 115 1 +143.89 +/- 31.59
206661 ncm-dbt-01 1086554 500 176 77 247 +69.71 +/- 15.13 2 19 109 118 2 +145.54 +/- 32.74
206660 ncm-dbt-03 1256306 500 158 87 255 +49.67 +/- 15.79 0 36 110 101 3 +96.94 +/- 32.54
206659 ncm-dbt-06 1215348 500 163 87 250 +53.22 +/- 15.47 0 29 122 93 6 +99.95 +/- 30.87
177721 ncm-dbt-02 1486126 168 51 21 96 +62.71 +/- 26.3 0 10 34 40 0 +129.8 +/- 59.02
177720 ncm-dbt-03 1506136 164 58 25 81 +70.88 +/- 24.42 0 6 37 39 0 +148.2 +/- 56.54
177719 ncm-dbt-01 1510763 166 55 23 88 +67.82 +/- 25.5 0 8 35 40 0 +141.25 +/- 58.33
177718 ncm-dbt-05 1486948 170 61 28 81 +68.31 +/- 22.91 0 5 42 38 0 +142.35 +/- 52.4
177717 ncm-dbt-06 1495141 168 59 25 84 +71.3 +/- 26.19 2 3 38 41 0 +159.18 +/- 55.64
177716 ncm-dbt-04 1483201 164 54 22 88 +68.67 +/- 24.28 0 4 44 32 2 +133.29 +/- 50.33

Commit

Commit ID e4a0c6c75950bf27b6dc32490a1102499643126b
Author Joost VandeVondele
Date 2021-11-29 11:56:01 UTC
Update default net to nn-4f56ecfca5b7.nnue New net trained with nnue-pytorch, started from a master net on a data set of Leela (T60.binpack+T74.binpck) Stockfish data (wrongIsRight_nodes5000pv2.binpack), and Michael Babigian's conversion of T60 Leela data (including TB7 rescoring) (farseer.binpack) available as a single interleaved binpack: https://drive.google.com/file/d/1_sQoWBl31WAxNXma2v45004CIVltytP8/view?usp=sharing The nnue-pytorch branch used is https://github.com/vondele/nnue-pytorch/tree/wdl passed STC: https://tests.stockfishchess.org/tests/view/61a3cc729f0c43dae1c71f1b LLR: 2.95 (-2.94,2.94) <0.00,2.50> Total: 49152 W: 12842 L: 12544 D: 23766 Ptnml(0-2): 154, 5542, 12904, 5804, 172 passed LTC: https://tests.stockfishchess.org/tests/view/61a43c6260afd064f2d724f1 LLR: 2.96 (-2.94,2.94) <0.50,3.00> Total: 25528 W: 6676 L: 6425 D: 12427 Ptnml(0-2): 9, 2593, 7315, 2832, 15 closes https://github.com/official-stockfish/Stockfish/pull/3816 Bench: 6885242
Copyright 2011–2024 Next Chess Move LLC