Dev Builds » 20180611-0754

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 05:47:12 2001591 2244 1095 73 1076 +170.78 +/- 10.15
ncm-et-4 05:47:07 2001975 2237 1141 70 1026 +181.15 +/- 10.44
ncm-et-6 03:37:12 2023977 1429 704 40 685 +174.84 +/- 12.69
ncm-et-7 01:28:03 2024429 570 261 22 287 +155.25 +/- 19.63
ncm-et-9 08:20:23 2007605 3261 1621 104 1536 +175.08 +/- 8.51
ncm-et-10 08:20:40 1990388 3221 1626 85 1510 +180.99 +/- 8.56
ncm-et-12 04:01:24 2019048 1566 782 31 753 +181.51 +/- 12.03
ncm-et-13 05:47:24 2000397 2255 1150 72 1033 +180.82 +/- 10.41
ncm-et-15 08:20:22 1993339 3217 1612 96 1509 +177.77 +/- 8.58
20000 9992 593 9415 +177.19 +/- 3.43

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
49980 ncm-et-10 2018-08-16 08:11 00:22:23 1980754 146 74 5 67 +178.38 +/- 41.22
49979 ncm-et-15 2018-08-16 08:09 00:24:24 1949813 147 74 4 69 +179.99 +/- 40.34
49978 ncm-et-3 2018-08-16 08:08 00:25:43 1988297 164 81 4 79 +177.0 +/- 37.47
49977 ncm-et-4 2018-08-16 08:06 00:27:06 1989559 170 85 7 78 +172.27 +/- 38.29
49976 ncm-et-13 2018-08-16 08:05 00:28:23 1984995 183 102 10 71 +192.12 +/- 40.7
49975 ncm-et-9 2018-08-16 08:04 00:29:39 1991456 190 92 10 88 +160.46 +/- 36.15
49974 ncm-et-10 2018-08-16 06:51 01:18:29 1980130 500 251 13 236 +179.9 +/- 21.66
49973 ncm-et-15 2018-08-16 06:51 01:17:02 1983419 500 264 12 224 +192.71 +/- 22.34
49972 ncm-et-3 2018-08-16 06:49 01:17:55 1988139 500 259 12 229 +188.08 +/- 22.04
49971 ncm-et-13 2018-08-16 06:48 01:15:40 1989243 500 265 13 222 +192.71 +/- 22.49
49970 ncm-et-4 2018-08-16 06:48 01:17:21 1989089 500 251 16 233 +177.22 +/- 21.92
49969 ncm-et-9 2018-08-16 06:46 01:16:03 1991139 500 252 14 234 +179.9 +/- 21.81
49968 ncm-et-15 2018-08-16 05:31 01:18:14 1979659 500 250 13 237 +179.0 +/- 21.61
49967 ncm-et-10 2018-08-16 05:31 01:19:17 1942054 500 247 14 239 +175.44 +/- 21.52
49966 ncm-et-13 2018-08-16 05:30 01:16:48 1990506 500 249 8 243 +182.61 +/- 21.1
49965 ncm-et-3 2018-08-16 05:30 01:17:45 1991141 500 247 10 243 +179.0 +/- 21.17
49964 ncm-et-4 2018-08-16 05:30 01:16:54 1991139 500 254 18 228 +178.11 +/- 22.26
49963 ncm-et-9 2018-08-16 05:29 01:16:46 1988454 500 250 19 231 +173.67 +/- 22.11
49962 ncm-et-15 2018-08-16 04:11 01:19:21 1951135 500 245 22 233 +166.66 +/- 22.05
49961 ncm-et-10 2018-08-16 04:11 01:18:58 1946423 500 251 10 239 +182.61 +/- 21.4
49960 ncm-et-3 2018-08-16 04:11 01:17:55 1990826 500 229 24 247 +151.35 +/- 21.32
49959 ncm-et-4 2018-08-16 04:11 01:17:46 1992882 500 260 16 224 +185.33 +/- 22.45
49958 ncm-et-13 2018-08-16 04:11 01:18:25 1988296 500 235 14 251 +164.93 +/- 20.86
49957 ncm-et-9 2018-08-16 04:11 01:16:45 1987666 500 240 9 251 +173.67 +/- 20.69
40505 ncm-et-9 2018-06-11 23:23 00:10:50 2026718 71 33 1 37 +168.71 +/- 53.95
40504 ncm-et-12 2018-06-11 23:22 00:11:03 2019371 66 30 1 35 +163.81 +/- 55.37
40503 ncm-et-15 2018-06-11 23:22 00:11:01 2021000 70 31 5 34 +135.53 +/- 58.7
40502 ncm-et-10 2018-06-11 23:22 00:11:36 2020347 75 37 2 36 +175.73 +/- 56.06
40501 ncm-et-6 2018-06-11 23:19 00:14:13 2024590 92 46 1 45 +185.85 +/- 49.2
40500 ncm-et-12 2018-06-11 22:04 01:16:51 2017264 500 248 13 239 +177.22 +/- 21.49
40499 ncm-et-15 2018-06-11 22:04 01:17:08 2020510 500 241 18 241 +166.66 +/- 21.52
40498 ncm-et-9 2018-06-11 22:04 01:17:39 2023446 500 265 17 218 +189.0 +/- 22.83
40497 ncm-et-10 2018-06-11 22:03 01:17:18 2016933 500 249 15 236 +176.33 +/- 21.72
40496 ncm-et-6 2018-06-11 22:03 01:15:26 2023773 500 242 17 241 +168.4 +/- 21.49
40495 ncm-et-9 2018-06-11 20:47 01:16:02 2025572 500 260 15 225 +186.25 +/- 22.36
40494 ncm-et-13 2018-06-11 20:47 00:11:20 2025083 72 36 2 34 +178.21 +/- 57.9
40493 ncm-et-4 2018-06-11 20:47 00:11:13 2025899 67 38 3 26 +201.38 +/- 68.19
40492 ncm-et-6 2018-06-11 20:47 01:15:07 2024263 500 239 12 249 +170.15 +/- 20.91
40491 ncm-et-12 2018-06-11 20:47 01:16:50 2020999 500 262 8 230 +194.57 +/- 21.85
40490 ncm-et-7 2018-06-11 20:46 00:11:22 2022467 70 34 0 36 +184.28 +/- 53.97
40489 ncm-et-10 2018-06-11 20:46 01:16:26 2018395 500 245 14 241 +173.67 +/- 21.41
40488 ncm-et-15 2018-06-11 20:46 01:17:14 2020510 500 251 9 240 +183.51 +/- 21.3
40487 ncm-et-3 2018-06-11 20:46 00:12:18 2025408 80 41 2 37 +185.11 +/- 55.48
40486 ncm-et-6 2018-06-11 19:29 00:52:26 2023282 337 177 10 150 +188.79 +/- 27.45
40485 ncm-et-9 2018-06-11 19:29 01:16:39 2026390 500 229 19 252 +155.54 +/- 20.94
40484 ncm-et-3 2018-06-11 19:29 01:15:36 2025736 500 238 21 241 +161.49 +/- 21.59
40483 ncm-et-12 2018-06-11 19:29 01:16:40 2018559 500 242 9 249 +175.44 +/- 20.8
40482 ncm-et-15 2018-06-11 19:29 01:15:58 2020673 500 256 13 231 +184.42 +/- 21.95
40481 ncm-et-7 2018-06-11 19:29 01:16:41 2026391 500 227 22 251 +151.35 +/- 21.06
40480 ncm-et-4 2018-06-11 19:29 01:16:47 2023282 500 253 10 237 +184.42 +/- 21.51
40479 ncm-et-10 2018-06-11 19:29 01:16:13 2018070 500 272 12 216 +200.24 +/- 22.83
40478 ncm-et-13 2018-06-11 19:29 01:16:48 2024263 500 263 25 212 +179.9 +/- 23.33

Commit

Commit ID 86e467520f780c8b2cfbfe2b4451987de66882c7
Author Stefan Geschwentner
Date 2018-06-11 07:54:32 UTC
Optimize contempt value (21) After several tests it seems best to increase contempt from 12 to 21. This does not regress against contempt=0 and gives a gain of around 7-8 elo against SF 7 in comparison to current default contempt. STC: Test for non-regression contempt=21 against contempt=0 LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 71250 W: 13956 L: 13926 D: 43368 http://tests.stockfishchess.org/tests/view/5b19a58d0ebc5902ab9c3bfa STC: Test contempt 21 against SF 7 ELO: 190.06 +-2.8 (95%) LOS: 100.0% Total: 40000 W: 22608 L: 2676 D: 14716 http://tests.stockfishchess.org/tests/view/5b19a6520ebc5902ab9c3c0e STC: Test master against SF 7 for comparison ELO: 182.95 +-2.7 (95%) LOS: 100.0% Total: 40000 W: 21905 L: 2595 D: 15500 http://tests.stockfishchess.org/tests/view/5b16f5bc0ebc59214346d5ca LTC: Test for non-regression contempt=21 against contempt=0 LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 47666 W: 6914 L: 6832 D: 33920 http://tests.stockfishchess.org/tests/view/5b1a170b0ebc5902ab9c3fde LTC: Test contempt 21 against SF 7 ELO: 203.92 +-2.6 (95%) LOS: 100.0% Total: 40000 W: 22447 L: 1340 D: 16213 http://tests.stockfishchess.org/tests/view/5b1a174b0ebc5902ab9c3fe1 LTC: Test master against SF 7 for comparison ELO: 196.08 +-2.6 (95%) LOS: 100.0% Total: 40000 W: 21639 L: 1191 D: 17170 http://tests.stockfishchess.org/tests/view/5b1a17e40ebc5902ab9c3fe4 Closes https://github.com/official-stockfish/Stockfish/pull/1646 Bench: 4786912
Copyright 2011–2024 Next Chess Move LLC