Lc0 vs Stockfish end of March 2019?

Josepito_Tazito · March 28, 2019, 1:19am

Who is most likely to win?
I recently read that Leela had passed Stockfish, is it also valid on the Next Chess Move website?

chendry · May 18, 2019, 7:07pm

Sorry it’s taken me a while to respond. I’ve been trying to figure out a way to automate LcZero vs Stockfish for a while now on NCM but kept running in to trouble.

But I now have some initial results!

What ultimately worked was building a UCI layer on top of NCM. So now I essentially have a UCI engine that acts as a wrapper for NCM, and makes a web request to our production hardware to calculate each move. So it’s the exact equivalent of manually playing LcZero vs Stockfish on NCM using the calculate button, but fully automated.

I just ran 10 games of the latest dev build (20190517-1138) running on our 20 core servers vs the latest LcZero network (42372) running on our GPU servers, each engine calculating 15 seconds per move. Here’s the results:

Score of ncm-sf-20190517-1138 vs ncm-lc0-42372: 1 - 1 - 8  [0.500] 10
Elo difference: 0.0 +/- 98.7, LOS: 50.0 %, DrawRatio: 80.0 %

It’s obviously just 10 games, so hard to draw any certain conclusions, but it looks like they’re similar in strength on NCM’s hardware.

Here’s the cutechess-cli parameters I used:

cutechess-cli \
  -games 10 \
  -pgnout ./result.pgn \
  -resign movecount=3 score=400 \
  -draw movenumber=34 movecount=8 score=20 \
  -each st=15 timemargin=120000 proto=uci \
  -engine \
    name=ncm-sf-20190517-1138 \
    cmd=./ncmuci.rb \
    option.Engine=bf6b647a1afd0bfa25ee627622824a3ecb666c5d \
    option.PaidCpu=true \
  -engine \
    name=ncm-lc0-42372 \
    cmd=./ncmuci.rb \
    option.Engine=lc0:42372 \
    option.PaidGpu=true

PGN is pasted below.

Now that I have this somewhat automated I’ll be able to run some more tests to get a little better picture of how the two compare on NCM.

[Event "?"]
[Site "?"]
[Date "2019.05.18"]
[Round "1"]
[White "ncm-sf-20190517-1138"]
[Black "ncm-lc0-42372"]
[Result "1/2-1/2"]
[ECO "C65"]
[GameDuration "00:11:21"]
[GameEndTime "2019-05-18T10:33:58.233 CDT"]
[GameStartTime "2019-05-18T10:22:36.647 CDT"]
[Opening "Ruy Lopez"]
[PlyCount "45"]
[TimeControl "15/move"]
[Variation "Berlin defense"]

1. e4 {+0.55/25 17s} e5 {-0.36/15 12s} 2. Nf3 {+0.62/27 17s} Nc6 {-0.37/15 12s}
3. Bb5 {+0.61/27 17s} Nf6 {-0.36/15 12s} 4. d3 {+0.61/26 17s} Bc5 {-0.24/11 11s}
5. Bxc6 {+0.75/28 17s} dxc6 {-0.20/10 11s} 6. O-O {+0.63/24 17s}
Bd6 {-0.19/10 15s} 7. a4 {+0.67/26 17s} Be6 {-0.18/10 15s} 8. Na3 {+0.62/26 17s}
Qe7 {-0.14/10 13s} 9. b3 {+0.57/25 18s} a5 {-0.06/10 13s} 10. Nc4 {+0.40/27 17s}
Bxc4 {-0.01/10 12s} 11. bxc4 {+0.47/27 18s} Nd7 {0.00/9 13s}
12. c3 {+0.49/25 17s} Qe6 {+0.01/8 13s} 13. Ng5 {+0.51/26 18s} Qg6 {+0.22/9 12s}
14. Nf3 {+0.34/27 17s} O-O-O {+0.25/9 12s} 15. Rb1 {+0.43/27 18s}
Rhe8 {+0.29/10 14s} 16. Re1 {+0.41/28 17s} Nc5 {+0.35/10 15s}
17. Be3 {+0.56/31 17s} b6 {+0.31/11 15s} 18. Qc2 {+0.46/28 17s}
Bf8 {+0.40/9 13s} 19. Red1 {+0.41/30 18s} Qe6 {+0.38/10 15s}
20. Ng5 {+0.29/26 17s} Qg6 {+0.32/11 11s} 21. Nf3 {+0.33/27 17s}
Qe6 {+0.38/10 14s} 22. Ng5 {+0.25/27 18s} Qg6 {+0.36/11 11s}
23. Nf3 {+0.40/30 17s, Draw by 3-fold repetition} 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2019.05.18"]
[Round "1"]
[White "ncm-lc0-42372"]
[Black "ncm-sf-20190517-1138"]
[Result "1/2-1/2"]
[ECO "C11"]
[GameDuration "00:20:14"]
[GameEndTime "2019-05-18T10:54:13.211 CDT"]
[GameStartTime "2019-05-18T10:33:58.233 CDT"]
[Opening "French"]
[PlyCount "83"]
[TimeControl "15/move"]
[Variation "Steinitz, Boleslavsky Variation"]

1. e4 {+0.41/14 13s} e6 {+0.05/27 17s} 2. d4 {+0.73/16 15s} d5 {-0.07/26 18s}
3. Nc3 {+0.72/15 12s} Nf6 {0.00/30 17s} 4. e5 {+0.69/15 12s} Nfd7 {0.00/33 17s}
5. f4 {+0.73/13 11s} c5 {0.00/32 17s} 6. Nf3 {+0.71/13 11s} Nc6 {0.00/29 17s}
7. Be3 {+0.74/13 11s} cxd4 {0.00/28 17s} 8. Nxd4 {+0.85/18 11s}
Bc5 {0.00/28 18s} 9. Qd2 {+1.14/12 11s} O-O {-0.18/26 18s}
10. O-O-O {+1.06/13 12s} Nxd4 {+0.14/28 17s} 11. Bxd4 {+1.07/14 11s}
a6 {+0.07/28 18s} 12. h4 {+1.12/13 12s} b5 {0.00/30 18s} 13. h5 {+1.14/14 12s}
b4 {0.00/33 17s} 14. Na4 {+1.09/17 13s} Bxd4 {0.00/33 18s}
15. Qxd4 {+1.05/16 11s} Qa5 {0.00/33 18s} 16. h6 {+1.07/16 14s} g6 {0.00/32 17s}
17. b3 {+1.02/15 11s} Bb7 {0.00/34 17s} 18. Kb1 {+1.06/14 12s} Bc6 {0.00/31 17s}
19. Nb2 {+1.03/14 11s} Qc5 {0.00/31 17s} 20. Rh3 {+1.03/14 11s}
Qxd4 {-0.09/32 17s} 21. Rxd4 {+1.01/14 11s} a5 {-0.29/32 17s}
22. c3 {+1.15/15 12s} f6 {-0.18/31 17s} 23. exf6 {+1.27/16 11s}
Nxf6 {-0.09/29 18s} 24. cxb4 {+1.12/19 12s} axb4 {0.00/33 17s}
25. Nd3 {+1.31/16 12s} Bb5 {-0.19/33 18s} 26. Rxb4 {+0.91/16 11s}
Rab8 {0.00/37 17s} 27. a3 {+1.09/16 13s} e5 {-0.13/33 17s}
28. Rxb5 {+0.82/17 12s} Rxb5 {-0.37/31 18s} 29. Nxe5 {+0.81/14 11s}
Rb7 {0.00/32 17s} 30. Kb2 {+0.85/14 12s} Ne4 {-0.51/29 17s}
31. a4 {+0.87/13 12s} Rxf4 {0.00/33 18s} 32. Bb5 {+0.78/13 12s}
Re7 {0.00/31 17s} 33. Nc6 {+0.97/14 12s} Rb7 {0.00/32 17s}
34. Nd8 {+1.19/13 14s} Rb6 {-0.09/31 17s} 35. Bc6 {+0.97/15 11s}
Rf2+ {-0.09/31 17s} 36. Ka3 {+0.86/15 11s} Nd2 {-0.21/30 17s}
37. Bb5 {+0.91/13 11s} Rxg2 {-0.18/31 18s} 38. Rd3 {+0.94/14 14s}
Rd6 {-0.09/33 17s} 39. Nb7 {+0.87/15 13s} Rb6 {0.00/33 18s}
40. Nd8 {+0.94/15 14s} Rd6 {-0.09/29 17s} 41. Nb7 {+0.86/15 12s}
Rb6 {-0.22/30 18s} 42. Nd8 {+0.96/15 16s, Draw by 3-fold repetition} 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2019.05.18"]
[Round "1"]
[White "ncm-sf-20190517-1138"]
[Black "ncm-lc0-42372"]
[Result "1-0"]
[ECO "C65"]
[GameDuration "00:20:05"]
[GameEndTime "2019-05-18T11:14:18.541 CDT"]
[GameStartTime "2019-05-18T10:54:13.212 CDT"]
[Opening "Ruy Lopez"]
[PlyCount "80"]
[Termination "adjudication"]
[TimeControl "15/move"]
[Variation "Berlin defense"]

1. e4 {+0.51/26 17s} e5 {-0.36/15 12s} 2. Nf3 {+0.64/27 17s} Nc6 {-0.36/15 12s}
3. Bb5 {+0.63/28 17s} Nf6 {-0.36/15 12s} 4. d3 {+0.55/27 17s} Bc5 {-0.24/11 11s}
5. Bxc6 {+0.69/28 18s} dxc6 {-0.20/10 11s} 6. O-O {+0.58/24 17s}
Bd6 {-0.19/10 14s} 7. h3 {+0.47/25 17s} Be6 {-0.18/11 13s} 8. Ng5 {+0.48/26 17s}
Bd7 {-0.20/12 13s} 9. Nd2 {+0.64/29 18s} h6 {-0.12/13 12s}
10. Ngf3 {+0.37/28 17s} Be6 {-0.11/12 12s} 11. b3 {+0.37/25 18s}
Nd7 {-0.10/11 12s} 12. Nc4 {+0.50/24 17s} Bxc4 {-0.08/10 12s}
13. bxc4 {+0.55/27 18s} Qe7 {-0.04/8 13s} 14. Rb1 {+0.58/25 17s}
b6 {+0.07/9 12s} 15. Qe2 {+0.45/25 17s} O-O-O {+0.22/9 12s}
16. c3 {+0.59/26 18s} g5 {+0.31/9 12s} 17. Be3 {+0.58/24 17s} c5 {+0.34/9 14s}
18. Rfe1 {+0.31/26 17s} Rdg8 {+0.31/9 12s} 19. g3 {0.00/27 17s}
Qe6 {+0.19/10 17s} 20. Kg2 {0.00/28 17s} Be7 {+0.19/9 13s}
21. Nd2 {-0.22/26 17s} h5 {+0.23/11 17s} 22. d4 {0.00/25 18s}
exd4 {+0.35/13 12s} 23. cxd4 {+0.08/27 17s} cxd4 {+0.38/13 12s}
24. Bxd4 {+0.09/29 18s} Rh6 {+0.42/12 11s} 25. Rb5 {-0.09/28 17s}
c5 {+0.44/12 12s} 26. Be3 {-0.09/27 17s} Ne5 {+0.96/11 12s}
27. Rb3 {-0.09/29 17s} Rf6 {+1.55/11 12s} 28. a4 {0.00/34 17s} g4 {+0.09/14 12s}
29. h4 {+0.49/31 17s} Nf3 {-0.09/12 13s} 30. Reb1 {+0.58/30 17s}
Bd6 {-0.49/15 17s} 31. a5 {+0.69/28 17s} Bc7 {-0.51/15 11s}
32. axb6 {+0.57/29 17s} axb6 {-0.55/13 11s} 33. Rd3 {+0.73/29 17s}
Re8 {-0.63/14 14s} 34. Ra1 {+0.45/28 17s} Qe5 {-0.77/12 14s}
35. Raa3 {+0.83/28 17s} Nxd2 {-1.03/11 15s} 36. Qxd2 {+0.91/29 17s}
Qxe4+ {-1.30/11 14s} 37. Kh2 {+0.81/30 18s} Rfe6 {-1.00/12 16s}
38. Qa2 {+9.40/31 17s} Bb8 {-4.39/10 12s} 39. Rd5 {+9.61/33 17s}
Qf3 {-10.73/10 17s} 40. Ra7 {+148.92/46 18s}
Bxa7 {-15.29/11 12s, White wins by adjudication} 1-0

[Event "?"]
[Site "?"]
[Date "2019.05.18"]
[Round "1"]
[White "ncm-lc0-42372"]
[Black "ncm-sf-20190517-1138"]
[Result "1/2-1/2"]
[ECO "C00"]
[GameDuration "00:20:50"]
[GameEndTime "2019-05-18T11:35:08.943 CDT"]
[GameStartTime "2019-05-18T11:14:18.542 CDT"]
[Opening "French defense"]
[PlyCount "84"]
[TimeControl "15/move"]

1. e4 {+0.42/14 13s} e6 {0.00/26 17s} 2. Nc3 {+0.71/16 17s} d5 {-0.11/28 17s}
3. d4 {+0.72/16 11s} Nf6 {0.00/29 17s} 4. e5 {+0.72/15 12s} Nfd7 {0.00/31 17s}
5. f4 {+0.70/14 11s} c5 {0.00/32 17s} 6. Nf3 {+0.71/13 11s} Nc6 {0.00/29 17s}
7. Be3 {+0.72/13 11s} Qb6 {0.00/30 17s} 8. Na4 {+1.12/18 11s}
Qa5+ {-0.32/28 17s} 9. c3 {+1.11/18 11s} c4 {-0.32/29 17s} 10. b4 {+1.56/12 11s}
Qc7 {-0.26/29 17s} 11. Be2 {+1.57/10 12s} b5 {-0.40/27 17s}
12. Nc5 {+1.65/13 11s} a5 {-0.41/27 17s} 13. a3 {+1.62/13 11s}
Be7 {-0.37/27 17s} 14. O-O {+1.64/12 11s} Nxc5 {-0.20/28 17s}
15. dxc5 {+1.96/10 11s} g6 {-0.29/26 17s} 16. Qd2 {+1.76/9 16s}
O-O {-0.17/26 17s} 17. Nd4 {+2.33/13 12s} Nxd4 {-0.30/28 18s}
18. Bxd4 {+2.37/12 11s} Ra6 {-0.39/26 17s} 19. Rae1 {+2.49/10 13s}
Bd7 {-0.38/30 17s} 20. Bd1 {+2.33/11 13s} Rfa8 {-0.15/31 17s}
21. Bc2 {+2.22/11 12s} axb4 {-0.34/31 22s} 22. axb4 {+2.16/10 11s}
Qd8 {-0.79/27 17s} 23. Bb1 {+2.11/9 13s} Qf8 {-0.90/28 17s}
24. g4 {+2.38/10 12s} Qg7 {-0.89/26 17s} 25. Kh1 {+2.42/10 13s}
Qh6 {-1.00/30 17s} 26. Qg2 {+2.54/9 12s} Ra1 {-1.37/27 18s}
27. Qf3 {+2.71/9 12s} Be8 {-1.34/27 17s} 28. f5 {+2.85/9 12s} Bg5 {-1.21/30 18s}
29. Re2 {+2.70/9 12s} Bf4 {-1.22/30 18s} 30. Qxf4 {+5.32/15 14s}
Qxf4 {-1.27/35 17s} 31. Rxf4 {+4.96/13 11s} Rxb1+ {-1.52/34 17s}
32. Kg2 {+4.84/11 11s} Bd7 {-1.50/31 17s} 33. fxg6 {+5.05/10 11s}
hxg6 {-1.41/38 18s} 34. h4 {+5.01/9 13s} Kg7 {-1.39/36 17s}
35. Ref2 {+5.65/11 13s} Be8 {-1.34/39 17s} 36. Rf1 {+5.82/11 12s}
Rxf1 {-1.38/47 18s} 37. Rxf1 {+6.21/9 11s} Bc6 {-1.25/45 18s}
38. Kg3 {+5.85/9 15s} Bb7 {-1.18/44 17s} 39. Kf4 {+6.19/9 15s}
Kh6 {-1.30/45 17s} 40. Kg3 {+6.49/10 14s} Kg7 {-1.30/47 17s}
41. Kf4 {+6.11/9 15s} Kh6 {-1.24/45 17s} 42. Kg3 {+6.59/10 14s}
Kg7 {-1.23/46 18s, Draw by 3-fold repetition} 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2019.05.18"]
[Round "1"]
[White "ncm-sf-20190517-1138"]
[Black "ncm-lc0-42372"]
[Result "1/2-1/2"]
[ECO "A46"]
[GameDuration "00:23:53"]
[GameEndTime "2019-05-18T11:59:02.680 CDT"]
[GameStartTime "2019-05-18T11:35:08.944 CDT"]
[Opening "Queen's pawn game"]
[PlyCount "91"]
[TimeControl "15/move"]

1. d4 {+0.57/26 17s} Nf6 {-0.33/14 14s} 2. Nf3 {+0.57/25 17s} e6 {-0.32/14 15s}
3. c4 {+0.51/27 18s} d5 {-0.33/13 12s} 4. Nc3 {+0.45/26 18s} dxc4 {-0.25/14 12s}
5. e4 {+0.59/25 17s} Bb4 {-0.14/18 12s} 6. Bg5 {+0.55/26 17s} h6 {-0.12/18 13s}
7. Bxf6 {+0.30/28 17s} Qxf6 {-0.12/16 12s} 8. Bxc4 {+0.51/27 17s}
c5 {-0.09/15 11s} 9. O-O {+0.32/26 17s} cxd4 {-0.06/14 11s}
10. Nb5 {+0.45/28 18s} Qe7 {-0.22/15 11s} 11. Qxd4 {+0.58/30 17s}
O-O {-0.26/14 11s} 12. Nxa7 {+0.53/29 17s} Bc5 {-0.27/13 12s}
13. Nxc8 {+0.43/30 17s} Rxc8 {-0.28/11 11s} 14. Qd3 {+0.46/28 17s}
Nc6 {-0.28/10 14s} 15. Qe2 {+0.58/27 17s} Rd8 {-0.28/10 14s}
16. Rac1 {+0.50/30 18s} Nd4 {-0.17/11 13s} 17. Nxd4 {+0.54/35 17s}
Rxd4 {-0.16/10 12s} 18. Rfd1 {+0.45/34 17s} Rxd1+ {-0.16/9 14s}
19. Rxd1 {+0.47/33 17s} Rd8 {-0.15/8 12s} 20. Bd3 {+0.40/32 18s}
g6 {-0.18/8 14s} 21. g3 {+0.41/33 17s} h5 {-0.21/7 15s} 22. Kg2 {+0.41/32 17s}
h4 {-0.13/7 13s} 23. a3 {+0.35/30 17s} Bb6 {-0.10/8 16s} 24. e5 {+0.26/35 18s}
Kg7 {-0.12/10 17s} 25. f4 {+0.13/31 18s} hxg3 {-0.17/9 15s}
26. hxg3 {+0.27/34 17s} Qc5 {-0.23/9 17s} 27. Rh1 {+0.26/35 17s}
Qd5+ {-0.30/11 14s} 28. Be4 {+0.45/38 17s} Qa5 {-0.28/11 16s}
29. Rd1 {+0.28/33 17s} Rxd1 {-0.30/10 12s} 30. Qxd1 {+0.27/35 18s}
Be3 {-0.28/9 16s} 31. Kf3 {+0.28/36 17s} Bc5 {-0.27/9 14s}
32. Kg4 {+0.40/36 17s} Bf8 {-0.29/8 14s} 33. Qc1 {+0.22/35 19s}
Qb5 {-0.13/9 15s} 34. Qc2 {+0.45/44 17s} b6 {-0.11/8 13s} 35. b4 {+0.16/42 18s}
Qf1 {-0.11/9 13s} 36. Qd3 {+0.23/40 18s} Qf2 {-0.12/9 17s}
37. Kh3 {+0.20/41 18s} Be7 {-0.14/9 16s} 38. Qf3 {+0.18/40 17s}
Qg1 {-0.11/8 17s} 39. Bd3 {+0.22/38 17s} Qa1 {-0.07/8 17s}
40. Be4 {+0.23/41 18s} Qg1 {-0.10/8 17s} 41. Bd3 {+0.16/40 17s}
Qa1 {-0.07/8 17s} 42. Be2 {+0.18/41 18s} Qc1 {-0.05/8 17s}
43. Bf1 {+0.15/37 17s} Qa1 {-0.05/8 17s} 44. Be2 {+0.20/42 17s}
Qc1 {-0.05/8 17s} 45. Bf1 {+0.17/36 18s} Qa1 {-0.05/8 16s}
46. Be2 {+0.20/40 18s, Draw by 3-fold repetition} 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2019.05.18"]
[Round "1"]
[White "ncm-lc0-42372"]
[Black "ncm-sf-20190517-1138"]
[Result "1/2-1/2"]
[ECO "C11"]
[GameDuration "00:17:10"]
[GameEndTime "2019-05-18T12:16:12.840 CDT"]
[GameStartTime "2019-05-18T11:59:02.681 CDT"]
[Opening "French"]
[PlyCount "68"]
[TimeControl "15/move"]
[Variation "Steinitz, Boleslavsky Variation"]

1. e4 {+0.42/14 13s} e6 {+0.09/28 17s} 2. d4 {+0.73/16 15s} d5 {+0.09/28 17s}
3. Nc3 {+0.72/15 11s} Nf6 {-0.08/27 18s} 4. e5 {+0.70/15 12s} Nfd7 {0.00/32 17s}
5. f4 {+0.72/13 12s} c5 {0.00/31 17s} 6. Nf3 {+0.72/13 11s} Nc6 {0.00/31 17s}
7. Be3 {+0.72/13 11s} Qb6 {0.00/30 17s} 8. Na4 {+1.11/19 12s}
Qa5+ {-0.16/28 18s} 9. c3 {+1.13/17 11s} c4 {-0.33/29 17s} 10. b4 {+1.56/12 11s}
Qc7 {-0.32/29 17s} 11. Be2 {+1.57/10 12s} b5 {-0.39/27 17s}
12. Nc5 {+1.64/13 11s} a5 {-0.31/27 17s} 13. a3 {+1.60/12 11s}
Be7 {-0.46/24 17s} 14. O-O {+1.66/12 12s} Nxc5 {-0.54/28 17s}
15. dxc5 {+1.94/10 11s} Bd7 {-0.43/26 17s} 16. Qd2 {+2.17/10 12s}
Qb7 {-0.36/25 18s} 17. Rae1 {+2.13/9 12s} g6 {-0.25/26 17s}
18. Rc1 {+2.02/9 15s} Ra6 {-0.23/25 17s} 19. Bd1 {+1.70/9 17s}
axb4 {-0.39/27 17s} 20. axb4 {+1.56/11 11s} h5 {-0.26/26 18s}
21. Bc2 {+1.45/10 14s} Kf8 {-0.69/28 17s} 22. Ra1 {+2.30/10 15s}
Kg7 {-0.67/32 18s} 23. Rxa6 {+2.94/10 12s} Qxa6 {-0.55/31 17s}
24. Bb1 {+2.99/9 13s} Ra8 {-0.66/31 17s} 25. h3 {+2.80/9 12s} Rg8 {-0.59/32 17s}
26. Bf2 {+3.01/9 17s} Qa7 {-0.70/30 18s} 27. Nd4 {+2.95/8 15s}
Qb7 {-0.64/30 18s} 28. Nf3 {+2.89/9 14s} Qc7 {-0.69/28 17s}
29. Bd4 {+2.92/9 16s} Qa7 {-0.70/32 17s} 30. Re1 {+3.25/9 17s}
Rh8 {-0.63/34 18s} 31. Re2 {+3.11/8 16s} Qa1 {-0.66/36 18s}
32. Re1 {+3.16/9 11s} Qa7 {-0.69/33 18s} 33. Re2 {+3.13/8 16s}
Qa1 {-0.68/35 17s} 34. Re1 {+3.22/9 11s}
Qa7 {-0.67/34 17s, Draw by 3-fold repetition} 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2019.05.18"]
[Round "1"]
[White "ncm-sf-20190517-1138"]
[Black "ncm-lc0-42372"]
[Result "1/2-1/2"]
[ECO "C65"]
[GameDuration "00:28:20"]
[GameEndTime "2019-05-18T12:44:33.375 CDT"]
[GameStartTime "2019-05-18T12:16:12.840 CDT"]
[Opening "Ruy Lopez"]
[PlyCount "112"]
[TimeControl "15/move"]
[Variation "Berlin defense"]

1. e4 {+0.60/27 18s} e5 {-0.36/15 12s} 2. Nf3 {+0.79/27 17s} Nc6 {-0.37/15 12s}
3. Bb5 {+0.61/27 17s} Nf6 {-0.37/15 12s} 4. d3 {+0.68/27 17s} Bc5 {-0.24/11 11s}
5. Bxc6 {+0.65/27 17s} dxc6 {-0.20/10 11s} 6. O-O {+0.57/24 17s}
Bd6 {-0.19/10 14s} 7. a4 {+0.67/26 17s} Be6 {-0.18/10 15s} 8. Na3 {+0.66/25 18s}
Qe7 {-0.14/10 13s} 9. b3 {+0.59/26 17s} a5 {-0.07/10 13s} 10. Nc4 {+0.48/28 18s}
Bxc4 {-0.01/10 12s} 11. bxc4 {+0.42/27 18s} Nd7 {0.00/9 13s}
12. Qe2 {+0.36/26 17s} O-O-O {+0.18/9 14s} 13. c3 {+0.38/27 18s}
Rhe8 {+0.17/9 12s} 14. Re1 {+0.30/27 17s} c5 {+0.26/8 13s}
15. Rb1 {+0.32/29 17s} b6 {+0.28/8 12s} 16. Qb2 {+0.44/28 17s} Nb8 {+0.30/9 12s}
17. Qb5 {+0.39/27 17s} Qe6 {+0.33/9 12s} 18. Be3 {+0.15/27 17s}
Bf8 {+0.32/10 13s} 19. Ng5 {+0.08/27 17s} Qg6 {+0.32/10 12s}
20. Nf3 {+0.19/30 18s} f6 {+0.46/9 14s} 21. Red1 {+0.08/26 17s}
Rd7 {+0.49/9 12s} 22. Ne1 {+0.11/28 17s} Qf7 {+0.41/10 16s}
23. f3 {+0.20/27 18s} f5 {+0.39/10 16s} 24. Bf2 {+0.29/25 18s}
fxe4 {+0.46/11 12s} 25. fxe4 {+0.21/32 17s} Qe6 {+0.97/10 12s}
26. Qb2 {0.00/31 18s} Be7 {+0.91/9 12s} 27. Qe2 {+0.10/28 17s}
Bg5 {+0.88/10 12s} 28. Nf3 {0.00/30 17s} Bf6 {+1.00/9 13s} 29. Ne1 {0.00/27 17s}
Rf7 {+1.13/9 12s} 30. Nf3 {+0.01/28 17s} Nc6 {+1.21/8 12s} 31. Rf1 {0.00/29 17s}
Rd8 {+1.38/8 12s} 32. Be3 {-0.01/27 17s} h6 {+1.48/8 14s} 33. Rbd1 {0.00/29 17s}
Rfd7 {+1.69/8 12s} 34. Ne1 {0.00/30 17s} Rd6 {+1.70/8 12s} 35. Rd2 {0.00/32 17s}
Ne7 {+1.82/8 13s} 36. Rb2 {-0.09/31 17s} Ng6 {+1.78/9 13s} 37. g3 {-0.44/27 17s}
Nh8 {+1.83/8 13s} 38. Kg2 {0.00/36 17s} Qd7 {+1.95/8 14s} 39. Ra2 {0.00/36 17s}
Nf7 {+2.21/8 15s} 40. h4 {0.00/34 17s} Qc6 {+2.28/8 13s} 41. Kh2 {-0.09/34 17s}
Kb7 {+2.12/8 15s} 42. Rb2 {-0.08/31 18s} R6d7 {+2.22/8 13s}
43. Bg1 {-0.50/27 17s} Ka7 {+2.25/8 12s} 44. Ra2 {-0.62/26 17s}
Qe6 {+2.31/8 15s} 45. Kg2 {-0.53/27 17s} Nd6 {+2.32/9 13s}
46. Qh5 {-0.78/28 18s} Nc8 {+2.36/9 13s} 47. Qf5 {-0.53/31 17s}
Qc6 {+2.56/9 13s} 48. Qg4 {-0.43/29 17s} Rd6 {+2.58/8 14s}
49. Qe2 {-0.53/27 17s} Ne7 {+2.62/8 12s} 50. Qg4 {-0.38/29 18s}
Qe8 {+2.54/8 17s} 51. Be3 {-0.52/29 17s} Ng8 {+2.61/8 13s}
52. Qe2 {-0.63/27 18s} Qc6 {+2.66/8 15s} 53. Rf2 {-0.73/25 18s}
Qe8 {+2.67/8 14s} 54. Rf1 {-0.65/27 17s} Qc6 {+2.60/8 17s}
55. Bg1 {-0.93/24 17s} Ne7 {+2.56/8 14s} 56. Be3 {-0.46/27 17s}
Ng8 {+2.62/8 13s, Draw by 3-fold repetition} 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2019.05.18"]
[Round "1"]
[White "ncm-lc0-42372"]
[Black "ncm-sf-20190517-1138"]
[Result "1/2-1/2"]
[ECO "C11"]
[GameDuration "00:18:20"]
[GameEndTime "2019-05-18T13:02:54.080 CDT"]
[GameStartTime "2019-05-18T12:44:33.377 CDT"]
[Opening "French"]
[PlyCount "72"]
[TimeControl "15/move"]
[Variation "Steinitz, Boleslavsky Variation"]

1. e4 {+0.42/14 13s} e6 {+0.14/27 17s} 2. d4 {+0.73/16 15s} d5 {0.00/27 18s}
3. Nc3 {+0.72/15 12s} Nf6 {0.00/30 17s} 4. e5 {+0.70/15 12s} Nfd7 {0.00/32 17s}
5. f4 {+0.71/14 12s} c5 {0.00/30 18s} 6. Nf3 {+0.70/13 11s} Nc6 {0.00/30 17s}
7. Be3 {+0.72/13 11s} Qb6 {-0.08/27 17s} 8. Na4 {+1.16/18 12s}
Qa5+ {-0.32/26 17s} 9. c3 {+1.11/17 12s} c4 {-0.37/27 17s} 10. b4 {+1.56/12 11s}
Qc7 {-0.26/28 18s} 11. Be2 {+1.57/10 12s} b5 {-0.48/27 17s}
12. Nc5 {+1.64/13 11s} a5 {-0.25/29 18s} 13. a3 {+1.62/13 11s}
Be7 {-0.38/26 17s} 14. O-O {+1.67/12 11s} Nxc5 {-0.41/25 17s}
15. dxc5 {+1.94/10 11s} O-O {-0.32/27 17s} 16. Nd4 {+2.06/11 12s}
Nxd4 {-0.46/27 17s} 17. Bxd4 {+2.13/10 11s} Bd7 {-0.39/26 17s}
18. Bg4 {+2.30/10 13s} g6 {-0.57/27 17s} 19. Qf3 {+2.13/10 16s}
axb4 {-0.51/27 18s} 20. axb4 {+1.95/11 11s} Rxa1 {-0.45/28 17s}
21. Rxa1 {+1.89/9 11s} Qb7 {-0.64/34 18s} 22. Qg3 {+2.44/13 16s}
Ra8 {-0.80/29 18s} 23. Rf1 {+2.35/12 12s} Bd8 {-1.10/29 17s}
24. h4 {+2.64/10 12s} Bc8 {-0.75/32 17s} 25. h5 {+2.50/10 13s}
Qe7 {-0.63/33 17s} 26. Bf2 {+2.30/10 17s} Bd7 {-0.67/31 17s}
27. Qf3 {+2.36/9 17s} Ra3 {-0.69/31 17s} 28. Qh3 {+2.24/9 14s}
Be8 {-0.72/28 18s} 29. Re1 {+2.31/9 17s} Bc6 {-0.75/32 18s}
30. Rf1 {+2.17/10 12s} Be8 {-0.75/30 18s} 31. Re1 {+2.34/9 17s}
Bd7 {-0.73/31 18s} 32. Rc1 {+2.28/9 17s} Ra2 {-0.89/31 17s}
33. Rf1 {+2.16/9 12s} Ra3 {-0.87/30 17s} 34. Rd1 {+2.36/9 17s}
Be8 {-0.83/30 18s} 35. Rb1 {+2.36/9 16s} Kg7 {-0.71/32 18s}
36. Rf1 {+2.31/9 14s} Kg8 {-0.74/34 17s, Draw by 3-fold repetition} 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2019.05.18"]
[Round "1"]
[White "ncm-sf-20190517-1138"]
[Black "ncm-lc0-42372"]
[Result "1/2-1/2"]
[ECO "A46"]
[GameDuration "00:19:22"]
[GameEndTime "2019-05-18T13:22:17.013 CDT"]
[GameStartTime "2019-05-18T13:02:54.080 CDT"]
[Opening "Queen's pawn game"]
[PlyCount "77"]
[TimeControl "15/move"]

1. d4 {+0.65/26 17s} Nf6 {-0.33/14 14s} 2. Nf3 {+0.40/25 17s} e6 {-0.32/14 15s}
3. Bf4 {+0.50/26 17s} c5 {-0.24/14 17s} 4. e3 {+0.45/27 17s} d5 {-0.22/13 12s}
5. Be2 {+0.47/26 17s} Qb6 {-0.07/11 11s} 6. b3 {+0.43/26 18s} Nc6 {0.00/13 14s}
7. O-O {+0.29/26 17s} Nh5 {+0.05/15 12s} 8. Be5 {+0.02/29 18s}
cxd4 {+0.21/14 11s} 9. Bxd4 {+0.09/28 18s} Nxd4 {+0.20/12 12s}
10. Qxd4 {+0.15/26 17s} Qxd4 {+0.28/12 12s} 11. Nxd4 {+0.24/30 17s}
Nf6 {+0.28/12 11s} 12. c4 {+0.15/30 17s} dxc4 {+0.26/11 12s}
13. bxc4 {0.00/32 17s} Bd7 {+0.30/10 13s} 14. Nd2 {-0.09/29 17s}
Bb4 {+0.29/11 12s} 15. N2f3 {-0.09/31 17s} Bd6 {+0.27/11 12s}
16. Rfb1 {0.00/31 17s} Rb8 {+0.24/11 12s} 17. Nb5 {0.00/33 18s}
Bxb5 {+0.24/10 12s} 18. cxb5 {+0.02/31 18s} Nd5 {+0.25/9 16s}
19. Bc4 {0.00/32 17s} Nb6 {+0.30/10 12s} 20. Be2 {+0.10/31 17s}
Na4 {+0.27/10 14s} 21. Rc1 {+0.12/31 17s} Ke7 {+0.25/10 12s}
22. Bd1 {+0.04/30 17s} Nb6 {+0.29/10 16s} 23. a4 {+0.06/29 17s}
Rhc8 {+0.33/10 12s} 24. g3 {0.00/29 18s} Bb4 {+0.47/9 13s} 25. h4 {0.00/30 17s}
Nd5 {+0.48/9 17s} 26. Kg2 {0.00/32 18s} Bc3 {+0.47/9 15s} 27. Rab1 {0.00/33 17s}
h6 {+0.50/9 14s} 28. Bb3 {0.00/37 17s} Nf6 {+0.47/10 12s} 29. Rc2 {0.00/37 18s}
Ne4 {+0.73/11 12s} 30. Rbc1 {0.00/40 17s} Rc5 {+0.75/12 11s}
31. Nd2 {0.00/38 17s} Bxd2 {+0.68/15 11s} 32. Rxc5 {0.00/43 18s}
Bxc1 {+0.68/13 11s} 33. Rxc1 {0.00/40 17s} Rd8 {+0.68/12 12s}
34. Rc7+ {0.00/38 18s} Rd7 {+0.61/12 11s} 35. Rc4 {0.00/38 17s}
Nd6 {+0.58/11 14s} 36. Rc3 {0.00/39 17s} Ne4 {+0.56/11 14s}
37. Rc4 {0.00/39 17s} Nd6 {+0.58/11 13s} 38. Rc3 {0.00/39 17s}
Ne4 {+0.56/11 14s} 39. Rc4 {0.00/36 17s, Draw by 3-fold repetition} 1/2-1/2

[Event "?"]
[Site "?"]
[Date "2019.05.18"]
[Round "1"]
[White "ncm-lc0-42372"]
[Black "ncm-sf-20190517-1138"]
[Result "1-0"]
[ECO "C11"]
[GameDuration "00:25:01"]
[GameEndTime "2019-05-18T13:47:18.523 CDT"]
[GameStartTime "2019-05-18T13:22:17.013 CDT"]
[Opening "French"]
[PlyCount "100"]
[Termination "adjudication"]
[TimeControl "15/move"]
[Variation "Steinitz, Boleslavsky Variation"]

1. e4 {+0.42/14 13s} e6 {-0.06/27 17s} 2. d4 {+0.74/16 14s} d5 {0.00/28 18s}
3. Nc3 {+0.73/15 12s} Nf6 {+0.14/25 18s} 4. e5 {+0.73/15 12s}
Nfd7 {-0.13/27 17s} 5. f4 {+0.71/14 11s} c5 {-0.08/29 17s} 6. Nf3 {+0.71/13 11s}
Nc6 {0.00/30 17s} 7. Be3 {+0.73/13 11s} Qb6 {-0.19/26 17s} 8. Na4 {+1.16/18 12s}
Qa5+ {0.00/28 17s} 9. c3 {+1.14/18 12s} c4 {-0.29/28 17s} 10. b4 {+1.56/12 11s}
Qc7 {-0.37/29 17s} 11. Be2 {+1.58/10 12s} b5 {-0.34/28 18s}
12. Nc5 {+1.65/13 11s} a5 {-0.40/27 17s} 13. a3 {+1.64/13 11s}
Be7 {-0.41/26 17s} 14. O-O {+1.64/12 11s} Nxc5 {-0.17/26 18s}
15. dxc5 {+1.95/10 12s} O-O {-0.21/25 17s} 16. Nd4 {+2.08/11 12s}
Nxd4 {-0.53/29 17s} 17. Bxd4 {+2.12/10 11s} Bd7 {-0.50/28 17s}
18. Bg4 {+2.29/10 13s} g6 {-0.51/29 18s} 19. Qf3 {+2.13/10 15s}
Rfc8 {-0.48/26 17s} 20. Rae1 {+1.89/10 17s} axb4 {-0.40/32 17s}
21. axb4 {+1.76/10 11s} Ra2 {-0.53/30 17s} 22. g3 {+1.99/9 17s}
Rca8 {-0.42/29 18s} 23. h4 {+1.91/12 12s} h5 {-0.49/30 17s}
24. Bxh5 {+1.88/15 12s} gxh5 {-0.32/30 17s} 25. Qxh5 {+1.84/14 11s}
Rd2 {-0.53/30 17s} 26. Qg4+ {+2.26/13 12s} Kh8 {-0.22/29 17s}
27. Re2 {+2.81/12 12s} Rxd4 {-0.82/31 17s} 28. cxd4 {+2.62/14 16s}
Qc6 {-1.58/26 18s} 29. Rg2 {+3.78/12 16s} Qa6 {-1.47/28 18s}
30. Qh5+ {+2.58/13 15s} Kg7 {-1.59/27 17s} 31. Qg4+ {+3.13/11 12s}
Kh7 {-1.53/27 17s} 32. Kh2 {+3.46/10 12s} Kh8 {-1.60/25 17s}
33. Qh5+ {+3.42/12 12s} Kg7 {-1.70/28 17s} 34. Rff2 {+3.64/10 13s}
Be8 {-1.76/26 17s} 35. Qe2 {+3.48/10 16s} Kg8 {-1.44/26 17s}
36. Qg4+ {+3.34/11 16s} Kh8 {-0.73/27 17s} 37. Rf3 {+3.40/11 15s}
Qc6 {-0.66/27 17s} 38. Rgf2 {+3.67/11 16s} Bd7 {-1.68/29 17s}
39. Qh5+ {+3.57/12 12s} Kg7 {-1.60/29 17s} 40. Rg2 {+3.61/11 13s}
Qa6 {-1.45/28 17s} 41. Rff2 {+3.58/11 13s} Be8 {-1.53/26 18s}
42. Qe2 {+3.42/10 16s} Kg8 {-1.33/26 17s} 43. Rf1 {+3.36/11 16s}
Ra7 {-2.23/27 18s} 44. Qg4+ {+6.79/12 11s} Kh7 {-3.47/30 17s}
45. Qh5+ {+7.94/12 11s} Kg7 {-3.72/30 17s} 46. g4 {+9.38/10 11s}
Qc8 {-3.55/32 17s} 47. g5 {+9.38/10 11s} Bf8 {-3.53/33 18s}
48. Qg4 {+9.02/9 12s} Kg8 {-4.16/27 17s} 49. h5 {+9.24/9 12s} Ra6 {-4.23/26 17s}
50. Rf3 {+9.77/9 13s} Bg7 {-4.30/25 17s, White wins by adjudication} 1-0

chendry · May 21, 2019, 1:46pm

It turns out that my UCI wrapper was not sending the full move history. I fixed that, and the latest results for Stockfish (20190517-1138) vs LcZero (42372) is:

Wins: 4, Losses: 10, Draws: 48

PGN with results attached! I’ll continue to run tests.

results.pgn (202.3 KB)

chendry · May 25, 2019, 12:51pm

We just completed a full 100 game run:

Score of ncm-sf-20190517-1138 vs ncm-lc0-42372: 14 - 12 - 74  [0.510] 100
ELO difference: 6.95 +/- 34.78

results.pgn (345.6 KB)