What is the best country in bot games?

Forum rules
This forum is limited to topics relating to the game Diplomacy only. Other posts or topics will be relocated to the correct forum category or deleted. Please be respectful and follow our normal site rules at http://www.webdiplomacy.net/rules.php.

Post a reply

Confirmation code
Enter the code exactly as it appears. All letters are case insensitive.
Smilies
:points: :-D :eyeroll: :neutral: :nmr: :razz: :raging: :-) ;) :( :sick: :o :? 8-) :x :shock: :lol: :cry: :evil: :?: :smirk: :!:
View more smilies

BBCode is ON
[img] is ON
[flash] is OFF
[url] is OFF
Smilies are ON

Topic review
   

If you wish to attach one or more files enter the details below.

Expand view Topic review: What is the best country in bot games?

Re: What is the best country in bot games?

by georgefc3 » Mon Aug 08, 2022 4:08 pm

These are extremely strong numbers.

The only thing that looks a little strange is France. Supposedly France is an easy country to solo with. (I've struggled myself...)

The other numbers, especially Russia, is very impressive.

Re: What is the best country in bot games?

by Trigfea63 » Sun Aug 07, 2022 7:04 pm

It's a small sample size, but I'll share my results so far against the bots. I count draws as losses for the win percentages.

England: 3-2-2 (43%)
France: 2-6-0 (25%)
Germany: 3-2-2 (43%)
Austria: 3-3-0 (50%)
Italy: 4-3-1 (50%)
Russia: 3-2-0 (60%)
Turkey: 3-3-0 (50%)

Differences in win percentages compared to others could be due to the small sample size, partly or entirely. Still, a few observations:

I haven't seen nearly as big a variation as others in playing one power vs another. My win percentages are all in the same ballpark, except for France (where my game may need improvement). As England and Austria, maybe I've been luckier than average and my percentages will come down with more games. As Austria, like everyone else, I win when Italy doesn't attack, and I lose when Italy attacks.

As Russia, I usually send Moscow south and try to ally with Turkey. If Turkey is up for the jugg and Italy attacks Austria, it seems like Russia has a chance even if it takes a beating in the north early on. At least, something like that has worked 3 out of 5 times so far. We'll see if it holds up with more games.

More information and links to the games can be found here:
https://docs.google.com/spreadsheets/d/ ... edit#gid=0

Re: What is the best country in bot games?

by georgefc3 » Thu Jul 28, 2022 3:55 am

Here is another win, this time as Germany. Much faster as the game ended in 1909.

The key here was to take out England quickly. After that everything fell into place.

https://webdiplomacy.net/board.php?gameID=426643

Re: What is the best country in bot games?

by Trigfea63 » Wed Jul 27, 2022 8:38 pm

Well played. It's pretty unusual to see Turkey with a fleet in North Sea and in control of Scandinavia!

Re: What is the best country in bot games?

by georgefc3 » Wed Jul 27, 2022 7:35 pm

Here is an interesting game. This is a Turkey/Italy alliance vs the rest of the board.

I got stuck behind a stalemate line. I was at 10 centers and Italy was at 8 (roughly). I played the same moves for about 5 whole seasons. Then Italy decided to go to the MAO and was somehow able to secure Iberia. Amazing that the other bots didn't stop him.

I let Italy grow. He had a fleet in the Ionian for the longest time, blocking my fleet in the Aegean. He lost a unit at one point and took out the fleet in the Ionian.

I assisted him with my two fleets. One fleet made it to the North Sea!

I eventually stabbed him. I finished with 22 centers including all of Scandinavia and all of Italy proper.

Here is the link:

https://webdiplomacy.net/board.php?gameID=426517

Comments?

Re: What is the best country in bot games?

by Jamiet99uk » Sun Jul 24, 2022 4:40 pm

kestasjk wrote:
Sun Jul 24, 2022 6:41 am
Trigfea63 wrote:
Tue Jul 12, 2022 3:12 am
That is some very interesting data, thank you.

I don't have any comparable data, I haven't played nearly enough bot games. But your post made me want to share an anecdote on a game I played recently. I was Italy. By the end of 1906, I had lost all my home centers and was down to 2 units and 2 SCs. And yet ...

https://webdiplomacy.net/board.php?game ... #gamePanel

So, yes, it definitely pays to play bot games out all the way to the end!

Also, I am curious if anyone has any insight into Turkey's (and Austria's) behavior/programming that would allow this to happen.
Yeah .. that is very odd, Ill see if paquette wants to take a look
It almost looks as if once the Bot has progressed its "front line", it does not prioritise defending SCs "behind the line".

Or, in Turkey's case particularly in that game, it looks as if the Bot values *home* SCs and *non-home* SCs as being of equal value, so it does not shift units back to protect home SCs as long as it is winning new SCs elsewhere. If this is part of the explanation, then clearly the programming should be adjusted to account for the fact that home SCs are more valuable due to being able to build only there.

Re: What is the best country in bot games?

by kestasjk » Sun Jul 24, 2022 6:41 am

Trigfea63 wrote:
Tue Jul 12, 2022 3:12 am
That is some very interesting data, thank you.

I don't have any comparable data, I haven't played nearly enough bot games. But your post made me want to share an anecdote on a game I played recently. I was Italy. By the end of 1906, I had lost all my home centers and was down to 2 units and 2 SCs. And yet ...

https://webdiplomacy.net/board.php?game ... #gamePanel

So, yes, it definitely pays to play bot games out all the way to the end!

Also, I am curious if anyone has any insight into Turkey's (and Austria's) behavior/programming that would allow this to happen.
Yeah .. that is very odd, Ill see if paquette wants to take a look

Re: What is the best country in bot games?

by Trigfea63 » Tue Jul 12, 2022 3:12 am

That is some very interesting data, thank you.

I don't have any comparable data, I haven't played nearly enough bot games. But your post made me want to share an anecdote on a game I played recently. I was Italy. By the end of 1906, I had lost all my home centers and was down to 2 units and 2 SCs. And yet ...

https://webdiplomacy.net/board.php?game ... #gamePanel

So, yes, it definitely pays to play bot games out all the way to the end!

Also, I am curious if anyone has any insight into Turkey's (and Austria's) behavior/programming that would allow this to happen.

Re: What is the best country in bot games?

by DougJoe » Mon Jul 11, 2022 7:16 pm

Don't know if people are still into playing the bots, but here's another update - I'm up to 50 games with each power for a total of 350 games. My results:

Code: Select all

Power	Wins	Win %	D	S	E
Austria	9	18.00%	5	9	27
England	14	28.00%	8	15	13
France	23	46.00%	8	9	10
Germany	16	32.00%	9	7	18
Italy	28	56.00%	2	12	8
Russia	20	40.00%	5	11	14
Turkey	35	70.00%	3	9	3
Total	145	41.43%	40	72	93
Since round 30, the last update, the powers have not moved much.
T: 70%->70%
I: 57%->56%
F: 47%->46%
R: 40%->40%
G: 33%->32%
E: 23%->28%
A:14%->18%

I was really hoping to get France up to 50%, Austria up to 20%, and my overall win rate up to 3/7 (roughly 42%) but alas, it was not to be. At some point I will do some deeper analysis based on what my openings were as well as what the bots like to play, but that's going to take some time.

As usual, games and results at: https://docs.google.com/spreadsheets/d/ ... sp=sharing

I ended up building a couple of graphs that show win rate over time - I really like how the one with all the powers split out looks (the graph is below all the data, scroll down to see it.)

Re: What is the best country in bot games?

by Claesar » Thu Jun 10, 2021 12:32 pm

Bladerunners wrote:
Thu Jun 10, 2021 7:51 am
The bots are programmed to recognize human player and will
concentrate moves on the human player. Ex i played england 12 games in a row where all 3 of F/G/R target england. I played next few games as F/G/R and england left alone in each game and did well. Thats not random ...
The bots really cannot. They simply do not have access to that data. However, as they're thinking alike they will understand each other more easily.

Re: What is the best country in bot games?

by Bladerunners » Thu Jun 10, 2021 7:51 am

The bots are programmed to recognize human player and will
concentrate moves on the human player. Ex i played england 12 games in a row where all 3 of F/G/R target england. I played next few games as F/G/R and england left alone in each game and did well. Thats not random ...

Re: What is the best country in bot games?

by Nescio » Thu Jun 03, 2021 12:56 pm

And I'm now at one hundred games against bots. Here are the results (i.e. solo victories):

Code: Select all

Turkey  :  6 /  10 = 0.6
Italy   :  6 /  12 = 0.5
Germany :  5 /  11 = 0.455
France  :  4 /  11 = 0.364
Austria :  6 /  21 = 0.286
Russia  :  3 /  21 = 0.143
England :  2 /  15 = 0.133
  all   : 32 / 101 = 0.317
Compare this with my results from a few months ago, when I had completed only half as many games against bots:

Code: Select all

Turkey  :  4 /  4 = 1
Germany :  3 /  5 = 0.6
Italy   :  2 /  6 = 0.33
Austria :  5 / 17 = 0.29
France  :  1 /  5 = 0.2
England :  1 / 11 = 0.09
Russia  :  0 /  5 = 0
  all   : 16 / 53 = 0.3
It's still a rather small sample, though. Of the openings I've used, I did most only once or twice, and there are still many, many more I haven't tried yet. Ideally every opening ought to be repeated a few thousand times.

Perhaps one of the developers could analyse and share the results of all bot games by all players on this site? That would give a more representative outcome.

Re: What is the best country in bot games?

by Nescio » Mon Apr 19, 2021 7:29 pm

DougJoe wrote:
Mon Apr 19, 2021 4:01 pm
Those are definitely some interesting approaches to Austria! Interesting to see that you've had the most success with the "common" Ser/Alb/Gal. I'd be interested to see the Rum/Alb/Tri solo if you care to provide a link.
That I won win the Ser, Alb, Gal opening a few times is at least partially because I've used it more often, most of the other openings I played only once (and there are still some I haven't tried).
Here's the game you asked for: http://webdiplomacy.net/board.php?gameID=355827
I find this one more interesting, though: http://webdiplomacy.net/board.php?gameID=355819
DougJoe wrote:
Mon Apr 19, 2021 4:01 pm
I completely understand the notion of wanting to try different things and not get bored as opposed to simply trying to win all the time.
Actually I do try to win all the time, that's the objective of the game. I just try to win with different openings, rather than doing the same moves over and over again.
DougJoe wrote:
Mon Apr 19, 2021 4:01 pm
I've always been interested in having a true "database' of each of my games, including all of the orders.
All orders is probably a bit much. Besides, they can already be obtained by following the game links.
Recording only your opening moves makes sense to me: all subsequent orders will (or should) be based on what the other players do.

Re: What is the best country in bot games?

by DougJoe » Mon Apr 19, 2021 4:01 pm

Nescio wrote:
Sun Apr 18, 2021 1:03 pm
It's nice you keep track of your games. However, I'm not really that interested in which countries survived or how many centres they had.
When I started playing against the bots I was curious as to the question of "am I a better player than the AI" which led to the various stat tracking (plus I'm just kind of a stat junkie). I was also curious, since the bot games are gunboat, how the various powers would rank when compared to Swordman's gunboat tier list.
Nescio wrote:
Sun Apr 18, 2021 1:03 pm
Although I like winning, I dislike repetitiveness, and I play against bots to try out different things. I prefer Austria to Turkey, which is boring: the latter has only four realistic opening moves, the former dozens; here are the ones I've tried so far:

Code: Select all

Austria (5 / 18)
Rum, Alb, Bud:
  6-way draw, Autumn 1907
Rum, Alb, Gal:
  eliminated, Spring 1904
Rum, Alb, Tri:
  won, Autumn 1908
Rum, Alb, Tyr:
  7-way draw, Autumn 1901
Rum, Ven, Gal:
  5-way draw, Autumn 1907
Ser, Alb, Bud:
  eliminated, Autumn 1906
Ser, Alb, Gal:
  won, Autumn 1909
  won, Autumn 1909
  won, Autumn 1910
  4-way draw, Autumn 1910
  5-way draw, Autumn 1909
Ser, Alb, Tri: 
  6-way draw, Autumn 1906
  eliminated, Autumn 1905
Ser, Alb, Tyr:
  won, Autumn 1908
  survived, Autumn 1913
Ser, Ven, Gal: 
  5-way draw, Spring 1912
  7-way draw, Autumn 1905
Tri, Adr, Tyr: 
  6-way draw, Autumn 1905
It's a small sample and to do it properly, each opening ought to be repeated many times.

Those are definitely some interesting approaches to Austria! Interesting to see that you've had the most success with the "common" Ser/Alb/Gal. I'd be interested to see the Rum/Alb/Tri solo if you care to provide a link.

I completely understand the notion of wanting to try different things and not get bored as opposed to simply trying to win all the time.
Nescio wrote:
Sun Apr 18, 2021 1:03 pm
I realize 210 games is a lot to go through, yet it would be nice if you could record your opening moves. And if it turns out you usually start with the same moves, try something else more often.
I've always been interested in having a true "database' of each of my games, including all of the orders. I believe that others that play here have come up with mechanisms to pull the moves from games through scraping the HTML- I could probably do something similar to see exactly how varied my openings with each power have been, although I've got enough other little hobby projects going on that it might be a while before I get to it... I do, at least, have the game ID list to start with.

Re: What is the best country in bot games?

by Nescio » Sun Apr 18, 2021 1:03 pm

DougJoe wrote:
Fri Apr 16, 2021 8:21 pm
Nice, thanks for sharing as well! 5 out of 17 as Austria seems pretty good! Apparently my Germany needs work, because everyone else I've read seems to think Germany is easy.
Austria and Germany have the advantage they're in the centre of the map and therefore have many ways to expand. Provided not all their neighbours simultaneously attack them at the start of the game, of course.
DougJoe wrote:
Fri Apr 16, 2021 8:21 pm
Also, as to which bots are "better" than the others, it's hard to tell because the bots stop playing once the human is eliminated (which skews the stats).
Yeah, that's quite annoying. Kestas Bot seems to have a 9% win rate, though, whereas the other bots are at 2% or 3%.
DougJoe wrote:
Fri Apr 16, 2021 8:21 pm
The bots seem to do best with Turkey, France, and Germany, at least according to the numbers that I have in my 210 games. (Again, my stats at https://docs.google.com/spreadsheets/d/ ... sp=sharing ).
It's nice you keep track of your games. However, I'm not really that interested in which countries survived or how many centres they had.
Although I like winning, I dislike repetitiveness, and I play against bots to try out different things. I prefer Austria to Turkey, which is boring: the latter has only four realistic opening moves, the former dozens; here are the ones I've tried so far:

Code: Select all

Austria (5 / 18)
Rum, Alb, Bud:
  6-way draw, Autumn 1907
Rum, Alb, Gal:
  eliminated, Spring 1904
Rum, Alb, Tri:
  won, Autumn 1908
Rum, Alb, Tyr:
  7-way draw, Autumn 1901
Rum, Ven, Gal:
  5-way draw, Autumn 1907
Ser, Alb, Bud:
  eliminated, Autumn 1906
Ser, Alb, Gal:
  won, Autumn 1909
  won, Autumn 1909
  won, Autumn 1910
  4-way draw, Autumn 1910
  5-way draw, Autumn 1909
Ser, Alb, Tri: 
  6-way draw, Autumn 1906
  eliminated, Autumn 1905
Ser, Alb, Tyr:
  won, Autumn 1908
  survived, Autumn 1913
Ser, Ven, Gal: 
  5-way draw, Spring 1912
  7-way draw, Autumn 1905
Tri, Adr, Tyr: 
  6-way draw, Autumn 1905
It's a small sample and to do it properly, each opening ought to be repeated many times.
I realize 210 games is a lot to go through, yet it would be nice if you could record your opening moves. And if it turns out you usually start with the same moves, try something else more often.

Re: What is the best country in bot games?

by Nescio » Sun Apr 18, 2021 12:29 pm

Ogion wrote:
Thu Apr 15, 2021 7:41 pm
Question: do you all play all the way through, even if you're clearly done for? I understand this is good practice to do that.
“Good practice” as in “good sport” or in “good exercise”?
It depends. I'll always issue orders, of course. The objective of the game is to win by controlling the majority of centres on the map, so that's what I aim to achieve.
However, I won't stubbornly go on only to get defeated. Whenever I believe I no longer have a chance of achieving a solo-victory, I'll vote for a draw. I certainly try to survive as long as possible, because all survivors are included in draws. And if at some point other players (or bots) behave unexpectedly, it might allow me to wiggle out of a tricky situation and recover. Getting a hard-fought victory from a near-defeat is far more satisfying than a couple of easy wins.

Re: What is the best country in bot games?

by DougJoe » Fri Apr 16, 2021 8:21 pm

Nescio wrote:
Thu Apr 15, 2021 7:26 pm
Thanks for sharing your results!
Here's how often I've won so far when playing against bots:

Code: Select all

England :  1 / 11 = 0.09
France  :  1 /  5 = 0.2
Italy   :  2 /  6 = 0.33
Germany :  3 /  5 = 0.6
Austria :  5 / 17 = 0.29
Turkey  :  4 /  4 = 1
Russia  :  0 /  5 = 0
  all   : 16 / 53 = 0.3
I realize my sample is rather small and probably not very representative. Moreover, against bots I tend to experiment with different openings (e.g. Mos→Liv, StP→Bot, Sev→Rum, War→Sil as Russia). Furthermore, I occassionally mess up things by not checking my orders.

As for the bots, are some better than others? I've seen them successfully perform a convoy Tun→Syr as Italy, which is fairly predictable, but I don't recall seeing them block it as Turkey.
Nice, thanks for sharing as well! 5 out of 17 as Austria seems pretty good!
Apparently my Germany needs work, because everyone else I've read seems to think Germany is easy.

Also, as to which bots are "better" than the others, it's hard to tell because the bots stop playing once the human is eliminated (which skews the stats). The bots seem to do best with Turkey, France, and Germany, at least according to the numbers that I have in my 210 games. (Again, my stats at https://docs.google.com/spreadsheets/d/ ... sp=sharing ).
Ogion wrote:
Thu Apr 15, 2021 7:41 pm
Question: do you all play all the way through, even if you're clearly done for? I understand this is good practice to do that.
Personally, I do - mostly because I want my statistics to accurately reflect my level of play... I don't want the "failures" to be hidden or masked, so to speak. Plus, sometimes it's actually fun to try to wiggle out of what seems to be impending doom. I could certainly understand why people wouldn't - I rage quit/resign my fair share of chess games after a blunder... but I've seen enough weird things happen with the bots here (especially the later the game goes) that I give it a go.

I just finished this game ( http://webdiplomacy.net/board.php?gameID=356111 ) which was a very rare occurrence of the A/I bots coordinating rather well (often times they don't get the support into AEG correct between them, or Italy simply tries for EMS and is blocked). By the end of 1907, I was down to 1 center, an army in Smyrna. I thought that the A/I kerfuffle in Venice was going to spark a war between them and save me (although it didn't really at the time) and I got back to 3 by the end of 1909. I made a couple of wrong choices in 1910 and 1911 and that was that... but it was fun while it lasted (and I did survive, but I thought I had a chance for a comeback).

I think though, that comebacks from a super-low number of centers to solos are truly fairly rare... this game ( http://webdiplomacy.net/board.php?gameID=339763 ) I think (there's a lot of games to remember!) is the worst position that I've managed to solo from. Had a great start as England, got whooped by Germany mid-game, and in 1918 went from 6 SC to 2 (Por and Mar) and had to disband 4 units. I decided, that winter to dump everything but F Yor and F Por, knowing that Mar was probably doomed and hoping that Por would survive due to the G/I conflict. I thought that, for the most part, it was over - for sure Germany would turn around to chase the fleet in Yor, and I'd eventually lose Por... but he didn't - he bottled up the MAO - and that let me take Edi back. So I was still at two. Using the fleet in Edi as a starting point, I was able to take back Scandinavia and my home centers from Germany while Italy was kept at bay, and then beating through Italy/Iberia/some of Germany's remains... it was a nail-biter all the way, where the 18th center was a fleet that had snuck past the Ionian and could have been blocked out of Con.

Thanks *again* to everyone who was involved in the creation and implementation of the bots!

Re: What is the best country in bot games?

by Ogion » Thu Apr 15, 2021 7:41 pm

Question: do you all play all the way through, even if you're clearly done for? I understand this is good practice to do that.

Re: What is the best country in bot games?

by Nescio » Thu Apr 15, 2021 7:26 pm

Thanks for sharing your results!
Here's how often I've won so far when playing against bots:

Code: Select all

England :  1 / 11 = 0.09
France  :  1 /  5 = 0.2
Italy   :  2 /  6 = 0.33
Germany :  3 /  5 = 0.6
Austria :  5 / 17 = 0.29
Turkey  :  4 /  4 = 1
Russia  :  0 /  5 = 0
  all   : 16 / 53 = 0.3
I realize my sample is rather small and probably not very representative. Moreover, against bots I tend to experiment with different openings (e.g. Mos→Liv, StP→Bot, Sev→Rum, War→Sil as Russia). Furthermore, I occassionally mess up things by not checking my orders.

As for the bots, are some better than others? I've seen them successfully perform a convoy Tun→Syr as Italy, which is fairly predictable, but I don't recall seeing them block it as Turkey.

Re: What is the best country in bot games?

by Fianwa » Sat Apr 10, 2021 6:40 pm

Turkey is very easy for draws, Germany (if you play it right) and Italy are best for wins

Top