AI bots on webDiplomacy: Skynet edition!

Site announcements from the moderator team go here.
Post Reply
Message
Author
Carl Tuckerson
Posts: 457
Joined: Mon Apr 08, 2019 8:23 pm
Karma: 316
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#81 Post by Carl Tuckerson » Mon Sep 16, 2019 11:41 am

AI Austria is faithful to a fault to human Italian players that don't attack it right off the bat. I've run nearly the exact same strategy with Italy now, where I execute a slightly delayed Lepanto and show friendship to Jane while it gets entrenched with AI Russia and AI Turkey. Austria rewards this show of patience by never attacking Venice, even when I convoy both armies into Anatolia, and even helps me kill off Turkey sometimes by supporting me to Constantinople. Austria is then consistently caught off-guard by my building armies in Venice and Naples and loses 2-3 centers to my very telegraphed backstab every single time. I'm surprised Austria even wants to play with me anymore...

https://webdiplomacy.net/board.php?game ... #gamePanel
https://webdiplomacy.net/board.php?game ... #gamePanel
https://webdiplomacy.net/board.php?game ... #gamePanel
https://webdiplomacy.net/board.php?game ... #gamePanel
https://webdiplomacy.net/board.php?game ... #gamePanel
https://webdiplomacy.net/board.php?game ... #gamePanel
https://webdiplomacy.net/board.php?game ... #gamePanel
https://webdiplomacy.net/board.php?game ... #gamePanel

I went on to win six of these eight games, draw one at 17 centers when the AI demonstrated a stalemate line, and 4-way draw another that hadn't reached a clear conclusion because I was stuck in a holding pattern due to atrocious logistical positioning, but which I think probably ends in a 4-way draw or 3-way draw in the end anyway.

I think this specific behavior is slightly too exploitable. I don't know if this is the place we ought to report these things; if another place would be preferred I will resubmit there. But I'm highly confident I am not of the caliber of player to win 75% of gunboats, even if Italy is rapidly becoming my favorite country...

EDIT: Seems I've been preempted a bit and incorrectly referred to the users as the names of the bots, when the bots play each country at random. This is even more interesting to me, as it suggests this exploit is consistent across multiple of the bots (unless I happened to hit the same bot playing Austria eight times in a row).
1

diplomat61
Posts: 89
Joined: Sun Jul 07, 2019 5:08 pm
Karma: 55
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#82 Post by diplomat61 » Mon Sep 16, 2019 11:49 am

Claesar wrote:
Mon Sep 16, 2019 11:34 am
diplomat61 wrote:
Mon Sep 16, 2019 11:24 am
If all bots are equal perhaps it is an indication of hard a particular country is to play.
The bots are distributed randomly, so no. They play all the countries.
Are the bots equal? If so then it would be the context in which they operate, i.e. the country they are playing, that would govern their success.
1

Tugster
Posts: 87
Joined: Sun Dec 31, 2017 12:14 pm
Karma: 87
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#83 Post by Tugster » Mon Sep 16, 2019 2:04 pm

I have played three times, once as England, France and Germany, solo every time. Bots show zero long term awareness of impending solos, continuing to attack their nearest neighbor even while I am passing through 14 or 15 SC on the way to solo. I am a very experienced gunboat player and the bots are way below the skill of an average human player. It is very easy to predict what they will do each turn.
2

Maniac
Bronze Donator
Bronze Donator
Posts: 1813
Joined: Sun Dec 31, 2017 12:20 am
Location: https://www.parliament.uk/
Karma: 1114
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#84 Post by Maniac » Mon Sep 16, 2019 2:10 pm

Can I be the first to thank the AI bots for carrying out this thankless task
7

jmo1121109
Lifetime Site Contributor
Posts: 1099
Joined: Fri Sep 29, 2017 4:20 pm
Karma: 2944
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#85 Post by jmo1121109 » Mon Sep 16, 2019 3:27 pm

Tugster wrote:
Mon Sep 16, 2019 2:04 pm
I have played three times, once as England, France and Germany, solo every time. Bots show zero long term awareness of impending solos, continuing to attack their nearest neighbor even while I am passing through 14 or 15 SC on the way to solo. I am a very experienced gunboat player and the bots are way below the skill of an average human player. It is very easy to predict what they will do each turn.
I see your success didn't continue :). Their play will vary game to game even as the same country.
1

KalelChase
Gold Donator
Gold Donator
Posts: 639
Joined: Sat Jan 13, 2018 4:00 am
Karma: 75
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#86 Post by KalelChase » Mon Sep 16, 2019 4:16 pm

Enjoying the Bots... Two observations.

This may scratch my 'pick-up game' gunboat itch, so I might play less Live games with real people.

I'm not sure I love the 'draw' once I'm eliminated. I'd like the bots to continue so I can see which bot wins.

Other than that this is a fun start. Thanks.

jmo1121109
Lifetime Site Contributor
Posts: 1099
Joined: Fri Sep 29, 2017 4:20 pm
Karma: 2944
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#87 Post by jmo1121109 » Mon Sep 16, 2019 4:21 pm

KalelChase wrote:
Mon Sep 16, 2019 4:16 pm
Enjoying the Bots... Two observations.

This may scratch my 'pick-up game' gunboat itch, so I might play less Live games with real people.

I'm not sure I love the 'draw' once I'm eliminated. I'd like the bots to continue so I can see which bot wins.

Other than that this is a fun start. Thanks.
The bots do not understand stalemate lines, so when we were not forcing the draw some of the bots stalemated each other and made it to year 2600+ in game and crashed the server, which is partially why the site was so slow Friday into Saturday.
2

Johnny Big Horse
Gold Donator
Gold Donator
Posts: 416
Joined: Tue Aug 21, 2018 7:36 am
Karma: 443
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#88 Post by Johnny Big Horse » Mon Sep 16, 2019 4:22 pm

I played 2. One as Germany and got creamed by Russia. The bots were relentless.

The other game I was England, and killed both France and Germany by myself and at the same time. They never combined against me. But I still had to draw, as I was so focused on them, Italy and Austria took the East, and we stalemated.

You guys are really good to beat these bots. I always lose in Gunboat.

This is a great training tool. You can play the same country over and over, until you get it.

tr1285
Posts: 59
Joined: Tue Oct 23, 2018 8:25 pm
Location: NJ, USA
Karma: 79
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#89 Post by tr1285 » Mon Sep 16, 2019 4:59 pm

I've never soloed a gunboat game before I played the bots. I played them and won as Russia. I would tend to agree with some others here they have some room for improvement. I found their moves to be repetitive and predictable and quite passive on defense. My German ally didn't seem to care that I was going to solo.

I'll try some more games though.
1

bo_sox48
Site Admin
Site Admin
Posts: 3901
Joined: Thu Jun 08, 2017 1:01 am
Karma: 2785
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#90 Post by bo_sox48 » Mon Sep 16, 2019 5:09 pm

Claesar wrote:
Mon Sep 16, 2019 11:34 am
Rylanzor wrote:
Mon Sep 16, 2019 11:17 am
Do the points the bots have indicate how good they are?
We should look at their GR next month to see how good they are.
Bot games should be excluded from GR if I remember correctly, and that should include the bot accounts as well.
2

CptMike
Posts: 309
Joined: Sun Dec 31, 2017 8:12 am
Location: Liège, BE
Karma: 54
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#91 Post by CptMike » Mon Sep 16, 2019 6:03 pm

Once again I DO insist :
Thank you very much for introducing bot's on Webdip!

There will be a next step in future to improve the IA's skills ( I have read and understood that we can NOT improve this at short term ) but in 1v1 the bot really made numerous errors:

Trial : CptMike vs IA bot
1

mhsmith0
Posts: 318
Joined: Wed Jan 03, 2018 12:35 am
Karma: 186
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#92 Post by mhsmith0 » Mon Sep 16, 2019 6:33 pm

CptMike wrote:
Mon Sep 16, 2019 6:03 pm
Once again I DO insist :
Thank you very much for introducing bot's on Webdip!

There will be a next step in future to improve the IA's skills ( I have read and understood that we can NOT improve this at short term ) but in 1v1 the bot really made numerous errors:

Trial : CptMike vs IA bot
yeah kinda agree w/ that. was def. a fun game but bot had some issues
http://webdiplomacy.net/board.php?gameI ... nocache=27
fall 1902 mun-bur isn't super obvious from austria but it's borderline gg for france if it hits. not really sure it did great in coin flip type situations, and it wasn't super hard to engineer a 1905 destroy on his berlin army just be continuing to mess around and create weird situations
1

jmo1121109
Lifetime Site Contributor
Posts: 1099
Joined: Fri Sep 29, 2017 4:20 pm
Karma: 2944
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#93 Post by jmo1121109 » Mon Sep 16, 2019 6:42 pm

As previously stated, the bots were NOT trained for 1 vs 1 so their skill in those variants will be significantly less than in classic games.
2

Squigs44
Developer
Developer
Posts: 4003
Joined: Thu Jul 12, 2018 11:50 pm
Location: OKC
Karma: 2010
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#94 Post by Squigs44 » Mon Sep 16, 2019 7:13 pm

bo_sox48 wrote:
Mon Sep 16, 2019 5:09 pm
Claesar wrote:
Mon Sep 16, 2019 11:34 am
Rylanzor wrote:
Mon Sep 16, 2019 11:17 am
Do the points the bots have indicate how good they are?
We should look at their GR next month to see how good they are.
Bot games should be excluded from GR if I remember correctly, and that should include the bot accounts as well.
Well, GR is still in construction (its development took a backseat to implementing the bots), so anything pertaining to GR gets a bit tricky.
The way GR is currently run, bots are treated as normal accounts. The way GR will be run eventually is that games with bots won't count. We may however use those games to approximate the GR of the bot accounts just for the fun stat.
3

Tom Bombadil
Gold Donator
Gold Donator
Posts: 2927
Joined: Tue Oct 03, 2017 1:52 pm
Location: Detroit, MI
Karma: 2524
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#95 Post by Tom Bombadil » Mon Sep 16, 2019 7:37 pm

jmo1121109 wrote:
Mon Sep 16, 2019 6:42 pm
As previously stated, the bots were NOT trained for 1 vs 1 so their skill in those variants will be significantly less than in classic games.
I must be part bot...
3

Carl Tuckerson
Posts: 457
Joined: Mon Apr 08, 2019 8:23 pm
Karma: 316
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#96 Post by Carl Tuckerson » Mon Sep 16, 2019 8:29 pm

@smart people: were the bots trained using a lot of games from the site generally or were they focused on specific users / games?

I have a hunch that the bots' behavior loosely represents the historical webDiplomacy metagame up until the end of their training. Their behavior might reflect general trends in the userbase behavior, which might have practical lessons for non-bot games.

I'm sorry there are so many caveats and hedges in that theory, it rides on an assumption I can't validate. Would be interested to hear the answer :-)
2

Squigs44
Developer
Developer
Posts: 4003
Joined: Thu Jul 12, 2018 11:50 pm
Location: OKC
Karma: 2010
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#97 Post by Squigs44 » Mon Sep 16, 2019 10:14 pm

Carl Tuckerson wrote:
Mon Sep 16, 2019 8:29 pm
@smart people: were the bots trained using a lot of games from the site generally or were they focused on specific users / games?

I have a hunch that the bots' behavior loosely represents the historical webDiplomacy metagame up until the end of their training. Their behavior might reflect general trends in the userbase behavior, which might have practical lessons for non-bot games.

I'm sorry there are so many caveats and hedges in that theory, it rides on an assumption I can't validate. Would be interested to hear the answer :-)
So according to the research paper (linked in the site banner) they used over 150,000 games in their dataset. This includes games on webdip as well as some other sites. So no, the data isn't really targeted.
2

Restitution
Posts: 225
Joined: Thu Jan 31, 2019 7:00 am
Karma: 180
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#98 Post by Restitution » Mon Sep 16, 2019 10:36 pm

What's the reason that the SL models were used here rather than the RL models? Were you not able to produce decent performance with the RL models?
1

captainmeme
Posts: 614
Joined: Fri Sep 29, 2017 3:06 pm
Location: Manchester, UK
Karma: 759
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#99 Post by captainmeme » Mon Sep 16, 2019 11:26 pm

Restitution wrote:
Mon Sep 16, 2019 10:36 pm
What's the reason that the SL models were used here rather than the RL models? Were you not able to produce decent performance with the RL models?
This is answered at the end of the paper:

"Probably the most interesting result to emerge from our analysis is the difference between the SL agent (trained on human data) and the RL agent (trained with self-play). Our coalition analysis suggests that the supervised agent was able to learn to coordinate support orders while this behaviour appears to deteriorate during self-play training."
3

LeonWalras
Posts: 123
Joined: Sun Dec 31, 2017 8:13 am
Karma: 145
Contact:

Re: AI bots on webDiplomacy: Skynet edition!

#100 Post by LeonWalras » Tue Sep 17, 2019 12:52 am

yuuki wrote:
Mon Sep 16, 2019 10:28 am
Has anybody had a bot game in which Italy attacks Austria early? Just curious as the bots seem to love the Austria Italy alliance so far from what I have seen.
Given how popular the opening is on this site, I actually wasn't at all surprised to see Italy attack Austria right off the bat.

http://webdiplomacy.net/board.php?gameID=246397

Post Reply

Who is online

Users browsing this forum: No registered users and 7 guests