AI performance
Posted: Sun Dec 11, 2022 5:24 am
Hi all,
With FAIR winding down their AI research they’ve decommissioned their FairBot which used to run our FvA GvI games. As a stopgap I subbed in the MILA bot just to see if it worked at all, and it looks like it does and at least plays sensibly.
However I’ve never played an FvA game to any level of competence, so I don’t know if “FairBot” is effectively broken now. Can someone decent at FvA/GvI give an AI game a go and let me know how it goes?
Note we are trying to host the FAIR no-press bots ourselves, just like we’re hosting the MILA bots right now, as soon as possible to provide a higher difficulty level.
We also want to provide CICERO games asap, but that will be trickier due to the heavy hardware requirements. In order to be the first site to offer this, which I think webDiplomacy should be, we may need to have a system where we integrate into AWS/Azure so that we can quickly spin up a 56 GPU system to play a game for just the brief periods we need.
In this way we might be able to have CICERO full-text games, but we’d need to figure out how much the IaaS costs would be since these cloud services are often a lot pricier than you would guess. You think okay I’ll spin up 56 CPUs, use it for a few minutes, then shut it down, that should cost a few minutes, but they always have tricks where the minimum time period is an hour so that you get these huge unexpected bills.
Anyway any feedback on FvA/GvI performance would be appreciated.
With FAIR winding down their AI research they’ve decommissioned their FairBot which used to run our FvA GvI games. As a stopgap I subbed in the MILA bot just to see if it worked at all, and it looks like it does and at least plays sensibly.
However I’ve never played an FvA game to any level of competence, so I don’t know if “FairBot” is effectively broken now. Can someone decent at FvA/GvI give an AI game a go and let me know how it goes?
Note we are trying to host the FAIR no-press bots ourselves, just like we’re hosting the MILA bots right now, as soon as possible to provide a higher difficulty level.
We also want to provide CICERO games asap, but that will be trickier due to the heavy hardware requirements. In order to be the first site to offer this, which I think webDiplomacy should be, we may need to have a system where we integrate into AWS/Azure so that we can quickly spin up a 56 GPU system to play a game for just the brief periods we need.
In this way we might be able to have CICERO full-text games, but we’d need to figure out how much the IaaS costs would be since these cloud services are often a lot pricier than you would guess. You think okay I’ll spin up 56 CPUs, use it for a few minutes, then shut it down, that should cost a few minutes, but they always have tricks where the minimum time period is an hour so that you get these huge unexpected bills.
Anyway any feedback on FvA/GvI performance would be appreciated.