EIDRaS Ratings
Forum rules
This forum is limited to topics relating to the game Diplomacy only. Other posts or topics will be relocated to the correct forum category or deleted. Please be respectful and follow our normal site rules at http://www.webdiplomacy.net/rules.php.
This forum is limited to topics relating to the game Diplomacy only. Other posts or topics will be relocated to the correct forum category or deleted. Please be respectful and follow our normal site rules at http://www.webdiplomacy.net/rules.php.
Re: EIDRaS Ratings
Cool, I'll tell the script to ignore them for now. You might have missed my edit but I also need the weighting for Known World. I assume 0.25?
- ghug
- Bronze Donator
- Posts: 18263
- Joined: Mon Mar 20, 2017 3:51 pm
- Location: Seattle
- Karma: 11573
- Contact:
Re: EIDRaS Ratings
I didn't, I just didn't know yet. HR says it's the same as World. I'll try to get git updated soon.
Re: EIDRaS Ratings
Are games under a certain length excluded (i.e. 3 turns or less)?
I'm trying to reconcile the games played and am running into issues.
I'm trying to reconcile the games played and am running into issues.
Re: EIDRaS Ratings
GR excludes games that finish in 1904 or before, I believe.
I've been told this cut-off is not arbitrary; one cannot win a solo victory before 1905.
I've been told this cut-off is not arbitrary; one cannot win a solo victory before 1905.
- ghug
- Bronze Donator
- Posts: 18263
- Joined: Mon Mar 20, 2017 3:51 pm
- Location: Seattle
- Karma: 11573
- Contact:
Re: EIDRaS Ratings
It's just before 1904. A solo is theoretically possible in 1904, though practically unachievable.
Re: EIDRaS Ratings
Thanks.
Last issue before I can post a proper comparison:
There are some users (e.g. shaun.thompson) who are listed as banned in the csv dump you posted but are included in the Ghost Rating and are not banned on the site so I think the GR list must be grabbing the banned list from another (more correct) table.
Last issue before I can post a proper comparison:
There are some users (e.g. shaun.thompson) who are listed as banned in the csv dump you posted but are included in the Ghost Rating and are not banned on the site so I think the GR list must be grabbing the banned list from another (more correct) table.
-
- Posts: 1167
- Joined: Thu Oct 19, 2017 5:36 pm
- Karma: 117
- Contact:
Re: EIDRaS Ratings
Isn't it possible for a solo to be achieved in 1903 as well? Let's look at each of the countries path to victory:
Russia's trajectory is something like this:
1901 - 4 SCs to 8 SCs - 4 units to 8 units
1902 - 8 SCs to 16 SCs - 8 units to 12 units
1903 - 16 SCs to 28 SCs - 12 units to 16 units
And for the other countries (except England) something like this:
1901 - 3 SCs to 6 SCs - 3 units to 6 units
1902 - 6 SCs to 12 SCs - 6 units to 9 units
1903 - 12 SCs to 21 SCs - 9 units to 12 units
And England's trajectory something like this?
1901 - 3 SCs to 5 SCs - 3 units to 5 units
1902 - 5 SCs to 10 SCs - 5 units to 8 units
1903 - 10 SCs to 18 SCs - 8 units to 11 units
- ghug
- Bronze Donator
- Posts: 18263
- Joined: Mon Mar 20, 2017 3:51 pm
- Location: Seattle
- Karma: 11573
- Contact:
Re: EIDRaS Ratings
Not all of your units can take centers every year. It's possible Russia can solo in 1903, but I think it's 1904, and for some it's only 1905.
@Yonni, I'm not sure about that. I know GR just uses the dump.
@Yonni, I'm not sure about that. I know GR just uses the dump.
-
- Posts: 6908
- Joined: Fri Oct 20, 2017 2:11 pm
- Location: possibly Britain
- Karma: 9624
- Contact:
Re: EIDRaS Ratings
I don't think a 1903 solo is possible without Russia's neighbors actively vacating centers for Russia to take. i.e. It won't happen naturally.
-
- Posts: 1167
- Joined: Thu Oct 19, 2017 5:36 pm
- Karma: 117
- Contact:
Re: EIDRaS Ratings
Well obviously it's realistically impossible to solo in 3 years with any of the countries, but it is possible to solo in 3 years.President Eden wrote: ↑Tue Jan 23, 2018 7:59 pmI don't think a 1903 solo is possible without Russia's neighbors actively vacating centers for Russia to take. i.e. It won't happen naturally.
Re: EIDRaS Ratings
After a quick and entirely not rigorous look through the database, the quickest solo I could find that looked somewhat legit was Russia in 1907:
http://www.webdiplomacy.net/board.php?gameID=11156
http://www.webdiplomacy.net/board.php?gameID=11156
Re: EIDRaS Ratings
Here is a side-by-side comparison of Ghost Rating and EIDRaS in a convenient Google Sheet so everyone should be able to access it:
https://docs.google.com/spreadsheets/d/ ... sp=sharing
A few comments:
https://docs.google.com/spreadsheets/d/ ... sp=sharing
A few comments:
- This is for all variant and press types except for 1v1
- The weightings for each variant are the same as for GR
- There is a slight discrepancy in the games played for some people and I'm not sure why
- GR is meant to exclude games that end at 1903 or earlier. However, I believe the code just excludes games that end at turn 3 or earlier (i.e. 1902). I've given EIDRaS the same cutoff for the sake of comparison
- Some of the biggest risers are newer players (e.g. Kugs). This is a feature of EIDRaS as it allows people to reach their "true rating" quicker. The amount that the system does that can be tweaked later
- On that note, there are a bunch of variables that can be tweaked in EIDRaS. If people are interested in adopting it as a rating system, we can have discussions about what values people would like.
-
- Posts: 1167
- Joined: Thu Oct 19, 2017 5:36 pm
- Karma: 117
- Contact:
Re: EIDRaS Ratings
Taking a look at all of the games that were won in 3 years I see quite a bit of blatantly obvious cheating. However I was able to find the following games which were won in 3 years and were legitimate solos:Yonni wrote: ↑Tue Jan 23, 2018 9:48 pmAfter a quick and entirely not rigorous look through the database, the quickest solo I could find that looked somewhat legit was Russia in 1907:
http://www.webdiplomacy.net/board.php?gameID=11156
http://webdiplomacy.net/board.php?gameID=158353
http://webdiplomacy.net/board.php?gameID=89551
http://webdiplomacy.net/board.php?gameID=158353
Based on this I feel like these games should at least be included in the user's GR; or any other rating system your using.
-
- Posts: 190
- Joined: Thu Mar 23, 2017 1:57 am
- Location: Chicago, Illinois, USA
- Karma: 81
- Contact:
Re: EIDRaS Ratings
I disagree. Players were told that games ending before 1904 would not count towards GR, so I think the same should be upheld for YR. A lot of games that result in CD are drawn in 1903 are done so because of the fact that these games would not could, so the very small number of "legitimate" solos would be heavily outnumbered by the erroneous counting of games that were draw for the explicit reason of it not being counted.ChippeRock wrote: ↑Tue Jan 23, 2018 10:29 pmTaking a look at all of the games that were won in 3 years I see quite a bit of blatantly obvious cheating. However I was able to find the following games which were won in 3 years and were legitimate solos:Yonni wrote: ↑Tue Jan 23, 2018 9:48 pmAfter a quick and entirely not rigorous look through the database, the quickest solo I could find that looked somewhat legit was Russia in 1907:
http://www.webdiplomacy.net/board.php?gameID=11156
http://webdiplomacy.net/board.php?gameID=158353
http://webdiplomacy.net/board.php?gameID=89551
http://webdiplomacy.net/board.php?gameID=158353
Based on this I feel like these games should at least be included in the user's GR; or any other rating system your using.
- ghug
- Bronze Donator
- Posts: 18263
- Joined: Mon Mar 20, 2017 3:51 pm
- Location: Seattle
- Karma: 11573
- Contact:
Re: EIDRaS Ratings
Did you change the expected result calculation for each scoring system? The existing one is tailored to DSS. We expect the best players to do even better in SoS and the worst players to do even worse, and we expect the opposite in PPSC.
-
- Posts: 1167
- Joined: Thu Oct 19, 2017 5:36 pm
- Karma: 117
- Contact:
Re: EIDRaS Ratings
I never said put all games that ended early in this category here. I just said put those specific games in. Also, it's basically impossible to find a game where no one NMRed or CDed in. So I don't think you should exclude games. Perhaps you could make sure that results of a game with a NMR or CD don't matter as much as a game without a NMR or CD but that's about all you should do in my opinion.Yoyoyozo wrote: ↑Tue Jan 23, 2018 11:32 pmI disagree. Players were told that games ending before 1904 would not count towards GR, so I think the same should be upheld for YR. A lot of games that result in CD are drawn in 1903 are done so because of the fact that these games would not could, so the very small number of "legitimate" solos would be heavily outnumbered by the erroneous counting of games that were draw for the explicit reason of it not being counted.ChippeRock wrote: ↑Tue Jan 23, 2018 10:29 pmTaking a look at all of the games that were won in 3 years I see quite a bit of blatantly obvious cheating. However I was able to find the following games which were won in 3 years and were legitimate solos:Yonni wrote: ↑Tue Jan 23, 2018 9:48 pmAfter a quick and entirely not rigorous look through the database, the quickest solo I could find that looked somewhat legit was Russia in 1907:
http://www.webdiplomacy.net/board.php?gameID=11156
http://webdiplomacy.net/board.php?gameID=158353
http://webdiplomacy.net/board.php?gameID=89551
http://webdiplomacy.net/board.php?gameID=158353
Based on this I feel like these games should at least be included in the user's GR; or any other rating system your using.
You can also find many games with instances of cheating, so I don't think you should remove games that had cheating neither.
-
- Gold Donator
- Posts: 2694
- Joined: Tue Mar 21, 2017 10:28 pm
- Location: Brighton, UK
- Karma: 1333
- Contact:
Re: EIDRaS Ratings
I really enjoy how Bo is basically the only person to have the exact same rank in both systems. Not even Maths can change Bo being the worst ![Very Happy :-D](./images/smilies/icon_e_biggrin.gif)
![Very Happy :-D](./images/smilies/icon_e_biggrin.gif)
Re: EIDRaS Ratings
The expected score doesn't change with the scoring system but I'm not sure what you mean that it's tailored for DSS. How would you go about changing it for the other systems?
- ghug
- Bronze Donator
- Posts: 18263
- Joined: Mon Mar 20, 2017 3:51 pm
- Location: Seattle
- Karma: 11573
- Contact:
Re: EIDRaS Ratings
Basically, you're never going to get much more than 50% of the pot in PPSC, so expected values have to be lowered. The squares aspect of SoS exacerbates the disparity in results, so expected values have to be spread out accordingly.
Re: EIDRaS Ratings
Ah, the truth finally comes out.Hellenic Riot wrote: ↑Wed Jan 24, 2018 12:17 amI really enjoy how Bo is basically the only person to have the exact same rank in both systems. Not even Maths can change Bo being the worst :-D
Both of those games, one of which you listed twice, were pretty terrible. When we talk about a natural solo, that implies that everyone actually plays with some mark of competency, no? A solo in five or six years is very much possible, but even four years seems far fetched without some players literally walking out of their centers to make way for a single unit to move in.ChippeRock wrote: ↑Tue Jan 23, 2018 10:29 pmTaking a look at all of the games that were won in 3 years I see quite a bit of blatantly obvious cheating. However I was able to find the following games which were won in 3 years and were legitimate solos:Yonni wrote: ↑Tue Jan 23, 2018 9:48 pmAfter a quick and entirely not rigorous look through the database, the quickest solo I could find that looked somewhat legit was Russia in 1907:
http://www.webdiplomacy.net/board.php?gameID=11156
http://webdiplomacy.net/board.php?gameID=158353
http://webdiplomacy.net/board.php?gameID=89551
http://webdiplomacy.net/board.php?gameID=158353
Based on this I feel like these games should at least be included in the user's GR; or any other rating system your using.
Who is online
Users browsing this forum: No registered users and 164 guests