User rating/ranking (ELO system)

Comments: 59

• 12 Oct, '19
  Tiffany

  Could be fun. Similar to the Catan app. Although, it may encourage some users to try to "game" or cheat the system by creating fake accounts to play against.

• 14 Oct, '19
  Esqarrouth Admin

  Any ideas how the cheating could be prevented?

• 16 Oct, '19
  Jesse

  Make it mandatory that all players in a game need to be logged in for it to count as a rated game. It will not prevent the issue completely but that is the best that can be done as long as the site is free of cost.

• 29 Oct, '19
  Aubrie

  Maybe come up with ways to detect accounts that are throwing games (one example could be if they do multiple trades of 3+ cards for 1)
  
  And then deduct 1000 elo points from them, so future games won’t count.
  If they complain, review some of their games and see if it was shady. It should be pretty obvious, eg if they play 1 way against the public, but completely different against 1 opponent, against whom they play many times.

• 04 Nov, '19
  Matttyyy

  Adds some sort of competition and motivation to keep playing and winning. Makes it fun even when you play against some lackluster competition.

• 14 Jan
  Jay

  require login for all users

• 14 Jan
  player Merged

  At some point you might reach a level where it's hard to find enough similarly experienced players online without playing tournaments, I'm not sure this is a bad thing.
  
  Perhaps each level requires even more games to get to the next level (ie, maybe level 1 requires 1 game to get to level 2. But Level 10 requires 10 wins to get to the next level.
  
  This feature also implies an option to filter games to similarly ranked players, or to play an unranked game (just fun, right!?)

• 14 Jan
  player Merged

  Oh. And perhaps there is a ceiling for unpaid players. IE... get to rank 5 only if you haven't subscribed.

• 14 Jan
  Connor Merged

  I am not one who would agree with putting a cap on people who dont pay money. But possibly you meant to just have a verified account with email, in which i'd agree and say that would be good.

• 15 Jan
  player

  I'd prefer a ranking system, just to know the players skill, as opposed to a rating system. I just posted a description of that.
  
  The ELO system sucks, and is subject to abuse. If someone thinks they won't win, they start abusing the lowest rank player to ensure they get 2nd place, just to keep their ELO up. It tends to promote abusive/anti-social play.
  
  Also, it's kind of meaningless when a random lucky win by a terrible or low ranked player drops your ELO like a rock.

• 15 Jan
  player

  (High level, the ranking system I suggest (as a start) is you have to win X games against players of similar or higher rank to be bumped up a level. Start at level 1, win some games against level 1+ players, get bumped to level 2. Then you have to win a number of games against level 2+ players to get bumped to level 3.
  
  I suggest making it win X of games for your level. So Level 1 requires 1 win against Level 1+ players. Level 10 requires 10 wins against level 10+ players.)

• 16 Jan
  player Merged

  Conner, what is your opinion of the approach to ranking? Or tweaks you think would be productive.

• 28 Jan
  DA

  Some sort of monitoring system for players that seem to win excessively? Are they always playing with the same players, obvious game throwing trades, fast win times? Of course the ban hammer should drop if accused players are caught.
  
  Hope you guys can come up with something because it would make the game that much more enticing! Keep up the good work!

• 16 Mar
  Gemma

  was working, now isn't??

• 21 Mar
  PotatoRiot

  I really like players proposal! This would prevent abuse starting from lever 2 (well one could farm accounts to get to a higher level with the main account but well at least the top 10 players one would see in their history if they only played with the same accounts over and over again...)

• 15 Apr
  LTAlex

  Also to prevent cheating you can create a calibrating system for new accounts and get fewer points for playing against lower-rated players.

• 24 Apr
  OnTheBrinkMN

  Way back when, when I played Catan on Sea3D (S3Dconnector), they had a pretty good ratingsystem, with a possibility to report abuses and stuff. Players with same IP-adresses and using fake accounts to boost their rating would be blocked (for a certain period) eventually if someone reported it. Worked fine then (more than 10 years ago), so can't see why it shouldn't work now

• 27 Apr
  player Merged

  No, ELO sucks as a way of calculating rankings and it wasn't designed for this style of game (it was designed for chess where there was no element of randomness, two players, and no bots to abuse/game). I do agree some kind of ranking system would be useful and have proposed a loose idea for one, basically that you can only increase in rank, and that is done by winning a certain number of games against equal or higher ranked opponents

• 27 Apr
  player Merged

  Some of the biggest flaws of ELO is it gives way too big a ELO boost (or ELO hit) for a lucky win by an unskilled opponent, or encourages people to play for 2nd by abusing low position players, or encourages people to drive a player to quit and then game the bot to win (or let the bot win) to gain ELO.

• 11 May
  Chris Merged

  I think this would be a fantastic addition.
  
  First, ELO would have to be coded into the game, and some thought placed into that - would you see opponents' ELO before the game starts? Would you be able to create a table with minimum and maximum ELO, etc. etc.
  BoardGameArena would be good to compare against, they have it pretty well down pat if you ask me.
  
  Currently a player's profile shows Wins, Games, Points, Win %, Pts/game, and Karma. [CONTINUED]

• 11 May
  Chris Merged

  With the addition of ELO, allowing sorting by different columns, perhaps a new "season" that starts every 3 or 4 months, and separate leaderboards for "vs humans only" and "All games", it would be all set.

• 12 May
  player Merged

  In the long run ELO works. Gotta learn how to math.

• 13 May
  Sasha Wilde Admin

  "Rank [ELO] system with ranked gameplay" (suggested by LukeFish on 2020-04-25), including upvotes (3) and comments (3), was merged into this suggestion.

• 13 May
  Sasha Wilde Admin

  "Add a Leader board on the home page" (suggested by Kenpachi on 2020-04-12), including upvotes (4) and comments (2), was merged into this suggestion.

• 13 May
  Sasha Wilde Admin

  "Enhancement: Player ranking based on games won against similarly ranked players" (suggested by player on 2020-01-14), including upvotes (2) and comments (4), was merged into this suggestion.

• 13 May
  Sasha Wilde Admin

  "Ranking" (suggested by Natasha on 2020-02-28), including upvotes (1) and comments (0), was merged into this suggestion.

• 16 May
  Elma Houghton Merged

  to rate somebody during the game,, ie if they drop out, are horrid, or do not play well.. i know its dubious.. but maybe as a personal rating as well as the rating we have for how many games we play.

• 16 May
  Valeria Merged

  Like this idea... o u can select o kick someone based on that. Is very anoying when people retired bcs they dont like the numbers o for the karma. If u could rate them when game is finish even if they leave before..

• 16 May
  player Merged

  I understand the intent, but surely sure this system would be equally misused. I've played more than enough games where people are clearly playing with their friends and as such just target the 3rd or 4th player. How do you think they'll rank the 4th person who complains or quits due to overly aggressive and bullying players!?

• 22 May
  Zak

  I think the rank/rating system could work by making a rank queue that you have to queue into in order to prevent people from botting and winning their games. If there isn’t a queue for ranked then there is no way to actually play with people that are your rank/skill, nor is there a way to not prevent cheating

• 27 May
  Raj Merged

  Similar to chess, you could implement an Elo system where players can increase / decrease their Elo as they play more games. It is a good way to track your improvement and progress and would incentivize more people to play alone vs. with their friends.

• 29 May
  player Merged

  ELO is not suitable for Catan. I agree there should be a ranked system where if you win X games against similarly (or higher) ranked players your rank goes up, but having it drop drastically because of bad dice or poor play by other unskilled players (who screw up a game) isn't reasonable. There's to much luck and variables for ELO to be accurate (unlike chess which is 1-on-1 and entirely skill based)

• 29 May
  player Merged

  And honestly I don't think your rank should ever drop, you don't lose experience or skill from losing a game. You just aren't worthy of a higher ranking (yet)

• 31 May
  Puddnhead

  ELO would be great. The risk of people gaming the system to improve their ELO doesn't matter much to me. The main point is to protect the low-rated players who are new to the game from having to be paired with experts. It's no fun to try out a new game and then lose every game.

• 26 Jun
  Donna Merged

  no comment

• 01 Jul
  NFOGhost Merged

  I was looking for the same. I would like to know who is strong so I can either play against them or spectate them.

• 02 Jul
  Jared

  Since there already is a huge tournament presence through Discord and Instagram for Colonist and other Catan apps, creating a ranked system and tournaments through Colonist would put it ahead of many other competitors such as Catan Universe and Catan VR

• 24 Jul
  Troy

  I like this idea, but also like the idea of just general personal stats. Win pct, average place, win streak, etc.

• 24 Jul
  Troy

  I like the idea of a rating system, but it sounds a little complex/could be controversial, probably not high priority. At the least a leaderboard would be really cool. Giving the user the option to sort by wins, points, points per game, win pct, games played, games finished, finished pct, etc. Being able to filter on daily, weekly, monthly.

• 24 Jul
  Troy Merged

  LOVE the idea of a leaderboard. Would be really cool. Giving the user the option to sort by wins, points, points per game, win pct, games played, games finished, finished pct, etc. Being able to filter on daily, weekly, monthly stats.

• 24 Jul
  Troy Merged

  Also, you should be able to filter on game rules. If I am looking at a win pct leaderboard, I am only curious about win percentages of games with the same number of players. Player A with a win pct of 45% that only plays 2 person games is not comparable to Player B with win pct of 35% that only plays 4 player games. Same goes for points per game.

• 30 Jul
  Austin Admin

  "Create a ranked ladder where you can climb up the ranks by playing similarly ranked players" (suggested by Raj on 2020-05-27), including upvotes (6) and comments (2), was merged into this suggestion.

• 15 Aug
  JUAN Admin

  "Leaderboard of wins and points" (suggested by Matt on 2020-05-21), including upvotes (4) and comments (3), was merged into this suggestion.

• 15 Aug
  JUAN Admin

  "Earn points for wins. Lose points to quit a game" (suggested by Donna on 2020-06-26), including upvotes (1) and comments (1), was merged into this suggestion.

• 18 Aug
  JUAN Admin

  "give someone a rating based on their play" (suggested by Elma Houghton on 2020-05-16), including upvotes (4) and comments (2), was merged into this suggestion.

• 26 Aug
  Shikamaru

  It would be nice to include a "power score" statistic in each player's profile. Win rate does not tell whole story because the "odds" for players of equivalent skill winning a 1v1 game (50%) > odds of winning a 1v4 game (25%). Power score = Overall winrate divided by "overall expected winrate." Expected winrate = (#2 person games)(1/2) + (#3 person games)(1/3) + (#4 person games)(1/4).... I'd also suggest removing games where 50% or more of the players are bots from the calculation.

• 26 Aug
  Shikamaru Merged

  A player's win rate is not a great measure of that player's skill. That is because your odds of winning a 2 person game are higher than your odds of winning a 4 person game. Therefore two players of equivalent skill are likely to have much different win rates if one player tends to play 3 person games and the other tends to play 4 person games. A"power score" can normalize a player's "actual win rate" by that player's "expected win rate." Expected win rate = (# of 2 person games played)(1/2)

• 26 Aug
  Shikamaru Merged

  As a follow on: there are many ways to translate the above calculation into a user-friendly number. One way: the "power score" could be indexed to 100 for ease of interpretation. For example, assume a player exclusively plays 4-person games, and that player has a 25% winrate. That player's power score could be 100 (i.e. 25%/25% x 100). Under this system, if a player plays exclusively 4-person games and has a 40% winrate, then that player would have a power score of 160 (i.e. 40%/25% x 100).

• 26 Aug
  john Merged

  This seems rather confusing, and tells you nothing about the skill of their opponents. I'd prefer a ranking system, where someone's rank (starting at zero) only increases [by 1] after X wins against similar or higher ranked players. If you beat someone of a lower rank, that's meaningless as you should have won. [Rank should never decrease, as losing a game doesn't decrease your skill]. This would allow filtering by skill. [Some refinement needed to prevent friend circles from gaming it]

• 26 Aug
  john Merged

  At the very least, 2 player vs 3 player vs 4 player are different games, so I don't see how you can lump them together under a single rating.

• 26 Aug
  Shikamaru Merged

  I agree that a ranking system would be best. However, I'm suggesting a simple addition to a player's profile that normalizes their winrate to account for the fact that it is easier to win a 2-person game than a 4-person game. A ranking system like the one you suggest is a major development effort. The "power score" I suggest is a simple metric that can be added to a player's profile. It is a much easier "ask" from developers and would serve as a useful way of assessing player skill for now

• 26 Aug
  JUAN Admin

  "Add "power score" to each player's profile" (suggested by Shikamaru on 2020-08-26), including upvotes (5) and comments (4), was merged into this suggestion.

• 28 Aug
  JUAN Admin

  "Super league" (suggested by Halit on 2020-04-18), including upvotes (1) and comments (0), was merged into this suggestion.

• 09 Sep
  Anton

  For ELO system: Different rankings for 4-player games, 3-player games, and 2-player games.
  
  The goal here is that people want to be matched with people of similar skill.
  
  Alternative to ELO: You could ask players if they want to queue in “normal” or “experienced”. Slap on some requirements such as, at least X amount of wins. You could also do a survey at the end of the game “rate this game :( , :/ , :)” and look at difference in player stats to see which variables are off in :( games

• 13 Sep
  tmblwd

  Definite support for ELO (maximum change per game could easily be reduced for Catan to limit the random swings element).
  I also play AOE2 that uses the first 10 games you play to put you at roughly the correct rank. For these matches larger changes are allowed.
  
  Ranked queues are great! Try to match with those at same level and increase window depending on how many people in the queue.
  
  I don't care for leader tables, but for me the ranking and queing are very important developments.

• 29 Sep
  JUAN Admin

  "Implement an Elo System for Ranked Play" (suggested by Joshua Migneco on 2020-09-29), including upvotes (1) and comments (0), was merged into this suggestion.

• 06 Oct
  Ollie

  Definitely needs an ELO system. Would play and spend much more money.

• 16 Oct
  Konidias

  Simple way to curb cheating would be to charge a small one time fee to unlocked ranked matches. ($5 or something). This would let you play against other ranked players and the $5 charge would reduce the amount of people trolling/cheating as getting caught would result in them losing money. This has always been a decent deterrent in online games.

• 2 days ago
  Stroom

  Glicko2 seems like the best option.
  Usable out of the box, it seems. Have to add some database on your side.
  https://www.npmjs.com/package/glicko2