User Ranking/Leaderboards (ELO system)

Comments: 106

• 12 Oct, '19
  Tiffany

  Could be fun. Similar to the Catan app. Although, it may encourage some users to try to "game" or cheat the system by creating fake accounts to play against.

• 14 Oct, '19
  Esqarrouth Admin

  Any ideas how the cheating could be prevented?

• 16 Oct, '19
  Jesse

  Make it mandatory that all players in a game need to be logged in for it to count as a rated game. It will not prevent the issue completely but that is the best that can be done as long as the site is free of cost.

• 29 Oct, '19
  Aubrie

  Maybe come up with ways to detect accounts that are throwing games (one example could be if they do multiple trades of 3+ cards for 1)
  
  And then deduct 1000 elo points from them, so future games won’t count.
  If they complain, review some of their games and see if it was shady. It should be pretty obvious, eg if they play 1 way against the public, but completely different against 1 opponent, against whom they play many times.

• 04 Nov, '19
  Matttyyy

  Adds some sort of competition and motivation to keep playing and winning. Makes it fun even when you play against some lackluster competition.

• 14 Jan, '20
  Jay

  require login for all users

• 14 Jan, '20
  player Merged

  At some point you might reach a level where it's hard to find enough similarly experienced players online without playing tournaments, I'm not sure this is a bad thing.
  
  Perhaps each level requires even more games to get to the next level (ie, maybe level 1 requires 1 game to get to level 2. But Level 10 requires 10 wins to get to the next level.
  
  This feature also implies an option to filter games to similarly ranked players, or to play an unranked game (just fun, right!?)

• 14 Jan, '20
  player Merged

  Oh. And perhaps there is a ceiling for unpaid players. IE... get to rank 5 only if you haven't subscribed.

• 14 Jan, '20
  Connor Merged

  I am not one who would agree with putting a cap on people who dont pay money. But possibly you meant to just have a verified account with email, in which i'd agree and say that would be good.

• 15 Jan, '20
  player

  I'd prefer a ranking system, just to know the players skill, as opposed to a rating system. I just posted a description of that.
  
  The ELO system sucks, and is subject to abuse. If someone thinks they won't win, they start abusing the lowest rank player to ensure they get 2nd place, just to keep their ELO up. It tends to promote abusive/anti-social play.
  
  Also, it's kind of meaningless when a random lucky win by a terrible or low ranked player drops your ELO like a rock.

• 15 Jan, '20
  player

  (High level, the ranking system I suggest (as a start) is you have to win X games against players of similar or higher rank to be bumped up a level. Start at level 1, win some games against level 1+ players, get bumped to level 2. Then you have to win a number of games against level 2+ players to get bumped to level 3.
  
  I suggest making it win X of games for your level. So Level 1 requires 1 win against Level 1+ players. Level 10 requires 10 wins against level 10+ players.)

• 16 Jan, '20
  player Merged

  Conner, what is your opinion of the approach to ranking? Or tweaks you think would be productive.

• 28 Jan, '20
  DA

  Some sort of monitoring system for players that seem to win excessively? Are they always playing with the same players, obvious game throwing trades, fast win times? Of course the ban hammer should drop if accused players are caught.
  
  Hope you guys can come up with something because it would make the game that much more enticing! Keep up the good work!

• 16 Mar, '20
  Gemma

  was working, now isn't??

• 21 Mar, '20
  PotatoRiot

  I really like players proposal! This would prevent abuse starting from lever 2 (well one could farm accounts to get to a higher level with the main account but well at least the top 10 players one would see in their history if they only played with the same accounts over and over again...)

• 15 Apr, '20
  LTAlex

  Also to prevent cheating you can create a calibrating system for new accounts and get fewer points for playing against lower-rated players.

• 24 Apr, '20
  OnTheBrinkMN

  Way back when, when I played Catan on Sea3D (S3Dconnector), they had a pretty good ratingsystem, with a possibility to report abuses and stuff. Players with same IP-adresses and using fake accounts to boost their rating would be blocked (for a certain period) eventually if someone reported it. Worked fine then (more than 10 years ago), so can't see why it shouldn't work now

• 27 Apr, '20
  player Merged

  No, ELO sucks as a way of calculating rankings and it wasn't designed for this style of game (it was designed for chess where there was no element of randomness, two players, and no bots to abuse/game). I do agree some kind of ranking system would be useful and have proposed a loose idea for one, basically that you can only increase in rank, and that is done by winning a certain number of games against equal or higher ranked opponents

• 27 Apr, '20
  player Merged

  Some of the biggest flaws of ELO is it gives way too big a ELO boost (or ELO hit) for a lucky win by an unskilled opponent, or encourages people to play for 2nd by abusing low position players, or encourages people to drive a player to quit and then game the bot to win (or let the bot win) to gain ELO.

• 11 May, '20
  Chris Merged

  I think this would be a fantastic addition.
  
  First, ELO would have to be coded into the game, and some thought placed into that - would you see opponents' ELO before the game starts? Would you be able to create a table with minimum and maximum ELO, etc. etc.
  BoardGameArena would be good to compare against, they have it pretty well down pat if you ask me.
  
  Currently a player's profile shows Wins, Games, Points, Win %, Pts/game, and Karma. [CONTINUED]

• 11 May, '20
  Chris Merged

  With the addition of ELO, allowing sorting by different columns, perhaps a new "season" that starts every 3 or 4 months, and separate leaderboards for "vs humans only" and "All games", it would be all set.

• 12 May, '20
  player Merged

  In the long run ELO works. Gotta learn how to math.

• 13 May, '20
  Sasha Wilde Admin

  "Rank [ELO] system with ranked gameplay" (suggested by LukeFish on 2020-04-25), including upvotes (3) and comments (3), was merged into this suggestion.

• 13 May, '20
  Sasha Wilde Admin

  "Add a Leader board on the home page" (suggested by Kenpachi on 2020-04-12), including upvotes (4) and comments (2), was merged into this suggestion.

• 13 May, '20
  Sasha Wilde Admin

  "Enhancement: Player ranking based on games won against similarly ranked players" (suggested by player on 2020-01-14), including upvotes (2) and comments (4), was merged into this suggestion.

• 13 May, '20
  Sasha Wilde Admin

  "Ranking" (suggested by Natasha on 2020-02-28), including upvotes (1) and comments (0), was merged into this suggestion.

• 16 May, '20
  Elma Houghton Merged

  to rate somebody during the game,, ie if they drop out, are horrid, or do not play well.. i know its dubious.. but maybe as a personal rating as well as the rating we have for how many games we play.

• 16 May, '20
  Valeria Merged

  Like this idea... o u can select o kick someone based on that. Is very anoying when people retired bcs they dont like the numbers o for the karma. If u could rate them when game is finish even if they leave before..

• 16 May, '20
  player Merged

  I understand the intent, but surely sure this system would be equally misused. I've played more than enough games where people are clearly playing with their friends and as such just target the 3rd or 4th player. How do you think they'll rank the 4th person who complains or quits due to overly aggressive and bullying players!?

• 22 May, '20
  Zak

  I think the rank/rating system could work by making a rank queue that you have to queue into in order to prevent people from botting and winning their games. If there isn’t a queue for ranked then there is no way to actually play with people that are your rank/skill, nor is there a way to not prevent cheating

• 27 May, '20
  Raj Merged

  Similar to chess, you could implement an Elo system where players can increase / decrease their Elo as they play more games. It is a good way to track your improvement and progress and would incentivize more people to play alone vs. with their friends.

• 29 May, '20
  player Merged

  ELO is not suitable for Catan. I agree there should be a ranked system where if you win X games against similarly (or higher) ranked players your rank goes up, but having it drop drastically because of bad dice or poor play by other unskilled players (who screw up a game) isn't reasonable. There's to much luck and variables for ELO to be accurate (unlike chess which is 1-on-1 and entirely skill based)

• 29 May, '20
  player Merged

  And honestly I don't think your rank should ever drop, you don't lose experience or skill from losing a game. You just aren't worthy of a higher ranking (yet)

• 31 May, '20
  Puddnhead

  ELO would be great. The risk of people gaming the system to improve their ELO doesn't matter much to me. The main point is to protect the low-rated players who are new to the game from having to be paired with experts. It's no fun to try out a new game and then lose every game.

• 26 Jun, '20
  Donna Merged

  no comment

• 01 Jul, '20
  NFOGhost Merged

  I was looking for the same. I would like to know who is strong so I can either play against them or spectate them.

• 02 Jul, '20
  Jared

  Since there already is a huge tournament presence through Discord and Instagram for Colonist and other Catan apps, creating a ranked system and tournaments through Colonist would put it ahead of many other competitors such as Catan Universe and Catan VR

• 24 Jul, '20
  Troy

  I like this idea, but also like the idea of just general personal stats. Win pct, average place, win streak, etc.

• 24 Jul, '20
  Troy

  I like the idea of a rating system, but it sounds a little complex/could be controversial, probably not high priority. At the least a leaderboard would be really cool. Giving the user the option to sort by wins, points, points per game, win pct, games played, games finished, finished pct, etc. Being able to filter on daily, weekly, monthly.

• 24 Jul, '20
  Troy Merged

  LOVE the idea of a leaderboard. Would be really cool. Giving the user the option to sort by wins, points, points per game, win pct, games played, games finished, finished pct, etc. Being able to filter on daily, weekly, monthly stats.

• 24 Jul, '20
  Troy Merged

  Also, you should be able to filter on game rules. If I am looking at a win pct leaderboard, I am only curious about win percentages of games with the same number of players. Player A with a win pct of 45% that only plays 2 person games is not comparable to Player B with win pct of 35% that only plays 4 player games. Same goes for points per game.

• 30 Jul, '20
  Austin Admin

  "Create a ranked ladder where you can climb up the ranks by playing similarly ranked players" (suggested by Raj on 2020-05-27), including upvotes (6) and comments (2), was merged into this suggestion.

• 15 Aug, '20
  JUAN Admin

  "Leaderboard of wins and points" (suggested by Matt on 2020-05-21), including upvotes (4) and comments (3), was merged into this suggestion.

• 15 Aug, '20
  JUAN Admin

  "Earn points for wins. Lose points to quit a game" (suggested by Donna on 2020-06-26), including upvotes (1) and comments (1), was merged into this suggestion.

• 18 Aug, '20
  JUAN Admin

  "give someone a rating based on their play" (suggested by Elma Houghton on 2020-05-16), including upvotes (4) and comments (2), was merged into this suggestion.

• 26 Aug, '20
  Shikamaru

  It would be nice to include a "power score" statistic in each player's profile. Win rate does not tell whole story because the "odds" for players of equivalent skill winning a 1v1 game (50%) > odds of winning a 1v4 game (25%). Power score = Overall winrate divided by "overall expected winrate." Expected winrate = (#2 person games)(1/2) + (#3 person games)(1/3) + (#4 person games)(1/4).... I'd also suggest removing games where 50% or more of the players are bots from the calculation.

• 26 Aug, '20
  Shikamaru Merged

  A player's win rate is not a great measure of that player's skill. That is because your odds of winning a 2 person game are higher than your odds of winning a 4 person game. Therefore two players of equivalent skill are likely to have much different win rates if one player tends to play 3 person games and the other tends to play 4 person games. A"power score" can normalize a player's "actual win rate" by that player's "expected win rate." Expected win rate = (# of 2 person games played)(1/2)

• 26 Aug, '20
  Shikamaru Merged

  As a follow on: there are many ways to translate the above calculation into a user-friendly number. One way: the "power score" could be indexed to 100 for ease of interpretation. For example, assume a player exclusively plays 4-person games, and that player has a 25% winrate. That player's power score could be 100 (i.e. 25%/25% x 100). Under this system, if a player plays exclusively 4-person games and has a 40% winrate, then that player would have a power score of 160 (i.e. 40%/25% x 100).

• 26 Aug, '20
  john Merged

  This seems rather confusing, and tells you nothing about the skill of their opponents. I'd prefer a ranking system, where someone's rank (starting at zero) only increases [by 1] after X wins against similar or higher ranked players. If you beat someone of a lower rank, that's meaningless as you should have won. [Rank should never decrease, as losing a game doesn't decrease your skill]. This would allow filtering by skill. [Some refinement needed to prevent friend circles from gaming it]

• 26 Aug, '20
  john Merged

  At the very least, 2 player vs 3 player vs 4 player are different games, so I don't see how you can lump them together under a single rating.