[Site] Normalize Player Ratings (Average = 0)

This forum is a storehouse for all Finalized Suggestions to be periodically reviewed during Feature Updates.

Moderators: Suggestions Team, Global Moderators

Forum rules
Please read the Community Guidelines before posting.

Should we change the rating system, or leave it as it is?

Yes, change it.
78
52%
No, leave it.
71
48%
 
Total votes : 149

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby MichelSableheart on Fri Sep 24, 2010 4:12 pm

The simplest answer to this is they don't average 3. For me, I only rate if I have a really good or bad experience (or if I'm really bored so I decide to get closer to ther medal). In games like that, everyone is good, so it's rare to have a really bad experience
So those players will be rated mostly 4-5 (or 1-2 in the proposal), because they are better then the average player. This will cause them to stand out in positive direction. I would say that this is exactly what you want.

Regarding your second point: even if it is not helpful for you, it is an improvement over the current situation (where those 5% of players is not recognizable at all), without any negative result compared to the current situation.
User avatar
Colonel MichelSableheart
 
Posts: 610
Joined: Sat Jun 27, 2009 5:10 pm
Medals: 21
Standard Achievement (2) Doubles Achievement (1) Triples Achievement (1) Quadruples Achievement (1) Manual Troops Achievement (1)
Fog of War Achievement (2) Speed Achievement (1) Teammate Achievement (1) Random Map Achievement (1) Cross-Map Achievement (1)
Ratings Achievement (3) Tournament Achievement (1) General Achievement (1) Clan Achievement (3) Tournament Contribution (1)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby temporos on Fri Sep 24, 2010 7:42 pm

jrh: Why are you so fiercely opposed to this idea? Is it because you're worried about losing your 4.7 "above average - outstanding" rating and being seen as merely "average" (which is what 4.7 represents now)?

You are correct in that only 5%-ish of the CC players will deviate further than 0.1 or 0.2 from the average under the new system. This is exactly what is supposed to happen. The truly exceptional (good and bad) players will be the ones beyond three standard deviations from the norm, and statistically, this should be way below 5%.

The current system is broken by definition: above average is now considered average, defeating the whole purpose. If this is a bad idea, then what is your proposed solution to the ratings problem?
--
The Great and Powerful T.

... What? This is a game of global conquest, isn't it? ;)
User avatar
Sergeant 1st Class temporos
 
Posts: 40
Joined: Sun Jul 04, 2010 6:37 pm
Location: Grand Rapids, Michigan, United States
Medals: 5
Standard Achievement (1) Manual Troops Achievement (1) Fog of War Achievement (1) Trench Warfare Achievement (1) Ratings Achievement (1)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby Metsfanmax on Fri Sep 24, 2010 7:46 pm

jrh is opposed to it because he thinks it's unfortunate that clans will no longer have a nice number that they can use to arbitrarily exclude people :P
User avatar
Sergeant 1st Class Metsfanmax
 
Posts: 4014
Joined: Wed Apr 11, 2007 11:01 pm
Location: NY
Medals: 43
Standard Achievement (3) Doubles Achievement (2) Triples Achievement (1) Quadruples Achievement (1) Terminator Achievement (1)
Assassin Achievement (1) Manual Troops Achievement (2) Freestyle Achievement (1) Nuclear Spoils Achievement (1) Fog of War Achievement (3)
Trench Warfare Achievement (1) Speed Achievement (3) Teammate Achievement (1) Random Map Achievement (1) Cross-Map Achievement (1)
Battle Royale Achievement (1) Ratings Achievement (2) Tournament Achievement (1) General Achievement (7) Clan Achievement (2)
General Contribution (7)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby jrh_cardinal on Fri Sep 24, 2010 10:54 pm

Metsfanmax wrote:jrh is opposed to it because he thinks it's unfortunate that clans will no longer have a nice number that they can use to arbitrarily exclude people :P

put in a very crude way, ya, that's a good reason

another (which I have said much more often) is in general, random people in public games do not rate as much as cc obsessed people who play a lot of private/tournament/clan games. And if you get rated by a greater percent of people, your rating will be farther from 0 in whichever general direction people rate you.

I have made valid point after valid point, your guys response every time is "but if it works out perfectly it will work out perfectly"
duh. That's what the original rating scale was supposed to do, along with everything else ever created, work out perfectly. However, it will not work out perfectly.


And temporos, thank you.
First, I know statistics, including 68-95-99.7 rule (the exact numbers vary slightly based on who you're talking to, but it's close). Have you calculated the standard deviation of player ratings under the new scale? No, because there is no new scale yet, so there's no data to analyze. I was just throwing out a number, had nothing to do with statistics or standard deviation.

Second, over 99% of people are within 2 standard deviations of the mean. In a truly perfect -2 to 2 rating scale, this would be from about -1 to 1, because you only need to go out about 4 standard deviations total (you don't need to distinguish between the top 0.00014% of the population or whatever it is). That way there are numbers to distinguish between the 40th percentile and the 60th percentile. In your example, which is exactly what would happen because everyone's rating is being massively weighed towards the center,
temporos wrote:only 5%-ish of the CC players will deviate further than 0.1 or 0.2 from the average under the new system.

So if 95% of players are -.2 to .2 (your larger parameter), that's two standard deviations, 68% of players are at -.1, 0, or .1, and most of those are at 0. How does that help anyone? Even in your utopian world, like half the site has the exact same rating, 0. It helps more in the current system, at least there's a difference between 4.4 and 4.9, plus there is 4.5, 4.6, 4.7, and 4.8 in the middle, so the people know in general what block to group you in. In the new way, everyone currently with a 4.5-4.8 would have a 0, IN THE BEST CASE SCENARIO.

temporos wrote:Is it because you're worried about losing your 4.7 "above average - outstanding" rating and being seen as merely "average" (which is what 4.7 represents now)?

I could care less what my rating is. Besides, anyone who's played 10 games on cc knows 4.7 is merely average. And what are you doing insulting my rating when you have a 4.4?

temporos wrote:The current system is broken by definition: above average is now considered average, defeating the whole purpose. If this is a bad idea, then what is your proposed solution to the ratings problem?

Why does everything have to be a problem? What do you care who the top 2.5% of the cc population in those three categories are? Team partners? I know plenty of goody-two-shoes, people with really high ratings (as in 4.9's), that I absolutely would not want to partner with consistently, and plenty of 4.6's that are really fun.
The current rating scale defines the overly rude/complaining types (4.5 and down usually). Those are the only people you should consider writing off just for their rating, everyone else could easily be fun to play with.

Your rating scale defines the Gandhi's and the Hitler's, then everyone else has a 0, that doesn't help.
Image
User avatar
Sergeant 1st Class jrh_cardinal
 
Posts: 2715
Joined: Sat May 16, 2009 7:15 pm
Medals: 74
Standard Achievement (3) Doubles Achievement (2) Triples Achievement (2) Quadruples Achievement (3) Terminator Achievement (1)
Assassin Achievement (2) Manual Troops Achievement (2) Freestyle Achievement (2) Nuclear Spoils Achievement (2) Fog of War Achievement (3)
Speed Achievement (2) Random Map Achievement (1) Cross-Map Achievement (3) Ratings Achievement (2) Tournament Achievement (7)
General Achievement (3) Clan Achievement (2) Tournament Contribution (30) General Contribution (2)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby Metsfanmax on Fri Sep 24, 2010 11:13 pm

jrh_cardinal wrote:
Metsfanmax wrote:jrh is opposed to it because he thinks it's unfortunate that clans will no longer have a nice number that they can use to arbitrarily exclude people :P

put in a very crude way, ya, that's a good reason

another (which I have said much more often) is in general, random people in public games do not rate as much as cc obsessed people who play a lot of private/tournament/clan games. And if you get rated by a greater percent of people, your rating will be farther from 0 in whichever general direction people rate you.

I have made valid point after valid point, your guys response every time is "but if it works out perfectly it will work out perfectly"
duh. That's what the original rating scale was supposed to do, along with everything else ever created, work out perfectly. However, it will not work out perfectly.



None of your points are valid in the sense that none of them are offensive reasons not to make this switch; they're all defensive reasons why it might not work. But as long as you agree that there is a new motivation, even if you don't share in our optimism that people will change, then it's worth a shot.

If nothing else, then this scale will cause most peoples' ratings to fall in the center of the ratings scale, which is ideal. It also makes it a lot easier to rate honestly. Currently people are afraid of giving out 1's and 2's for fear of being foed or rated harshly in turn, because those ratings are seen as being far outside the "real" rating scale. This would solve that problem, because if the average is 0, then giving out a -1 is suddenly not really a huge criticism, it just says you're below average.
User avatar
Sergeant 1st Class Metsfanmax
 
Posts: 4014
Joined: Wed Apr 11, 2007 11:01 pm
Location: NY
Medals: 43
Standard Achievement (3) Doubles Achievement (2) Triples Achievement (1) Quadruples Achievement (1) Terminator Achievement (1)
Assassin Achievement (1) Manual Troops Achievement (2) Freestyle Achievement (1) Nuclear Spoils Achievement (1) Fog of War Achievement (3)
Trench Warfare Achievement (1) Speed Achievement (3) Teammate Achievement (1) Random Map Achievement (1) Cross-Map Achievement (1)
Battle Royale Achievement (1) Ratings Achievement (2) Tournament Achievement (1) General Achievement (7) Clan Achievement (2)
General Contribution (7)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby jrh_cardinal on Fri Sep 24, 2010 11:36 pm

Metsfanmax wrote:None of your points are valid in the sense that none of them are offensive reasons not to make this switch; they're all defensive reasons why it might not work. But as long as you agree that there is a new motivation, even if you don't share in our optimism that people will change, then it's worth a shot.

My points are perfectly valid. I know that he current rating scale isn't perfect, I'm stating my opinion why this new system will not work, you're saying why you think it will. Respond to my points or don't comment from now on, thanks.

Ans no, I don't agree. I have conceded all of the stuff I can not prove, such as motivation, to say why even if your ideas work exactly as you want them to, we will still be worse off.
I'm tired of saying the same things twice with no substance from you in the middle. If you are going to continue to spew out bs like this without responding to my actual point, I'm not going to respond.

Metsfanmax wrote:If nothing else, then this scale will cause most peoples' ratings to fall in the center of the ratings scale, which is ideal. It also makes it a lot easier to rate honestly. Currently people are afraid of giving out 1's and 2's for fear of being foed or rated harshly in turn, because those ratings are seen as being far outside the "real" rating scale. This would solve that problem, because if the average is 0, then giving out a -1 is suddenly not really a huge criticism, it just says you're below average.

No, incorrect. Another thing I conceded in order to conclude that even if it works out perfectly for you guys most people's rating will be 0 so it will still be a bad change. I think that either people will continue to not rate, or in your utopia, people will continue to rate high, as you proved in your own post a while back (another thing you stopped responding to).

So you're worried about what someone who you gave a 1 thinks about you? Personally, anyone that is deserving of me giving a 1, I'd rather never play again anyway, at least not for a while.

Below average is not a criticism?
Image
User avatar
Sergeant 1st Class jrh_cardinal
 
Posts: 2715
Joined: Sat May 16, 2009 7:15 pm
Medals: 74
Standard Achievement (3) Doubles Achievement (2) Triples Achievement (2) Quadruples Achievement (3) Terminator Achievement (1)
Assassin Achievement (2) Manual Troops Achievement (2) Freestyle Achievement (2) Nuclear Spoils Achievement (2) Fog of War Achievement (3)
Speed Achievement (2) Random Map Achievement (1) Cross-Map Achievement (3) Ratings Achievement (2) Tournament Achievement (7)
General Achievement (3) Clan Achievement (2) Tournament Contribution (30) General Contribution (2)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby Bruceswar on Sat Sep 25, 2010 12:49 am

this debate is far too long to get into but I will say this. If having you not rated means you are average then WTF do we have ratings for? The whole premise of 0 being auto given is silly. jhr has made many good points which you guys fail to miss. The top 5% of the scoreboard are generally addicts or at least care enough to rate some or a few people. So say we use the average is 0.. but the average player (according the the scores) is close to 1000. Now in my eyes anybody who is not over 1400 is below average, so that means I think 75% or more of CC is below average. Do I rate like so? Hell no as it would only wreck a lower ranks chances of getting into games. As the current system is setup, anybody who rated how people should be, would likely be in C&A for ratings abuse. Giving someone 1 star, 2 stars and 3 stars is generally looked upon as "WTF did you do that for?" If I rated 75% of the people I rated 3 stars or less, I would have had my rights revoked long ago. Everybody see's average as different thing. I generally rate people all 5's unless they give me a reason to rate them lower, which I do not do often. OK so enough ratings talk...

Scrap it and bring feedback back!
Highest Rank: 26 Highest Score: 3480
Image
User avatar
Captain Bruceswar
 
Posts: 9562
Joined: Sun Dec 23, 2007 12:36 am
Location: Cow Pastures
Medals: 141
Monthly Leader Bronze (1) Standard Achievement (4) Doubles Achievement (4) Triples Achievement (4) Quadruples Achievement (4)
Terminator Achievement (3) Assassin Achievement (3) Manual Troops Achievement (3) Freestyle Achievement (4) Polymorphic Achievement (1)
Nuclear Spoils Achievement (2) Fog of War Achievement (4) Trench Warfare Achievement (1) Speed Achievement (4) Teammate Achievement (3)
Random Map Achievement (2) Cross-Map Achievement (4) Beta Map Achievement (1) Battle Royale Achievement (1) Ratings Achievement (4)
Tournament Achievement (14) General Achievement (14) Clan Achievement (19) Training Achievement (6) Map Contribution (1)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby MichelSableheart on Sat Sep 25, 2010 2:00 am

@Jrh: what makes you think that under the proposed system, we wouldn't be able to recognize the overly rude/complaining types that the current system allows you to identify? Those would still be in the lower tier of the ratings.

Similary, I fail to see why the fact why someone who consistently plays private/tournament/clan games getting rated more is a problem. If those players indeed do rate more because they care more about the site, then in general the ratings they give will also more accurately reflect the ratee's ability. As such, someone they consistently rate 5's is definately above average, and deserves to stand out.

Thirdly, what percentage of players only rates someone all 5's if they think the player is exceptionally well, and don't rate if they think someone is average? If that percentage is high, introducing the new system would have a signficantly positive effect on the accuracy of ratings. The ratings wouldn't collapse all around 0, as you are suggesting, but actually spread out.
User avatar
Colonel MichelSableheart
 
Posts: 610
Joined: Sat Jun 27, 2009 5:10 pm
Medals: 21
Standard Achievement (2) Doubles Achievement (1) Triples Achievement (1) Quadruples Achievement (1) Manual Troops Achievement (1)
Fog of War Achievement (2) Speed Achievement (1) Teammate Achievement (1) Random Map Achievement (1) Cross-Map Achievement (1)
Ratings Achievement (3) Tournament Achievement (1) General Achievement (1) Clan Achievement (3) Tournament Contribution (1)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby MichelSableheart on Sat Sep 25, 2010 2:08 am

@Brucewar: Speaking from experience, if you consistently rated players you consider average 3 stars, you would get a complaint in C&A about once or twice a year, which has no results whatsoever because you aren't abusing the system. However, the mere fact that rating someone average is for some players considered abuse is exactly what we are trying to fix.
User avatar
Colonel MichelSableheart
 
Posts: 610
Joined: Sat Jun 27, 2009 5:10 pm
Medals: 21
Standard Achievement (2) Doubles Achievement (1) Triples Achievement (1) Quadruples Achievement (1) Manual Troops Achievement (1)
Fog of War Achievement (2) Speed Achievement (1) Teammate Achievement (1) Random Map Achievement (1) Cross-Map Achievement (1)
Ratings Achievement (3) Tournament Achievement (1) General Achievement (1) Clan Achievement (3) Tournament Contribution (1)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby TheForgivenOne on Sat Sep 25, 2010 2:14 am

I'd also like to point out the fact that many players don't rate anyone at all. I've seen players who have been here for a long long time only rate a max of 5 people. Many people just rate either A: Players they like. or B: Players they dislike. Just because they didn't rate the player, does not make them average. I have played Cooks that I thought played well, but didn't rate them. I've played Majors and Colonels that played like aces, but I didn't rate them. I for one, on the majority, only rate people that I don't enjoy playing. Does that make every other player I versed normal? No.
Image
User avatar
Sergeant TheForgivenOne
 
Posts: 5154
Joined: Fri May 15, 2009 8:27 pm
Location: Lost somewhere in the snow. HELP ME
Medals: 83
Standard Achievement (4) Doubles Achievement (3) Triples Achievement (3) Quadruples Achievement (3) Terminator Achievement (3)
Assassin Achievement (3) Manual Troops Achievement (3) Freestyle Achievement (4) Nuclear Spoils Achievement (3) Fog of War Achievement (4)
Trench Warfare Achievement (2) Speed Achievement (3) Teammate Achievement (2) Random Map Achievement (2) Cross-Map Achievement (3)
Beta Map Achievement (1) Battle Royale Achievement (2) Ratings Achievement (3) General Achievement (14) Clan Achievement (7)
General Contribution (11)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby Bruceswar on Sat Sep 25, 2010 5:04 am

MichelSableheart wrote:@Brucewar: Speaking from experience, if you consistently rated players you consider average 3 stars, you would get a complaint in C&A about once or twice a year, which has no results whatsoever because you aren't abusing the system. However, the mere fact that rating someone average is for some players considered abuse is exactly what we are trying to fix.



If I had a 5 pages of rating that were 75% 1's 2's and 3's .. There would be more than 2 threads, or I would be turned in as an abuser. Average is in the eye of the beholder. To a cook anybody above him looks good. To someone like me most all players look like shit when they play. No offense to any low ranks.
Highest Rank: 26 Highest Score: 3480
Image
User avatar
Captain Bruceswar
 
Posts: 9562
Joined: Sun Dec 23, 2007 12:36 am
Location: Cow Pastures
Medals: 141
Monthly Leader Bronze (1) Standard Achievement (4) Doubles Achievement (4) Triples Achievement (4) Quadruples Achievement (4)
Terminator Achievement (3) Assassin Achievement (3) Manual Troops Achievement (3) Freestyle Achievement (4) Polymorphic Achievement (1)
Nuclear Spoils Achievement (2) Fog of War Achievement (4) Trench Warfare Achievement (1) Speed Achievement (4) Teammate Achievement (3)
Random Map Achievement (2) Cross-Map Achievement (4) Beta Map Achievement (1) Battle Royale Achievement (1) Ratings Achievement (4)
Tournament Achievement (14) General Achievement (14) Clan Achievement (19) Training Achievement (6) Map Contribution (1)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby Metsfanmax on Sat Sep 25, 2010 7:48 am

jrh_cardinal wrote:My points are perfectly valid. I know that he current rating scale isn't perfect, I'm stating my opinion why this new system will not work, you're saying why you think it will. Respond to my points or don't comment from now on, thanks.


If your points have no meaning in this debate, then there's no point wasting time discussing them. All of the arguments that are potential reasons why people might not change their ratings attitude are irrelevant, because they're pure speculation. As long as there are legitimate reasons why people might actually change the way they rate (which there are), then the change is worth a shot. Neither of us can accurately predict how people will respond to this change. It is my belief that people will rate more as a result of this change being put into place, and as a result, the ratings system will become more accurate, which is the goal here. Furthermore, even if people don't rate more, the mean score will still be about 0, and having the center of the scale be the mean is ideal, which is reason enough to implement this change.

Yes, it would be ideal if people would use all 5 stars from the beginning, so that the average was 3. But since people tend to rate in such a way that the average is heavily skewed towards the tail of the scale, clearly we need to try something new if we ever want it to change.

Ans no, I don't agree. I have conceded all of the stuff I can not prove, such as motivation, to say why even if your ideas work exactly as you want them to, we will still be worse off.
I'm tired of saying the same things twice with no substance from you in the middle. If you are going to continue to spew out bs like this without responding to my actual point, I'm not going to respond.


I'm not "spewing out BS," and that's an unfair way to avoid responding to what I'm saying. I've answered your points reasonably by observing that none of what you said shows that we'll be worse off. The only point that even comes close to that is your claim that because most people will have a score with magnitude no higher than 0.2, it will be harder for clans and other groups to figure out who the good (and bad) players are. What you fail to also observe is that since the current scale now has everyone more or less at 4.8 plus or minus 0.2, this can't make the system any worse. Furthermore, it gives you more room at the top of the spectrum to figure out who the truly exceptional players are - having a 4.9 or 5.0 does not indicate greatness currently, because people are so free with their 5's. Anyone who scored above 0.2 in the new system would actually be legitimately highly rated, and so you could find players that way.

The reason why it's a bad idea to discard players with ratings under 4.6, for clans, is that it effectively reinforces the pettiness of the current system. You're encouraging players to artificially inflate the ratings system in order to make themselves look better. Someone with a 4.4 rating ought to actually be a very good player, if you consider the scale objectively. Plus, all it takes is a few vindictive 1's from spiteful players to bring down a newer player's average - and I know that's happened to all of us. This is why I have no sympathy for that argument - the best way to fix the system is to reward people for giving honest ratings. Barring that, the next best thing is what was suggested here.


No, incorrect. Another thing I conceded in order to conclude that even if it works out perfectly for you guys most people's rating will be 0 so it will still be a bad change. I think that either people will continue to not rate, or in your utopia, people will continue to rate high, as you proved in your own post a while back (another thing you stopped responding to).


That doesn't make it a bad change, that just means that some of our goals might not be achieved. And no, I didn't "prove" that people will continue to rate high. I actually observed that people will be motivated to simply give more ratings in the hopes that players will rate them back highly - and players may rate them back, and give them low ratings, but that's a good thing if it means people are giving honest ratings. I find it unlikely that if players get low ratings, they'll suddenly stop giving out ratings - we don't see that in the current system, and there's even more of a motivation now in that sense, since low ratings affect you more.

So you're worried about what someone who you gave a 1 thinks about you? Personally, anyone that is deserving of me giving a 1, I'd rather never play again anyway, at least not for a while.


Again, you're outright enforcing the terribleness of the current system. It is true that in many cases now, people give spiteful 1's, perhaps because they didn't like your personality in game chat and so they rate you a 1 for gameplay. Still, if someone legitimately thinks you're a bad player and rates you a 1, you're going to just ignore them? Above, you said that I need to respond to your points and not ignore them. Are you not going to apply that logic to your own situation? Are you so convinced that you are absolutely a great player that you're not even willing to consider someone else's point of view on the matter?

If someone gives me a non-spite 1, it means that in some way I wasn't doing a good job, and I certainly care when people tell me that. If you don't care about the same, then why are you even bothering discussing the ratings system?

Below average is not a criticism?


It's not a huge criticism. Please don't take my words out of context just to try to win a point - it's childish.
User avatar
Sergeant 1st Class Metsfanmax
 
Posts: 4014
Joined: Wed Apr 11, 2007 11:01 pm
Location: NY
Medals: 43
Standard Achievement (3) Doubles Achievement (2) Triples Achievement (1) Quadruples Achievement (1) Terminator Achievement (1)
Assassin Achievement (1) Manual Troops Achievement (2) Freestyle Achievement (1) Nuclear Spoils Achievement (1) Fog of War Achievement (3)
Trench Warfare Achievement (1) Speed Achievement (3) Teammate Achievement (1) Random Map Achievement (1) Cross-Map Achievement (1)
Battle Royale Achievement (1) Ratings Achievement (2) Tournament Achievement (1) General Achievement (7) Clan Achievement (2)
General Contribution (7)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby temporos on Sat Sep 25, 2010 11:13 am

I do not understand the "everbody's a winner" attitude that motivates people to rate everyone as "outstanding" (5 stars).

The system is broken (i.e., it doesn't work as designed). There are three possible solutions to this:
  1. Do nothing. CC goes on using a ratings system that has become absolutely meaningless.
  2. Normalize player ratings. The ratings system has a chance of becoming meaningful, and if it fails, then it wouldn't be any less meaningful than the current system.
  3. Scrap the ratings system altogether. If we can't agree on a system that has a chance of working properly, then the system should be removed entirely.
--
The Great and Powerful T.

... What? This is a game of global conquest, isn't it? ;)
User avatar
Sergeant 1st Class temporos
 
Posts: 40
Joined: Sun Jul 04, 2010 6:37 pm
Location: Grand Rapids, Michigan, United States
Medals: 5
Standard Achievement (1) Manual Troops Achievement (1) Fog of War Achievement (1) Trench Warfare Achievement (1) Ratings Achievement (1)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby Woodruff on Sat Sep 25, 2010 11:33 am

jrh_cardinal wrote:If you play against premium oficers in clans/usergroups, they are much more likely to rate because they simply care more about the game than some freemie private you meet in a random public game.


This freemie private takes a lot of exception to that statement. I am not a member of any clans or usergroups nor will I ever be, yet I am quite active in the fora, to include the Suggestions and Cheating and Abuse fora. I also organize tournaments for people who are so inclined to participate in. Other than tournament games, I play almost exclusively public games. And finally, I rate every player I play against every time I play them. I would wager that I am at least above average on the "caring about the game/website" among even premium officers, yet I certainly don't fit the box you've created to put "players that care" into.

As for this thread, in my view the real key is that THERE IS NO DOWNSIDE to it. It may revert to being just what we have now, that's true...but it really CAN'T get any worse. And there is a reasonable possibility that it may actually correct the system.
...I prefer a man who will burn the flag and then wrap himself in the Constitution to a man who will burn the Constitution and then wrap himself in the flag.
User avatar
Corporal 1st Class Woodruff
 
Posts: 4964
Joined: Sat Jan 05, 2008 9:15 am
Medals: 27
Standard Achievement (4) Quadruples Achievement (1) Terminator Achievement (2) Manual Troops Achievement (1) Fog of War Achievement (3)
Speed Achievement (3) Teammate Achievement (1) Random Map Achievement (1) Cross-Map Achievement (3) Ratings Achievement (4)
Tournament Contribution (4)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby jrh_cardinal on Sat Sep 25, 2010 7:38 pm

Woodruff wrote:
jrh_cardinal wrote:If you play against premium oficers in clans/usergroups, they are much more likely to rate because they simply care more about the game than some freemie private you meet in a random public game.


This freemie private takes a lot of exception to that statement. I am not a member of any clans or usergroups nor will I ever be, yet I am quite active in the fora, to include the Suggestions and Cheating and Abuse fora. I also organize tournaments for people who are so inclined to participate in. Other than tournament games, I play almost exclusively public games. And finally, I rate every player I play against every time I play them. I would wager that I am at least above average on the "caring about the game/website" among even premium officers, yet I certainly don't fit the box you've created to put "players that care" into.

As for this thread, in my view the real key is that THERE IS NO DOWNSIDE to it. It may revert to being just what we have now, that's true...but it really CAN'T get any worse. And there is a reasonable possibility that it may actually correct the system.

In general, woodruff.

Clearly none of us are going to change each others viewpoints. Temporos and max, all of my points have said why I think we will be worse off. I'm fine with you disagreeing with that, but it pisses me off when you say I never say why it will be any worse, because I do. I'm done arguing, it's up to lack and tfo to pick who they agree with.

To sum up:
I don't care if it's in the middle of the scale, I care if I can tell who the rude/obnoxious players are. If that means people with 4.9's are rude/obnoxious, fine, I can make sure I only partner with 5.0's. Under the new system, if everything goes as you want it to, and I mean everything, then we are still worse off. Everyone who is not Gandhi or Hitler will be within .1 of 0, as you admitted. Most will be at 0. That doesn't help me determine players who I will not have fun partnering with.

edit- maybe we can get a poll tfo?
Image
User avatar
Sergeant 1st Class jrh_cardinal
 
Posts: 2715
Joined: Sat May 16, 2009 7:15 pm
Medals: 74
Standard Achievement (3) Doubles Achievement (2) Triples Achievement (2) Quadruples Achievement (3) Terminator Achievement (1)
Assassin Achievement (2) Manual Troops Achievement (2) Freestyle Achievement (2) Nuclear Spoils Achievement (2) Fog of War Achievement (3)
Speed Achievement (2) Random Map Achievement (1) Cross-Map Achievement (3) Ratings Achievement (2) Tournament Achievement (7)
General Achievement (3) Clan Achievement (2) Tournament Contribution (30) General Contribution (2)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby temporos on Sat Sep 25, 2010 9:08 pm

jrh_cardinal wrote:Temporos... it pisses me off when you say I never say why it will be any worse...

I don't believe I ever said that. Yes, I wasn't the only one mentioned in that paragraph, but if you're going to make accusations, you must be specific and distinct.

I am curious about why you are becoming so emotionally disturbed by this debate. I'm trying to look at it from a logical, mathematical point-of-view. My goal is not "sticking it to" anyone here. I have made observations and suggested what I believe to be the most logical course of action. If you prefer the status-quo, so be it. It's ultimately up to the mods to decide.
--
The Great and Powerful T.

... What? This is a game of global conquest, isn't it? ;)
User avatar
Sergeant 1st Class temporos
 
Posts: 40
Joined: Sun Jul 04, 2010 6:37 pm
Location: Grand Rapids, Michigan, United States
Medals: 5
Standard Achievement (1) Manual Troops Achievement (1) Fog of War Achievement (1) Trench Warfare Achievement (1) Ratings Achievement (1)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby AAFitz on Sat Sep 25, 2010 9:27 pm

the rating system works perfectly how it is. the rating tells you exactly what you will get from a player. the only thing that doesnt match up is the actual label to the number, but after a few games, its not hard to figure out what the ratings mean

4.1 will be a pain in the ass every time and a 5.0 will hardly ever be. they are all a little bit of both between that. Your suggestion would actually make it harder, because there would be less degrees of criteria. right now there are 5.0 to 4.0 essentially
anyone below 4.0 is the same as 4.0 with a near guarantee to either play insane, or chat insane.
john9blue wrote:"honestly i think martin might be better off dead"

sekretar: "i go to russia and then, without comp, i hoppe, i forgot this shit who kill my nerves long time!"
User avatar
Lieutenant AAFitz
 
Posts: 7222
Joined: Sun Sep 17, 2006 9:47 am
Location: On top of the World 2.1
Medals: 84
Monthly Leader Bronze (1) Standard Achievement (4) Doubles Achievement (4) Triples Achievement (4) Quadruples Achievement (3)
Terminator Achievement (2) Assassin Achievement (3) Manual Troops Achievement (4) Freestyle Achievement (4) Polymorphic Achievement (2)
Nuclear Spoils Achievement (3) Fog of War Achievement (4) Trench Warfare Achievement (2) Speed Achievement (4) Teammate Achievement (3)
Random Map Achievement (2) Cross-Map Achievement (3) Ratings Achievement (4) Tournament Achievement (8) General Achievement (2)
Clan Achievement (8) Tournament Contribution (8) General Contribution (2)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby jrh_cardinal on Sat Sep 25, 2010 10:27 pm

temporos wrote:but if you're going to make accusations, you must be specific and distinct.

this is not some court. I am not a lawyer. I am not going to make my post much longer, and spend three times as much time writing it so that it's grammatically clear exactly who I'm accusing who of, clearly you can use logic to deduce that that statement was directed towards max. I used plenty of math and logic, even used your guys math, and logically proved why that makes the rating scale worse.

And I'm not emotionally disturbed. Take your own advice. If your going to accuse me of being emotionally disturbed, I'll take a full legal paper using logical and mathematical proof of your accusation, I expect it in an hour.


You guys wonder why I got tired of arguing. Every post of mine until the last two only dealt with the issues and trying to prove your viewpoints wrong. All along the way max avoids my points or attempts to make excuses why my points aren't valid rather than actually trying to prove them wrong, then starts going after me personally. Now you do the same thing. Honestly, you guys are unbelievable. Can't you just have a heated discussion about the issues, without bringing in the integrity of the two people involved?
Image
User avatar
Sergeant 1st Class jrh_cardinal
 
Posts: 2715
Joined: Sat May 16, 2009 7:15 pm
Medals: 74
Standard Achievement (3) Doubles Achievement (2) Triples Achievement (2) Quadruples Achievement (3) Terminator Achievement (1)
Assassin Achievement (2) Manual Troops Achievement (2) Freestyle Achievement (2) Nuclear Spoils Achievement (2) Fog of War Achievement (3)
Speed Achievement (2) Random Map Achievement (1) Cross-Map Achievement (3) Ratings Achievement (2) Tournament Achievement (7)
General Achievement (3) Clan Achievement (2) Tournament Contribution (30) General Contribution (2)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby TheForgivenOne on Sun Sep 26, 2010 2:43 am

Poll added.
Image
User avatar
Sergeant TheForgivenOne
 
Posts: 5154
Joined: Fri May 15, 2009 8:27 pm
Location: Lost somewhere in the snow. HELP ME
Medals: 83
Standard Achievement (4) Doubles Achievement (3) Triples Achievement (3) Quadruples Achievement (3) Terminator Achievement (3)
Assassin Achievement (3) Manual Troops Achievement (3) Freestyle Achievement (4) Nuclear Spoils Achievement (3) Fog of War Achievement (4)
Trench Warfare Achievement (2) Speed Achievement (3) Teammate Achievement (2) Random Map Achievement (2) Cross-Map Achievement (3)
Beta Map Achievement (1) Battle Royale Achievement (2) Ratings Achievement (3) General Achievement (14) Clan Achievement (7)
General Contribution (11)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby greenoaks on Sun Sep 26, 2010 8:05 am

MichelSableheart wrote:
The simplest answer to this is they don't average 3. For me, I only rate if I have a really good or bad experience (or if I'm really bored so I decide to get closer to ther medal). In games like that, everyone is good, so it's rare to have a really bad experience
So those players will be rated mostly 4-5 (or 1-2 in the proposal), because they are better then the average player. This will cause them to stand out in positive direction. I would say that this is exactly what you want.

i like this :D
User avatar
Sergeant 1st Class greenoaks
 
Posts: 9997
Joined: Mon Nov 12, 2007 12:47 am
Medals: 138
Standard Achievement (4) Doubles Achievement (3) Triples Achievement (4) Quadruples Achievement (3) Terminator Achievement (3)
Assassin Achievement (3) Manual Troops Achievement (4) Freestyle Achievement (4) Polymorphic Achievement (1) Nuclear Spoils Achievement (4)
Fog of War Achievement (4) Trench Warfare Achievement (2) Speed Achievement (2) Teammate Achievement (2) Random Map Achievement (2)
Cross-Map Achievement (4) Ratings Achievement (4) Tournament Achievement (30) General Achievement (3) Clan Achievement (14)
Tournament Contribution (34) General Contribution (4)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby Jatekos on Sun Sep 26, 2010 8:24 am

AAFitz wrote:the rating system works perfectly how it is. the rating tells you exactly what you will get from a player. the only thing that doesnt match up is the actual label to the number, but after a few games, its not hard to figure out what the ratings mean

4.1 will be a pain in the ass every time and a 5.0 will hardly ever be. they are all a little bit of both between that. Your suggestion would actually make it harder, because there would be less degrees of criteria. right now there are 5.0 to 4.0 essentially
anyone below 4.0 is the same as 4.0 with a near guarantee to either play insane, or chat insane.

The rating system is very far from being perfect and it is high time to change it. If the only problems were the "labels" with it, then that would already mean a valid reason for the change.
You are right regarding players with 4.1 and below, but there are players with 4.7 and 4.8 ratings on the last page of the scoreboard. I am not so sure that their ratings truly represent how they play.
I think that the proposed change would not only fix the "labels", but could also influence the attitude of people ragarding rating. If part of the players who currently automatically give all 5s to everyone start to use a more varied scale, then it"s definitely worth it.
Last edited by Jatekos on Sun Sep 26, 2010 3:42 pm, edited 1 time in total.
Lieutenant Jatekos
 
Posts: 180
Joined: Fri Dec 05, 2008 6:47 pm
Medals: 22
Standard Achievement (3) Terminator Achievement (1) Manual Troops Achievement (1) Nuclear Spoils Achievement (2) Fog of War Achievement (1)
Speed Achievement (1) Cross-Map Achievement (1) Bot Achievement (3) Ratings Achievement (4) Tournament Achievement (1)
General Achievement (4)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby Metsfanmax on Sun Sep 26, 2010 8:54 am

jrh_cardinal wrote:You guys wonder why I got tired of arguing. Every post of mine until the last two only dealt with the issues and trying to prove your viewpoints wrong. All along the way max avoids my points or attempts to make excuses why my points aren't valid rather than actually trying to prove them wrong, then starts going after me personally.


I never went after you personally, because unlike you, I'm not getting worked up about this debate. I want this change to be implemented, but only because I think it rationally makes sense, not because I care a lot about the ratings system.

Now you do the same thing. Honestly, you guys are unbelievable. Can't you just have a heated discussion about the issues, without bringing in the integrity of the two people involved?


Not once did I question your integrity, and it's unfortunate that you would even suggest that I have, as a way to indicate that somehow I didn't debate you honestly. The only remark I made that was even somewhat unrelated to the content of the debate itself was when I said it was childish to paraphrase my comment into something I didn't say, and then attack me for it. And that was an unfair method of debate, and I called you on it. That's not the same thing as an ad hominem attack.

I understand that you're saying that your points show why this system would be worse than the current one, but in reality that's incorrect. There's only one argument you've consistently made that you've even suggested would make the system worse, which is that if everyone is within 0.1 of the mean, then it's harder to figure out who to play with. The reason why this is totally irrelevant is because that's true now. Most people fall around 4.7 plus or minus 0.1, with a smaller minority at 4.6 and 4.9. Thus even if most players did fall in the range you quoted, it would be the same situation as now - if you're trying to discriminate and find players that are well above average, then all you have to do is find the ones which are above 0.1.

At any rate, in a normal distribution, roughly 2/3 of the players would be within one SD of the mean; you've indicated that you understand statistics, so this shouldn't come as a surprise to you. The problem is that we have no idea what the standard deviation will be until we implement this system. We could probably estimate it if we had all the information on the current ratings system, which we do not. If I had to guess, I would imagine the standard deviation would be 0.2 under this system, not 0.1 (because I think that people will rate at a slightly higher rate). If that's the case, it would be even easier to discriminate than it is currently. So either it gets better or it stays the same. That's why there's no logical reason not to do this.
User avatar
Sergeant 1st Class Metsfanmax
 
Posts: 4014
Joined: Wed Apr 11, 2007 11:01 pm
Location: NY
Medals: 43
Standard Achievement (3) Doubles Achievement (2) Triples Achievement (1) Quadruples Achievement (1) Terminator Achievement (1)
Assassin Achievement (1) Manual Troops Achievement (2) Freestyle Achievement (1) Nuclear Spoils Achievement (1) Fog of War Achievement (3)
Trench Warfare Achievement (1) Speed Achievement (3) Teammate Achievement (1) Random Map Achievement (1) Cross-Map Achievement (1)
Battle Royale Achievement (1) Ratings Achievement (2) Tournament Achievement (1) General Achievement (7) Clan Achievement (2)
General Contribution (7)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby temporos on Sun Sep 26, 2010 1:17 pm

*shrugs* Whatever. I'm going to rate players according to the defined scale. If they don't impress me (good or bad), then they are average, and they deserve a 3.
--
The Great and Powerful T.

... What? This is a game of global conquest, isn't it? ;)
User avatar
Sergeant 1st Class temporos
 
Posts: 40
Joined: Sun Jul 04, 2010 6:37 pm
Location: Grand Rapids, Michigan, United States
Medals: 5
Standard Achievement (1) Manual Troops Achievement (1) Fog of War Achievement (1) Trench Warfare Achievement (1) Ratings Achievement (1)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby TheForgivenOne on Sun Sep 26, 2010 4:37 pm

Just remember people. lack has the final word on this. If he likes how the system is, he can leave it as it is. So don't go into conniptions if this gets implemented or not.
Image
User avatar
Sergeant TheForgivenOne
 
Posts: 5154
Joined: Fri May 15, 2009 8:27 pm
Location: Lost somewhere in the snow. HELP ME
Medals: 83
Standard Achievement (4) Doubles Achievement (3) Triples Achievement (3) Quadruples Achievement (3) Terminator Achievement (3)
Assassin Achievement (3) Manual Troops Achievement (3) Freestyle Achievement (4) Nuclear Spoils Achievement (3) Fog of War Achievement (4)
Trench Warfare Achievement (2) Speed Achievement (3) Teammate Achievement (2) Random Map Achievement (2) Cross-Map Achievement (3)
Beta Map Achievement (1) Battle Royale Achievement (2) Ratings Achievement (3) General Achievement (14) Clan Achievement (7)
General Contribution (11)

Re: Normalize Player Ratings (Average = 0) [Stickied ~ TFO]

Postby natty dread on Sun Sep 26, 2010 7:59 pm

At any rate, in a normal distribution, roughly 2/3 of the players would be within one SD of the mean; you've indicated that you understand statistics, so this shouldn't come as a surprise to you. The problem is that we have no idea what the standard deviation will be until we implement this system. We could probably estimate it if we had all the information on the current ratings system, which we do not. If I had to guess, I would imagine the standard deviation would be 0.2 under this system, not 0.1 (because I think that people will rate at a slightly higher rate). If that's the case, it would be even easier to discriminate than it is currently. So either it gets better or it stays the same. That's why there's no logical reason not to do this.


I agree with this.
Image
User avatar
Sergeant 1st Class natty dread
 
Posts: 13318
Joined: Fri Feb 08, 2008 8:58 pm
Location: fucked off
Medals: 49
Standard Achievement (2) Doubles Achievement (2) Triples Achievement (1) Quadruples Achievement (1) Terminator Achievement (2)
Manual Troops Achievement (1) Nuclear Spoils Achievement (1) Fog of War Achievement (1) Teammate Achievement (1) Cross-Map Achievement (3)
Ratings Achievement (3) General Achievement (12) Map Contribution (12) General Contribution (7)

PreviousNext

Return to Submitted Suggestions

Who is online

Users browsing this forum: No registered users

cron
Login