lackattack wrote:=============================================
UPDATE
I'm making progress on these changes and I'm probably going to be able to throw in the "change color of star for players needing re-rating" suggestion.
I'm getting to the part about making ratings relative to each rater's "average rating left" and I'm having second thoughts. It won't fully solve the problem - some people will still typically leave 5's and others will still typically leave 3's and get complaints about it. Also the solution is quite hard to explain and understand.
I'm looking at other suggestions brought up:
* 4 stars (1-Very Bad, 2-Bad, 3-Good, 4-Very Good) with no "average", so people could typically leave 3 with less controversy.
* 3 stars (1-Bad, 2-Good, 3-Very Good) so that "average" would be more positive sounding as "Good".
* 4 stars with a cap on how often you can rate 1's or 4's. For example, only one "extreme" rating per game to force ratings to be more moderate and therefore (hopefully) accurate.
What do you guys think? I need some more feedback!
=============================================After two weeks of experience with the new ratings system and a lot of important input from Conquer Club members like you, it's pretty clear that it could use some fixing.
So here is a 4-point plan to address the major problems with ratings, based on ideas brought up in this forum:
Problem: We want to know the reasons behind the stars, but written comments lead to too many complaints.
Solution: Introduce descriptive tags that you can attach to ratings, to explain them. >>
discussion topic <<
Problem: There is too much inconsistency - some people follow our scale and leave 3 for an average player, others typically leave 5.
Solution: Display average rating left (ARL) on each rating and factor it into your overall rating score. >>
discussion topic <<
Problem: We have few options when left "unfair" ratings.
Solution: Allow written responses to ratings. >>
discussion topic <<
Problem: We want to rate gameplay behaviour that affects the game experience for others, but doesn't fall under "Fair Play".
Solution: Introduce an attribute for Gameplay (which would include teamwork). >>
discussion topic <<
None of this is set in stone and we need you input! Please comment on the individual solutions in their respective topics and comment on our overall approach here.
Thanks for helping us make a better Conquer Club!
EDIT: Due to popular demand I've added a 5th point to the plan...
Problem: Attendance should be automated, not a rating!
Solution: Add attendance stat to player profile, remove it from ratings. >>
discussion topic <<