Ratings Reloaded - Community Consultation - UPDATED

Talk about all things related to Conquer Club

Moderators: Global Moderators, Discussions Team

Forum rules
Please read the community guidelines before posting.

Ratings Reloaded - Community Consultation - UPDATED

Postby lackattack on Wed Jun 25, 2008 4:01 pm

=============================================

UPDATE

I'm making progress on these changes and I'm probably going to be able to throw in the "change color of star for players needing re-rating" suggestion.

I'm getting to the part about making ratings relative to each rater's "average rating left" and I'm having second thoughts. It won't fully solve the problem - some people will still typically leave 5's and others will still typically leave 3's and get complaints about it. Also the solution is quite hard to explain and understand.

I'm looking at other suggestions brought up:

* 4 stars (1-Very Bad, 2-Bad, 3-Good, 4-Very Good) with no "average", so people could typically leave 3 with less controversy.
* 3 stars (1-Bad, 2-Good, 3-Very Good) so that "average" would be more positive sounding as "Good".
* 4 stars with a cap on how often you can rate 1's or 4's. For example, only one "extreme" rating per game to force ratings to be more moderate and therefore (hopefully) accurate.

What do you guys think? I need some more feedback!

=============================================


After two weeks of experience with the new ratings system and a lot of important input from Conquer Club members like you, it's pretty clear that it could use some fixing.

So here is a 4-point plan to address the major problems with ratings, based on ideas brought up in this forum:

Problem: We want to know the reasons behind the stars, but written comments lead to too many complaints.
Solution: Introduce descriptive tags that you can attach to ratings, to explain them. >> discussion topic <<

Problem: There is too much inconsistency - some people follow our scale and leave 3 for an average player, others typically leave 5.
Solution: Display average rating left (ARL) on each rating and factor it into your overall rating score. >> discussion topic <<

Problem: We have few options when left "unfair" ratings.
Solution: Allow written responses to ratings. >> discussion topic <<

Problem: We want to rate gameplay behaviour that affects the game experience for others, but doesn't fall under "Fair Play".
Solution: Introduce an attribute for Gameplay (which would include teamwork). >> discussion topic <<

None of this is set in stone and we need you input! Please comment on the individual solutions in their respective topics and comment on our overall approach here.

Thanks for helping us make a better Conquer Club!

EDIT: Due to popular demand I've added a 5th point to the plan...

Problem: Attendance should be automated, not a rating!
Solution: Add attendance stat to player profile, remove it from ratings. >> discussion topic <<
User avatar
Private 1st Class lackattack
Retired Administrator
 
Posts: 6235
Joined: Sun Jan 01, 2006 10:34 pm
Location: Montreal, QC
Medals: 9
Standard Achievement (1) Doubles Achievement (1) Triples Achievement (1) Freestyle Achievement (1) Speed Achievement (1)
Teammate Achievement (1) Cross-Map Achievement (1) General Achievement (2)

Re: Ratings Reloaded - Community Consultation

Postby bbqpenguin on Wed Jun 25, 2008 4:43 pm

if half the companies in the world had the same customer service and determination to please that CC has, the world would be a much more pleasant place. even though i couldn't care less about the ratings, i applaud the admin's efforts to put the customer first. thanks guys!


[/asskissing]
Last edited by bbqpenguin on Wed Jun 25, 2008 4:58 pm, edited 1 time in total.
Sergeant 1st Class bbqpenguin
 
Posts: 226
Joined: Thu Mar 06, 2008 12:11 am
Medals: 11
Standard Achievement (3) Doubles Achievement (1) Triples Achievement (2) Quadruples Achievement (2) Terminator Achievement (1)
Speed Achievement (1) Cross-Map Achievement (1)

Re: Ratings Reloaded - Community Consultation

Postby t-o-m on Wed Jun 25, 2008 4:49 pm

i dont find that people use the speicific ratings for the speicif category (fairplay ect)

someone who i accused of bring a multi whne i think he was, left me a 1* rating in everything, even attendance when it was a casual game and i took my turns virtually 30seconds after him!
so that needs to be adressed i think - i dont know a solution
Colonel t-o-m
 
Posts: 2821
Joined: Sat Mar 22, 2008 2:22 pm
Location: Redistributing wealth
Medals: 39
Standard Achievement (3) Doubles Achievement (3) Triples Achievement (2) Quadruples Achievement (1) Terminator Achievement (1)
Assassin Achievement (2) Manual Troops Achievement (2) Freestyle Achievement (3) Fog of War Achievement (3) Speed Achievement (3)
Teammate Achievement (2) Cross-Map Achievement (2) Ratings Achievement (3) Tournament Achievement (1) General Achievement (1)
Clan Achievement (2) Map Contribution (1) Tournament Contribution (3) General Contribution (1)

Re: Ratings Reloaded - Community Consultation

Postby jonesthecurl on Wed Jun 25, 2008 4:50 pm

Nicely said penguin.The ratings are never gonna be perfect, you won't please everyone whatever you do. As long as they give some sort of indication when a player is someone I probably wouldn't want to play against, that'll do me fine.
Last edited by jonesthecurl on Wed Jun 25, 2008 4:51 pm, edited 1 time in total.
User avatar
Sergeant 1st Class jonesthecurl
 
Posts: 588
Joined: Sun Mar 16, 2008 9:42 am
Location: disused action figure warehouse
Medals: 19
Standard Achievement (2) Doubles Achievement (2) Triples Achievement (1) Terminator Achievement (2) Assassin Achievement (1)
Manual Troops Achievement (1) Nuclear Spoils Achievement (1) Fog of War Achievement (1) Trench Warfare Achievement (1) Teammate Achievement (1)
Random Map Achievement (1) Cross-Map Achievement (2) Ratings Achievement (3)

Re: Ratings Reloaded - Community Consultation

Postby zsp on Wed Jun 25, 2008 4:51 pm

i really love some of these ideas lack...nice
User avatar
Lieutenant zsp
 
Posts: 103
Joined: Fri Jun 08, 2007 8:22 am
Location: Bannington, Bansville
Medals: 9
Standard Achievement (2) Doubles Achievement (1) Triples Achievement (2) Terminator Achievement (2) Speed Achievement (1)
Ratings Achievement (1)

Re: Ratings Reloaded - Community Consultation

Postby suggs on Wed Jun 25, 2008 5:05 pm

It seems you have ruled out written feedback, which is a mistake.
You could just set CLEAR guidelines, eg no swearing.
But anything else is fine, as you have a chance to respond to the feedback.

To all the whingers who can't hack a negative and complain, send an automated response along the lines of "see our guidelines here, we don't get involved in disputes".
Problem solved.
User avatar
Sergeant 1st Class suggs
 
Posts: 4016
Joined: Sun Jun 24, 2007 4:16 pm
Location: At the end of the beginning...
Medals: 7
Standard Achievement (3) Doubles Achievement (1) Terminator Achievement (1) Cross-Map Achievement (1) Ratings Achievement (1)

Re: Ratings Reloaded - Community Consultation

Postby Snorri1234 on Wed Jun 25, 2008 5:07 pm

Written feedback is lovely.
"Some motherfuckers are always trying to ice skate uphill."

Duane: You know what they say about love and war.
Tim: Yes, one involves a lot of physical and psychological pain, and the other one's war.
User avatar
Private Snorri1234
 
Posts: 3438
Joined: Wed Sep 12, 2007 11:52 am
Location: Right in the middle of a fucking reptile zoo.
Medals: 6
Doubles Achievement (1) Quadruples Achievement (1) Freestyle Achievement (1) Fog of War Achievement (1) Ratings Achievement (1)
Clan Achievement (1)

Re: Ratings Reloaded - Community Consultation

Postby Pedronicus on Wed Jun 25, 2008 5:10 pm

The attendance part of the ratings should be automated.
If you take your go in under 2 hours 5 stars
under 6 hours 4 stars
under 15 hours 3 stars
under 23 hours 59 minutes 2 stars
miss a go - 1 star.

these are just loose suggestions - a poll would be a good idea for the first 4 categories

the attendance ratings should be worked out as mean average over the amount of goes each person takes per game. Attendance can be based on pure math times and shouldn't be another way to be abused by disgruntled players trying to reduce someones overall rating or making a deadbeat look good because you beat him and always gave 5 stars regardless of attendance.

This should happen to every single game you play to create a really good mean figure for each player.

Speed games should be amended by dividing what ever agreed time limits per star rating by 360 (360 x 4 = 1440, which is the day in minutes)

People who take their goes quickly should be rewarded with accurate rankings. Personal opinions of what constitutes fast play are bollox.
Last edited by Pedronicus on Wed Jun 25, 2008 5:17 pm, edited 1 time in total.
Image
Highest position 7th. Highest points 3311 All of my graffiti can be found here
Major Pedronicus
 
Posts: 2079
Joined: Tue Jan 24, 2006 2:42 pm
Location: Busy not shitting you....
Medals: 71
Standard Achievement (3) Doubles Achievement (4) Triples Achievement (3) Quadruples Achievement (3) Terminator Achievement (2)
Assassin Achievement (2) Manual Troops Achievement (3) Freestyle Achievement (3) Nuclear Spoils Achievement (1) Fog of War Achievement (4)
Trench Warfare Achievement (2) Speed Achievement (2) Teammate Achievement (2) Random Map Achievement (2) Cross-Map Achievement (3)
Ratings Achievement (4) Tournament Achievement (6) General Achievement (5) Clan Achievement (13) Tournament Contribution (4)

Re: Ratings Reloaded - Community Consultation

Postby ZeakCytho on Wed Jun 25, 2008 5:12 pm

Pedronicus wrote:The attendance part of the ratings should be automated.
If you take your go in under 2 hours 5 stars
under 6 hours 4 stars
under 12 hours 3 stars
under 23 hours 2 stars
miss a go - 1 star.

these are just loose suggestions - a poll would be a good idea for the first 4 categories

the attendance ratings should be worked out as mean average over the amount of goes each person takes per game. Attendance can be based on pure math times and shouldn't be another way to be abused by disgruntled players trying to reduce someones overall rating or making a deadbeat look good because you beat him and always gave 5 stars regardless of attendance.

This should happen to every single game you play to create a really good mean figure for each player.

Speed games should be amended by dividing what ever agreed time limits per star rating by 360 (360 x 4 = 1440, which is the day in minutes)

People who take their goes quickly should be rewarded with accurate rankings. Personal opinions of what constitutes fast play are bollox.


But the rating is for attendance, not speed. There are many times when I take my turn five minutes after the last guy's, but there are plenty of times when I'm asleep when that happens. You can't punish people for not being on every second. That being said, you can and should punish them for missing turns.

I think attendance should be automated, but based on the number of turns you miss.
User avatar
Captain ZeakCytho
 
Posts: 1251
Joined: Wed Sep 12, 2007 4:36 pm
Medals: 18
Standard Achievement (2) Doubles Achievement (2) Triples Achievement (1) Quadruples Achievement (2) Fog of War Achievement (1)
Speed Achievement (1) Cross-Map Achievement (3) Ratings Achievement (3) Map Contribution (2) General Contribution (1)

Re: Ratings Reloaded - Community Consultation

Postby Pedronicus on Wed Jun 25, 2008 5:19 pm

I'm not suggesting we all take amphetamines and give up sleep - We all sleep, but if you log on once a day one part during the evening or log in when you wake up and another when you get back from school / work - it will all even out.
A mean figure of your attendance will become evident over time.
Image
Highest position 7th. Highest points 3311 All of my graffiti can be found here
Major Pedronicus
 
Posts: 2079
Joined: Tue Jan 24, 2006 2:42 pm
Location: Busy not shitting you....
Medals: 71
Standard Achievement (3) Doubles Achievement (4) Triples Achievement (3) Quadruples Achievement (3) Terminator Achievement (2)
Assassin Achievement (2) Manual Troops Achievement (3) Freestyle Achievement (3) Nuclear Spoils Achievement (1) Fog of War Achievement (4)
Trench Warfare Achievement (2) Speed Achievement (2) Teammate Achievement (2) Random Map Achievement (2) Cross-Map Achievement (3)
Ratings Achievement (4) Tournament Achievement (6) General Achievement (5) Clan Achievement (13) Tournament Contribution (4)

Re: Ratings Reloaded - Community Consultation

Postby Frop on Wed Jun 25, 2008 5:32 pm

I've commented on all 4 threads and ironically our whole ordeal has been for naught. We could've saved a lot of time and effort if we would've only solved the problem of moderating feedback complaints.

Edit: Suggs, you rock. Spot on.
User avatar
Captain Frop
 
Posts: 1202
Joined: Thu May 10, 2007 3:02 pm
Medals: 19
Standard Achievement (1) Doubles Achievement (2) Triples Achievement (3) Quadruples Achievement (1) Teammate Achievement (2)
Cross-Map Achievement (2) Ratings Achievement (2) General Achievement (1) Clan Achievement (4) General Contribution (1)

Re: Ratings Reloaded - Community Consultation

Postby CAPK81 on Wed Jun 25, 2008 5:40 pm

Why dont you just tell us how many turns the players have missed ? How many they have taken on time. Thats what i care about not what someone thinks about how i am a team player when they have never been on my team !
Colonel CAPK81
 
Posts: 315
Joined: Wed Dec 19, 2007 4:05 pm
Location: florida
Medals: 76
Standard Achievement (3) Doubles Achievement (4) Triples Achievement (4) Quadruples Achievement (4) Terminator Achievement (1)
Manual Troops Achievement (2) Freestyle Achievement (1) Nuclear Spoils Achievement (2) Fog of War Achievement (4) Trench Warfare Achievement (2)
Speed Achievement (2) Teammate Achievement (3) Random Map Achievement (2) Cross-Map Achievement (3) Beta Map Achievement (1)
Bot Achievement (3) Ratings Achievement (4) Tournament Achievement (20) General Achievement (1) Clan Achievement (10)

Re: Ratings Reloaded - Community Consultation

Postby Pedronicus on Wed Jun 25, 2008 5:55 pm

Attendance can't based on just missing goes - It has to take into consideration how often / quickly you take turns when you take your turn. It is open to a certain amount of abuse by players who organise real time games in 24hour turn games, but it's not something that should be decided by another players interpretation of what constitutes a good attendance.
if all games are counted - it will all even out in the long run.

It's the only part of the ratings that can be automated
Image
Highest position 7th. Highest points 3311 All of my graffiti can be found here
Major Pedronicus
 
Posts: 2079
Joined: Tue Jan 24, 2006 2:42 pm
Location: Busy not shitting you....
Medals: 71
Standard Achievement (3) Doubles Achievement (4) Triples Achievement (3) Quadruples Achievement (3) Terminator Achievement (2)
Assassin Achievement (2) Manual Troops Achievement (3) Freestyle Achievement (3) Nuclear Spoils Achievement (1) Fog of War Achievement (4)
Trench Warfare Achievement (2) Speed Achievement (2) Teammate Achievement (2) Random Map Achievement (2) Cross-Map Achievement (3)
Ratings Achievement (4) Tournament Achievement (6) General Achievement (5) Clan Achievement (13) Tournament Contribution (4)

Re: Ratings Reloaded - Community Consultation

Postby wicked on Wed Jun 25, 2008 6:08 pm

CAPK81 wrote:Why dont you just tell us how many turns the players have missed ? How many they have taken on time. Thats what i care about not what someone thinks about how i am a team player when they have never been on my team !


I think this is a good idea - just scrap the attendance rating and instead have a # turns missed stat on the profile page.
User avatar
Major wicked
 
Posts: 15794
Joined: Thu Jan 26, 2006 1:23 pm
Medals: 18
Standard Achievement (3) Doubles Achievement (1) Triples Achievement (1) Terminator Achievement (2) Assassin Achievement (1)
Freestyle Achievement (2) Fog of War Achievement (2) Speed Achievement (1) Teammate Achievement (1) Cross-Map Achievement (2)
Ratings Achievement (1) General Contribution (1)

Re: Ratings Reloaded - Community Consultation

Postby mcapizzi on Wed Jun 25, 2008 6:09 pm

I have been frustrated with the rating system and find myself missing the written feedback.

I think one can learn a lot more about a player from the feedback written by and left for her or him.

I hope it returns in some way.
Image
User avatar
Lieutenant mcapizzi
 
Posts: 9
Joined: Sat Sep 01, 2007 10:29 am
Location: The wild west (AKA Arizona)
Medals: 19
Standard Achievement (2) Doubles Achievement (1) Triples Achievement (2) Quadruples Achievement (3) Manual Troops Achievement (1)
Fog of War Achievement (2) Speed Achievement (2) Cross-Map Achievement (3) Ratings Achievement (1) Tournament Achievement (1)
Clan Achievement (1)

Next

Return to General Discussion

Who is online

Users browsing this forum: No registered users and 1 guest

Login