Algorithm of 400 Clan Ranking Algorithm

Abandoned challenges and other old information.

Moderators: Clan Directors, Global Moderators

Forum rules
Please read the Community Guidelines before posting.

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby Dako on Wed Mar 30, 2011 2:36 am

Wow, great job. I will look at it again to reread it cause there are a lot of info here.
Image
User avatar
Brigadier Dako
 
Posts: 3942
Joined: Sun Aug 26, 2007 9:07 am
Location: St. Petersburg, Russia
Medals: 115
Standard Achievement (3) Doubles Achievement (3) Triples Achievement (3) Quadruples Achievement (3) Terminator Achievement (2)
Assassin Achievement (1) Manual Troops Achievement (2) Freestyle Achievement (2) Polymorphic Achievement (1) Nuclear Spoils Achievement (2)
Fog of War Achievement (3) Trench Warfare Achievement (1) Speed Achievement (1) Teammate Achievement (2) Random Map Achievement (2)
Cross-Map Achievement (3) Battle Royale Achievement (1) Ratings Achievement (3) Tournament Achievement (13) General Achievement (24)
Clan Achievement (20) General Contribution (20)

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby danryan on Wed Mar 30, 2011 8:38 am

I have to say, this is a very credible model from what I'm seeing so far. For one, it clearly shows what effect your input data has. Secondly, it removes all incentive for "farming" a clan. Lastly, it penalizes a clan (but not too severely) for inactivity, due to the decay factor. I'd like to hear jpcloet's take on it since he has put a lot of work into a lot of different models over the years to try and come up with a mathematical model.
User avatar
Lieutenant danryan
 
Posts: 3428
Joined: Tue Jan 09, 2007 8:30 pm
Medals: 152
Standard Achievement (4) Doubles Achievement (4) Triples Achievement (4) Quadruples Achievement (4) Terminator Achievement (3)
Assassin Achievement (3) Manual Troops Achievement (3) Freestyle Achievement (4) Polymorphic Achievement (1) Nuclear Spoils Achievement (3)
Fog of War Achievement (4) Trench Warfare Achievement (2) Speed Achievement (4) Teammate Achievement (3) Random Map Achievement (3)
Cross-Map Achievement (4) Beta Map Achievement (1) Ratings Achievement (4) Tournament Achievement (31) General Achievement (7)
Clan Achievement (12) Tournament Contribution (30) General Contribution (14)

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby jpcloet on Wed Mar 30, 2011 9:33 am

I have a few question on the final rankings to help clarify.

1) TSM is due to lack of challenges correct?
2) MM seems to be the biggest outlier in my mind, considering the overall quality of opponents. Is S2 playing a part? This is the only real anomaly for me.
3) Is the O&H loss by LOW keeping LOW from the top 3?
4) What does the top 10 look like with a KORT win over THOTA in CCup1?
Image
User avatar
Captain jpcloet
 
Posts: 4426
Joined: Sat Mar 17, 2007 9:18 am
Medals: 69
Standard Achievement (4) Doubles Achievement (3) Triples Achievement (3) Quadruples Achievement (3) Terminator Achievement (2)
Assassin Achievement (1) Manual Troops Achievement (1) Freestyle Achievement (1) Nuclear Spoils Achievement (2) Fog of War Achievement (3)
Speed Achievement (1) Teammate Achievement (2) Random Map Achievement (1) Cross-Map Achievement (3) Battle Royale Achievement (1)
Ratings Achievement (3) Tournament Achievement (7) General Achievement (7) Clan Achievement (5) Tournament Contribution (8)
General Contribution (8)

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby josko.ri on Wed Mar 30, 2011 12:44 pm

I very like this system of calculation, results are very reliable I think. decay idea is great. only one complaint, you put 32-28 result in TOFU vs KORT challenge in database, which couldnt be valid. for achieving that result TOFU used forbidden bonus according to the official rules of the challenge, so it shouldnt be validated as regular result.
Image
User avatar
General josko.ri
 
Posts: 1726
Joined: Sun Nov 15, 2009 5:18 pm
Medals: 98
Conqueror Achievement (1) Monthly Leader Silver (1) Monthly Leader Bronze (2) Standard Achievement (3) Doubles Achievement (2)
Triples Achievement (2) Quadruples Achievement (3) Terminator Achievement (1) Assassin Achievement (1) Manual Troops Achievement (1)
Freestyle Achievement (1) Polymorphic Achievement (2) Nuclear Spoils Achievement (2) Fog of War Achievement (3) Trench Warfare Achievement (1)
Speed Achievement (1) Teammate Achievement (2) Random Map Achievement (2) Cross-Map Achievement (3) Beta Map Achievement (1)
Ratings Achievement (3) Tournament Achievement (26) General Achievement (16) Clan Achievement (17) Tournament Contribution (1)

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby Gold Knight on Wed Mar 30, 2011 12:52 pm

Dako wrote:Wow, great job. I will look at it again to reread it cause there are a lot of info here.


Agreed, someone finally put some colorful pictures up so us peasants can understand... :lol: It does seem like a pretty close representation of what the clan landscape is IMO. Where the hell have you been in the CLA the past year while we've been bickering over 40 different ranking systems?
Image
xxtig12683xx wrote:yea, my fav part was being in the sewer riding a surfboard and wacking these alien creatures.

shit was badass
User avatar
Captain Gold Knight
 
Posts: 2715
Joined: Tue Apr 17, 2007 9:47 am
Location: Out here in these woods...
Medals: 40
Standard Achievement (2) Doubles Achievement (3) Triples Achievement (4) Quadruples Achievement (3) Terminator Achievement (1)
Manual Troops Achievement (1) Nuclear Spoils Achievement (1) Fog of War Achievement (3) Teammate Achievement (3) Random Map Achievement (2)
Cross-Map Achievement (3) Ratings Achievement (3) Tournament Achievement (4) General Achievement (2) Clan Achievement (5)

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby Leehar on Wed Mar 30, 2011 1:19 pm

josko.ri wrote:I very like this system of calculation, results are very reliable I think. decay idea is great. only one complaint, you put 32-28 result in TOFU vs KORT challenge in database, which couldnt be valid. for achieving that result TOFU used forbidden bonus according to the official rules of the challenge, so it shouldnt be validated as regular result.

It's already been validated under clan results so I doubt this is really the place for that argument
Image
show
User avatar
Brigadier Leehar
Head Clan Director
Head Clan Director
 
Posts: 5961
Joined: Fri Mar 06, 2009 12:12 pm
Location: Graduation Ceremony
Medals: 125
Standard Achievement (3) Doubles Achievement (3) Triples Achievement (3) Quadruples Achievement (3) Terminator Achievement (2)
Assassin Achievement (1) Manual Troops Achievement (2) Freestyle Achievement (2) Polymorphic Achievement (1) Nuclear Spoils Achievement (2)
Fog of War Achievement (4) Trench Warfare Achievement (2) Speed Achievement (2) Teammate Achievement (2) Random Map Achievement (2)
Cross-Map Achievement (4) Beta Map Achievement (1) Battle Royale Achievement (1) Ratings Achievement (4) Tournament Achievement (31)
General Achievement (21) Clan Achievement (13) Training Achievement (7) Challenge Achievement (1) General Contribution (8)

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby Leehar on Wed Mar 30, 2011 1:42 pm

jpcloet wrote:I have a few question on the final rankings to help clarify.

1) TSM is due to lack of challenges correct?
2) MM seems to be the biggest outlier in my mind, considering the overall quality of opponents. Is S2 playing a part? This is the only real anomaly for me.
3) Is the O&H loss by LOW keeping LOW from the top 3?
4) What does the top 10 look like with a KORT win over THOTA in CCup1?

I was wondering more along the lines of if cl3 results were taken into account or something for tsm to be so far down?
I'd think the O&H loss would be too far back to have that much waiting, and it's still a surprise that IA is in the top 3 after losing to Low in their most recent full-scale challenge?
Image
show
User avatar
Brigadier Leehar
Head Clan Director
Head Clan Director
 
Posts: 5961
Joined: Fri Mar 06, 2009 12:12 pm
Location: Graduation Ceremony
Medals: 125
Standard Achievement (3) Doubles Achievement (3) Triples Achievement (3) Quadruples Achievement (3) Terminator Achievement (2)
Assassin Achievement (1) Manual Troops Achievement (2) Freestyle Achievement (2) Polymorphic Achievement (1) Nuclear Spoils Achievement (2)
Fog of War Achievement (4) Trench Warfare Achievement (2) Speed Achievement (2) Teammate Achievement (2) Random Map Achievement (2)
Cross-Map Achievement (4) Beta Map Achievement (1) Battle Royale Achievement (1) Ratings Achievement (4) Tournament Achievement (31)
General Achievement (21) Clan Achievement (13) Training Achievement (7) Challenge Achievement (1) General Contribution (8)

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby FarangDemon on Thu Mar 31, 2011 12:22 am

Admittedly, I'm not the data guy and I don't want to be the data guy. If someone wants to maintain a data file(s) I can link to it from my site.

All you have to do to change/add data on your own:

1) Click the link to the data file from my site (http://www.killersapp.com/algorithmof400.htm)
2) Open it in Excel or notepad
3) Change existing war data / add new entries
4) Paste it into the input box of my site
Click image to enlarge.
image

"He came dancin across the water.... FarangDemon, FarangDemon.... mmmhh....what a killer..."
User avatar
Brigadier FarangDemon
 
Posts: 700
Joined: Wed Apr 23, 2008 1:36 am
Medals: 33
Standard Achievement (2) Doubles Achievement (2) Triples Achievement (2) Quadruples Achievement (2) Terminator Achievement (1)
Freestyle Achievement (2) Nuclear Spoils Achievement (1) Fog of War Achievement (3) Cross-Map Achievement (3) Ratings Achievement (1)
Tournament Achievement (6) General Achievement (2) Clan Achievement (4) Map Contribution (1) Tournament Contribution (1)

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby FarangDemon on Thu Mar 31, 2011 2:57 pm

jpcloet wrote:I have a few question on the final rankings to help clarify.

1) TSM is due to lack of challenges correct?



You can see the basis of the rating for every clan by checking "Display Basis".

Image

Tieing Grim Reapers and losing to BSS and Gen 1 gives TSM an 800 weighted at 17%, so that's what is bringing them down the most. I'm guessing that was CL3, so it's recent. The weight that is applied to each challenge is the number of games in the challenge times the decay factor (a number between 0%-100% based on how long ago the challenge took place). They don't have as much total weight as other clans do, so these CL3 losses/ties affect their score more than a clan with more wars and hence more weight.

I did not include their recent win in CL3 Quarterfinals as the final score was undecided when I put the data file together. This should give them a boost.

jpcloet wrote:2) MM seems to be the biggest outlier in my mind, considering the overall quality of opponents. Is S2 playing a part? This is the only real anomaly for me.


Image

Looks like 39% of their rating weight (losses to BSS, AOD, EMPIRE, Devils Brigade) averages below 800. Three out of four of these losses were brutal, winning 28-33% of games. In this model (min delta = 200, max delta = 600), clans that lose by a larger margin are penalized more.

jpcloet wrote:3) Is the O&H loss by LOW keeping LOW from the top 3?


Image

That O&H loss is weighted at just 5%, but at 599, it is still quite damaging.
Losses to THOTA, KoRT and TOFU weighted at combined 27% are also lowering them a little from where they otherwise would be based on other, lower weighted results (perhaps from past).

jpcloet wrote:4) What does the top 10 look like with a KORT win over THOTA in CCup1?


What margin should I use? It would probably end up #1 KoRT, #2 TOFU.

leehar wrote:I'd think the O&H loss would be too far back to have that much waiting, and it's still a surprise that IA is in the top 3 after losing to Low in their most recent full-scale challenge?


Image

The IA loss to LOW accounts for 12% of IA's rating. It drags us down the most, but we are buoyed by our strong performance in CL3, which is very recent and accounts for a ton of games (90 games in regular season).
Last edited by FarangDemon on Fri Apr 01, 2011 12:20 am, edited 1 time in total.
Click image to enlarge.
image

"He came dancin across the water.... FarangDemon, FarangDemon.... mmmhh....what a killer..."
User avatar
Brigadier FarangDemon
 
Posts: 700
Joined: Wed Apr 23, 2008 1:36 am
Medals: 33
Standard Achievement (2) Doubles Achievement (2) Triples Achievement (2) Quadruples Achievement (2) Terminator Achievement (1)
Freestyle Achievement (2) Nuclear Spoils Achievement (1) Fog of War Achievement (3) Cross-Map Achievement (3) Ratings Achievement (1)
Tournament Achievement (6) General Achievement (2) Clan Achievement (4) Map Contribution (1) Tournament Contribution (1)

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby jpcloet on Thu Mar 31, 2011 3:34 pm

FarangDemon wrote:Tieing Grim Reapers and losing to BSS and Gen 1 gives TSM an 800 weighted at 17%, so that's what is bringing them down the most. I'm guessing that was CL3, so it's recent.


Yes that was CL3, that mean's this is now a fully inclusive measure. Some will argue the league should not be included. One of the things I did before was to have the final league score against a generic team so that it got some weight as the divisions. More so for CL2.

Eg.

TSM 55 CL3A 45
Image
User avatar
Captain jpcloet
 
Posts: 4426
Joined: Sat Mar 17, 2007 9:18 am
Medals: 69
Standard Achievement (4) Doubles Achievement (3) Triples Achievement (3) Quadruples Achievement (3) Terminator Achievement (2)
Assassin Achievement (1) Manual Troops Achievement (1) Freestyle Achievement (1) Nuclear Spoils Achievement (2) Fog of War Achievement (3)
Speed Achievement (1) Teammate Achievement (2) Random Map Achievement (1) Cross-Map Achievement (3) Battle Royale Achievement (1)
Ratings Achievement (3) Tournament Achievement (7) General Achievement (7) Clan Achievement (5) Tournament Contribution (8)
General Contribution (8)

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby FarangDemon on Fri Apr 01, 2011 1:45 am

jpcloet wrote:Yes that was CL3, that mean's this is now a fully inclusive measure. Some will argue the league should not be included.


I don't want to take your job, I'm just providing you a tool you or others can use to generate rankings based on your data. It's up to you to decide what data to use for your official ranking.

1) Regular Clan Wars (no CL)
2) All Data (Regular Clan Wars and CL)

Just put it into the right format and paste it into my script. http://killersapp.com/AllData.txt

In my example of how the script works, I included all data for two reasons:

Most Data
    The more data used, the more accurate the results of this algorithm.
Most Fair
    Choosing to discount certain results would, in my opinion, be a can of worms, as each clan would be motivated to lobby to exclude the wars where they performed the worst.

Note: Individual clan league war results are automatically weighted less than regular wars, because they consist of fewer games.

So you could maintain two clan war data sets and provide graphs for both, in order to please all of the people. But I'd recommend using all data for the above reasons.

jpcloet wrote:One of the things I did before was to have the final league score against a generic team so that it got some weight as the divisions. More so for CL2.

Eg.

TSM 55 CL3A 45


Ok so that would count as TSM beating a team with rating 1000? You can definitely implement this and see what it looks like. Some drawbacks I see with this:

1) Dilutes the data
2) Assumes competitiveness of each division is equal
3) Obscures the data - Clans on the bottom end up losing to a clan of rating 1000 at a high-to-moderate loss margin instead of to high ranked clans at high margins and medium ranked clans at moderate margins.

Due to item 3) I have no idea what the end effect will be, but it is confusing. I have a vague idea of what your intent is, but I'm not sure it will be accomplished due to this obscuring effect.

So I personally think it's a lot more straightforward and cleaner if we just keep data in original format, Clan 1 vs Clan 2 for each CL War.
Click image to enlarge.
image

"He came dancin across the water.... FarangDemon, FarangDemon.... mmmhh....what a killer..."
User avatar
Brigadier FarangDemon
 
Posts: 700
Joined: Wed Apr 23, 2008 1:36 am
Medals: 33
Standard Achievement (2) Doubles Achievement (2) Triples Achievement (2) Quadruples Achievement (2) Terminator Achievement (1)
Freestyle Achievement (2) Nuclear Spoils Achievement (1) Fog of War Achievement (3) Cross-Map Achievement (3) Ratings Achievement (1)
Tournament Achievement (6) General Achievement (2) Clan Achievement (4) Map Contribution (1) Tournament Contribution (1)

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby josko.ri on Fri Apr 01, 2011 4:16 am

jpcloet wrote:
FarangDemon wrote:Tieing Grim Reapers and losing to BSS and Gen 1 gives TSM an 800 weighted at 17%, so that's what is bringing them down the most. I'm guessing that was CL3, so it's recent.


Yes that was CL3, that mean's this is now a fully inclusive measure. Some will argue the league should not be included. One of the things I did before was to have the final league score against a generic team so that it got some weight as the divisions. More so for CL2.

Eg.

TSM 55 CL3A 45

I think that small number of games in CLA3 is actually validated by smaller weight factor in FG's calculations, and I agree with that totally. Weight factor may be dependent on number of games played and time passed from the war, not only by time passed.

I dont like your idea JP about TSM55 CL3A45 because it in any way does not include strength of opponents in Division. the fact that both teams from Divisions C&D and zero teams from Division A&B advanced to semis proves that some Divisions were stronger, and in ranking like this one it should be included strength of opponents in CL3 Divisions, which I think is implemented in FG's graphs.
Image
User avatar
General josko.ri
 
Posts: 1726
Joined: Sun Nov 15, 2009 5:18 pm
Medals: 98
Conqueror Achievement (1) Monthly Leader Silver (1) Monthly Leader Bronze (2) Standard Achievement (3) Doubles Achievement (2)
Triples Achievement (2) Quadruples Achievement (3) Terminator Achievement (1) Assassin Achievement (1) Manual Troops Achievement (1)
Freestyle Achievement (1) Polymorphic Achievement (2) Nuclear Spoils Achievement (2) Fog of War Achievement (3) Trench Warfare Achievement (1)
Speed Achievement (1) Teammate Achievement (2) Random Map Achievement (2) Cross-Map Achievement (3) Beta Map Achievement (1)
Ratings Achievement (3) Tournament Achievement (26) General Achievement (16) Clan Achievement (17) Tournament Contribution (1)

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby Dako on Fri Apr 01, 2011 5:18 am

I disagree that Div C&D were stronger than Div A&B. You can only tell that one clan was stronger than the other at the moment with given settings, but you cannot propagate it on the whole division strength.
Image
User avatar
Brigadier Dako
 
Posts: 3942
Joined: Sun Aug 26, 2007 9:07 am
Location: St. Petersburg, Russia
Medals: 115
Standard Achievement (3) Doubles Achievement (3) Triples Achievement (3) Quadruples Achievement (3) Terminator Achievement (2)
Assassin Achievement (1) Manual Troops Achievement (2) Freestyle Achievement (2) Polymorphic Achievement (1) Nuclear Spoils Achievement (2)
Fog of War Achievement (3) Trench Warfare Achievement (1) Speed Achievement (1) Teammate Achievement (2) Random Map Achievement (2)
Cross-Map Achievement (3) Battle Royale Achievement (1) Ratings Achievement (3) Tournament Achievement (13) General Achievement (24)
Clan Achievement (20) General Contribution (20)

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby josko.ri on Fri Apr 01, 2011 5:28 am

Dako wrote:I disagree that Div C&D were stronger than Div A&B. You can only tell that one clan was stronger than the other at the moment with given settings, but you cannot propagate it on the whole division strength.

so you then think that Divisions C&D were not the strongest? if so, again my point has sense, that it is not fair to validate score of 55 compared with average score of 45 in Division because not all Divisions were with the same strength (it is questioned and subjective opinion which one were stronger and which one easier, but I think everyone agrees that Divisions were not equal, some were stronger and some were easier). because of that I very like to validate Division results according to opponents faced in Division.

and I think that FD very good implemented factor of only 18 games challenge because Weight factor from Empire-Kort war is 10%, and weight factor from TSM-Kort Division challenge is 6% no matter that Empire war was from May and TSM challenge was from December. so obviously, number of games per challenge is included in weight factor next to time passed, and I totally support it. it is true that small challenges can sometimes be decided due to some bad luck/drops but then it is validated with small weight factor, so it makes good point to me.
Image
User avatar
General josko.ri
 
Posts: 1726
Joined: Sun Nov 15, 2009 5:18 pm
Medals: 98
Conqueror Achievement (1) Monthly Leader Silver (1) Monthly Leader Bronze (2) Standard Achievement (3) Doubles Achievement (2)
Triples Achievement (2) Quadruples Achievement (3) Terminator Achievement (1) Assassin Achievement (1) Manual Troops Achievement (1)
Freestyle Achievement (1) Polymorphic Achievement (2) Nuclear Spoils Achievement (2) Fog of War Achievement (3) Trench Warfare Achievement (1)
Speed Achievement (1) Teammate Achievement (2) Random Map Achievement (2) Cross-Map Achievement (3) Beta Map Achievement (1)
Ratings Achievement (3) Tournament Achievement (26) General Achievement (16) Clan Achievement (17) Tournament Contribution (1)

Re: Algorithm of 400 Clan Ranking for All Wars (NEW Graphs!)

Postby Dako on Fri Apr 01, 2011 6:16 am

I didn't say you were wrong in your opinion on "each clan against score of the division" method. I haven't said your point didn't have sense ether. Please read my post more careful next time as it will save breath for both of us :).
Image
User avatar
Brigadier Dako
 
Posts: 3942
Joined: Sun Aug 26, 2007 9:07 am
Location: St. Petersburg, Russia
Medals: 115
Standard Achievement (3) Doubles Achievement (3) Triples Achievement (3) Quadruples Achievement (3) Terminator Achievement (2)
Assassin Achievement (1) Manual Troops Achievement (2) Freestyle Achievement (2) Polymorphic Achievement (1) Nuclear Spoils Achievement (2)
Fog of War Achievement (3) Trench Warfare Achievement (1) Speed Achievement (1) Teammate Achievement (2) Random Map Achievement (2)
Cross-Map Achievement (3) Battle Royale Achievement (1) Ratings Achievement (3) Tournament Achievement (13) General Achievement (24)
Clan Achievement (20) General Contribution (20)

PreviousNext

Return to Clan Archives

Who is online

Users browsing this forum: No registered users and 1 guest

Login