cspare wrote:Ok, cool. thanks.
I implemented a work around that works pretty good as well. I improved a Xpath query so that I could eliminate 2 for loops, I'm getting a pretty good performance now. Having to download all xml files still stays the main bottleneck though.
I was also wondering if you guys also keep record of a player's actual score over time, or only the events that cause the score to change (so effectively only storing the score delta)? This could help fill in the gaps of the missing game logs.
You can make one saving by preventing downloading of all the xml files if the number of games hasn't changed by using persistent data.
Store the data you need as well as the number of games. Read page one of the xmls and compare game numbers to decide whether to use any more of the xmls.
The event tags store all points changes available except for games with missing logs. We've been looking at missing logs for a while now and unfortunately there is no way to accurately recalculate all of the points - the logs are literally gone. Since we can't guarantee finding missing logs sandwiched between visible logs we cannot recalculate all point changes. Pity.