If this has been abused before then perhaps some adjustments can be made. It doesn't mean that it's a stupid idea. In fact, I think the idea behind it is very fair.
As it stands now, if a person is eliminated before their first turn, they lose points solely for the fact that they (most likely) were ...