Personally, it can go either way... Calling someone a fag is different from saying they are a fag.
The difference between the N - word and Fag, is that N is a racial word.
Personally... Calling me a fag is no different from calling me a retard. Calling me the N - word is different though (And because I am white).