As pointed out before, I don't think you are a repwhore (I admit, I used to think, but as time went on, I realized I was wrong), as you said, a lot of people think that you are, which leads them to think you are contradicting yourself. That led me to suggest you to remove change your signature. People, whom you helped will surely remember you, with or without that signature, and I think a little well-deserved rep never does any bad. But I think you'd save a lot of misunderstood gossip among the users mentioned before with removing it.