To be clear, the people who ask that generally aren't also people who give me a hard time about my hair, more people who are into hair-dying.

Since I reached the point of being able to consider it dispassionately, I've reckoned that I probably stood out for other reasons (much more of a nerd in school than I am now ...) and it was just a convenient point of attack.  I'm mostly over it nowadays though.