You are crazy! That's for certain ;)
Recently I had decided to wear orange for a round -- shirt, glove, shoes, and my hat had a hint. What put it over the top was that my drive shaft and its grip are also orange (Tour AD). My playing partners had a field day.
I don't seem to get the same ribbing when I wear black though -- even though most of grips and a 3w, and all the ferrules are black ;) Or when I wear red and my 3w shaft is red. I think it just comes down to the bright colours drawing more attention.
I do know I guy that has different colour ferrules and grips for different clubs -- long irons vs. short. It certainly "pops" when he wears an outfit that matches.