I think this is how it feels for many people in the beginning when they start to express themselves. However sooner or later you realize that regardless of what you wear or do, people will find a way to judge you. Even if you try your hardest to "fit in", someone will find a way to go "oh that haircut is soooo 2007" or "those shoes are so ugly". This became especially clear to me when I worked in the restaurant business. People there do love their gossip moments.
Biggest difference is, when you wear things that stick out more people will often not bother to hide their feelings as much. This makes it easier to determine who's worth your time and who isn't!
As for the attention... eventually you won't notice it. After a few years you won't even instinctively associate it with what you wear because it's just a natural part of you. These days I often find myself thinking "wtf why is that old lady staring at me" and then I go "oh right I'm wearing horns. Forgot."