Well... from a branding perspective, it makes sense to have a comic style that fits your narrative or your target audience. I feel like that often happens automatically, since we as artists are usually influenced by what we enjoy.
If you feel like your style puts people off, you have a couple of choices.
Either you don't care, because you are doing this for yourself and you just love drawing your comic and you believe in it the way it is.
Or you look at your work critically, take it apart, think about audience, your intent, etc - and then see what you have to change.
Both options are completely fine and legitimate. Some stories use art that clashes with the story (like extremely cute drawings with extreme horror), and that can what makes it so great. It really depends on what you want as an artist, and what your goals are.