In general, good/amazing art is a hooker at the very beginning but that doesn't mean it'll stay that way as the story continues. As some already said, One-Punch Man and Mob Psycho 100 are very solid story-telling wise whereas their art isn't that great (though I also kind of fell in love with One's style..?)
I think a good balance is always good. I was surprised that my art for my first attempt on Heirs to the Crown was considered "great" and even got me a few followers because really, there aren't many pages out so it couldn't really be because of the story haha
(If you rank yourself at about this level or even better, you definitely don't need to worry about anything - I mean look at all the off-model faces :'D)
If anything, most comics can be devided between "great art but mediocre story" and "mediocre art but great story" - it is very rare to find an artist who is also a really good story-teller so it really depends on what you'd rather want to focus, what is more important to you. The longer the story, the more you probably should focus on that instead of high quality art to keep your readers intrigued. If it's a relatively short comic with a relatively simple story structure, it's easier to indulge more into the art.
Ideally, you have a perfect balance but this is the scale you're most likely moving on.
Also remember that some art styles suit this comic better, and other art styles that comic. Maybe you are unsatisfied because you haven't really found the visual language for your comic? I don't want to assume anything here, just some brainstorming what might help you loose the knot ^^
I already mentioned it in another thread but anyway, there are also a lot of comics which didn't have very great art at the beginning but then grew incredibly beautiful with later pages. That's pretty common and usually happens to everyone due to practice. But if you shy away from starting, you won't ever get there!