Absolutely. And it's not just manga. Becoming a successful writer or artist is probably 95% luck: The right pair of eyeballs has to land on your work. You can build a thousand, ten thousand, a million fans, but if the right people are not aware of your work it will not go anywhere. That is not to say that you should stop trying, but you shouldn't be creating solely to make yourself rich or popular. Enjoy making your stuff and maybe, just maybe, the right people will see it.
Heck, there are countless rejected TV shows, songs, musical artists, etc that are very good but just didn't get the recognition they deserved.