No, I actually prefer to work in B&W. It's faster and I like how it looks, although for my current project I personally thought color would work better for the story. I would say you can only develop the skill to color well if you started coloring, all things that require skill also require effort to learn that skill, but it's up to you what you want to do. If you prefer B&W than go for it!
As for readers in general, unfortunately you probably will get less people interested because colors are flashy and sparkly. I know when I was working on a colorless webcomic I got the occasional comment about how it should be colored, and when advertising there were folks who straight-up told me they wouldn't even look at it because it was B&W. People be like that sometimes.