See to me, color would be MORE of an overload to the senses than black and white would be. If it's garish color-work, at least. Maybe it's worse on a screen than it is on paper? I don't think I've experienced that, in any event, so yeah, it's hard for me to say. (Which is a good thing to be aware of, on my end!)
If you have a - what I would probably deem? - a medical issue, then sure, keep scrollin'! If you naturally gravitate towards color over B&W, that's also a preference that's yours to have. I don't think people generally avoid things out of malice, but if someone's like, "Hey, this is really good! I'd think you'd like this." and the response is, "Sorry, I don't read stuff in B&W b/c it's not as good", that, to me, is an unfortunate take. Again, akin to someone who wouldn't watch a cartoon because they have preconceived notions towards the medium, as opposed to the work itself.
But at the end of the day, everyone's got to find their own in-roads towards the stuff they like. Arm-twisting and badgering doesn't do it. I'm working in black and white, right now. I think my stuff is pretty good. If the B&W thing is a barrier for someone, I'll tell 'em to have a nice day, and go looking for the next person who'd be into it. Plenty of eyes, out there.
