It's not really that bad but...
I had one instance of a friend telling me "Oh, I don't even like comics, but I read yours, because we are frieeeends. If you have passion for it, there has to be something to it, right?". Felt kinda weird to have someone look at my art, not because she liked it, but because of our current status as buddies. But it might as well have been the circumstances that made me react to it strongly, it really is a small thing.
Another compliment I often get, that can be annoying is the "wow! I admire how persistent you are with your work on your comic" and then nothing else. I know, it's not even a bad comment. It's just... can't you find anything else to like bout my art aside from the fact that I draw a lot?