I think you misunderstood the question, it's about whether or not you specifically would judge a book by its cover, not about whether or not you where scared of other people judging you by the covers of the books you read...
That's good tho, don't give a shit about what anyone thinks. You keep liking what you like :3