It's natural to be conflict or risk-adverse, but disagreement isn't always a bad thing that needs to avoided. If anything, the more you know about a person's opinions/beliefs, the more that you know whether you should engage with them. You can use the disagreement as a point of discussion/education (if you want to expend the emotional labour).
At risk of sounding callous—and this is a strange example—if my comic included my personal core moral/ethical belief as an underlying theme (e.g., human rights for group XYZ are important) and my friend didn't believe in XYZ human rights, we would probably not be friends to begin with. There are also different degrees of disagreement, gravity, and impact—"I don't like dogs" vs. "I absolutely hate dogs and will destroy anyone that likes dogs". I could maybe tolerate disagreement in the former (a matter of taste), but not so much the latter (harmful). [Note: I love dogs.]
Of course there are situations where you can't cut off relationships so easily, but like others have said, you don't have to share your comic with them, especially if they're not the intended audience for your comic. It isn't your responsibility to "win other people over" at the expense of meeting your own vision/mission for your comic.
If your relationship with them is mutually loving/caring, they would likely extend the same care/kindness back to you (even in a situation where you may disagree). It's easy to fall into black/white thinking and fixate on the negative potential outcomes only. If you find yourself in this situation (we all do it), I'd encourage you to balance out your thinking!
None of my family reads my comics, but they conceptually know that I draw them from time to time. A lot of my friends know I draw comics and read them if they have time/are interested/etc., but I'd say that the majority of them don't keep up with me for my comics/craft, but rather for me as an individual (comic-making is a facet of my life, not an entirety).
My personal advice for making the comic (take it or leave it!):
Make it and put it out there. If you don't even start, you'll never actually find out if something offends anyone. If you continue to be worried about offending your loved ones, just don't show them your comic. Or only show them snippets that you feel are "safe", relative to your own boundaries and comfort level. Or give them the choice to explore on their own, and if they have any "disagreements", who knows if you'll ever hear about them anyway (maybe they'll keep their opinions private because they're also avoiding conflict). We've all read things that we disagree with, but it doesn't mean we're going to go out of our way to contact the author about it.
I also found this article about "content warnings" in media interesting/relevant to some of the discussion here
The idea of consent for media is an interesting one, since people can close the window at any time and stop engaging with the media if it's not their cup of tea.