I get that, too. Like, I was heavily into sports as a kid. I was also the rebellious skater who hung out with a bunch of straight dudes and got into trouble all the time. I was in the military (secretly at time since the whole "don't ask, don't tell" thing was going). Most all of those are things society doesn't see as 'gay guy' material.
I've never really had a thing for porn. Don't judge people who do, but it just doesn't do anything for me. Never slept around either and all of my relationships have been dedicated and pretty wholesome.
There are also areas where I guess I'm pretty 'typical' gay. I love kids, and caring for them. I'm very openly a feminist, I get really involved in activism, I'm an artist.
But if you stop to think, those attributes could easily be any gender, and any sexuality. It's just weird how roles are so entrenched not just in genders, but in sexualities as well.