If it is not from your story, I am sorry, but as far as I remember, he:
a. showed his two buddies how to win a woman over quickly (a gymnast who immediately liked him; they didn't have sex)
b. got lured into a trap by a super-attractive female who was his enemy but mentioned how much she enjoyed sex with him and how she is going to miss it (they lived together for a while, and he 'saved' her)
c. the lady who is hunting him for her own purposes who masturbates in a shower thinking about him
d. the submissive cat girl he has sex with, finishing on her face--at which point I stopped reading because it was too much for me.
Your story starts with the following passage:
Valeir Duval, the buxom beauty of the Anju Academy, stared transfixed at the enchanted mirror in front of her office desk. She wasn't aware of it, but she was smiling. Something she always seemed to do while watching him.
next, another woman walks in... described as just raven-haired.
Three sentences down the road, you suppliment her description as 'raven-haired' with 'dark-haired oriental beauty'
Basically, from the first paragraph, women are treated as vessels of beauty that is overemphasized to the reader AND one of them is already lusting after him with a dreamy smile and parted lips.
I didn't see any other attractive male in any significant role, and lol, I normally notice them... certainly no raven-haired virile studs walking in...
I am not accusatory, I am just explaining why your story came across as a male power fantasy to me: all ladies are beautiful and all want to sleep with the cursed and angsty protagonist who either reluctantly or enthusiastically agree (alternatively gently puts them down). It is emphasized by the language used and the fixation on describing females with hair color plus 'beautiful' thrown in, and some questionable language (i.e. 'oriental'). Other males used in comic relief or Old&Wise roles, not as credible rivals.
There is nothing wrong with writing it, everyone has different power fantasies and many people enjoy reading them. Own your story's niche, promote it as such, and you might do better actually than trying to change it. Stories that speak to men have as much validity as those that are women-facing.