I think it's largely what we already do. No single person decides societal norms, for instance. Through teaching, learning, story telling, discussion, absorption of media, we communicate expectations. And I think things like, say, critiquing "cancel culture" is a good example of push back against the "I'm offended" side that's appropriate and needed.
You suggested (from what I could tell, feel free to correct me!) that either we completely side with the offended, and inhibit the free speech of the offender, or we completely side with the offender, and tell the offended unanimously to shove off. How is that in any way more practical, equitable, or unbiased?