I am definitely there with one of my characters, but I enjoy it at the end of the day.
One of my main characters has brain damaged that means talking is very slow and difficult for her. It means I have to spen forever on every single line figuring out how much I can cut, what she’d even bother to say, and which syllables are tricky for her. It means I end up tossing a lot of cool lines and having to give her exposiion to other leads. But I think characters limitations are what makes them really interesting.
I think there’s a lot of fun in it when you focus on what the character isn’t saying. If a charcter is polite and flowery, what are they talking around? If the character is abrupt and terse, what feelings are they having that they don’t express? There’s something very emotionally powerful about limited speech patterns because they make what does slip through all that more poignant.