Yeah I'm the opposite as well. I write for fun, actually, it's not really my job, and so there's just a lot less stress there. It's so much more enjoyable for me. But with art I'm always trying to push myself because everything I draw represents me on a professional level. And that's not to dismiss the talent of writing, because it takes a long time to develop and yeah, it's hard to do. And yeah, I also can't listen to music with words when I write, but that's not to say it's harder for me than the art is, it just takes concentration time.
And honestly, I think art and writing are so intertwined in comic creation, that you can't truly dismiss the fact that when you are setting up the composition of your panels and laying out the words and all that--you're still writing. It's a visual form of communication, but that is communication. The expressions I give to my characters is still something I think a lot about, and even if the episode were completely silent, I need to be able to tell a story by the unspoken dialogue of character movement and panel composition. So like...what's hard about writing is still something you have to do in art all the time.
I don't really go into auto-mode until I get to the coloring stage, and even then, I'll still have to sit back and make color drafts to make sure everything will sync in the end. And then, after I'm done with art...it's back to doing stretching exercises because I get mad carpal tunnel. So like...there is a physical aspect to it that like...it's comparing apples and oranges with art and writing, but for me art is like running sprints, and writing is like walking a mountain. Both are hard and satisfying in different ways, and both can compliment the other and make you stronger.