I think it's a common gripe for artists; you wither hate backgrounds, or you hate drawing characters...
I personally have difficulty with interior backgrounds. Outdoors are okay, but they're not as detailed as I'd like.
In the early chapters of my comic (which is actually what my readers are seeing now) I shied away from actually drawing anything for the setting (save a few large establishing panels) and just used a plain colour instead. Now I'm at a point in my buffer where I'm more confident with it. It's still a work in progress, though.