Nothing really wrong with that!
No-plot comics have been around for a good minute! They're very common in webcomics, especially if they're Slice of Life, and also a staple within Sunday newspaper cartoons.
For comics like these, episodes are connected in different ways. There's characters and settings, as you said, but there's also themes and premise that keep things going. And often times, any plot that develops is more subtle -- so we focus more on character development and interactions.
There's also a charm to them -- readers don't have to read earlier episodes to understand what's happening, and if they enjoy certain characters or certain episodes, they can also go back to those without missing much. There's a little bit of something for everyone with no-plot comics.
I don't have my own comic like that, but I do plan on making similar comics. It definitely makes for a fun exercise if you're used to making plot-driven work, and it can help you improve your writing skills!
So if you're planning something like that, I'd say go for it!