I'm one of those with slow but steady growing. Since my art got better, more people got interested and I have 57 readers now. And I think that's totaly fine, as my art is still improving and my first chapters looking bad.
A while ago I stoped carring too much about the numbers and just enjoy making comics
Also a nice icon realy helps, because it's the first thing, people see.