Yes. It's natural.
People will go to the beginning, read a bit, see it's not for them, and leave. And some people will read a bit, have to do something, and then come back to the series way later.
Unless you have a specific episode that is shared some place and views jump for that episode, a gradual downward slope from the first episode onward is expected.