I get what you mean. Coming from a fanfiction writing background, you pretty much have all the establishing details set up for you (That is, unless you're writing AUs and such). My chapter ones get to go right into the action because typically, people already know what's up. Now that I'm entering the realm of original content, I have to navigate that unknown territory.
Prologues and first chapters tend to be a balancing act between setting the tone, hooking people into reading, introducing them to your world and characters, and all sorts of stuff. It's like trying to sell someone why this unknown thing I made is worth their investment, except I have to do it in under a few minutes because there are even more people like me lined up to do the same.
But like others above have said, I enjoy this process! It's a lot of fun to figure out what the right balancing act is. When I was writing my prologue and chapter one, I underwent three to four revisions to get it to a point where I'm satisfied with it. I thought of it as a nice exercise of how much can I put in without overwhelming the readers. I also used this opportunity to set up little hints (that may not appear at hints at first read) and easter eggs for future chapters, so that was a lot of fun for me.
There's probably a lot I needed to improve on with my first chapters, but hey, you can only have them once in your series (LOL). I try not to be too harsh on myself.