I'm on team buffer. I worked my ass off during six months to build it, ended up with 36 pages ( which is really 31 pages in terms of updates, since the five first pages were posted in the same update ). I agree with the fact that at time it's really complicated to be so disconnected with what you are drawing and what people are reading, but having such a big buffer actually allowed me to take two month to plan the next part of the comic and actually take a rest ( which turns out is needed after churning so many pages in so little time when you're the person who does everything from start to finish ). Now I know I'll just go back to drawing pages at the start of september without having to worry about wether or not I will be on time because there will always be at least on page to fall back on.
So yeah, you kind of feel left out of the fun because you're so ahead of time and you cannot share the cool things you're doing right now, but I feel it's worth it, because I personally despise stress. The worst thing will probably to look back on the quality of the first pages of your buffer and realize there's so many mistakes you can't fix now, but heh, it would end up happening without buffer anyway, the first few pages of every comic are meh in retrospective.
I would say maybe have a little buffer at least. So you're not too ahead of your readers but you also have a fall back in case something goes awry. As a reader it really bums me when I go to check the comic the day it updates only to be greeted by nothing and/or a message to say sorry. I'm ok with announced hiatus, I'm ok with a few weeks of little doodles/bonus illustrations instead of comic pages, but just going to see the update and getting nothing ? If it happens too often, no matter how cool the comic, the chances I go back every week to read gets slimmer and slimmer.
so yeah, keep that in mind when choosing wether or not you want to go buffer-free