Back in 1997 I was like "Ooh, Debian is mildly easy to install (compared to Slackware). Just need to engage my brain a few times maybe."
(The first Slackware guide I read in 1996 had an ominous warning about getting the ModeLines right in XFree86 or the monitor will catch fire. This, fortunately, was a little bit of exaggeration. Over/under refresh frequency protection was already a thing.)
Now? "Oh no I fucked up my password shit and can't login. I'll need 5 more minutes to completely reinstall this Raspberry Pi image. I should have engaged my brain!"
Shit, we've gotten to the point that your average desk jockey can probably install freaking FreeBSD on the first try. If that's not a good sign I don't know what is.
The way I think it, it's possible a really small number of GPUs would be enough to render the framebuffer, you'd just need an army of low-power graphics units to receive the data and render it on screens.
Having a high-power GPU for every screen is definitely a loss unless the render job is distributed really well and there's also people around to admire the results at the distance where the pixel differences no longer matter. Which is to say, not here.