Gotta be real, the grind for sure. If the basic survival mechanics begin to feel like a grind rather than adding to the atmosphere, I feel like you've kinda fumbled your survival game design.
It's the difference between gathering food feeling meaningful in Don't Starve vs. feeling like it's tacked on in Minecraft survival mode, or even further, in No Man's Sky's survival-lite normal mode settings.