I used a RaspberryPi 4B for about 3 years. I connected storage over USB-3 to a pair of SATA SSDs. It handled everything pretty much flawlessly for two users and half a dozen devices. We even had multiple users on Plex. dietpi was brilliant for my first home server :).
Initial uploads may be slow depending on your storage layout but in my experience the requirements are super low.