I agree with using rsync.
Open a screen then use something like this command:
rsync -arvzip --progress {$remote}:/path/to/remote/files /path/to/local/files
If you are using a different port for SSH, you’ll need to pass an option like -e 'ssh -p 12345'
I’ve done both bare metal and docker. I find containers much easier to manage, troubleshoot and deploy