this post was submitted on 10 Feb 2025
813 points (99.4% liked)

linuxmemes

22427 readers
2024 users here now

Hint: :q!


Sister communities:


Community rules (click to expand)

1. Follow the site-wide rules

2. Be civil
  • Understand the difference between a joke and an insult.
  • Do not harrass or attack users for any reason. This includes using blanket terms, like "every user of thing".
  • Don't get baited into back-and-forth insults. We are not animals.
  • Leave remarks of "peasantry" to the PCMR community. If you dislike an OS/service/application, attack the thing you dislike, not the individuals who use it. Some people may not have a choice.
  • Bigotry will not be tolerated.
  • These rules are somewhat loosened when the subject is a public figure. Still, do not attack their person or incite harrassment.
  • 3. Post Linux-related content
  • Including Unix and BSD.
  • Non-Linux content is acceptable as long as it makes a reference to Linux. For example, the poorly made mockery of sudo in Windows.
  • No porn. Even if you watch it on a Linux machine.
  • 4. No recent reposts
  • Everybody uses Arch btw, can't quit Vim, <loves/tolerates/hates> systemd, and wants to interject for a moment. You can stop now.
  • 5. πŸ‡¬πŸ‡§ Language/язык/Sprache
  • This is primarily an English-speaking community. πŸ‡¬πŸ‡§πŸ‡¦πŸ‡ΊπŸ‡ΊπŸ‡Έ
  • Comments written in other languages are allowed.
  • The substance of a post should be comprehensible for people who only speak English.
  • Titles and post bodies written in other languages will be allowed, but only as long as the above rule is observed.
  • Β 

    Please report posts and comments that break these rules!


    Important: never execute code or follow advice that you don't understand or can't verify, especially here. The word of the day is credibility. This is a meme community -- even the most helpful comments might just be shitposts that can damage your system. Be aware, be smart, don't remove France.

    founded 2 years ago
    MODERATORS
     

    Background: 15 years of experience in software and apparently spoiled because it was already set up correctly.

    Been practicing doing my own servers, published a test site and 24 hours later, root was compromised.

    Rolled back to the backup before I made it public and now I have a security checklist.

    top 50 comments
    sorted by: hot top controversial new old
    [–] [email protected] 2 points 2 hours ago

    I don't think I'm ever opening up anything to the internet. It's scary out there.

    I don't trust my competence, and if I did, I dont trust my attention to detail. That's why I outsource my security: pihole+firebog for links, ISP for my firewall, and Tailscale for tunnels. I'm not claiming any of them are the best, but they're all better than me.

    [–] satans_methpipe 7 points 7 hours ago* (last edited 7 hours ago) (2 children)

    On a new linux install or image I will always:

    • Make new users(s)
    • Setup new user to sudo
    • Change ssh port
    • Change new user to authenticate ssh via key+password
    • Disable root ssh login
    [–] stebator 1 points 1 hour ago
    • Setup new user to sudo

    I hope it is not a passwordless sudo, it is basically the same as root.

    [–] njordomir 2 points 2 hours ago

    That's more or less the advice I've gotten as well. I've also read good things about fail2ban which tries to ban sources of repeated authentication failures to prevent brute force password attempts. I've used it, but the only person who has managed to get banned is myself! I did get back in after the delay, but I'm happy to know it works.

    [–] [email protected] 11 points 13 hours ago

    I'm having the opposite problem right now. Tightend a VM down so hard that now I can't get into it.

    [–] [email protected] 12 points 15 hours ago (1 children)
    [–] FauxLiving 21 points 14 hours ago
    [–] [email protected] 9 points 17 hours ago (2 children)

    I've been quite stupid with this but never really had issues. Ever since I changed the open ssh port from 22 to something else, my server is basically ignored by botnets. These days I obviously also have some other tricks like fail2ban, but it was funny how effective that was.

    [–] [email protected] 6 points 14 hours ago

    Almost the same here. I also change some ssh settings: disable root login, disable password, allow only public key login. That's about it. I never had any problems.

    [–] kalpol 2 points 15 hours ago

    Fsil2ban piped to pfblocker works great. Plus snort

    [–] [email protected] 8 points 17 hours ago

    Weird. My last setup had a NAT with a few VMs hosting a few different services. For example, Jellyfin, a web server, and novnc/vm. That turned out perfectly fine and it was exposed to the web. You must have had a vulnerable version of whatever web host you were using, or maybe if you had SSH open without rate limits.

    [–] [email protected] 27 points 23 hours ago (2 children)

    I'm confused. I never disable root user and never got hacked.

    Is the issue that the app is coded in a shitty way maybe ?

    [–] [email protected] 21 points 22 hours ago (2 children)

    You can't really disable the root user. You can make it so they can't login remotely, which is highly suggested.

    [–] [email protected] 9 points 21 hours ago (1 children)
    sudo passwd -l root
    

    This disables the root user

    [–] [email protected] 7 points 18 hours ago (3 children)

    There's no real advantage to disable the root user, and I really don't recommend it. You can disable SSH root login, and as long as you ensure root has a secure password that's different than your own account your system is just as safe with the added advantage of having the root account incase something happens.

    load more comments (3 replies)
    load more comments (1 replies)
    [–] cley_faye 3 points 23 hours ago

    You can't really disable it anyway.

    Hardening is mostly prevent root login from outside in case every other layer of authentication and access control broke, do not allow regular user to su/sudo into it for free, and have a tight grip on anything that's executable and have a setuid bit set. I did not install a system from scratch in a long time but I believe this would be the default on most things that are not geared toward end-user devices, too.

    [–] Thcdenton 11 points 21 hours ago

    I usually just follow this

    [–] recklessengagement 24 points 1 day ago

    This sounds like something everyone should go through at least once, to underscore the importance of hardening that can be easily taken for granted

    [–] [email protected] 23 points 1 day ago* (last edited 1 day ago) (6 children)

    I can’t even figure out how to expose my services to the internet, honestly it’s probably for the best Wireguard gets the job done in the end.

    load more comments (6 replies)
    [–] [email protected] 4 points 22 hours ago (1 children)
    load more comments (1 replies)
    [–] [email protected] 44 points 1 day ago (1 children)

    I've gotta say this post made me appreciate switching to lemmy. This post is actually helpful for the poor sap that didn't know better, instead of pure salt like another site I won't mention.

    [–] [email protected] 30 points 1 day ago (2 children)

    I shared it because, out there, there is a junior engineer experiencing severe imposter syndrome. And here I am, someone who has successfully delivered applications with millions of users and advanced to leadership roles within the tech industry, who overlook basic security principles.

    We all make mistakes!

    load more comments (2 replies)
    [–] [email protected] 33 points 1 day ago (2 children)

    As a linux n00b who just recently took the plunge and set up a public site (tho really just for my own / selfhosting),

    Can anyone recommend a good guide or starting place for how to harden the setup? Im running mint on my former gaming rig, site is set up LAMP

    [–] [email protected] 28 points 1 day ago (4 children)

    The other poster gave you a lot. If that's too much at once, the really low hanging fruit you want to start with is:

    • Choose an active, secure distro. There's a lot of flavors of Linux out there and they can be fun to try but if you're putting something up publicly it should be running on one that's well maintained and known for security. CentOS and Debian are excellent easy choices for example.

    • Similarly, pick well maintained software with a track record. Nginx and Apache have been around forever and have excellent track records, for example, both for being secure and fixing flaws quickly.

    • If you use Docker, once again keep an eye out for things that are actively maintained. If you decide to use Nginx, there will be five million containers to choose from. DockerHub gives you the tools to make this determination: Download number is a decent proxy for "how many people are using this" and the list of updates tells you how often and how recently it's being updated.

    • Finally, definitely do look at the other poster's notes about SSH. 5 seconds after you put up an SSH server, you'll be getting hit with rogue login attempts.

    • Definitely get a password manager, and it's not just one password per server but one password per service. Your login password to the computer is different from your login to any other things your server is running.

    The rest requires research, but these steps will protect you from the most common threats pretty effectively. The world is full of bots poking at every service they can find, so keeping them out is crucial. You won't be protected from a dedicated, knowledgeable attacker until you do the rest of what the other poster said, and then some, so try not to make too many enemies.

    [–] [email protected] 1 points 17 hours ago
    load more comments (3 replies)
    [–] horse_battery_staple 23 points 1 day ago* (last edited 1 day ago) (2 children)

    Paranoid external security. I'm assuming you already have a domain name. I'm also assuming you have some ICANN anonymization setup.

    This is your local reverse Proxy. You can manage all this with a container called nginx proxy manager, but it could benefit you to know it's inner workings first. https://www.howtogeek.com/devops/what-is-a-reverse-proxy-and-how-does-it-work/

    https://cloud9sc.com/nginx-proxy-manager-hardening/

    https://github.com/NginxProxyManager/nginx-proxy-manager

    Next you'll want to proxy your IP address as you don't want that pointing to your home address

    https://developers.cloudflare.com/learning-paths/get-started-free/onboarding/proxy-dns-records/

    Remote access is next. I would suggest setting up wireguard on a machine that's not your webserver, but you can also set that up in a container as well. Either way you'll need to punch another hole in your router to point to your wire guard bastion host on your local network. It has many clients for windows and linux and android and IOS

    https://github.com/angristan/wireguard-install

    https://www.wireguard.com/quickstart/

    https://github.com/linuxserver/docker-wireguard

    Now internally, I'm assuming you're using Linux. In that case I'd suggest securing your ssh on all machines that you log into. On the machines you're running you should also install fail2ban, UFW, git, and some monitoring if you have the overhead but the monitoring part is outside of the purview of this comment. If you're using UFW your very first command should be sudo ufw allow ssh

    https://www.howtogeek.com/443156/the-best-ways-to-secure-your-ssh-server/

    https://github.com/fail2ban/fail2ban

    https://www.digitalocean.com/community/tutorials/ufw-essentials-common-firewall-rules-and-commands

    Now for securing internal linux harden the kernel and remove root user. If you do this you should have a password manager setup. keepassx or bitwarden are ones I like. If those suck I'm sure someone will suggest something better. The password manager will have the root password for all of your Linux machines and they should be different passwords.

    https://www.makeuseof.com/ways-improve-linux-user-account-security/

    https://bitwarden.com/help/self-host-an-organization/

    https://keepass.info/

    Finally you can harden the kernel

    https://codezup.com/the-ultimate-guide-to-hardening-your-linux-system-with-kernel-parameters/

    TLDR: it takes research but a good place to start is here

    https://www.digitalocean.com/community/tutorials/recommended-security-measures-to-protect-your-servers

    load more comments (2 replies)
    [–] [email protected] 21 points 1 day ago (6 children)

    Permitting inbound SSH attempts, but disallowing actual logins, is an effective strategy to identify compromised hosts in real-time.

    The origin address of any login attempt is betraying it shouldn’t be trusted, and be fed into tarpits and block lists.

    [–] [email protected] 8 points 1 day ago

    Endlessh and fail2ban are great to setup a ssh honeypot. There even is a Prometheus exporter version for some nice stats

    Just expose endlessh on your public port 22 and if needed, configure your actual ssh on a different port. But generally: avoid exposing ssh if you don't actually need it or at least disable root login and disable password authentication completely.

    https://github.com/skeeto/endlessh https://github.com/shizunge/endlessh-go https://github.com/itskenny0/fail2ban-endlessh

    [–] [email protected] 4 points 23 hours ago

    If it is your single purpose to create a blocklist of suspect IP addresses, I guess this could be a honeypot strategy.

    If it's to secure your own servers, you're only playing whack-a-mole using this method. For every IP you block, ten more will pop up.

    Instead of blacklisting, it's better to whitelist the IP addresses or ranges that have a legitimate reason to connect to your server, or alternatively use someting like geoip firewall rules to limit the scope of your exposure.

    load more comments (4 replies)
    [–] punkwalrus 172 points 1 day ago (1 children)

    Basic setup for me is scripted on a new system. In regards to ssh, I make sure:

    • Root account is disabled, sudo only
    • ssh only by keys
    • sshd blocks all users but a few, via AllowUsers
    • All 'default usernames' are removed, like ec2-user or ubuntu for AWS ec2 systems
    • The default ssh port moved if ssh has to be exposed to the Internet. No, this doesn't make it "more secure" but damn, it reduces the script denials in my system logs, fight me.
    • Services are only allowed connections by an allow list of IPs or subnets. Internal, when possible.

    My systems are not "unhackable" but not low-hanging fruit, either. I assume everything I have out there can be hacked by someone SUPER determined, and have a vector of protection to mitigate backwash in case they gain full access.

    [–] feddylemmy 72 points 1 day ago (6 children)
    • The default ssh port moved if ssh has to be exposed to the Internet. No, this doesn't make it "more secure" but damn, it reduces the script denials in my system logs, fight me.

    Gosh I get unreasonably frustrated when someone says yeah but that's just security through obscurity. Like yeah, we all know what nmap is, a persistent threat will just look at all 65535 and figure out where ssh is listening.. But if you change your threat model and talk about bots? Logs are much cleaner and moving ports gets rid of a lot of traffic. Obviously so does enabling keys only.

    Also does anyone still port knock these days?

    load more comments (6 replies)
    [–] [email protected] 42 points 1 day ago (4 children)

    Do not allow username/password login for ssh. Force certificate authentication only!

    load more comments (4 replies)
    [–] [email protected] 4 points 1 day ago

    Yeah, about this; any ssh server that can be run as user and doesn't do shenanigans like switching user?

    [–] [email protected] 21 points 1 day ago (2 children)

    Had this years ago except it was a dumbass contractor where I worked who left a Windows server with FTP services exposed to the Internet and IIRC anonymous FTP enabled, on a Friday.

    When I came in on Monday it had become a repository for warez, malware, and questionable porn. We wiped out rather than trying to recover anything.

    load more comments (2 replies)
    [–] [email protected] 76 points 1 day ago (1 children)

    One time, I didn’t realize I had allowed all users to log in via ssh, and I had a user β€œsteam” whose password was just β€œsteam”.

    β€œHey, why is this Valheim server running like shit?”

    β€œWtf is xrx?”

    β€œOh, it looks like it’s mining crypto. Cool. Welp, gotta nuke this whole box now.”

    So anyway, now I use NixOS.

    load more comments (1 replies)
    load more comments
    view more: next β€Ί