I've got a 3 node cluster. They are a hodge-podge of weak, old hardware. Yes, it's worth it. Don't worry about HA and automatic migration. It's nice to have a single interface to all the nodes. Also look into the proxmox backup server (PBS). It's a very nice backup system.
this post was submitted on 03 Jul 2023
19 points (91.3% liked)
Selfhosted
40747 readers
662 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 2 years ago
MODERATORS
Thank I will definitely be looking into PBS!
Yes, yes, yes, yes. For the tiny amount of overhead, even the remote console is worth it. Especially when you get into crazy "omg I have so much hardware" homelab territory and have stuff strewn over half your home. Being able to rely on Proxmox being pretty rock solid (if you're careful and smart about your upgrades and not constantly insisting on running bleeding edge), and being able to access the consoles and 'reset buttons' of all your VMs from a single computer is AMAZING.
Yeah I'm trying not to get to the point where half my house is computers... 😂
That does sound really good though! Thanks!
What do you mean by worth it? Financially? Haha
Idk if any of this is beneficial financially...haha
Proxmox is all I use for VM hosting, it is well worth it IMO, I colo metal and I host several virtual machines on it, webservers, ircds, kbin, etc. I specifically use Virtual Machines (KVM) however, it does have the ability to do containerization too (LXC).
Man, I wish I could find a good colo solution that wouldn't kill me with fees. VPS isn't bad cost-wise, but I'd really like to be able to throw as much hardware as I want at it without paying $1k/mo.
I use Dacentec, their colo prices are really reasonable and start @ $40/month, it is well worth it when you have your own hardware and you can load whatever you want in it. I've had no issues with uptime or stability either.
Ok sweet! What are you running currently on them?
gitlab, several docker containers, kbin, ircds, a bouncer, 3-4 web servers, a couple seperate mysql servers, Handshake DNS hosting and Handshake nodes
Lots of large operations run proxmox. You're good
Absolutely. You're going to be paying for more overhead but I've never regretting setting up a cluster. I run mine on a t5500, a dl360 gen 6, and a raspberry pi as a witness.
On the cluster I'm running pfsense, file shares, home assistant, a pihole, and a Debian vm with docker that has containers running radarr, sonarr, watchtower, plex, jackett, and mealie. Also spin up various VMs for testing.
That's nice! I'm looking to make media server as well.
I switched to moving all of my media services from VMs to containers and haven't regretted it. Highly recommend that as your approach.
I left xteve off the list of services as well. Very useful if you plan on doing IPTV.
The primary reason to virtualize is to maximize the "bang for your buck" on your hardware. Containers are great, but have their limits.
So long as you have a desire to learn it (and the budget), I say dive in with Proxmox and see how you can put that hardware to use. VMWare ESXi is more common in a business/enterprise setting, but costs money to for anything beyond the basic functionality after the evaluation period.
Basic functionality is probably good for most people. I believe the biggest limit I hit was for the resources. Believe it was 8 vCore /8GB RAM on a single VM. Most of the other vSphere/vSAN and orchestrator stuff is probably beyond home lab needs
I picked up some systems with 16gb each and it's a Ryzen 5 2400. I think it should be good for my needs... hopefully.
Oh I was saying with the free mode of esxi there are limits placed on the VM resources, not the host. It can be a bit of a pain to get the updates and patches if you don’t pay for the license though. If you get a enterprise server (dell r730 etc) then you’d be able to get the custom dell package from their site for updates but it’s a pain lol
Depending on what you are trying to run those should be an okay start
Ah ok. I'll cross that bridge if I ever get there. This is just more to tinker and it'll be a glorified file server in the end of the day...haha
But just wanted to learn it and see where it goes l.
Fwiw as an SRE specialized in infrastructure for large companies, the primary limits of containers are not about resources, they're about isolation. It's hard to beat CPU hardware virtualization (VMs) for proper isolation with decent performance, but for maximizing resource utilization, containers are actually better if you aren't running untrusted code like a cloud provider. Which is why companies like Google use them at their scale. And in fact, at least for long enough for it to end up in books, ran their VMs through their container orchestration tools. Virtualization has a penalty because you're running multiple kernels and switching back and forth etc.
Ok great! I'm doing it to just learn and tinker with. Thank you!
for sure a proxmox server is great, id just say don't go for the cluster just yet. Frankly, most self hosted stuff is dockerized and thats a huge plus. And it seems you already have that sorted out (id even ask you if casa OSs fileshare and an external drive could handle the NAS aspect).
I say this not to be a killjoy, but because I have a proxmox node I both overbuilt (for small services and running off a UPS) and underbuilt (for multiple big VMs) all because bought it to, and i kid you mot, “use it for NAS, and a window VM and run other random things that I don’t know yet”. 2 years in and i still don't know what those random things are.
So, my two cents: start cheap get a node to learn and understand where you want to go from there.
view more: next ›