this post was submitted on 19 Jun 2023
709 points (97.7% liked)
Lemmy.World Announcements
29070 readers
342 users here now
This Community is intended for posts about the Lemmy.world server by the admins.
Follow us for server news π
Outages π₯
https://status.lemmy.world
For support with issues at Lemmy.world, go to the Lemmy.world Support community.
Support e-mail
Any support requests are best sent to [email protected] e-mail.
Report contact
- DM https://lemmy.world/u/lwreport
- Email [email protected] (PGP Supported)
Donations π
If you would like to make a donation to support the cost of running this platform, please do so at the following donation URLs.
If you can, please use / switch to Ko-Fi, it has the lowest fees for us
Join the team
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I have little understanding of the technical details of Lemmy, but I'm having a hard time understanding how it can scale. How do you build something like /r/funny with 40 million subscribers when the biggest Lemmy instance seems to be suffering at 30k users?
As far as I can see while users can subscribe to communities on different instances, communities themselves are locked to a single instance. How could a multi million strong community grow here?
First of all, as a software engineer I'm β well, "impressed" is the wrong word because I remember how efficient software used to be in the '90s β I'm "satisfied" with how well Lemmy instances are scaling. Even the largest instances are running on single, fairly-small servers.
Keep in mind that this is all alpha software and not only likely very unoptimized but also pretty buggy, so the surprisingly few problems there have been are more likely due to that than to real issues of scale.
Second, and more importantly, remember that having really big instances is "doing it wrong" to begin with. The intended design of Lemmy (and Fediverse services in general) is to have a whole lot of small instances, not a few big ones.
I guess my question is that you can't really control if a community grows to be huge or not. You can control who can create an account your instance, but unless you defederate, what happens if 20 million accounts subscribe to a single community? How is that load handled? Does it just collapse the entire instance under it's weight? Or is the fediverse just inherently built to stifle community growth past a certain scale?
I would hope that an instance/magazine that can't handle 20m users will have some sort of manual approval or other filter like Beehaw does. Beehaw defederated because they needed to breathe. Same with any other instance that begins to near its limit.
I was more referring about impacts of non-local users browsing communities on other instances. Which instance handles that load? If I browse lemmy.ml communities on my lemmy.world account am I impacting lemmy.world or lemmy.ml? What happens when all 35k lemmy.world users browse a lemmy.ml community because it's the most popular one? Does lemmy.ml need to support all their own users + any non-local visitors?
That's why I mentioned Beehaw. Beehaw defederated for this reason.
Users can view and post to content on communities across instances, as long as the instances federate with each other. That doesn't solve the separate issue of the individual instances being able to handle heavy traffic loads though.