Lemmy

2172 readers

27 users here now

Everything about Lemmy; bugs, gripes, praises, and advocacy.

For discussion about the lemmy.ml instance, go to [email protected].

founded 4 years ago

MODERATORS

[email protected]

Lemmy Federation Architecture Change Proposal (github.com)

submitted 1 year ago by [email protected] to c/[email protected]

7 comments fedilink hide all child comments

https://github.com/LemmyNet/lemmy/issues/3245

I posted far more details on the issue then I am putting here-

But, just to bring some math in- with the current full-mesh federation model, assuming 10,000 instances-

That will require nearly 50 million connections.

Each comment. Each vote. Each post, will have to be sent 50 million seperate times.

In the purposed hub-spoke model, We can reduce that by over 99%, so that each post/vote/comment/etc, only has to be sent 10,000 times (plus n*(n-1)/2 times, where n = number of hub servers).

The current full mesh architecture will not scale. I predict, exponential growth will continue to occur.

Let’s work on a solution to this problem together.

(Also- as federation has been completely broken on this particular server for me- there is a good chance I will not be able to see, or reply to anything posted below... That is, also assuming this even posts correctly to this server.)

you are viewing a single comment's thread
view the rest of the comments

[–] PlutoniumAcid 7 points 1 year ago

Is your logic faulty?

Yes, there are 50M total connections between 10k nodes, but when one server sees one comment/updootmwhatever, then that server "only" needs to send it to the 10k peers.

Those peers do not need to pass it on to all other peers; that would mean 50M messages total, but again, not from each peer.