Ask Lemmy

My line of thinking is really wondering about what optimisations are necessary to allow Lemmy to scale in this way. Large social media sites have very interesting designs to deal with the huge amount of data flowing through them, caching as much as possible close to where it will be needed. I don't know about Lemmy's design though and I don't really have a good idea of how that would impact optimisations.

To take an example I remember from reddit (actually I had to re-read about it because I didn't really remember it...) reddit caches ordered lists of things, for example, the list of posts on the homepage. The problem is that the ordering has to be reevaluated all the time because it can change whenever someone votes. (Let's assume we're looking at a listing which incorporates voting). To make that work efficiently the reddit programmers made vote processing actually update not just the backing store and invalidate the cache, but modify the "cache" directly, which is now more like a denormalised view of the backing data. The way this was done meant that later, when the rate of votes increased, there were again problems because all this processing was contending on these denormalised views. I'm thinking this is probably going to be complicated by the federated aspect, because that's a separate source of updates from those local sources.

I would also say that you can't expect linear scaling for donations: early adopters are going to be enthusiasts, and correspondingly more enthusiastic with their money!