this post was submitted on 09 Jul 2023
6 points (100.0% liked)

Lemmy Support

4633 readers
2 users here now

Support / questions about Lemmy.

Matrix Space: #lemmy-space

founded 5 years ago
MODERATORS
 

I'm trying to set up a personal Lemmy instance, and I've got it running but it doesn't seem to sync very well with posts and comments made before the instance was created. I ran [lemmony] (https://github.com/jheidecker/lemmony) to get the /all to work correctly and to start syncing communities, but now when I go to some communities and I look at the posts created before I subscribed to the community, they either don't show up or don't have the correct number of upvotes/comments. Also, when I search for communities, next to the community name is only the number of users from my instance subscribed, not the actual number of subscribers to the community. Is there a way to fix this?

you are viewing a single comment's thread
view the rest of the comments
[–] PriorProject 5 points 1 year ago* (last edited 1 year ago) (3 children)

I ran [lemmony] (https://github.com/jheidecker/lemmony) to get the /all to work correctly and to start syncing communities

You shouldn't run this script, at least not in its default config. It's more work, but a much better approach is hitting lemmyverse.net and manually subscribing to a bunch of communities you're interested in.

Unless you're very careful managing defederation and blocks, it subscribes you to thousands of communities you'll never read (including the deep/dark parts of the lemmyverse posting porn/loli, piracy, and hate-speech) that will be cached on your server, re-served to the public internet from your instance, and may have legal repercussions in your jurisdiction.

It also increases the federation load your server generates by 50x or more compared to a "normal" single-user instance that subs to 100 communities or so... which doesn't make you a very good fediverse citizen at a time when federation is being flaky and overloaded throughout the lemmyverse.

... when I go to some communities and I look at the posts created before I subscribed to the community, they either don't show up or don't have the correct number of upvotes/comments...

This is expected. To a first approximation, subscribing to a community asks the sending server to forward a copy of every post/comment/vote from now on. There's no significant historical backfill (although there are a few ways to get your instance to download a particular old post, or a handful of them).

But when you first subscribe, you'd expect to be missing old posts, and then to have posts right on the border have some comments missing depending on when they were made. New posts and comments should generally show up in an orderly fashion, except for the global issues with federated replication that cause many servers to struggle to stay exactly in sync.

... when I search for communities, next to the community name is only the number of users from my instance subscribed, not the actual number of subscribers to the community.

This is expected, subscriber counts are not federated. You need to visit the community's instance to see the global sub count.

[–] Quindius 2 points 1 year ago (1 children)

That does make sense, I'll probably go through and do that. I just wish there was a better way of sorting by all and historical syncs

[–] PriorProject 1 points 1 year ago

Yeah, it's confusing if you're not real steeped in how ActivityPub works... and admittedly not real intuitive.

If you choose to wipe the existing subs you made with the tool, you might want to delete the user you used to subscribe with them. I don't think wiping your db or server will tell the remote servers to unsub you. But I think deleting the user will clear all their subscriptions (not 100% sure though).

The normal way to do this would be to unsub every community, but I don't think this tool handles rolling back like that.

[–] [email protected] 0 points 1 year ago

But when you first subscribe, you’d expect to be missing old posts

OP didn't expect to be missing old posts, hence his question. I had the same surprising discovery. Not sure how the UX could be improved to convey to the user what is actually happening.