this post was submitted on 09 Jun 2023
34 points (97.2% liked)

Asklemmy

44119 readers
1001 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_[email protected]~

founded 5 years ago
MODERATORS
 

For example, I’m on Lemmy.sdf.org and I joined the [email protected] community. But there are many missing articles and comments. If I browse directly on Lemmy.ml for the same article there ~90% of comments are missing.

https://lemmy.ml/post/1152794 has 26 comments https://lemmy.sdf.org/post/11232 has 0 comments

top 39 comments
sorted by: hot top controversial new old
[–] [email protected] 16 points 2 years ago (1 children)

Pretty sure it doesn't "take a while" for things to sync up. Once an instance is discovered by another, any posts from that point forward will appear, but anything made before then will not. I have personally seen new instances sync with kbin.social that have less comments than if you look at the main instance's thread. They have added more comments, but only new ones made after it was discovered.

Whether I'm right or not, I'm not sure. Would have to hear from the devs to know for sure, but from all I've seen there is no syncing of archived or historical postings, just discovery of and acceptance of new data from other instances.

[–] [email protected] 6 points 2 years ago (1 children)

This is my understanding as well, after using a number of different instances over the last few months.

I believe this issue will mostly sort itself out in the future as the federated network becomes more "connected"

A new instance connecting to an existing one will have content from the established instance missing, but as time goes on that content becomes a smaller portion of the overall content.

I anticipate some development on this issue in the near future anyway, perhaps cached content that is able to be "pushed" to a requesting instance.

[–] [email protected] 2 points 2 years ago

Yeah it's still definitely an issue considering there will be plenty of old topics that people will want to search and refer back to, and any new instance or people making their own will be SOL if they come in years later after communities have been posting for a while.

[–] [email protected] 14 points 2 years ago* (last edited 2 years ago) (4 children)

This could mean that syncing is in progress between these two instances. In that case, if you check back in a bit, you should see all the comments.

Edit: just to clarify, I am speculating here - I'm still learning how it all works myself

[–] [email protected] 5 points 2 years ago (1 children)

Comments from before the first user subscribes simply do not sync. An instance only gets comments made after at least one user subscribes to a community.

[–] [email protected] 3 points 2 years ago (1 children)
[–] [email protected] 3 points 2 years ago

Yeah, I think it will change eventually, but there are some issues that make it hard to fix right away. Lemmy is basically beta software written by two guys that has been thrust into the spotlight by current events. There are going to be some growing pains, but I have hope that things will improve with time.

[–] sunspider 5 points 2 years ago

I think there might be more going on as the post in question is 4 days old, and all the comments are at least 1 day old; is the syncing typically days behind? The federated version that OP links shows 0 comments, and the version on my instance has just 5 comments.

Is it to do with when a user on the remote instance first interacted with the post? I.e, its only showing comments from after someone on lemmy.sdf.org first interacted with the post?

[–] [email protected] 3 points 2 years ago

your replay came quickly… so syncing seems to be working. If something doesn’t get synced is it retried against later? A good chunk of comments are missing across many posts. 😔

[–] [email protected] 2 points 2 years ago (1 children)

Would you mind elaborating on this a bit or linking to documentation that explains this in more detail? It seems that unless I visit any thread on its own instance, I'm not getting the actual number of upvotes and/or comments. Waiting and checking back doesn't seem to solve it (double checked on a post I checked about 4 hours ago, still can't see the full thing), so maybe it helps if I know what's going on exactly.

[–] [email protected] 7 points 2 years ago (2 children)

Yeah on Lemmy.sf.org the [email protected] community has most comments missing. But stuff like [email protected] seem to be synced better. Maybe there wasn't subscribers for Apple community until I subscribed? So now it is just slowly starting to sync up? If so how long does it take and how many days back will it got to fetch comments?

[–] [email protected] 5 points 2 years ago* (last edited 2 years ago) (2 children)

To add another example here, I saw the same behavior on this post: https://lemmy.ml/post/1136642. Right now it has 43 comments on lemmy.ml but over on my instance (link) there's only 18.

It's also unclear to me why some posts are not showing up, since the new ones (4h ago) appear, some old ones (7d ago) too, but some in the middle (6d, 5d ago) do not, which doesn't really make sense...

[–] [email protected] 3 points 2 years ago

Yeah this is pretty frustrating especially being it seems this asklemmy community is working fine…? Hard to grasp what’s going on with comments. 😕

[–] [email protected] 2 points 2 years ago (1 children)

I think it's because of the server overload some instances have been suffering. It might be affecting sync between instances in addition to the timeouts for user interaction.

[–] [email protected] 1 points 2 years ago

if there is overloading going on then there should be retrying. Seems that this isn’t happening or the retries are so late it ruins usability.

[–] [email protected] 1 points 2 years ago

Yep. For me it also matters whether I'm using my beehive account or my feddit.nl (much smaller instance) account. Guess it's just part of the federated part, but it's a bit annoying all the same

[–] [email protected] 13 points 2 years ago (1 children)

There could be several reasons for this, depending on what exactly you mean.

When the first person on an instance to subscribe to a remote community does so, the local mirror of that community starts receiving posts and comments from the original. But older posts and comments are not retrieved. You're only getting stuff going forward.

So, if you're talking about an instance that is much younger than Lemmy.ml, it'll have only a small fraction of the backlog.

On the other hand, if what you're seeing is that new comments and posts aren't reliably showing up, we'll, that's likely an issue of the server hosting the community being absolutely fucking destroyed by traffic right now.

[–] [email protected] 2 points 2 years ago

In my example the post is ~4 days old and the comments are as recent as a day ago. I can see the post on my instance but zero comments.

Are all posts synced but not comments if I’m the first to subscribe to a community on my instance?

[–] [email protected] 6 points 2 years ago* (last edited 2 years ago) (2 children)

check your language setting in your profile. make sure you have "Undefined" selected along with "English", then reload.

[–] [email protected] 3 points 2 years ago

I have "Undetermined" and "English" selected. There is no change to the comment count if I keep adding languages.

[–] [email protected] 1 points 2 years ago (1 children)

But, that should only matter when viewing via a logged in server. Those two links are to communities directly on servers. I suppose it’s possible no one on lemmy.sdf.org has subscribed to that community. That could explain the original question but doesn’t explain the example posted by @[email protected] example of https://lemmy.ml/post/1136642 vs https://lemmy.fdvrs.xyz/post/1436

(How do I get a link to reference a comment that works everywhere?)

[–] [email protected] 5 points 2 years ago* (last edited 2 years ago) (1 children)

I'm sorry, i don't know enough about lemmy yet to answer that. my advice about the language settings was what an admin told me when I had similar problems, and it worked for me. if it hasn't solved your problem, then I guess it's something else.

sorry I couldn't help more

[–] [email protected] 2 points 2 years ago (1 children)

No problem. You’ve probably been here longer than me. We’re all trying to figure this out. The question reveals issues I wasn’t aware of. You actually mentioned something that would be relevant in some situations that taught me something. I was just pointing out that I didn’t think your suggestion applied here.

All of us Reddit refugees are trying to figure out the nuances. I appreciate your comment because it taught me something new.

[–] [email protected] 4 points 2 years ago (1 children)

it's worth mentioning that changing your language setting may not have an immediate effect. it could take a but for the server to update, especially considering that it's under a very heavy load right now.

[–] [email protected] 2 points 2 years ago

But again, that’s if you are viewing the community via the server you are subscribed to. For me, that would be https://sh.itjust.works/c/[email protected] for the community and https://sh.itjust.works/post/8299 for the direct link. I just see 5 posts, which is less than either the original or the server OP is on.

My language settings shouldn’t matter when viewing servers I’m not logged in with. I do have both English and Undefined checked and only see 5 posts on that thread in sh.itjust.works.

[–] [email protected] 5 points 2 years ago (3 children)

Just to add... It is really not true to be told it doesn't matter what instance I'm on when in fact it seems that it really does matter if I'm interesting in participating in comments (or just reading them).

[–] [email protected] 2 points 2 years ago (1 children)

Well, you CAN participate, subscribe and read the community of another instance. You don't have to be part of the other instance to do so.

Just make sure you are browsing / searching all and not just local.

I am reading and writing this from kbin and not even Lemmy btw.

[–] [email protected] 1 points 2 years ago

I’m aware of how it should work. But click the two links above.

Since I originally posted this thread only 3 comments are newly visible on my local fedi while the origin fedi (Lemmy.ml) still has 26 comments. So it took over a day to sync 3 comments made days ago? 🤨

What’s frustrating is not all communities are this out of sync. AskLemmy is staying pretty close to immediately synced. Other communities (on same origin server) can be more behind.

[–] PriorProject 0 points 2 years ago* (last edited 2 years ago)

Scope out this comment thread and come back tomorrow, things will look less funky: https://lemmy.world/comment/22210

It's unfortunate that the federation replication is most weird when you're new, disoriented, and most susceptible to getting confused. But once you've been subbed for a day or two you'll have all the same comments everyone else does. It would be cool if a bit more back-catalog of comments was fetched, but it's early days and not everything is perfect.

[–] [email protected] 0 points 2 years ago (1 children)

If you are the first to subscribe to one from another region, it takes a while for comments to sync. Once it does, you can read and comment to your heart's content.

[–] [email protected] 4 points 2 years ago (1 children)

It doesn't take a while for comments to sync. Comments from before the first user subscribes simply do not sync.

[–] [email protected] 1 points 2 years ago

Understood. The first user to subscribe may see it take a whole for the comments to sync.

That was my experience.

[–] [email protected] 2 points 2 years ago (1 children)

Because lemmy.ml is the official instance meaning it was created by the developers of the people who created the backend for lemmy as well so people assume it would be the correct one to join.

Thankfully fediverse doesn't work like that and in a few days I expect users to be spread around in instances more evenly.

[–] [email protected] 2 points 2 years ago (2 children)

That doesn't really make sense though - shouldn't comments be federated across all communities?

[–] [email protected] 1 points 2 years ago (1 children)

The person you are replying to deleted the comment. That said, as I understand it, comments are federated once someone on a server subscribes. So, not all comments will be federated. However, stuff listed in the comments here would seem to break my understanding of how federation works. I’m very curious to hear the answers.

[–] [email protected] 1 points 2 years ago* (last edited 2 years ago)

They do. However, it's only after federation has been established between two communities.

After a while, these newer communities will be federated in and everyone will be connected.

As lemmy.ml is the oldest community, it also has the most history (as the newer instances don't currently get the history).

This will likely be fixed at some point.

load more comments
view more: next ›