freamon

joined 1 year ago
MODERATOR OF
[–] freamon 1 points 6 days ago

He fixed things to get the missing communities back, but it looks like subsequent runs of the crawler lost them again, so now it's rejecting updates because the difference is too great (it always used to do this, so I don't know how it was publishing with so many missing before).

Anyway, it looks like I'm going to have to do the most NSFW imaginable - look at someone else's TypeScript project. I'll get back in touch with him if it doesn't correct itself, but it'll be nice if I can figure out what the problem is first.

[–] freamon 2 points 1 week ago (2 children)

Upstream crawler is missing about 20k communities - https://data.lemmyverse.net/ normally shows about 30k.

I've messaged the maintainer.

[–] freamon 1 points 2 weeks ago

Hmmm. Speaking of Fediverse interoperability, platforms other than yours (Pandacap) typically arrange things so that https://pandacap.azurewebsites.net was the domain, and something like https://pandacap.azurewebsites.net/users/lizard-socks was the user, but Pandacap wants to use https://pandacap.azurewebsites.net for both. Combined with the fact that it doesn't seem to support /.well-known/nodeinfo means that no other platform knows what software it's running.

When your actor sends something out, it uses the id https://pandacap.azurewebsites.net/, but when something tries to look that up, it returns a "Person" with a subtly different id of https://pandacap.azurewebsites.net (no trailing slash). So there's the potential to create the following:

  1. https://pandacap.azurewebsites.net/ sends something out.
  2. Instance hasn't heard of that, so looks it up, and creates a new user in its database, with the returned ID (https://pandacap.azurewebsites.net)
  3. https://pandacap.azurewebsites.net/ sends else something out. Instance looks in it's DB, finds nothing, so looks it up and tries to create it again. The best case is that it meets a DB uniqueness constraint, because the ID it gets back from that lookup does actually exist (so it can use that, but it was a long way around to find it). The worst case - when there's no DB uniqueness constraint -is that a 'new' user is created every time.
  4. Repeat step 3 for every new thing you send.

If every new platform treats the Fediverse as a wheel that needs to be re-invented, then the whole project is doomed.

[–] freamon 3 points 3 months ago (1 children)

It's the crawler at lemmyverse that's down - https://data.lemmyverse.net/ shows that it hasn't updated in 11 days

 

As you may have noticed, the crawler at https://lemmyverse.net isn't picking up anything from instances on versions 0.19.4 or 0.19.5.

The Issue itself is easily fixed, and there's already a PR for it from lemm.ee's admin, but there's been no response from the lemmyverse developer.

Does anyway have any other ways of contacting him?
If this continues (I realise 2 weeks isn't that long), is anyone interested in forking the code and hosting it on a new domain?

Thanks.

[–] freamon 7 points 5 months ago (7 children)
[–] freamon 1 points 5 months ago

Tragically, this also means that, even after 31 years, I've still never 'get good' enough.

[–] freamon -2 points 5 months ago

Speaking of wildly inaccurate:

Not sure Lemmy gets to throw stones (it'd probably miss).

[–] freamon 3 points 6 months ago (2 children)

Not sure where to post this. Sometimes (in ways that are difficult to replicate), I get a JSON response for a reddthat post in my browser instead of an HTML one. It's happened before on mobile (Chrome) and today also desktop (MS Edge), so I was able to make a screenshot:

I'm assuming it's related to 0.19.4, but maybe others have seen this behaviour before the upgrade. Apologies if you're already aware - I had a quick look for other mentions but didn't find any.

[–] freamon 3 points 6 months ago (1 children)

Sorry. Maybe I used the wrong term. I meant to say it's not part of the CommonMark spec (as supported by Lemmy) - like spoilers, there's identifiers that have gained popularity, but they're still not properly official. I did do a quick web-search before I made that comment, which suggested there are some sites that use a single tilde for strikethrough.

I didn't intend any criticism of your post - I was just cheekily using it to have a tangential ding at notions of Fediverse interoperability.

[–] freamon 3 points 6 months ago (3 children)

With apologies for being off-topic ...

Lemmy: we're a Fediverse app, so can communicate with lots of other ones!
Also Lemmy: here's some non-standardised Markdown, with no indication that it is Markdown, or which variant of strikethrough we support, and a 'mediaType' of 'text/html'

[–] freamon 1 points 6 months ago

Oh. Then I'm genuinely sorry. I thought we were both having fun, engaging in a good old-fashioned flame war. Add that to 'incorrect assumptions' pile then, I guess.

[–] freamon 0 points 6 months ago (2 children)

It was never a threat to remove your posts. The 'threat', to the extent there ever was one, was to not bother seeking clarification in the event of any ambiguity, and only then if they were reported. As for accusations, I didn't realise it was plural now. I think I said that I interpreted your vote as disapproval of my approach, which still doesn't seem like an unreasonable interpretation.

I've never moderated anything before, certainly not on Reddit. You were saying that I reminded you of someone who complained to Crayola. Now I apparently remind you of someone on Reddit. There's nothing I can do about tenuous connections your brain is making, and this can never be a proper disagreement if you're repeatedly wondering off into fantasy.

 

(bonus opportunity to brush up on your Portuguese swear words)

177
submitted 7 months ago by freamon to c/gifs
 

I realise this is a known issue and that lemmy.world isn't the only instance that does this. Also, I'm aware that there are other things affecting federation. But I'm seeing some things not federate, and can't help thinking that things would be going smoother if all the output from the biggest lemmy instance wasn't 50% spam.

Hopefully this doesn't seem like I'm shit-stirring, or trying to make the Issue I'm interested in more important than other Issues. It's something I mention occasionally, but it might be a bit abstract if you're not the admin of another instance.

The red terminal is a tail -f of the nginx log on my server. The green terminal is outputting some details from the ActivityPub JSON containing the Announce. You should be able to see the correlation between the lines in the nginx log, and lines from the activity, and that everything is duplicated.

This was generated by me commenting on an old post, using content that spawns an answer from a couple of bots, and then me upvoting the response. (so CREATE, CREATE, LIKE, is being announced as CREATE, CREATE, CREATE, CREATE, LIKE, LIKE). If you scale that up to every activity by every user, you'll appreciate that LW is creating a lot of work for anyone else in the Fediverse, just to filter out the duplicates.

-1
Remote Post 1 (20:53) (self.test_local_2)
submitted 8 months ago by freamon to c/[email protected]
 

For anyone unaware, a community's outbox typically contains the last 50 or so Post Announcements - it is retrieved when you are the first person to find a community on a remote instance. It also seems to be fetched whenever an community on a remote instance realizes it's out of sync with the community on its host instance.

Compare:

curl --header 'accept: application/json' https://lemmy.world/c/memes | jq -r .outbox           
=> https://lemmy.world/c/memes/outbox                
curl --header 'accept: application/json' https://lemmy.world/c/memes/outbox | jq .       
{
  "error": "unknown",
  "message": "Record not found"
}

with

curl --header 'accept: application/json' https://lemmy.world/c/linuxmemes | jq -r .outbox      
=> https://lemmy.world/c/linuxmemes/outbox          
curl --header 'accept: application/json' https://lemmy.world/c/linuxmemes/outbox | jq .orderedItems[0]   
{   
    "id": "https://lemmy.world/activities/announce/create/0223f939-aafc-4215-9c20-a3460c967f63" 
    ... (the rest of the most recent post from linux memes)
}

(I came across this randomly, so I don't know if 'memes' is the only community missing an outbox. Others I've tried have been OK though)

135
submitted 9 months ago by freamon to c/gifs
 

Hello again,

February's finally over, so 4 Frame memes are old news. Now, for March, memes with rhymes in them are what's required to get Featured in the Community.

This one will be stickied until a new meme with (ideally terrible) rhymes in and [ILPM] somewhere in the title is submitted, and then the new post will be stickied instead (it's a manual affair atm, so it won't be instant)

Thanks!

view more: next ›