this post was submitted on 20 Mar 2025
142 points (96.7% liked)

Fediverse

32013 readers
2787 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).

If you wanted to get help with moderating your own community then head over to [email protected]!

Rules

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration)

founded 2 years ago
MODERATORS
 

I made a Lemmy instance with a custom algorithm that keeps only the top 20% most unique (=interesting?) posts. It does this by calculating a similarity score between every post on my instance and all posts that came before it. The top 80% of posts with the highest self-similarity get removed instantly.

The idea would be that this allows me to cut through the noise that's running through the communities, similar to how xkcd-signal attempted to do 20 years ago.

The instance is mostly meant for reading, not posting. So it has a very open federation policy (for now).

If anything, this is experimental. So please let me know what you think! You can see the type of stuff that gets removed in the modlog (https://lemmy.coffee/modlog).

you are viewing a single comment's thread
view the rest of the comments
[–] anon6789 7 points 3 days ago (1 children)

I was curious what would happen to the ratio of political posts, specifically Trump/Elon, to other communities, but it feels >= the amount as All on lemmy.world.

None of my superb owls look to have made it through, but I didn't see them removed in the mod log. We're a pretty large community, so I'd have thought some would have gotten through. I don't recall if I saw stuff from any of the animal comms.

[–] [email protected] 2 points 19 hours ago (1 children)

I'll take a look at [email protected]!

The political posts thing is interesting. So far, mainly news posts with text descriptions remain on the front page (which I personally prefer over the memes, but that's just my preference). I am having a hard time deciding if I actually find them interesting though.. ^^ I think I actually prefer it over my reddit homepage, there tends to be much of the same, usually.

For comparison, see: https://imgur.com/a/xbzMXmQ

[–] anon6789 2 points 17 hours ago (1 children)

I do look to have made it to your feed now! It deleted my 3 posts that were photos with short blurbs and kept my news article that is mostly text.

We rarely get the meme type posts, but if your setup is looking at anything like text:photo ratio, that could be doing it.

I have most meme communities block myself, so I understand how overtaking they can be to a feed. 😁

I'm interested in what you're doing because I am interested in news and politics, but it would be nice to get rid of most of the garbage US news and the dupe posts, and let a better variety of news come in. I've gone to keyword blocking, but while I have "Trump" blocked, I'd still like to see things from other countries about their responses to his actions., for example.

[–] [email protected] 2 points 17 hours ago

I do very few things explicitly, I just punish self-similarity in a very specific way. I guess posts with actual text in the body are just more unique, given all previous posts on the instance.

Maybe using the filtered posts as a base in combination with some client side keyword blocking will be useful? The keyword blocking would be much more individual for each user.