this post was submitted on 01 Jul 2023
941 points (97.7% liked)

Technology

60129 readers
3351 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
 

Elon has responded to the criticism and is increasing the limits to a whopping:

Verified accounts: 8000 posts/day
Unverified accounts: 800 posts/day
New unverified accounts: 400 posts/day
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 25 points 2 years ago* (last edited 2 years ago) (1 children)

Text feed are the lightest weight most cachable thing you can serve. The costliest part of the text component is the mixer that ranks the content. The companies scraping them don't care about the ranking they just want bulk tweets. That's what the API is for. Elon charged them insane rates so they all went off the API that cost Twitter a tiny fraction to serve and instead the API consumers switched to crawling the website instead, which costs Twitter orders of magnitude more, but is free for scrapers. Elon is indeed a stable genius.

[โ€“] Gold_ghost057 5 points 2 years ago

Holy shit, I hadn't stopped to realize your point there!!! Of course any AI scrapers would just start bit crawler accounts, if any of them weren't already doing that as well. Along with any other info scrapers out there - I can only think of the one example tbh