this post was submitted on 21 Jan 2025
159 points (99.4% liked)
Fuck AI
1781 readers
386 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
founded 10 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I'm not sure I fully understand.
This generates garbage if it thinks the client making the request is an ai crawler. That much I get.
What I don't understand is when it talks about trapping the crawler. What does that mean?
Simply put, a crawler reads a site, takes note of all the links in the site then reads all of these sites, again notes all the links there, reads those, etc. This website always and only links to internal resources which were randomly generated and again only link to other randomly generated sources, trapping the crawler if it has no properly configured exit condition.