Fuck AI

1781 readers

354 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

founded 10 months ago

MODERATORS

159

iocaine - The deadliest poison known to AI (git.madhouse-project.org)

submitted 1 week ago by [email protected] to c/fuck_ai

15 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 11 points 1 week ago (1 children)

So it's like nightshade for LLMs?

[–] [email protected] 14 points 1 week ago

Better, actually. This feeds the crawler a potentially infinite amount of nonsense data. If not caught, this will fill up the whatever storage medium is used. Since the data is generated using Markov-chains, any LLM trained on it will learn to disregard context that goes farther back than one word, which would be disastrous for the quality of any output the LLM produces.

Technically, it would be possible for a single page using iocaine to completely ruin an LLM. With nightshade you'd have to poison quite a number of images. On the other hand, Iocaine text can be easily detected by a human, while nightshade is designed to not be noticeable by humans.