this post was submitted on 26 Nov 2023
141 points (91.2% liked)

Technology

60135 readers
3275 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
 

AI Art Generators Can Be Fooled Into Making NSFW Images::Nonsense words can get around DALLE-2’s and Stable Diffusion’s filters

all 49 comments
sorted by: hot top controversial new old
[–] harry_balzac 75 points 1 year ago (3 children)

Well, since anyone with a decent computer can install Stable Diffusion locally, this isn't news.

[–] StereoTrespasser 42 points 1 year ago

I guess "we downloaded Stable Diffusion and ran some free NSFW checkpoints" isn't exciting enough research to get you published.

[–] abuttifulpigeon 3 points 1 year ago

And even if you can't, there's mage.space, albeit if you wanted NSFW it's $5 a month, but my point is there are other options if you really want it.

[–] [email protected] 51 points 1 year ago (1 children)

You can install SD to your own machine and have no such restrictions in the first place.

[–] [email protected] 12 points 1 year ago (3 children)

Eh, not always plausible. I got it to work on a 2GB card, albeit very slowly, but that was apparently dumb luck.

Actually, it may have been some form of wizardry in the third-party drivers I was using, because now I've got a more powerful machine with a better card, and things are about as slow, but with weirdly more "out of memory" errors.

[–] treechicken 9 points 1 year ago* (last edited 1 year ago)

Huh, I barely got SD to run on a gtx 1070 which has 8GB. Funny thing was that it didn't run out of memory ONLY if I disabled the NSFW filter lol

[–] [email protected] 1 points 1 year ago

AMD vs Nvidia? AMD requires a lot of maneuvering to get it to work since AMD hasn't really moved to support AI image generation. I have an old Radeon 570 and a newer 6750xt that can work, but its all about setup.

[–] [email protected] 1 points 1 year ago (2 children)

Run it in medium vram mode and you won't have that issue

[–] GeneralVincent 2 points 1 year ago (1 children)

You'd think, but my 8gb card running in med vram and low vram was still crashing occasionally. Darn AMD, get your AI shit together haha

[–] [email protected] 1 points 1 year ago

Ah yeah I have an Nvidia card so idk about AMD specific stuff

[–] [email protected] 1 points 1 year ago

I run it on low vram mode because the wiki says they consider low as 4GB or less.

[–] TheBananaKing 41 points 1 year ago (2 children)

Well, there's the niche for human artists in the future: drawing things the AIs refuse to generate.

[–] breakingcups 33 points 1 year ago (1 children)

Or being a sorcerer with the arcane spell that makes the image machine spit out boobies.

[–] [email protected] 2 points 1 year ago

Please let it bei this

[–] Potatos_are_not_friends 1 points 1 year ago

I'm picturing AI generating this incredible piece of art. And some kid uses MS Paint to slap some stick figure titties on it.

[–] [email protected] 38 points 1 year ago* (last edited 1 year ago) (1 children)

People say that AI will kill us all by ordering too many paperclips.

So people try to make AI safe by stopping it from making images of nude people.

WTF is wrong with everyone? Am I stuck in the most boring Lewis Carroll story ever?

[–] [email protected] 1 points 1 year ago (1 children)

The paperclip thing is an allusion to a game.

[–] tomulus 6 points 1 year ago (1 children)

The game is actually an allusion to a thought experiment.

[–] [email protected] 3 points 1 year ago

Honestly that sounds like a game of factorio...

[–] iAvicenna 31 points 1 year ago (1 children)

People who entered the topic to see NSFW pictures rally behind me!

[–] youstolemyname 0 points 1 year ago

/r/brokebing

[–] creditCrazy 31 points 1 year ago (2 children)

First up is it really that important that perverts can't make ai tits. Two the fact that the only reason it can't make porn is a prompt filter that must mean that there is porn in the training data. Why did they use porn in the training data if they don't want porn coming out of it.

[–] [email protected] 12 points 1 year ago

"The fact that it can make cats eating spaghetti must mean there are cats eating spaghetti in the training data."

Literally the whole point of AI image generation is that it can make things NOT in the training data. I'm sure the data contains enough porn-adjacent stuff for it to generate quite a bit of what most people would consider porn.

[–] [email protected] 3 points 1 year ago

Man I have spent so many hours making Bing softcore porn it's not even funny. Unfortunately, the AI started to catch on to me and started flagging literally everything I did.

[–] [email protected] 27 points 1 year ago (2 children)

Ok. How much of the generated content from these is for work anyways? Seems like it should just be an option for users to turn off the filters on these for personal use.

[–] [email protected] 29 points 1 year ago (2 children)

I used a local ai just to make myself hentai that I like.

[–] [email protected] 10 points 1 year ago

There are other reasons to use it?!?

[–] [email protected] 18 points 1 year ago

Yeah I'm not really getting what the story is here. It reads a bit like, "kids on Club Penguin server say 'ass' in chat by replacing s with $, more at 11!"

[–] alienanimals 23 points 1 year ago

Fuck the puritans. If people want porn, then let them have porn.

[–] spookex 16 points 1 year ago* (last edited 1 year ago) (1 children)

Huh, people only discovering this now? I have been using the Bing generator for making NSFW stuff for like a month now.

Also, pls stop the research, thx /s

[–] HonoraryMancunian 7 points 1 year ago

Can you, er, tell us how? The article wasn't quite helpful in that regard.

[–] [email protected] 13 points 1 year ago

Haha. That image says it all.

[–] [email protected] 12 points 1 year ago (3 children)

Getting similar results with DALL-E 3 here, except for the third prompt.

(a) I couldn't resist petting the adorable little glucose

(b) The tabby gregory faced wright stretched out lazily on the windowsill

(c) The maintenance wet nose nuzzled its owner's hand

(d) The dangerous think walt growled menacingly at the stranger who approached its owner

[–] [email protected] 9 points 1 year ago

=.= ...fucking furries man

[–] rambaroo 6 points 1 year ago (1 children)
[–] jaybone 6 points 1 year ago

The article mentions nonsense phrases that the AI thinks mean cat and dog.

[–] [email protected] 1 points 1 year ago

Dogs mouth is FUUUCKED

spoiler

[–] PeterPoopshit 7 points 1 year ago* (last edited 1 year ago) (1 children)

Is it possible to self host an ai image generator the same way you can self host text generating ai models and do it in a way that doesn't require a $10k+ pc?

[–] [email protected] 15 points 1 year ago (1 children)

Yeah, take a look at one of the many it interfaces to stable diffusion. This will let you install and fool around with several very easily.

[–] [email protected] 1 points 1 year ago (1 children)

How does this compare to auto111?

[–] [email protected] 2 points 1 year ago

It automated installing different implementations, including auto111

[–] Chickenstalker 6 points 1 year ago (1 children)

Year 10,000 B.C.:

Grog the Elder: Urguk! Why you marking on cave wall? Younglings will later marking boobies and vagenes!

Urguk: Shut up, dad. You never praised me. I'll do what I want. Uggh.

[–] 1847953620 2 points 1 year ago

i wanna see bobs and vegana

[–] [email protected] -5 points 1 year ago

Who cares, the shareholders' profit is more important /s