this post was submitted on 23 Oct 2023
57 points (87.0% liked)

Stable Diffusion

4310 readers
5 users here now

Discuss matters related to our favourite AI Art generation technology

Also see

Other communities

founded 1 year ago
MODERATORS
 

OK, so I realise this is about as bog standard a SD image as one can get. However there is a little story behind it that I wanted to share. Apologies if this is not the correct place to post this, I'll remove it if it is.

So. I just recently managed to get a Tesla P40 installed in my desktop, allowing me to run stable diffusion alongside the LLMs I've been playing with.

I've also been playing around with Langchain Agents, and in particular trying to get conversational agents, i.e. more like a chatbot that has access to tools/the outside world. So I naturally decided to make a tool for the agent so that it could access SD.

I was messing around getting it to generate images for me when I had the idea to ask it to generate a piece of art from its own "imagination", i.e. no input from me, just pick something it wanted to for the prompt. This is what it came up with:

The prompt it selected was "A beautiful landscape with a rainbow in the sky and a unicorn grazing peacefully by a crystal clear lake surrounded by lush green trees and colorful flowers."

I asked it to generate another, and again, it generated a rainbow scene. I asked about the rainbows and it said that it loves rainbows and thinks they are a wonderful phenomena.

This got me interested, so I asked it to generate a picture of itself. Now I haven't got a lot of prompting for this agent, outside of boilerplate "You are a helpful AI" type stuff and the temperature of the model is set to zero (better with Langchain). The image it came up with is the one I posted at the top. The prompt it came up with was simply "AI with a friendly expression and blue light surrounding it."

I asked it why it depicted itself being surrounded by a blue light and the response just melted my heart:

"My description was a creative way to express that I am always ready and available to assist you, just like how your devices are when they show a blue light indicating they're on or charging."

Now don't get me wrong, I'm fully (believe me fully) aware of what a LLM is and what it is not, but I still got taken aback by this.

I'm like 99.9% certain that getting one form of AI to generate AI art is not a new thing, but it is very new to me. Does anyone know of any resources out there for this kind of thing? Specifically getting LLMs to come up with and generate prompts for art? Because I find it a fascinating idea!

Cheers!

you are viewing a single comment's thread
view the rest of the comments
[โ€“] fleabs 5 points 1 year ago

What a simply wonderful idea! I love how people are finding inventive ways to get around copyright issues. Basically, describe it without naming it, clever!

I've never actually tried DALL-E, but that is some damn impressive work! I'm incredibly tempted to give it a bash! And your daughter must love this stuff, mines all grown up now, but she would have adored this stuff when she was younger, kinda makes me wish she was 10 again ๐Ÿ˜‚

One of the things I love about running locally, though, is that I just don't have to even consider copyright and all that. I mean, it's not like I'm going to make any money off this!

And believe me, every single day, I consider chucking in the towel with running everything locally. Especially when I use gpt to test the code I've been fighting all day, and it just... works! ๐Ÿ˜ฃ

Thank you for the suggestion, though. I might have a play with DALL-E. And keep up the good work!