I don't think this is Gemini trying to run some of its own code to save facts about the user and whoops displaying the code it was trying to run to the user rather than running it or anything like that. That's not how software works, and not how LLMs work.

More likely somewhere in Gemini's training data, there's one or more code examples (specifically Python code examples, by the looks of it) that have something to do with the user's prompt. The relationship between Python code examples and the user's prompt may well be extremely nonobvious, but there'd have to be something about the prompt that made Gemini hallucinate that.

Source: Am software engineer. Though I don't have any hands-on experience with generative AI to speak of. I do think generative AI is a bullshit hype bubble, though.

[–] Takumidesh 43 points 17 hours ago (4 children)

Another thing to consider is that it's really easy to manipulate these types of screenshots by just telling the AI to respond to your prompt in a certain way.

You can just say 'respond to my next sentence with python code saving my info' and it will do it.

[–] kautau 15 points 12 hours ago (1 children)

Or just inspect element, no need to reinvent the wheel when you can modify anything you see on the web

[–] [email protected] 3 points 7 hours ago (1 children)

and image editing has been trivial for decades

[–] kautau 2 points 6 hours ago

True, but as a right of meme passage you always need to save your output with like 30% jpeg compression

load more comments (2 replies)

load more comments (7 replies)

load more comments (10 replies)