this post was submitted on 12 Jan 2025
1169 points (98.1% liked)
memes
10963 readers
4694 users here now
Community rules
1. Be civil
No trolling, bigotry or other insulting / annoying behaviour
2. No politics
This is non-politics community. For political memes please go to [email protected]
3. No recent reposts
Check for reposts when posting a meme, you can only repost after 1 month
4. No bots
No bots without the express approval of the mods or the admins
5. No Spam/Ads
No advertisements or spam. This is an instance rule and the only way to live.
Sister communities
- [email protected] : Star Trek memes, chat and shitposts
- [email protected] : Lemmy Shitposts, anything and everything goes.
- [email protected] : Linux themed memes
- [email protected] : for those who love comic stories.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Surely they've thought about this, right?
Lotta people here saying ChatGPT can only generate text, can't interact with its host system, etc. While it can't directly run terminal commands like this, it can absolutely execute code, even code that interacts with its host system. If you really want you can just ask ChatGPT to write and execute a python program that, for example, lists the directory structure of its host system. And it's not just generating fake results - the interface notes when code is actually being executed vs. just printed out. Sometimes it'll even write and execute short programs to answer questions you ask it that have nothing to do with programming.
After a bit of testing though, they have given some thought to situations like this. It refused to run code I gave it that used the python subprocess module to run the command, and even refused to run code that used subprocess or exec commands when I obfuscated the purpose of the code, out of general security concerns.
Like anything else with ChatGPT, you can just sweet-talk it into running the code anyways. It doesn't work. Maybe someone who knows more about Linux could come up with a command that might do something interesting. I really doubt anything ChatGPT does is allowed to successfully run sudo commands.
Edit: I fixed an issue with my code (detailed in my comment below) and the output changed. Now its output is:
image of output
So it seems confirmed that no sudo commands will work with ChatGPT.
Do you think this is a lesson they learned the hard way?
Yes, I'm sure the phds and senior SWEs/computer scientists working on LLMs never considered the possibility that arbitrary code execution could be a security risk. It wasn't the very first fucking thing that anybody involved thought about, because everybody else but you is stupid. 😑
First, lose the attitude, not everyone here works in IT. Second, you'd be surprised what people can overlook.