this post was submitted on 02 Aug 2023
361 points (94.1% liked)
Technology
60085 readers
4129 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Yeah but humans can use critical thinking, even on themselves when they make shit up. I've definitely said something and then thought to myself "wait that doesn't make sense for x reason, that can't be right" and then I research and correct myself.
AI is incapable of this.
We think in multiple passes though, we have system 1 that thinks fast and makes mistakes, and we have a system 2 that works slower and thinks critically about the things going on in our brain, that's how we correct ourselves. ChatGPT works a lot like our system 1, it goes with the most likely response without thinking, but there's no reason that it can't be one part of a multistep system that has self analysis like we do. It isn't incapable of that, it just hasn't been built yet
Exactly, if you replicate this behaviour with a "system 2 AI" correcting the main one it will probably give similar results as most of us.
Heck you can eventually have 5 separate AIs discussing things out for you and then presenting the answer, at top speed.
It will never be perfect, but it will outmatch humans soon enough.
Can't do this YET one method to reduce this could be to: create a response to query, then before responding to the human, check if answer is insane by querying a separate instance trained slightly differently...
Give it time. We will get past this.
We will need an entirely different type of AI that functions on an inherently different structure to get past this hurdle, but yes I do agree it will eventually happen.
Agreed. This will not come from a LLM....but honestly don't think it's that far off.
You're just being victim of your own biases. You only notice that was the case when you were successful in Detecting your hallucinations. You wouldn't know if you made stuff up by accident and nobody noticed, not even you.
Whereas we are checking 100% of th AI responses, do we check 100% of our responses?
Sure it's not the same thing or AI might do more,, but the problem is your example. Where people think they are infallible because of their biases. when it's not the case at all. We are imperfect, and we overlook our shortcomings possibly foregoing a better solution because of this. Because we measure the AI objectively, but we don't measure what we compare it to.
I never said we always question ourselves I just said that AI can't so your entire reply doesn't apply here