this post was submitted on 02 Aug 2023
361 points (94.1% liked)

Technology

59720 readers
6095 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Tech experts are starting to doubt that ChatGPT and A.I. ‘hallucinations’ will ever go away: ‘This isn’t fixable’::Experts are starting to doubt it, and even OpenAI CEO Sam Altman is a bit stumped.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 41 points 1 year ago (8 children)

People make a big deal out of this but they forget humans will make shit up all the time.

[–] Cybermass 29 points 1 year ago (3 children)

Yeah but humans can use critical thinking, even on themselves when they make shit up. I've definitely said something and then thought to myself "wait that doesn't make sense for x reason, that can't be right" and then I research and correct myself.

AI is incapable of this.

[–] [email protected] 7 points 1 year ago (1 children)

We think in multiple passes though, we have system 1 that thinks fast and makes mistakes, and we have a system 2 that works slower and thinks critically about the things going on in our brain, that's how we correct ourselves. ChatGPT works a lot like our system 1, it goes with the most likely response without thinking, but there's no reason that it can't be one part of a multistep system that has self analysis like we do. It isn't incapable of that, it just hasn't been built yet

[–] [email protected] 3 points 1 year ago

Exactly, if you replicate this behaviour with a "system 2 AI" correcting the main one it will probably give similar results as most of us.

Heck you can eventually have 5 separate AIs discussing things out for you and then presenting the answer, at top speed.

It will never be perfect, but it will outmatch humans soon enough.

[–] Bitswap 6 points 1 year ago (1 children)

Can't do this YET one method to reduce this could be to: create a response to query, then before responding to the human, check if answer is insane by querying a separate instance trained slightly differently...

Give it time. We will get past this.

[–] Cybermass 3 points 1 year ago (1 children)

We will need an entirely different type of AI that functions on an inherently different structure to get past this hurdle, but yes I do agree it will eventually happen.

[–] Bitswap 1 points 1 year ago

Agreed. This will not come from a LLM....but honestly don't think it's that far off.

[–] [email protected] 3 points 1 year ago (1 children)

You're just being victim of your own biases. You only notice that was the case when you were successful in Detecting your hallucinations. You wouldn't know if you made stuff up by accident and nobody noticed, not even you.

Whereas we are checking 100% of th AI responses, do we check 100% of our responses?

Sure it's not the same thing or AI might do more,, but the problem is your example. Where people think they are infallible because of their biases. when it's not the case at all. We are imperfect, and we overlook our shortcomings possibly foregoing a better solution because of this. Because we measure the AI objectively, but we don't measure what we compare it to.

[–] Cybermass 2 points 1 year ago

I never said we always question ourselves I just said that AI can't so your entire reply doesn't apply here

load more comments (4 replies)