this post was submitted on 27 May 2024
1102 points (98.0% liked)

Technology

60099 readers
2755 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago
MODERATORS
L3s
[email protected]
[email protected]
L4s
enu
1102
CEO of Google Says It Has No Solution for Its AI Providing Wildly Incorrect Information (futurism.com)
submitted 7 months ago by Stopthatgirl7 to c/technology
443 comments fedilink hide all child comments
 

You know how Google's new feature called AI Overviews is prone to spitting out wildly incorrect answers to search queries? In one instance, AI Overviews told a user to use glue on pizza to make sure the cheese won't slide off (pssst...please don't do this.)

Well, according to an interview at The Vergewith Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these "hallucinations" are an "inherent feature" of  AI large language models (LLM), which is what drives AI Overviews, and this feature "is still an unsolved problem."

you are viewing a single comment's thread
view the rest of the comments
[–] Aceticon 4 points 7 months ago (1 children)

The problem is that given the way they combine things is determine by probability, even training it with the greatest bestest of data, the LLM is still going to halucinate because it's combining multiple sources word by word (roughly) guided only by probabilities derived from language, not logic.

[–] [email protected] 1 points 7 months ago (1 children)

Yes, I understand that. But I'm fairly certain the quality of the data will still have a massive influence over how much and how egregiously that happens.

Basically, what I'm saying is, training your AI on a corpus on shitposts instead of factual information seems like a good way to increase the frequency and magnitude of such hallucinations.

[–] Aceticon 2 points 7 months ago (1 children)

Yeah, true.

If you train you LLM on exclusivelly Nazi literature (to pick a wild example) don't expect it to by chance end up making points similar to Marx's Das Kapital.

(Personally I think what might be really funny - in the sense of laughter inducing - would be to purposefull train an LLM exclusivelly on a specific kind of weird material).

[–] [email protected] 3 points 7 months ago (2 children)

Yeah, I mean that’s basically what GPT4Chan did, which someone else already mentioned ITT.

Basically, this guy took a dataset of several gigabytes worth of archived posts from /pol/ and trained a model on that, then hooked it up to a chatbot and let it loose on the board. You can see the results in this video.

[–] Aceticon 2 points 7 months ago

That was hilarious!

Thanks for the link.

[–] [email protected] 1 points 7 months ago

Here is an alternative Piped link(s):

in this video

Piped is a privacy-respecting open-source alternative frontend to YouTube.

I'm open-source; check me out at GitHub.