488
Google apologizes for ‘missing the mark’ after Gemini generated racially diverse Nazis
(www.theverge.com)
This is a most excellent place for technology news and articles.
I'll get the usual downvotes for this, but:
is untrue, because current AI fundamentally is knowledge. Intelligence fundamentally is compression, and that's what the training process does - it compresses large amounts of data into a smaller size (and of course loses many details in the process).
But there's no way to argue that AI doesn't know anything if you look at its ability to recreate a great number of facts etc. from a small amount of activations. Yes, not everything is accurate, and it might never be perfect. I'm not trying to argue that "it will necessarily get better". But there's no argument that labels current AI technology as "not understanding" without resorting to a "special human sauce" argument, because the fundamental compression mechanisms behind it are the same as behind our intelligence.
Edit: yeah, this went about as expected. I don't know why the Lemmy community has so many weird opinions on AI topics.
Would it be accurate so say that while current AI does have the knowledge, it lacks the reasoning skills needed to apply the knowledge correctly?
I don't think it's generally true, because current AI can solve some reasoning tasks very well. But it's definitely something where they are lacking.
It isn't reasoning about anything. A human did the reasoning at some point, and the LLM's dataset includes that original information. The LLM is simply matching your prompt to that training data. It's not doing anything else. It's not thinking about the question you asked it. It's a glorified keyword search.
It's obvious you have no idea how LLMs work at a fundamental level, yet you keep talking about them like you're an expert.
So if I find a single example of an AI doing a reasoning task that's not in its training material, would you agree that you're wrong and AI does reason?
You won't find one. LLMs are literally incapable of the kind of reasoning you're talking about. All of their solutions are based on training data, no matter how "original" your problem might seem.
You didn't answer my question.