262
submitted 2 months ago by [email protected] to c/[email protected]
you are viewing a single comment's thread
view the rest of the comments
[-] [email protected] 28 points 2 months ago

Added to this finding, there's a perhaps greater reason to think LLMs will never deliver AGI. They lack independent reasoning. Some supporters of LLMs said reasoning might arrive via "emergent behavior". It hasn't.

People are looking to get to AGI in other ways. A startup called Symbolica says a whole new approach to AI called Category Theory might be what leads to AGI. Another is “objective-driven AI”, which is built to fulfill specific goals set by humans in 3D space. By the time they are 4 years old, a child has processed 50 times more training data than the largest LLM by existing and learning in the 3D world.

[-] [email protected] 28 points 2 months ago

They can quite possibly be a useful component. They're the language center of the brain.

People who ever thought they would actually resemble intelligence were woefully uninformed of how complex intelligence is.

[-] [email protected] 6 points 2 months ago* (last edited 2 months ago)

How complex is intelligence, though? People who were sure they don't were drawing from information we don't actually have.

[-] [email protected] 14 points 2 months ago

Yeah, so many people are confidently stating "LLMs can't think like humans do!" When we're actually still pretty unclear on how humans think.

Sure, an LLM on its own may not be an AGI. But they're remarkably closer than we would have predicted they could get just a few years ago, and it may well be that we just need to add a bit more "special sauce" (memory, prompting strategies, perhaps a couple of parallel LLMs that specialize in different types of reasoning) to get them over the hump. At this point a lot of the research isn't going into simply "make it bigger!", it's going into "use LLMs smarter."

load more comments (10 replies)
load more comments (10 replies)
load more comments (12 replies)
this post was submitted on 14 Apr 2024
262 points (91.5% liked)

Futurology

1507 readers
440 users here now

founded 10 months ago
MODERATORS