this post was submitted on 25 Jan 2025
90 points (91.7% liked)
Technology
61335 readers
3698 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Interesting conclusion, LLMs are inherently 1D in nature, and ARC is a 2D task. LLMs are able to emulate 2D reasoning for sufficiently small tasks, but suffer greatly as the size of the task increases. This is like asking humans to solve 4D problems.
This is probably a fundamental limitation in LLM architecture and will need to be solved someday, presumably by something completely different.
I've beaten Portal and Portal 2, have I not solved 4D problems?
Not really, portals give you shortcuts in 3D space, they don't allow you to interact with a whole different dimension. If you have Minecraft there's a really nice custom map called "The Hypercube" which sorts of emulates a 4th dimension, it felt much more confusing than Portal (2) for me.