this post was submitted on 03 Aug 2024
377 points (99.0% liked)
196
16732 readers
2840 users here now
Be sure to follow the rule before you head out.
Rule: You must post before you leave.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
from the image alone, no, because there's no way to intuit the mechanics of anything
I don't think that an LLM could do it. But the mechanics of baba is you should be in the training set, since it's a relatively well knoun indie game.
I feel like the amount of data required to train any neural network would be larger than all the levels that currently exist for baba is you
you'd probably just end up overfitting the hell out of your model
But the mechanics are explained in text on the internet.
that would require an LLM then, but also multiple full walkthroughs are explained in text on the internet, so how would you be sure it was figuring stuff out by itself?
As I said: I don't think an LLM could do it (since LLMs can't reason). Just saying that it wouldn't have to deduce the mechanics from a single screenshot.
I'm saying that if you're attempting to parse the mechanics of play by shoving in the whole internet and saying "well the instructions are in there somewhere" then the best tool for that is an LLM.