638
Remember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a lie
(www.nytimes.com)
this post was submitted on 15 May 2024
638 points (98.9% liked)
TechTakes
1483 readers
124 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
that's a misleading and meaningless way of putting it. if I rip a page out of my textbook and bring it into an exam room, I do not have with me all the data in my textbook. and yet
It doesn’t do that, either. LLMs retain the linguistic patterns found in textbooks, nothing more. It’s remarkable that they can do so much with this information alone, but it’s still a far cry from genuine intelligence.
And yet they can spit out copyrighted material verbatim, or near-verbatim, how strange and peculiar.
so weird!!!!!
Yeah, even setting aside the intelligence claims, I know I'd be feeling a lot more positive about LLMs as a fun theoretical tool if they weren't being sold as personal assistants or search engine replacements etc, which even the apologists here admit they're really really bad at.
(Also I'd argue "linguistic patterns" is pushing it. "Textual patterns" more like, it's not supposed to have any idea about grammar or even about what "text" is.) (I say "supposed to" because who knows what sort of hacks they're running under the hood.)
Yeah I completely agree with you there. I really don’t like the way AI is being monetized and commercialized; it all just seems poised to go terribly. Ideally there shouldn’t be any incentive to overstate the capabilities of these models, as doing so just makes everything worse.