this post was submitted on 12 Dec 2023
62 points (97.0% liked)

AI

4006 readers
1 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago
 

Previous Lemmy.ml post: https://lemmy.ml/post/1015476 Original X post (at Nitter): https://nitter.net/xwang_lk/status/1734356472606130646

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 6 points 9 months ago* (last edited 9 months ago)

To clarify: The authors/Stanford used this exact stated/non-question title for their press release: https://hai.stanford.edu/news/ais-ostensible-emergent-abilities-are-mirage, which ended up also being the title of the previous post on [email protected]. As already noted by @[email protected], this “AI’s Ostensible” title is therefore well in line with the paper’s actual conclusion, that is refuting current claims of emergence. And I picked the “AI’s Ostensible” title being from the authors/their employer, for clarity (especially when quoted inside a larger Lemmy post title), and continuity with the previous post.

It is clear to anyone who used them and understand the task they were trained on, […]

Yet where is the proof? This is the exact wishy-washy way of not substantiating a claim, which this paper investigated and have refuted.

[…] that LLMs do have emergent abilities.

I think you should really not drop that sentence immediately in front of your quite selective quote — the authors put it in emphasis for good reasons:

Ergo, emergent abilities may be creations of the researcher’s choices, not a fundamental property of the model family on the specific task.

So regarding “emergent abilities,” it is quite clear the authors argue that from their analysis, if at all, cherry-picked metrics carry these “emergent abilities,” not LLMs.