this post was submitted on 25 Apr 2024
120 points (96.2% liked)

BecomeMe

817 readers
2 users here now

Social Experiment. Become Me. What I see, you see.

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 3 points 8 months ago

A small nuanced correction to your comment about language models being pre-trained. That's true for GPT (its the P), and all modern high performance language models since 2017, but it was actually not in fashion before that period, and may not be again at some point in the future.