Machine Learning

1793 readers

11 users here now

founded 4 years ago

MODERATORS

[email protected]

Can gpt generate a gpt model? (sh.itjust.works)

submitted 6 months ago by [email protected] to c/[email protected]

8 comments fedilink hide all child comments

Imagine AI giving offsprings...

you are viewing a single comment's thread
view the rest of the comments

[–] Audalin 5 points 6 months ago (1 children)

You can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that's about it.

permalink
fedilink
source
hideshow 2 child comments

[–] [email protected] 2 points 6 months ago

Yep, this is called model distillation.

permalink
fedilink
source
parent