this post was submitted on 22 Sep 2023
28 points (100.0% liked)

LocalLLaMA

2252 readers
1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago
MODERATORS
[email protected]
[email protected]
[email protected]
28
Distilling step-by-step: Outperforming larger language models with less training data and smaller model sizes (blog.research.google)
submitted 1 year ago by [email protected] to c/[email protected]
3 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 2 points 1 year ago (1 children)

The code is available here:

https://github.com/google-research/distilling-step-by-step

[โ€“] [email protected] 1 points 1 year ago

Somehow this is even more confusing because that code hasn't been touched in 3 months, maybe just took them that long to validate? Will have to read through it, thanks!