Glagnar

joined 1 year ago
sorted by: new top controversial old
3
Extending Context Window of Large Language Models via Positional Interpolation (arxiv.org)
 

Paper released by Meta a few days ago, detailing a method for extending the context or "memory" of an LLM up to 32k tokens. What is interesting is that they give a mention to: https://kaiokendev.github.io/

This is a blog post written by a guy in his spare time who came up with the same method simultaneously, he calls it SuperHOT.

It's really exciting how AI/ Machine learning can be advanced by relatively ordinary people putting in hard work without the resources of Microsoft etc.

Terraria Dev: After 12 years the game still sells like hot cakes. There is so much demand it makes it hard to move on in c/[email protected]
[–] [email protected] 12 points 1 year ago (1 children)

I've gotten so much out of Terraria over the years, it makes me feel a bit guilty having paid less than £5 for it. Truly a great game.