this post was submitted on 20 Feb 2025
2 points (66.7% liked)

LocalLLaMA

2590 readers
5 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago
MODERATORS
[email protected]
[email protected]
[email protected]
2
Does DeepSeek* Solve the Small Scale Model Performance Puzzle? (community.intel.com)
submitted 2 days ago by [email protected] to c/[email protected]
2 comments fedilink hide all child comments
 

Just putting this here because I found this useful:

you are viewing a single comment's thread
view the rest of the comments
[–] icecreamtaco 1 points 2 days ago* (last edited 2 days ago)

I tested out a Deepseek model the other day. It took one minute to generate text and used up all my context space in one message. Local consumer models and "small" server hosted models are probably different classes because for my home pc it was a big performance downgrade.