this post was submitted on 24 Jan 2025
30 points (94.1% liked)

Free Open-Source Artificial Intelligence

3019 readers
32 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

FOSAI Time Capsule

founded 2 years ago
MODERATORS
Blaed
fosai
30
Open Source DeepSeek R1 Runs at 200 Tokens Per Second on Raspberry Pi (www.nextbigfuture.com)
submitted 5 days ago by cm0002 to c/fosai
9 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] BetaDoggo_ 5 points 5 days ago

200 tokens per second isn't achievable with a 1.5B even on low-midrange GPUs. Unless they're attaching an external GPU it's not happening on a raspberry pi.

This article is disjointed and smells like AI.