Free Open-Source Artificial Intelligence

3022 readers

72 users here now

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

founded 2 years ago

MODERATORS

submitted 6 days ago by cm0002 to c/fosai

9 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 6 days ago (1 children)

A recent i7 on CPU only can manage qwen 1.5 in a satisfactory way, comparable to big online players. Curious about recent ultra Intel and snapdragons

[–] [email protected] 1 points 6 days ago

My old computer and laptop run 13B models at 2 - 3 tokens a second on CPU only. That's a bit slower than I can read. I wonder what my new phone does.