this post was submitted on 23 Nov 2024
298 points (99.7% liked)

Technology

59675 readers
4666 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
L3s
[email protected]
[email protected]
L4s
enu
298
Microsoft’s controversial Recall scraper is finally entering public preview (arstechnica.com)
submitted 4 days ago by [email protected] to c/technology
46 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] brucethemoose 1 points 2 days ago* (last edited 2 days ago)

You can use larger "open" models through free or dirt-cheap APIs though.

TBH local LLMs are still kinda "meh" unless you have a high vram GPU. I agree that 8b is kinda underwhelming, but the step up to like Qwen 14B is enormous.