this post was submitted on 28 Dec 2023
118 points (96.8% liked)

Technology

63467 readers
4114 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s
enu
technopagan
L4s
118
Windows 12 and the coming AI chip war (www.computerworld.com)
submitted 1 year ago by L4s to c/technology
21 comments fedilink hide all child comments
 

Windows 12 and the coming AI chip war::A Windows release planned for next year may be the catalyst for a new wave of desktop chips with AI processing capabilities.

you are viewing a single comment's thread
view the rest of the comments
[–] Rootiest 12 points 1 year ago

Cloud AI services will always be more capable. You can do more with near-limitless RAM and processing power than you'll ever be able to do locally on your mobile/desktop system.

But locally-run AI's usefulness was never in question either.

An example of this is Google who made the Coral TPU and then the Pixel TPU chips specifically in a bid to bring AI to edge and mobile devices. And now they have been developing a version of their Bard AI that is built to run on mobile systems.

There is a huge market for it but there are a lot of challenges to running AI models on lower power hardware that have to be addressed. In its current state most AI on these platforms performed only get specific operations using very condensed models.