this post was submitted on 28 Dec 2023
118 points (96.8% liked)
Technology
60012 readers
2223 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Cloud AI services will always be more capable. You can do more with near-limitless RAM and processing power than you'll ever be able to do locally on your mobile/desktop system.
But locally-run AI's usefulness was never in question either.
An example of this is Google who made the Coral TPU and then the Pixel TPU chips specifically in a bid to bring AI to edge and mobile devices. And now they have been developing a version of their Bard AI that is built to run on mobile systems.
There is a huge market for it but there are a lot of challenges to running AI models on lower power hardware that have to be addressed. In its current state most AI on these platforms performed only get specific operations using very condensed models.
Not sure if you already know, but - sophisticated large language models can be run locally on basic consumer-grade hardware right now. LM Studio, which I've been playing with a bit, is a host for insanely powerful, free, and unrestricted LLMs.
I'm sure lots of big companies do, but there are lots of big companies and they all have their own goals. The article goes into it a bit, but lots of companies aren't exactly leaping to send off their most sensitive data into a third party cloud. They want AI to work with their data, but they want it locally and on-prem.
Plus you also got Intel, AMD, Nvidia, Qualcomm etc who want to sell as much as they can regardless of if it's going to be a cloud customer or a customer looking to train AI locally.
Being good for the consumer is just a side effect of the blending of money, business paranoia, competition, sensitive data and rapid expansion of an industry