Technology

59697 readers

5159 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

128

Bing Chat so hungry for GPUs, Microsoft will rent them from Oracle (www.theregister.com)

submitted 1 year ago by [email protected] to c/technology

16 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] partial_accumen 7 points 1 year ago (1 children)

It probably is very profitable and it doesn't need to be sustainable. This is likely a short term (3 years is short) deal.

This is the tip off for me:

In this case, Microsoft is using the system alongside its Azure Kubernetes Service to orchestrate Oracle's GPU nodes to keep up with what's said to be demand for Bing's AI features.

This doesn't really look like this is about Bing AI features but rather GPUs are in demand so much that MS can "rent in bulk" from Oracle, and then rent out Azure's own GPUs to Azure customers willing to pay per second for GPU usage at retail prices.

[–] RanchOnPancakes 3 points 1 year ago (1 children)

I mean all the processing needed for AI in general. its the new.... "big thing" they'll find some use. Give it to everyone. realize it won't make money if its free. Try to find a way to charge. It won't be good enough for that. People will move on. It'll end up in its niches where it makes senses and is considered a cost savings, and the world will move on. A ton of firms will merge and go bankrupt and then all the big tech companies will move onto the next "big thing".

[–] partial_accumen 2 points 1 year ago

Give it to everyone. realize it won’t make money if its free.

I don't think that's whats happening fully right now. AI solutions given away for free are users doing free work training AI. The users are the product, not the AI being used in those cases.

It’ll end up in its niches where it makes senses and is considered a cost savings, and the world will move on.

This is a lot of niches. I'm seeing quite a few jobs being replaced by AI, and its going to have a massive impact on economies. Its even worse than just "jobs lost". Its lots of low and middle skill jobs that AI can replace today. It going to eviscerate the pipeline of people that grow to higher positions. What then happens when more of the most skilled are needed? They won't exist because they weren't able to grow in the junior and middle skillset jobs replaced by AI. I'm not sure what we can do about that.