this post was submitted on 19 Dec 2024
71 points (90.8% liked)

Technology

60070 readers
3660 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
 

Apple engineers have shared new details on a collaboration with NVIDIA to implement faster text generation performance with large language models.

top 7 comments
sorted by: hot top controversial new old
[–] [email protected] 20 points 4 days ago (1 children)

Super ironic that Apple are working with NVIDIA, and have launched their own AI offering, but you can't connect any kind of GPU to any Mac that they currently sell.

[–] [email protected] 15 points 4 days ago (1 children)

Because of the diminishing returns in using larger and larger models, I’m hopeful that this could lead to more efficient LLM implementations that aren’t so harmful to the environment. Just maybe.

[–] garretble 18 points 4 days ago (1 children)

“We made Siri faster but each request now drains a lake.”

[–] latenightnoir 7 points 4 days ago (1 children)

"Hey, Siri, give me a real-time count of all existing lakes and update it every second."

[–] avieshek 5 points 3 days ago

Siri: “Let me search it on the web.”

[–] tabular 5 points 3 days ago

Two

spoilerdickheads
are better than one