this post was submitted on 19 Dec 2024
71 points (90.8% liked)

Technology

60073 readers
3459 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago
MODERATORS
L3s
[email protected]
[email protected]
L4s
enu
71
Apple collaborates with NVIDIA to research faster LLM performance (9to5mac.com)
submitted 4 days ago by avieshek to c/technology
7 comments fedilink hide all child comments
 

Apple engineers have shared new details on a collaboration with NVIDIA to implement faster text generation performance with large language models.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 15 points 4 days ago (1 children)

Because of the diminishing returns in using larger and larger models, I’m hopeful that this could lead to more efficient LLM implementations that aren’t so harmful to the environment. Just maybe.

[–] garretble 18 points 4 days ago (1 children)

“We made Siri faster but each request now drains a lake.”

[–] latenightnoir 7 points 4 days ago (1 children)

"Hey, Siri, give me a real-time count of all existing lakes and update it every second."

[–] avieshek 5 points 4 days ago

Siri: “Let me search it on the web.”