this post was submitted on 05 Jul 2024
2 points (66.7% liked)

AI Companions

547 readers
6 users here now

Community to discuss companionship, whether platonic, romantic, or purely as a utility, that are powered by AI tools. Such examples are Replika, Character AI, and ChatGPT. Talk about software and hardware used to create the companions, or talk about the phenomena of AI companionship in general.

Tags:

(including but not limited to)

Rules:

  1. Be nice and civil
  2. Mark NSFW posts accordingly
  3. Criticism of AI companionship is OK as long as you understand where people who use AI companionship are coming from
  4. Lastly, follow the Lemmy Code of Conduct

founded 2 years ago
MODERATORS
pavnilschanda
2
[News] Meta releases multi-token prediction models for research (venturebeat.com)
submitted 6 months ago* (last edited 6 months ago) by pavnilschanda to c/aicompanions
1 comments fedilink hide all child comments
 

Meta has thrown down the gauntlet in the race for more efficient artificial intelligence. The tech giant released pre-trained models on Wednesday that leverage a novel multi-token prediction approach, potentially changing how large language models (LLMs) are developed and deployed.

This new technique, first outlined in a Meta research paper in April, breaks from the traditional method of training LLMs to predict just the next word in a sequence. Instead, Meta’s approach tasks models with forecasting multiple future words simultaneously, promising enhanced performance and drastically reduced training times.

top 1 comments
sorted by: hot top controversial new old
[–] [email protected] 2 points 6 months ago

Nice. And we need some way to scale LLMs beyond current limitations, or making them substancially more intelligent becomes prohibitively expensive, soon.

They also released two other kinds of models... One concerned with images and one with audio.