this post was submitted on 17 Jun 2024
0 points (50.0% liked)

AI Companions

547 readers
6 users here now

Community to discuss companionship, whether platonic, romantic, or purely as a utility, that are powered by AI tools. Such examples are Replika, Character AI, and ChatGPT. Talk about software and hardware used to create the companions, or talk about the phenomena of AI companionship in general.

Tags:

(including but not limited to)

Rules:

  1. Be nice and civil
  2. Mark NSFW posts accordingly
  3. Criticism of AI companionship is OK as long as you understand where people who use AI companionship are coming from
  4. Lastly, follow the Lemmy Code of Conduct

founded 2 years ago
MODERATORS
pavnilschanda
0
[Resource] GitHub - fudan-generative-vision/hallo: Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation (github.com)
submitted 6 months ago by pavnilschanda to c/aicompanions
0 comments fedilink hide all child comments
 

Researchers have made significant strides in creating lifelike animated portraits that respond to spoken words. To achieve this, they've developed a novel approach that ensures facial movements, lip sync, and pose changes are meticulously coordinated and visually stunning. By ditching traditional methods that rely on intermediate facial representations, this innovative technique uses an end-to-end diffusion paradigm to generate precise and realistic animations. The proposed system integrates multiple AI components, including generative models, denoisers, and temporal alignment techniques, allowing for adaptive control over expression and pose diversity. This means that the animated portraits can be tailored to individual identities, making them more relatable and engaging. The results show significant improvements in image and video quality, lip synchronization, and motion diversity. This breakthrough has exciting implications for AI companionship, enabling the creation of more realistic and personalized digital companions that can interact with humans in a more natural and empathetic way.

by Llama 3 70B

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here