EshwaranandB/linly-x-gemini

0

stars

296

commits

Python

primary language

Feb 9, 2026

updated

Browse cluster: AI Avatar & Virtual Character Chat

README

🎥 Demo Video

Linly-Gemini Live Demo

🎭 Linly-Gemini Live: Real-Time AI Avatar(PersonasAI)

Python PyTorch Gradio Gemini License

A real-time, conversational AI avatar powered by Google's Gemini Live and TMElyralab's MuseTalk.

🚀 Live Demo on Hugging Face


✨ Features

  • 🗣️ Real-Time Interaction: Engage in seamless voice conversations with ultra-low latency powered by Gemini Live.
  • 👄 Lip-Sync Animation: Uses MuseTalk to generate realistic lip movements synced perfectly to the AI's audio response.
  • 👤 Custom Avatars: Upload any portrait image or video to create your own unique persona instantly.
  • 🔄 Self-Healing Deployment: Automatically detects and downloads missing model weights at runtime, ensuring robust deployments on Hugging Face Spaces.
  • 🛠️ Zero-Config Interface: Simple 2-button UI meant for immediate interaction—just "Start Streaming" and go.

🏗️ Architecture

This project combines state-of-the-art storage, inference, and LLM technologies:

  1. Frontend (Gradio): Captures microphone input and renders the video stream.
  2. Orchestrator (Python): manages the WebSocket connection and audio buffering.
  3. Brain (Gemini Live): Processes audio input and generates intelligent, conversational audio responses via a dedicated WebSocket bridge (hosted on Railway).
  4. Face Engine (MuseTalk): Takes the audio from Gemini and the video frames of the avatar to generate lip-synced video in real-time.

ARCHITECTURE

Contributors

Kedreamix

269 commits

yarkable

11 commits

EshwaranandB

8 commits

EshwaranandB/linly-x-gemini

0

stars

296

commits

Python

primary language

Feb 9, 2026

updated

Browse cluster: AI Avatar & Virtual Character Chat

README

🎥 Demo Video

Linly-Gemini Live Demo

🎭 Linly-Gemini Live: Real-Time AI Avatar(PersonasAI)

Python PyTorch Gradio Gemini License

A real-time, conversational AI avatar powered by Google's Gemini Live and TMElyralab's MuseTalk.

🚀 Live Demo on Hugging Face


✨ Features

  • 🗣️ Real-Time Interaction: Engage in seamless voice conversations with ultra-low latency powered by Gemini Live.
  • 👄 Lip-Sync Animation: Uses MuseTalk to generate realistic lip movements synced perfectly to the AI's audio response.
  • 👤 Custom Avatars: Upload any portrait image or video to create your own unique persona instantly.
  • 🔄 Self-Healing Deployment: Automatically detects and downloads missing model weights at runtime, ensuring robust deployments on Hugging Face Spaces.
  • 🛠️ Zero-Config Interface: Simple 2-button UI meant for immediate interaction—just "Start Streaming" and go.

🏗️ Architecture

This project combines state-of-the-art storage, inference, and LLM technologies:

  1. Frontend (Gradio): Captures microphone input and renders the video stream.
  2. Orchestrator (Python): manages the WebSocket connection and audio buffering.
  3. Brain (Gemini Live): Processes audio input and generates intelligent, conversational audio responses via a dedicated WebSocket bridge (hosted on Railway).
  4. Face Engine (MuseTalk): Takes the audio from Gemini and the video frames of the avatar to generate lip-synced video in real-time.

ARCHITECTURE

Contributors

Kedreamix

269 commits

yarkable

11 commits

EshwaranandB

8 commits

Languages

Python

67.1%

Jupyter Notebook

27.7%

Cuda

4.6%