r/LocalLLaMA · · 1 min read

Gemma Avatar: Talk to Gemma 4-31B face to face

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Gemma Avatar: Talk to Gemma 4-31B face to face

This is a voice chat with Gemma 4 31B where you talk to a 3D avatar. It listens while you speak, answers with a voice and a face (the avatar is exposed to the LLM as function tools: set_mood, make_hand_gesture, make_facial_expression) and Gemma decides the expressions on its own.

The stack is all open models: silero VAD, parakeet for STT, Gemma 4 31B (served by Cerebras, which is why replies come back fast), Qwen3-TTS. Raw PCM over a plain WebSocket.

For lip-syncing and avatar it uses met4citizen's TalkingHead + HeadAudio (https://github.com/met4citizen/TalkingHead + https://github.com/met4citizen/HeadAudio)

submitted by /u/paf1138
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA