Gemma Avatar: Talk to Gemma 4-31B face to face
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| This is a voice chat with Gemma 4 31B where you talk to a 3D avatar. It listens while you speak, answers with a voice and a face (the avatar is exposed to the LLM as function tools: set_mood, make_hand_gesture, make_facial_expression) and Gemma decides the expressions on its own. The stack is all open models: silero VAD, parakeet for STT, Gemma 4 31B (served by Cerebras, which is why replies come back fast), Qwen3-TTS. Raw PCM over a plain WebSocket. For lip-syncing and avatar it uses met4citizen's TalkingHead + HeadAudio (https://github.com/met4citizen/TalkingHead + https://github.com/met4citizen/HeadAudio) [link] [comments] |
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.