Local conversational AI

I thought this was going to be easy. I searched reddit, google and even tried to find a solution with LLMs. I saw a few nice things: unmute.sh seems promising, there are webgpu implementations that look impressive, i tried with Sillytavern Ollama and Koboldcpp. All of those solutions suck for various reasons. I remember when sesame ai was released and how I thought we are soon going to have this locally. That was quite some time ago.

So I'm coming to you for help.

Is there a local solution to get these things (i've ordered them by importance)?

- Holding a conversation (speech to speech) with reasonable speed on 16 gb of total ram

- Speaking english

- Easy to set up

- Speaking french (For language practise)

- Having some kind of memory/RAG

So you know such a thing?

When I look at the sesame subreddit there should be a lot of people that are REALLY interested in this kind of thing...