Qwen 3.6. struggling with German

Hi everyone,

I’m looking for advice on local AI setups. My goal is to have a local AI generate text documentation from my one-hour therapy sessions.

So far, I’ve experimented with Hermes Agent and tried Qwen 3.6 (27B & 35B) as well as Gemma 41B. My workflow involves transcribing audio with Whisper and then feeding the transcript to a local AI. This works fine with a cloud model, but I cannot use a cloud solution in production due to patient data and privacy concerns. I want to handle everything locally.

My main issue is that Qwen 3.6 struggles with German. It sometimes produces technically correct words that aren’t commonly used in natural German. Additionally, the text can sometimes feel very “AI-like,” whereas cloud models produce much more natural-sounding results. Second problem I am experiencing that both models sometimes cannot distinguish what is important and what is not important, cloud models handle this way better...

I’m wondering if there’s a targeted approach to make local models behave better—would fine-tuning help here? Has anyone managed to get this working in a meaningful way for structured German text documentation?

I’ve built a complex iterative skill setup, which works well with DeepSeek V4, but the local results are disappointing. I don’t understand why generating text documentation from one-hour therapy sessions locally seems so difficult, and I’d love to hear what has worked for others.

Thanks in advance!