r/LocalLLaMA · · 1 min read

Fix for Deep Seek v4 Flash 0731 tool calling has been added to llama cpp

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

This pull request was added to the main llama cpp about 12 hours ago.

I was experiencing some looping and poor behavior yesterday but haven't had any problems since this fix.

https://github.com/ggml-org/llama.cpp/pull/26269

submitted by /u/kwizzle
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA