ui: Add Thinking mode toggle with reasoning effort levels + improvements for Chat Form Add Action UI by allozaur · Pull Request #23434 · ggml-org/llama.cpp
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| | now you can enable/disable/limit thinking (check the video) [link] [comments] |
More from r/LocalLLaMA
-
Minimax M3 appears to have no political censorship
Jun 2
-
StepFun 3.5 MTP by pwilkin · Pull Request #23274 · ggml-org/llama.cpp
Jun 2
-
I have become George Jetson: my job is now Yes/No supervision for a machine I don’t fully understand.
Jun 2
-
1-bit Bonsai Image 4B and Ternary Bonsai Image 4B Image Generation for Local Devices with just 0.93 GB and 1.21 GB respectively of Diffusion Transformer Footprint. So tiny!
Jun 2
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.