r/LocalLLaMA · · 1 min read

Force <thinking> in Laguna-S-2.1

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Those who have tested the new Laguna model might have noticed how reluctant it is to think through medium-hard questions, and it does impact the output quality. It is great that the model does not "Qwen over" questions like "Hi, who are you", but it definitely should think more.

I have found a simple 10/10 way to force it to think through what it's saying: a simple chat template change. So that when reasoning is enabled, it does not only insert the <think> tag, but also a new line after it. Of course, it will FORCE the thinking part always, which is not what you might want in many use cases, but for coding or benchmarking, it is what can show what this model can do.

I only did test it at Q2, so it's faster, but results so far are great, e.g. single sentence reasoning for a greeting, tens of thousands of tokens for a coding task. The simple change:

 {%- if enable_thinking -%} {{- '<think> ' -}} {%- else -%} {{- '</think>' -}} {%- endif -%} 
submitted by /u/SnooPaintings8639
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA