Qwen 3.8 27B xhigh vs medium small comparison (+ others for fun)
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| It's a small experiment of mine to check thinking effort on Qwen and I do have to say xhigh does overthink but I'm not sure if it's bad because the result is rather amazing. Although the prompt was very open-ended so it took liberties. TL:DR at the bottom. Images in order: Qwen 27b is UD_Q4_XL and DS4 Flash is Q2_XXL Prompt: Write a simple html CARD about the benefits of eating apple. paste the code here. So apart from 27b's xhigh effort all models though this is a super simple request. Which it is, but they basically didn't think, or though for a few lines only, even the medium effort. In turn xhigh though very long and produced a result that is way above anything else in this test. I'm a bit torn on if it's good or not, because A) the quality of the xhigh result is insane B) it was a very simple prompt and technically every other model did it. Tokens (all values token output): For chatgpt and claude I used online versions and as far as I see they hide their tokens right now, but can't be much higher than 1K out. 27b medium modified prompt: Use pastel colors especially 'butter' and adjacent colors, it must be stylish, modern, and in-line with the required format I was interested to see if I try to recreate the xhigh version with a more concrete prompt how would it behave and I am very happy with this result. It followed user request and only though super quickly to produce a result that is pretty much what I asked for. It is not the same as xhigh, but for low tps setups medium should be pretty good. So far I am very impressed with qwen3.8 27b tl,dr: Seems like xhigh can get into quite a thinking match with itself even on simple prompts (probably helps that the prompt is open ended) but the end result will be better due to the thinking. It's a small tradeoff for size vs speed, but medium cuts thinking heavily while keeping a pretty good performance. [link] [comments] |
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.