Is Qwen3-VL-2B the only viable VLM for JSON extraction on a "potato"?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
After spending countless hours testing on 3 "potato" laptops (Intel i3, 8GB RAM, Win11, integrated GPU), that's my conclusion.
For reliably extracting data from images to JSON on low-end hardware, nothing else even comes close.
Yet, it’s completely missing from major benchmarks like Artificial Analysis or the Open LLM Leaderboard (while the 4B version is listed).
In my (non-scientific) testing, Qwen3-VL-2B Q4_K_M GGUF easily outperforms Qwen3-VL-4B and Qwen3.5 2B for this specific data extraction task.
The rest aren't even near an acceptable result.
- Why is it being ignored by benchmarks?
- Is there any other model that can actually handle JSON extraction on potatoes, phones, or Raspberry Pis?
[link] [comments]
More from r/LocalLLaMA
-
Been running Qwen3.6-27B through a 3-critic harness. The harness matters more than I thought
Jun 30
-
I Hate Dario Amodei, and everything he stands for.
Jun 29
-
Introducing LongCat-2.0 - , a large-scale MoE language model with 1.6 trillion total parameters and ~48 billion activated per token. This was the stealth model that was on Openrouter under the name 'owl-alpha'.
Jun 29
-
Krea-2-Turbo Image Model - Easy to be fully uncensored, but it can also EDIT Images!
Jun 29
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.