I got Qwen3-VL-Embedding-2B working with rkllm on an Orange Pi 5b
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| | This shit is cool, I have a demo script where it compares over 1,300 phrases for similarity to a live webcam image, and it can process one image every 10 seconds or so. I've been waiting fruitlessly for someone to get the model working on this platform, and well, here you go [link] [comments] |
More from r/LocalLLaMA
-
Re. what ever happened to Cohere’s Command-A series of models?
May 20
-
Qwen will release another 27B with high probability
May 20
-
24GB M4 Mac - is Qwen 9B only option while system is running?
May 20
-
Move to backend sampling for MTP draft path by gaugarg-nv · Pull Request #23287 · ggml-org/llama.cpp
May 20
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.