Qualcomm launches GenieX to run LLMs on their Windows Laptops

Qualcomm was behind every major chipmaker so they are playing catchup when it comes to SDKs.

https://aihub.qualcomm.com/geniex

I was able to get 20 tok/s running Gemma 4 26B A4B 0.5s for first token running on the GPU or NPU

10 tok/s on the GPU for Qwen 3.6 27B MTP

To use llama.cpp, just get any Q4_0 GGUF model and it will run on the CPU,GPU,NPU