LLaMa.cpp basic question
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I'm trying to install LLaMa with PI agent.
I ran
curl -fsSL https://pi.dev/install.sh | sh export PATH="/home/user/.local/share/pi-node/node-v22.22.3-linux-x64/bin:$PATH pi install npm:pi-llama.cpp These commands installed pi, added them to path and then I lastly installed an extension that supposedly allows PI agent to connect to my llama models (was that safe or is there a safer way of doing it?).
Lastly I ran
yay llama.cpp-vulkan
to install llama.cpp-vulkan. Unlike Ollama where I can just get models super easily I have no clue how to get them here. I googled it and asked ChatGPT but I still am so confused. Am I missing something? How do I do it?
[link] [comments]
More from r/LocalLLaMA
-
Does GPU spacing matter if we’re undervolting anyways?
May 23
-
Inference provider tiers by Cache-hit rates, using openrouter data
May 23
-
Run Chrome’s tiny Gemma4 (aka Gemini Nano) directly on PC without GPU
May 23
-
Did a 30 runs of llama-bench to find optimal settings for my use case (Frigate and HomeAssistant) on my MI60 32gb VRAM GPU - two models tested Gemma4 and Qwen3.6 - Figured I'd share in case it helps anyone else
May 23
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.