NVIDIA Jetson AGX Orin 64GB
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
So I have 2 of these from some deprecated equipment. What would their best use case or model be? It’s got about 205GB/s memory bandwidth 64GB unified maybe 55GB usable.
[link] [comments]
More from r/LocalLLaMA
-
We added W8A8 activation quantization to MLX — prefill went from 2.84s to 2.52s on M5 Pro
May 25
-
I made a local-first MCP tutorial repo with node-llama-cpp and a custom agent loop
May 25
-
Qwen 3.6 benchmarks on 2x RTX PRO 6000
May 25
-
server: fix checkpoints creation by jacekpoplawski · Pull Request #22929 · ggml-org/llama.cpp
May 25
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.