llama.cpp releases · · 1 min read

b9498

Mirrored from llama.cpp releases for archival readability. Support the source by reading on the original site.

ggml-cpu: extend RVV quantization vec dot to higher VLENs (#22754)

  • ggml-cpu: add rvv 512b,1024b impls for iq4_xs

  • ggml-cpu: refactor; add rvv 512b, 1024b impls for q6_K, i-quants

  • ggml-cpu: refactor; add 512 and 1024 implementations of tq3_s, iq3_xxs, iq2_s, iq2_xs, iq2_xxs

improve iq2_xs impl for rvv 256

Co-authored-by: Rehan Qasim [email protected]


Co-authored-by: taimur-10x [email protected]
Co-authored-by: Rehan Qasim [email protected]

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from llama.cpp releases