llama.cpp releases · · 1 min read

b9946

Mirrored from llama.cpp releases for archival readability. Support the source by reading on the original site.

hexagon: tiling, tracing and optimizations for unary ops (#25474)

  • hexagon: tile wide rows in pointwise unary ops to avoid VTCM overflow

  • unary: reject permuted tensors for now (not used by models)

  • hex-unary: replace divs with fastdiv

  • hex-unary: add vtcm layout and host computed kernel params

  • hex-unary: move fastdiv init into kernel params

  • hex-unary: add specialized thread functions to improve generated code

  • hex-unary: tracing instrumentation for unary ops

  • hex-unary: factor out hvx kernels, streamline and remove more duplication

  • ggml-hexagon: fix std::min collision with Windows min macro

  • hex-cmake: make lto build happy


Co-authored-by: Max Krasnyansky [email protected]

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from llama.cpp releases