b9255

hexagon: HMX quantized matmul rework (#23368)

• hmx-mm: update debug logging in hmx-mm

• hmx-mm: update dequant logic to use HVX_vector_x2/4

• hmx-mm: remove non-pipelined version of the quantize matmul

It seems that we don't reall need non-pipelined version

• hmx-mm: use activation depth mode and update naming

Co-authored-by: Kim-Chyan Gan [email protected]

• hex-mm: minor hmx matmul naming updates

• hmx-mm: remove unused vars

• snapdragon: scripts bump default ubatch-size to 1K

• hexagon: combine HMX and power and clock settings into a single set_power call

• hmx-mm: remove leftover of the scale repl helper

• hexagon: fix editconf error

---

Co-authored-by: Kim-Chyan Gan [email protected]

macOS/iOS:

• macOS Apple Silicon (arm64)
• macOS Apple Silicon (arm64, KleidiAI enabled)
• macOS Intel (x64)
• iOS XCFramework

Linux:

• Ubuntu x64 (CPU)
• Ubuntu arm64 (CPU)
• Ubuntu s390x (CPU)
• Ubuntu x64 (Vulkan)
• Ubuntu arm64 (Vulkan)
• Ubuntu x64 (ROCm 7.2)
• Ubuntu x64 (OpenVINO)
• Ubuntu x64 (SYCL FP32)
• Ubuntu x64 (SYCL FP16)

Android:

• Android arm64 (CPU)

Windows:

• Windows x64 (CPU)
• Windows arm64 (CPU)
• Windows x64 (CUDA 12) - CUDA 12.4 DLLs
• Windows x64 (CUDA 13) - CUDA 13.1 DLLs
• Windows x64 (Vulkan)
• Windows x64 (SYCL)
• Windows x64 (HIP)

openEuler:

• openEuler x86 (310p)
• openEuler x86 (910b, ACL Graph)
• openEuler aarch64 (310p)
• openEuler aarch64 (910b, ACL Graph)