b9319

ggml: gguf_init_from_callback and gguf_init_from_buffer (#22341)

• ggml: implement gguf_init_from_buffer

• test: gguf_init_from_buffer

• fix: memory breakdown for a model loaded with no_alloc from a file is consistent with being loaded from a buffer

• fix: use GGML_UNUSED

Co-authored-by: Copilot [email protected]

• fix: remove total_size from gguf_reader

• fix: file offset calculation, rename offset to data_offset

Co-authored-by: Copilot [email protected]

• refactor: extract model loader bug fixes to another PR

• feat: add gguf_init_from_callback

• fix: always require a max expected size

• fix: change gguf_reader_callback_t's output type to void *, change max_expected_size and offsets to uint64_t

• fix: harden against offset overflow in buffer read

• fix: remove seek behavior from the callback

• feat: max_chunk_read == 0 means SIZE_MAX

• fix: seeking in a gguf file with no tensors

---

Co-authored-by: Copilot [email protected]

macOS/iOS:

• macOS Apple Silicon (arm64)
• macOS Apple Silicon (arm64, KleidiAI enabled)
• macOS Intel (x64)
• iOS XCFramework

Linux:

• Ubuntu x64 (CPU)
• Ubuntu arm64 (CPU)
• Ubuntu s390x (CPU)
• Ubuntu x64 (Vulkan)
• Ubuntu arm64 (Vulkan)
• Ubuntu x64 (ROCm 7.2)
• Ubuntu x64 (OpenVINO)
• Ubuntu x64 (SYCL FP32)
• Ubuntu x64 (SYCL FP16)

Android:

• Android arm64 (CPU)

Windows:

• Windows x64 (CPU)
• Windows arm64 (CPU)
• Windows x64 (CUDA 12) - CUDA 12.4 DLLs
• Windows x64 (CUDA 13) - CUDA 13.1 DLLs
• Windows x64 (Vulkan)
• Windows x64 (SYCL)
• Windows x64 (HIP)

openEuler:

• openEuler x86 (310p)
• openEuler x86 (910b, ACL Graph)
• openEuler aarch64 (310p)
• openEuler aarch64 (910b, ACL Graph)

UI:

• UI