Extracting MoE experts from Kimi K3
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Has anyone yet tried to extract experts from kimi (or GLM 5.2) per chance? There is REAP that removes experts based on routing, but I could only run one K3 expert on my hardware. Could there maybe be a usual expert for different tasks? Would be fun to have a 104B Kimi model, although I think that it would be garbage
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.