r/LocalLLaMA · · 1 min read

Why is NO one talking about Microsoft's open source Fast Context!!!

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Why is NO one talking about Microsoft's open source Fast Context!!!

https://huggingface.co/microsoft/FastContext-1.0-4B-SFT
https://github.com/microsoft/fastcontext

FastContext-1.0 is a lightweight repository-exploration subagent for LLM coding agents. Instead of letting a single model both explore the repository and solve the task, FastContext separates these two roles: it is invoked on demand by a main coding agent, issues parallel read-only tool calls (READ, GLOB, GREP), and returns compact file paths and line ranges as focused context

https://github.com/can1357/oh-my-pi/pull/3164

I am personally adding support for local fast context to oh my pi, https://cognition.com/blog/swe-1-6 which is like fast context, if not better is also supported in my oh my pi pr.

Highlights:

  • FastContext improves end-to-end accuracy for every main agent and benchmark; the largest gains appear on SWE-bench Pro (e.g. GPT-5.4 +5.5, GLM-5.1 +5.0).
  • The biggest token savings reach 60.3% (GPT-5.4 on SWE-QA).
  • The compact 4B-RL explorer can outperform the larger 30B-SFT explorer — e.g. on GLM-5.1 SWE-bench Pro it reaches 22.5 vs. 20.0 while using fewer tokens.
submitted by /u/formatme
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA