I built a local-first hybrid router for AI Agent Skills (sub-20ms, zero tokens, runs on CPU) [P]
Mirrored from r/MachineLearning for archival readability. Support the source by reading on the original site.
| If you use agentic workflows with custom skills or rules (Cursor rules, Claude Code slash commands, OpenCode, etc.), you have probably run into the routing trade-off:
To solve this, I built Routed; an open-source, local-first hybrid router for agent skills that runs 100% offline on your CPU. GitHub: https://github.com/bshea-1/Routed https://i.redd.it/5ca68gffgxnh1.gif How it Works Under The HoodRouted indexes your installed skill directories and evaluates prompts through a 4-part hybrid scoring pipeline: * Dense Vector Embeddings (60%): Runs quantized ONNX models (Arctic Embed S / MiniLM) locally on CPU. The entire lookup completes in under 20ms without sending a single byte of prompt data over the wire. Supported EnvironmentsRouted auto-detects and injects adapters into: Cursor, Claude Code, LM Studio, Ollama, Antigravity IDE, Windsurf, OpenCode, Continue, Codex, and I just dropped support for MCP Servers!! And although v1.0 dropped last night, I just shipped v1.1.0 with two major additions based on early feedback:
UsageInside your agent chat, you can just use /route to trigger the best skill(s) dynamically. It also handles compound intents (e.g., matching multiple skills when a prompt asks for two distinct tasks). Pre-built binaries are available on GitHub Releases (macOS .pkg, Linux .deb, Windows .exe), or you can build it from source via Node. Check it out and let me know what you think or if there are other environments you would like added! [link] [comments] |
More from r/MachineLearning
-
How can I turn an industry ML project into a publication? [R]
Sep 28
-
Are there any good research papers around Text clustering using LLMs [R]
Sep 28
-
Free, open-source AI engineering course where you build each algorithm by hand: 523 lessons, now as EPUB/PDF books [P]
Sep 28
-
Two-stage shelf audit: YOLO finds the products, embeddings can't tell sibling SKUS apart. What should Stage 2 be? [P]
Sep 27
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.