vllm-project System

semantic-router

A programmable Mixture-of-Models router for heterogeneous LLM inference

5,133 stars 808 forks Last commit 3d ago Language Go License Apache-2.0
Sign in to like, install, or save to a bundle → View on GitHub → Docs ↗

Install

go install github.com/.../semantic-router@latest

Maintain this server? Add the badge

Show your README readers it's in a curated directory — and give them a one-click path to install docs and config.

Listed on Prismix ← links back here

Markdown

[![Listed on Prismix](https://prismix.dev/api/badge/mcp/vllm-project-semantic-router.svg)](https://prismix.dev/mcp/vllm-project-semantic-router)
Theme-aware version (auto dark/light on GitHub) →
<a href="https://prismix.dev/mcp/vllm-project-semantic-router"><picture><source media="(prefers-color-scheme: dark)" srcset="https://prismix.dev/api/badge/mcp/vllm-project-semantic-router.svg?theme=dark"><img alt="Listed on Prismix" src="https://prismix.dev/api/badge/mcp/vllm-project-semantic-router.svg"></picture></a>

About

A programmable Mixture-of-Models router for heterogeneous LLM inference

Discussion (0)

Sign in to comment →

No comments yet. Sign in to start the discussion.

More System servers