semantic-router

vllm-project System

semantic-router

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

4,656 stars 722 forks Last commit today Language Go License Apache-2.0

Sign in to like, install, or save to a bundle → View on GitHub → Docs ↗

Install

go install github.com/.../semantic-router@latest

Maintainer? Add the badge

← shows on your README, links back here

[![Listed on Prismix](https://prismix.dev/api/badge/mcp/vllm-project-semantic-router.svg)](https://prismix.dev/mcp/vllm-project-semantic-router)

About

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

Tags #ai-gateway #bert-classification #fine-tuning #golang #huggingface-candle #huggingface-transformers #kubernetes #llm

Discussion (0)

Sign in to comment →

No comments yet. Sign in to start the discussion.