semantic-router

vllm-project System

semantic-router

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

4,163 stars 667 forks Last commit today Language Go License Apache-2.0

Sign in to like, install, or save to a bundle → View on GitHub → Docs ↗

Install

go install github.com/.../semantic-router@latest

About

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

Tags #ai-gateway #bert-classification #fine-tuning #golang #huggingface-candle #huggingface-transformers #kubernetes #llm

Discussion (0)

Sign in to comment →

No comments yet. Sign in to start the discussion.