maximhq AI

bifrost

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

4,892 stars 586 forks Last commit today Language Go License Apache-2.0
Sign in to like, install, or save to a bundle → View on GitHub → Docs ↗

Install

go install github.com/.../bifrost@latest

About

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

Discussion (0)

Sign in to comment →

No comments yet. Sign in to start the discussion.

More AI servers