'Am I OpenAI compatible' - a tool and documentation for unified api signatures in open source AI.
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| This has turned out to be useful to many of my friends so I thought I'd share here as well. I created a tool and documentation page for most major open-souce project's adherence to 'OpenAI compatibility' after seeing inconsistencies between engines like vLLM and llama.cpp. Now official and unofficial signatures are documented. Beyond that there are gaps for many model types, so there's also ht-compatibility (inherited from OpenAI compatibility for those) Just wanted to share a tool I made that can be useful if you're plugging and playing llm and other ai endpoints e.g. into an app. Also if you're making your own proxy / middleware or even your own API interface this tool with make you and your agents job way easier. Maybe I'll add Anthropic compatible and other signatures as optional extensions :) Would love feedback and or contributions! Github: https://github.com/heiervang-technologies/am-i-openai-compatible Readthedocs: https://heiervang-technologies.github.io/am-i-openai-compatible/ Feel free to star it! <3 [link] [comments] |
More from r/LocalLLaMA
-
110 tok/s with 12GB VRAM on Qwen3.6 35B A3B and ik_llama.cpp
May 21
-
AMD Powers Next-Generation Agent Computers with New Ryzen AI Halo Developer Platform and Ryzen AI Max PRO 400 Series Processors
May 21
-
Qwen3.6 27B and llama.cpp appreciation post
May 21
-
Same task in github-copilot, pi, claude-code, and opencode with Qwen3.6 27B
May 21
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.