r/LocalLLaMA · · 1 min read

'Am I OpenAI compatible' - a tool and documentation for unified api signatures in open source AI.

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

'Am I OpenAI compatible' - a tool and documentation for unified api signatures in open source AI.

This has turned out to be useful to many of my friends so I thought I'd share here as well.

I created a tool and documentation page for most major open-souce project's adherence to 'OpenAI compatibility' after seeing inconsistencies between engines like vLLM and llama.cpp. Now official and unofficial signatures are documented.

Beyond that there are gaps for many model types, so there's also ht-compatibility (inherited from OpenAI compatibility for those)

Just wanted to share a tool I made that can be useful if you're plugging and playing llm and other ai endpoints e.g. into an app.

Also if you're making your own proxy / middleware or even your own API interface this tool with make you and your agents job way easier.

Maybe I'll add Anthropic compatible and other signatures as optional extensions :) Would love feedback and or contributions!

Github: https://github.com/heiervang-technologies/am-i-openai-compatible

Readthedocs: https://heiervang-technologies.github.io/am-i-openai-compatible/

Feel free to star it! <3

submitted by /u/k_means_clusterfuck
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA