A visualization of LLM API costs to ask for local resources
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I have not been successful with management to get funding for local resources despite bringing forth solid arguments about data sovereignty and related architectures.
What actually succeeded in getting a budget is showing them how you cannot forecast or negotiate or otherwise control the price of APIs.
I did so with building a very simple visualization of how prices moved in the past couple of years.
Here is the static Github Pages page https://rjalexa.github.io/llmprices/?f=anthropic-fable%2Canthropic-haiku%2Canthropic-opus%2Canthropic-sonnet with the example of Anthropic.
If you want to install it for yourself, or open Issues or PRs here is the repo https://github.com/rjalexa/llmprices
Take care.
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.