r/LocalLLaMA · · 1 min read

A visualization of LLM API costs to ask for local resources

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

I have not been successful with management to get funding for local resources despite bringing forth solid arguments about data sovereignty and related architectures.

What actually succeeded in getting a budget is showing them how you cannot forecast or negotiate or otherwise control the price of APIs.

I did so with building a very simple visualization of how prices moved in the past couple of years.

Here is the static Github Pages page https://rjalexa.github.io/llmprices/?f=anthropic-fable%2Canthropic-haiku%2Canthropic-opus%2Canthropic-sonnet with the example of Anthropic.

If you want to install it for yourself, or open Issues or PRs here is the repo https://github.com/rjalexa/llmprices

Take care.

submitted by /u/olddoglearnsnewtrick
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA