DS4 Flash incoming price increase "we've been able to reproduce their current prices even on rented GPUs"
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| Hello, I've seen these tweets from dax (anomalyco / opencode). I'm doubting the claim, so here is my question to you: given the [$0.14, $0.0028, $0.28] (input, cache, output per MTok) current prices, how would anyone be able to reproduce that AND be profitable on rented hardware? On my own hardware (2x Spark) at $0.20/kWh electricity price, I get: (ranges are from clock set from 1400Mhz to 2300Mhz ; power measured at the wall ; running 0731 with DSpark enabled - which doesn't reflect well in llama-benchy reports ; and I'm on solar, so this is imaginary energy cost) And that's without taking into account the price of the hardware itself. Does any of you have insights in how to host DS4 Flash more efficiently and serve users on rented hardware at the same price of current API? [link] [comments] |
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.