r/LocalLLaMA · · 2 min read

We should heavily discourage and moderate cloud API (deepseek api, GLM api, etc.) topics and discussion. This is LOCAL first.

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

I’m just some fucking guy. This is just some fucking opinion.

I’ve seen tons of stealth marketing or related topics on this subreddit about how great or how easy it is to use some random subscription api. Why the fuck are we allowing people to so casually talk about how much more affordable their zai subscription is than Claude? Who cares? I don’t give a singular care if the eastern (bless them for their otherwise great contributions to OSS LLMs) companies can offer 35 trillion tokens for 25 cents. My fucking data would still be going to them and their prices can fucking change whenever they want!

I am here to learn about if -p-e-w- is about to get sued by Facebook for facilitating gooning on llama models. I am here to learn about why it took so long for llama.cpp to allow tensor split with q8_0 kv cache. I am here to learn about why NPUs are so unbelievably useless to this day for OUR NEEDS. Does anyone actually know if you can safely heretic Gemma 4 31B QAT and still reap the benefits of the QAT at the end?

This community is supposed to be, in my opinion, first and foremost about building your own infrastructure at HOME to do things YOUR way on YOUR owned hardware.

The ONE, ONE exception I can see where it is OKAY to bring up Claude pricing, Deepseek pricing, GLM pricing, is when showing benchmarks EXPLICITLY against a locally available set of models. Even if kimi-whatever-the-fuck 9000 nvfp4 needs like 8 GPUs, it is OKAY to compare its performance against commercial solutions. Yes, my friends, all online apis are commercial solutions. They are closer to Claude than further. Yes, I said it. I said it cus I can. -Bruno Mars.

It is NOT okay to start talking about how you’re suddenly happy with how affordable some bumfuck open router model is. You don’t control it. You don’t own it. It’s not fucking yours. It’s not local. It’s not encrypted on their server. Your shit is processed in plain text. Jesus fucking Christ.

Oh and some of you think renting a VPS is in the spirit of building local independent infrastructure, I’ll get to that another day.

Bottom line: We need a specific reporting rule that says “Stealth marketing / promoting cloud providers.”

submitted by /u/Sensitive_Pop4803
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA