r/LocalLLaMA · · 1 min read

DSv4 Flash 0731 Running on Unoptimized Single 3090 System

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

DSv4 Flash 0731 Running on Unoptimized Single 3090 System

https://preview.redd.it/eqqebec92sgh1.png?width=873&format=png&auto=webp&s=4e9a120e439dc0a64ee4aef87d84b45c51f6bf02

- 3x32 DDR4 2400 Mhz ECC. CPU itself supports quad channel, and we already know why am i haven't filling those slot yet.
- E5 2690v4.
- 3090 Running on 250W.
- DSv4 is inside my HDD, since my SSD is almost full with VMs.
- Unsloth UD Q2 KXL
- CTX 64K

Final steady state is tg: 5.45 Tok/s , and 42 Tok/s pp processing

Definetely sleep overnight kind of generation, well anyway i am happy enough since i can't run GLM 5.2

submitted by /u/Altruistic_Heat_9531
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA