News / #model-release Tag Model releases 500 articles archived under #model-release · RSS Sign in to follow r/LocalLLaMA community 11d ago https://huggingface.co/poolside/Laguna-S-2.1-NVFP4 Updated release (August 2026). This is a new checkpoint that supersedes the earlier version of this repository. The weights have changed, not only the config, so if you downloaded a previous copy please re-download to pick up the current checkpoint.   submitted by  … 23 r/LocalLLaMA community 11d ago DeepSeek V4 @ IQ3XXS on M1 Ultra 128GB- 16 tok/s in LM Studio after patch M1 Ultra 128GB, Unsloth UD-IQ3_XXS, wired limit at 120GB. I was at 5-6 tok/s before the patch. Getting 15-16 tok/s now with the patched engine, and the output seems to have improved. Big thanks to this guy.   submitted by   /u/mil_phickelson [link]   [comments] 9 r/LocalLLaMA community 11d ago Parlor v2: best-effort fully local GPT-Live clone on an M3 Pro GPT-Live is so good that I use it almost every day. I've been wanting to replicate it since it was released. My first attempt was to fine-tune Gemma 4 12B to behave like a full-duplex model. Something like grafting a decision tick + speech head to the model. It failed after… 24 r/LocalLLaMA community 11d ago DeepSeek-V4-Flash-0731: When Low is higher than High I decided to test a few questions against DeepSeek-V4-Flash-0731. Locally, I was running Unsloth's UD-Q2_K_XL quant. After I saw the surprising shape of the results, I tested against DeepSeek's official API to confirm that I didn't do anything wrong. For anyone using OpenRouter,… 12 llama.cpp releases dev-tools 11d ago b10232 metal: implement DeepSeek V4 hyper-connections ( #26459 ) Implement GGML_OP_DSV4_HC_COMB, GGML_OP_DSV4_HC_PRE, and GGML_OP_DSV4_HC_POST with SIMDgroup register and shuffle optimized kernels. Add Metal dispatch and support plumbing and test the production Sinkhorn iteration count… 10 r/LocalLLaMA community 11d ago DeepSeek-V4-Flash-0731: surpasses Fable-5, Sol & Kimi-K3 on Chess Benchmark   submitted by   /u/mrwang89 [link]   [comments] 4 r/LocalLLaMA community 11d ago DSpark Benchmark Result on Deepseek v4 Flash 0731 TensorSharp supports DSpark on Deepseek v4 Flash 0731 now. Here is the benchmark result on 4x Nvidia A40 GPUs, cuda 12.8 with/without DSpark: Model: DeepSeek-V4-Flash-0731-UD-Q8_K_XL from https://huggingface.co/unsloth/DeepSeek-V4-Flash-0731-GGUF DSpark draft model from:… 31 r/LocalLLaMA community 11d ago All Qwen model oneshots: 1109 outputs to look at and compare! I've been busy this weekend generating oneshots for all the cheapest models on the openrouter and ended up going through all 33 qwen models across 35 prompts (there were some failures and only 1109 made out of 33*35 matrix). Here they are https://oneshotlm.com/model/?q=qwen Qwen… 35 r/LocalLLaMA community 11d ago Deepseek v4 flash - 100-150 faster t/s in prefill/pp. You have two choices here (in order of pref): Downgrade CUDA from 13.3 to 13.1 (skip 13.2 due to bugs) <- prefer this (thanks to u/fairydreaming for pointing this out) Use this vibed fork that works with CUDA 13.3 https://github.com/vektorprime/working_ds4_speed I was… 34 r/LocalLLaMA community 11d ago Deepseek-V4-Flash-0731 Dwarfstar on Mac Here is the prefill performance in an M2 Ultra with 192GB of RAM. For decode, at the following depth: Start: 28 t/s 45k: 23.5 t/s 192k: 18 t/s That speed is maintained with 8k token output at those depths.   submitted by   /u/Badger-Purple [link]   [comments] 17 r/LocalLLaMA community 12d ago Conclusion: r/LocalLLaMA still has brilliant open-weight research, but finding it requires wading through endless benchmark drama, non-local Discussion Points and repetitive hardware flexes. I let Gemma4-31b run on my laptop for like almost a day using a heavily altered pi to do a deep dive on our beloved Llama tangentially related Subreddit, and this was the conclusion. Feels pretty accurate. Kind funny to let a small LLM loose and see what happens. Next target I'm… 30 llama.cpp releases dev-tools 12d ago b10228 DeepseekV4 MTP + DSpark ( #25784 ) Website: https://llama.app macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu… 35 r/LocalLLaMA community 12d ago Has Qwen 3.8 has dropped yet? Day 90...   submitted by   /u/mailto_devnull [link]   [comments] 32 r/LocalLLaMA community 12d ago llama.cpp just added MTP / DSpark support for DeepSeek V4 Flash   submitted by   /u/rmhubbert [link]   [comments] 21 llama.cpp releases dev-tools 12d ago b10227 chat : add qwen3 specialized parser ( #26252 ) Add tagged thinking tool parser chat : refactor and add permute helper cont : add support for <tool_call> omission cont : update tool delimiters cont : add comment for qwen3-coder cont : fix trigger pattern for <function… 25 r/LocalLLaMA community 12d ago [Release] WinterMix — Qwen3.5-122B-A10B in native MLX: an 82 GiB build that beats 94–95 GiB quants, plus a 68 GiB build for agent swarms TL;DR: I spent 9 days developing a new quantization method for MLX models and measured 18 variants against each other on a single M5 Max MacBook Pro (128 GB). The result is the best-measuring MLX quant of Qwen3.5-122B-A10B I'm aware of at any size — the 82 GiB build edges out… 8 r/LocalLLaMA community 12d ago Setting up of a 16xGB10 (DGX Spark) cluster Preparing this to be able to run locally frontier level open models. Deepseek v4 pro, Kimi K3, future ones like GLM 5.5 and Minimax M4. 16x Asus GX10 linked by mikrotik crs804-4ddq with 4 breakout cables of 400 to 100gbit. Most probable I will be running 2 models on 8x cluster… 13 r/LocalLLaMA community 12d ago DeepSeek-V4-Flash 284B on 5.3GB of memory Following up on my Qwen 3.6 port , I wanted to keep adding models and ended up fixing a bunch of things along the way, so it's its own engine now: Mference . Same core idea from TurboFieldfare , MoE models activate a few B params per token, so keep the shared core and KV cache… 8 r/LocalLLaMA community 12d ago PSA for DeepSeek-V4-Flash-0731 users — don't blow out your prompt cache with system role messages mid-conversation DSv4F doesn't ship a jinja, but for distributions that do and faithfully reconstruct what DS releases in their chat template python, every system message is hoisted into the system prompt at the top -- the format has no mid-conversation system turn. So, anything you stick at the… 13 r/LocalLLaMA community 12d ago Real-world reality check on Qwen for autonomous coding agents TLDR below 👇🏼 I’ve seen a lot of hype around Qwen 3.6 35B and 3.5 120B lately, especially regarding coding and tool-use capabilities. On this subreddit it is the defacto recommended model for everyone without a Datacenter at home. I’ve been running Qwen 3.5 120B… 9 r/LocalLLaMA community 12d ago DeepSeek-V4-Flash-0731 UD-IQ3_XXS about 11t/s on 1x 7900 XTX 24GB + 3x MI60 32GB + 128GB DDR4 Hello, Also I want to join the hype of posting token specs. CPU: 2x Intel Xeon CPU E5-2650 v4 @ 2.20GHz RAM: 2x 4 Channel 2400MHz DDR4 GPU: 1x AMD Radeon 7900 XTX 24GB 3x AMD Instinct MI60 32GB Strange GPU combination, right? One of my AMD Instinct MI60 32GB failed, and I have… 35 Simon Willison community 12d ago July 2026 newsletter The June edition of my sponsors-only monthly newsletter is out. If you are a sponsor (or if you start a sponsorship now) you can access it here . This month: Accidental cyberattacks by OpenAl and Anthropic models under test GPT-5.6 Sol, Terra, and Luna Claude Opus 5 Kimi K3 and… 27 r/LocalLLaMA community 12d ago DeepSeek-V4-Flash-0731 UD-Q8_K_XL 17.20~ t/s on A6000 + 256GB DDR4 Hello everyone I want to join the hype of posting specs. CPU: AMD EPYC 74F3 24-Core RAM: 8 Channel 3200 DDR4 GPU: RTX A6000 48GB Prompt processing is in the high 70t/s (got down to mid 30t/s at 300k context). Inference is a steady 17.20t/s~ and the 48GB VRAM is enough to have… 10 r/LocalLLaMA community 12d ago Expert-only IQ3 requant of DeepSeek-V4-Flash-0731: better KLD than UD-IQ3_S, 1.4x decode on a CPU-spill rig Hey all, tldr / who this helps: you run a mixed multi-GPU box where the experts spill to RAM, and you want to stay in the 3-bit tier instead of dropping to Q2 to make it fit. https://huggingface.co/TacoTakumi/DeepSeek-V4-Flash-0731-GGUF I requantized only the 129 routed expert… 19 Vercel — AI dev-tools 12d ago Qwen 3.8 Max now available on Vercel AI Gateway Qwen 3.8 Max is now available on AI Gateway. Qwen 3.8 Max handles text-only and vision-language work in one model, with 2.4 trillion parameters and a context window of up to 1 million tokens. The model is suited for software engineering and office productivity, along with visual… 13 r/LocalLLaMA community 12d ago Koboldcpp v1.118 released   submitted by   /u/Fcking_Chuck [link]   [comments] 12 r/LocalLLaMA community 12d ago DeepSeek-V4-Flash-0731 on Bosgame M5 with RTX PRO 6000 Max-Q eGPU Here are my numbers: Quant Size Layout Decode Prefill Draft acceptance UD-Q8_K_XL 150.8 GiB 20 layers CUDA0 / 23 ROCm0 + drafter 44.0 t/s 564 t/s 0.535 UD-Q4_K_XL 144.4 GiB 22 / 21 + drafter 48.4 t/s 585 t/s 0.532 UD-Q2_K_XL 90.2 GiB entirely on CUDA0, no drafter 59.5 t/s 1513… 17 Simon Willison community 12d ago datasette-apps 0.2a0 Release: datasette-apps 0.2a0 Changes that improve Datasette Apps when created and edited using Datasette Agent : New app_debug() tool allowing agent to open an app (invisibly) and test it using JavaScript. #33 New app_list() tool for listing apps the user has permission to… 30 r/LocalLLaMA community 12d ago DeepSeek-V4-Flash-0731 UD-IQ3_S 12.5 tok/s on RTX 3090 +128GB DDR5 I managed to run DeepSeek-V4-Flash-0731 UD-IQ3_S in text-generation-webui with: RTX 3090 24 GB 128 GB DDR5 overclocked to 5600 MHz using AMD EXPO llama.cpp loader First, I had to use a rather brutal workaround: I replaced the llama.cpp binaries included with… 12 Hacker News — AI on Front Page community 12d ago Seedance 2.5 Article URL: https://seed.bytedance.com/en/blog/one-take-creation-flexible-referencing-introducing-seedance-2-5 Comments URL: https://news.ycombinator.com/item?id=49138302 Points: 205 # Comments: 94 16 Simon Willison community 12d ago Ten advances in mathematics and theoretical computer science Ten advances in mathematics and theoretical computer science A few days ago it was Anthropic discovering cryptographic weaknesses with Claude using Mythos Preview, spending $100,000 on tokens and with prompts that included "again we are not looking for low hanging fruit, we want… 18 r/LocalLLaMA community 12d ago What’s next for Qwen open-source releases? Been using Qwen 3.6 35B-A3B quite extensively lately and honestly, I’m pretty happy with it. Also tried a few community improvements like Ornith 1.0, which add some interesting tweaks. That said, I’m curious about what the community expects next from Qwen’s open-source roadmap.… 8 r/LocalLLaMA community 12d ago Is there a point where models just cannot get any smaller without losing intelligence? DeepSeek V4 Flash got me thinking... We keep seeing smaller models get way better. A model at a certain parameter count today can be much smarter than a model of the same size from a year or two ago. Better training, better data, better architectures, distillation, MoE, and all… 38 r/LocalLLaMA community 12d ago Fix for Deep Seek v4 Flash 0731 tool calling has been added to llama cpp This pull request was added to the main llama cpp about 12 hours ago. I was experiencing some looping and poor behavior yesterday but haven't had any problems since this fix. https://github.com/ggml-org/llama.cpp/pull/26269   submitted by   /u/kwizzle [link]  … 37 Hacker News — AI on Front Page community 12d ago NetBSD 11.0 Article URL: https://blog.netbsd.org/tnf/entry/netbsd_11_0_released Comments URL: https://news.ycombinator.com/item?id=49136736 Points: 225 # Comments: 97 14 r/LocalLLaMA community 12d ago Deepseek v4 flash 0731 still not holding up. The biggest issue with preview was its inability to follow rules prompts and skills. It seems like no matter what you do it ignores them. I've tried first person and second person. I've tried Chinese and English. It does not follow them. That's the only problem with these models… 14 r/LocalLLaMA community 12d ago DeepSeek V4 Flash 0731 IQ2_M benchmark for Dual 3060 and 96GB RAM ≈ 3.5 tok/s. Thanks to the community help I finally launched this llm. LM Studio refused to load weight onto second GPU but Unsloth Studio did so everything was done in there. Not a proper benchmark (used PC in parallel as well) but it gives an idea of the performance from dual 3060 with… 16 r/LocalLLaMA community 13d ago LongCat-Flash-Lite-Sparse Is Now Available for Download The weights have now been added to the repo an hour ago. This model is built upon LongCat-Flash-Lite , the differences are that LongCat-Flash-Lite-Sparse : Replaces dense MLA with LongCat Sparse Attention (LSA) Natively supports context lengths of up to 1M tokens (vs 256k for… 13 r/LocalLLaMA community 13d ago New official weights for Laguna S 2.1 FP8 & NVFP4 are now available Poolside have updated the FP8 and NVFP4 checkpoints for Laguna S 2.1, increasing the default context size to 1 million, and updating the configs. Here's hoping they fixed the looping issue, this model has been great in my development workflows, when not looping.   submitted… 6 r/LocalLLaMA community 13d ago DeepSeek-V4-Flash-0731: Oneshot evals, surprisingly not token efficient?? I ran the newly released DeepSeek-V4-Flash-0731 in my oneshot eval harness across 34 prompts and here are the results. https://oneshotlm.com/model/deepseek-deepseek-v4-flash-0731/ The providers on openrouter were unstable and I had to retry generation multiple times.… 10 r/LocalLLaMA community 13d ago DS4 flash 0731 - Acquarium Panel Failure - Q3_K_XL Unsloth https://preview.redd.it/1a39x4zivqgh1.png?width=1550&format=png&auto=webp&s=de591c039cc18782a6b5d8e402fdc1594be05132 start C:\llm\llamam5\build\bin\llama-server.exe --model "H:\UD-Q3_K_XL\DeepSeek-V4-Flash-0731-UD-Q3_K_XL-00001-of-00004.gguf" --host 127.0.0.1 --port 8080 -c… 33 r/LocalLLaMA community 13d ago New DeepSeek V4 Flash 0731 vs ChatGPT Luna comparison   submitted by   /u/perelmanych [link]   [comments] 23 r/LocalLLaMA community 13d ago Deepseek V4 Flash 0731. LM Studio loading only into RAM. The model refuses to load into VRAM and uses only RAM. What can be an issue? Q2_K_XL from Unsloth if that changes something.   submitted by   /u/esw123 [link]   [comments] 29 r/LocalLLaMA community 13d ago DeepSeek-V4-Flash-0731: Models you can run locally now have the intelligence score of the top frontier model from March 2026 March 6th, 2026 the highest intelligence index score was 51 for frontier models. deepseek-ai/DeepSeek-V4-Flash-0731 that has an intelligence score of 50. If these benchmarks are accurate, models available to run locally on <8K USD (us prices - just guestimating/not exact)… 19 r/LocalLLaMA community 13d ago Are 1B LLMs Going Away in 2026? I don't know much about llms aside from downloading them through a frontend and running them on my laptop or potato phone. Google released gemma 4, but unlike gemma 3, there isn't a 1b model this time. Llama also had a 1b model before, but there doesn't seem to be a new one.… 21 r/LocalLLaMA community 13d ago Qwen 3.6 27B Q5 on 3x2080ti: 55tps with llama.cpp. Can I squeeze out more? CPU: Threadripper 3970X RAM: 128GB DDR4 GPUs: 3x2080ti 11GB The current best parameters to run it: llama-server \ --model Qwen3.6-27B-Q5_K_S.gguf \ --n-gpu-layers 999 \ --split-mode tensor \ --flash-attn on \ --cache-type-k q8_0 \ --cache-type-v q8_0 \ --ctx-size 16384 \… 8 r/LocalLLaMA community 13d ago What speeds are everyone getting with deepseek v4 flash 0731? What speeds are everyone getting with deepseek v4 flash 0731? I’m getting~200 tps prompt processing / ~11 tps token gen, on 4x5060ti16gb with ddr4 3200 ram at 4-channel, via llamacpp, with context window of 128000, -ub/-b at 4096, “q8” unsloth’s lossless quant   submitted by… 36 r/LocalLLaMA community 13d ago Me: Worn out from all the new model drops this week, but still hyped for all the great new releases. I mean seriously y’all, what an amazing past few days. So many awesome new models to test out in the mid range model sizes.   submitted by   /u/Porespellar [link]   [comments] 15 Latent.Space news-outlet 13d ago [AINews] not much happened today apart from DeepSeek V4-Flash 0731, a quiet day. 4 r/LocalLLaMA community 13d ago DeepSeek-V4-Flash-Q4KExperts-F16HC-F16Compressor-F16Indexer-Q8Attn-Q8Shared-Q8Out-chat-v2-imatrix-0731.gguf Antirez stealthily uploaded the new weights in the old folder... and there we were tapping our fingers. https://huggingface.co/antirez/deepseek-v4-gguf/tree/main   submitted by   /u/challis88ocarina [link]   [comments] 14 Page 9 of 10 · 500 articles ← Newer Older →
