News / #model-release Tag Model releases 500 articles archived under #model-release · RSS Sign in to follow r/LocalLLaMA community 9d ago Qwen Developers' responses from their recent Twitter/X AMA Questions & Responses(in BOLD ) below. Favorite question(s) moved to end of the thread with combined responses(removed duplicates). Be optimistic folks. I'm sure we're getting other models too apart from 27B. And 27B gonna make massive noise on release. (Based on their… 11 r/LocalLLaMA community 9d ago I updated my localy run benchmark with DeepSeek V4 Flash 0731 It's the purple cluster on the top left (the good corner...) I'm running the MXFP4 version from Bartoswski with Dspark at 1K t/s prefill and 90 t/s gen (average). I tried different sampling params, you can check the detail. It's very efficient while scoring the best yet. Too bad… 12 r/LocalLLaMA community 9d ago Building a Fully Local PDF Read-Aloud & PDF-to-Audiobook Desktop App with Kokoro 82M, Qwen, and llama.cpp Hey everyone, I’ve been building Speechfony - a desktop app for reading PDFs (and EPUBs) with offline text-to-speech. Open a document, listen sentence-by-sentence with highlighting, or export selected pages to an MP3. Everything runs locally: Kokoro for speech, and an on-device… 5 r/LocalLLaMA community 9d ago Qwen3-TTS voice cloning is now in mainline llama.cpp — the old demo finally became real support People may remember the Qwen3-TTS llama.cpp demo from a few months ago. That PR said it probably wouldn’t be merged because llama.cpp was missing some of the graph and API pieces it needed. A new implementation was merged into master yesterday. What works now: -… 16 Smol AI News news-outlet 9d ago GDM leadership reset **Google DeepMind** undergoes a leadership reshuffle with **Demis Hassabis** moving to Chair and Chief Scientist roles, while **Koray Kavukcuoglu** takes operational control focusing on **Gemini** and product execution. The launch of **Discovery Loop** by founders including… 26 arXiv — NLP / Computation & Language research 9d ago Stuck on "A": Diagnosing and Repairing Interface Injury in Attention-to-KDA Linearization of a 0.6B Language Model arXiv:2608.02689v1 Announce Type: new Abstract: We convert 21 of 28 full-attention layers of Qwen3-0.6B-Base into KDA (Kimi Delta Attention) linear-attention layers on a single consumer-grade GPU budget, and ask a simple question: what exactly does the conversion break? After… 38 arXiv — NLP / Computation & Language research 9d ago Looking under the Wrong Lamppost: On the Limitations of Automated Translation Quality Estimation arXiv:2608.03577v1 Announce Type: new Abstract: Automation of Translation Quality Estimation (QE) has emerged as a widely discussed approach to managing translation quality at scale, and a growing number of tools and technologies have been released in pursuit of this goal.… 9 arXiv — NLP / Computation & Language research 9d ago Detecting Hallucinations and Recovering Verified Answers in Arabic Islamic Question Answering arXiv:2608.03720v1 Announce Type: new Abstract: Large language models can generate fluent responses to Islamic questions while introducing factual errors that are difficult to identify. This paper presents our system for \textsc{HalluScoring 2026} Task 2.1, \textit{Islamic… 5 arXiv — NLP / Computation & Language research 9d ago HalluTruthQA-4K: A Fine-Grained Corpus and Annotation Process for Arabic Hallucination Detection and Truth Verification arXiv:2608.03966v1 Announce Type: new Abstract: Large language models can generate fluent Arabic answers while introducing factual errors that are difficult to identify and verify. Existing Arabic hallucination resources often assign a binary label to an entire response,… 27 Vercel — AI dev-tools 9d ago AI Gateway is now available on AWS Marketplace AI Gateway is now available on AWS Marketplace . Teams can procure AI Gateway through their existing AWS account, consolidating inference spend onto their AWS bill and streamlining procurement. Purchases are available as private offers with annual contract terms, plus… 34 Vercel — AI dev-tools 9d ago Introducing the new v0 API Today we're introducing the new v0 API : programmatic, headless access to v0's app-building agent. Send a prompt and v0 generates an app, starts a dev server in a Vercel Sandbox , and gives you a preview URL you can embed in your own UI. Each chat is an isolated workspace for… 20 r/LocalLLaMA community 9d ago Intern S2 Mobius A Qwen3.5-35B derived model with an interesting architectural difference that results in larger throughput and less token consumption (allegedly): https://huggingface.co/internlm/Intern-S2-Mobius   submitted by   /u/Miserable-Dare5090 [link]   [comments] 7 r/LocalLLaMA community 9d ago GPT-X2.5-135M scores 3rd place on Open SLM Leaderboard on Huggingface, Beating Facebook's MobileLLM-R1-140M   submitted by   /u/Megneous [link]   [comments] 28 Latent.Space news-outlet 9d ago [AINews] Megakernels are so dead and so back A quiet day lets us highlight a Cursor launch and an engineering debate 12 r/LocalLLaMA community 9d ago Thinking of buying more DRAM right now... So I'm looking at https://huggingface.co/unsloth/DeepSeek-V4-Flash-0731-GGUF and I realize my 128GB of DRAM just isn't cutting it for this (incredibly powerful) model. If only I had another 64GB, I thought... EVERYBODY is probably thinking that right this second... I hate to say… 4 r/LocalLLaMA community 9d ago PSA Update CUDA from 13.2 to 13.3 to solve DeepSeek V4 Flash 0731 Looping Problem! So one of yall mentioned that cuda 13.1 or 13.2 is broken for unsloth so I looked in to it, and they were right. I had 13.2 installed, after I switched to 13.3 no more looping!!! Before the cuda update, the model was literally unusable. A few minutes into the run it would start… 20 r/LocalLLaMA community 9d ago DeepSeek-V4-Flash on SM89 4x48gb 4090s with DSpark https://github.com/yhfgyyf/vllm-deepseek-v4-sm89 I couldn't believe that someone actually got vLLM working with this particular set of GPUs, but here it is. The video is from right after I got it working with 64k context, but it is now running with 256k.   submitted by  … 26 Vercel — AI dev-tools 9d ago Full Sandbox egress firewall now available on Hobby plan All Vercel Sandbox firewall features are now available on the Hobby plan. This brings the same network isolation that protects production workloads to the free tier, giving Hobby builders control over exactly what leaves the sandbox while keeping secrets out of the code… 31 Vercel — AI dev-tools 9d ago Muse Spark 1.2 is now available on Vercel AI Gateway Muse Spark 1.2 from Meta is now available on AI Gateway. It is a coding-focused update to the previous Muse Spark model. While keeping its general capabilities, 1.2 ships with improvements in code generation, complex debugging, codebase understanding, and end-to-end developer… 22 Simon Willison community 9d ago New release of LLM adds support for reasoning traces, OpenAI Responses, server-side tools, and smarter logging I released LLM 0.32 this morning, the most significant new version of LLM since the initial launch of the project. The new version includes support for visible reasoning traces, server-side provider tools, redesigned content-addressable SQLite logs, new models, and new features… 9 Simon Willison community 9d ago New release of LLM adds support for reasoning traces, OpenAI Responses, server-side tools, and smarter logging I released LLM 0.32 this morning, the most significant new version of LLM since the initial launch of the project. The new version includes support for visible reasoning traces, server-side provider tools, redesigned content-addressable SQLite logs, new models, and new features… 29 r/LocalLLaMA community 9d ago DeepSeek-v4-Flash-Mini 54GB GGUF running at ~20.5 t/s Took the REAP adaptation of DeepSeek-V4-Flash ( 0xSero/DeepSeek-V4-Flash-0731-REAP ) along with antirez/deepseek-v4-gguf as inspiration, and decided to see how aggressive we could get with standard quant tricks to create a budget-friendly "Mini" build. For the lulz, naturally.… 11 Simon Willison community 9d ago llm-anthropic 0.26 Release: llm-anthropic 0.26 Includes new features enabled by LLM 0.32 : New models: claude-fable-5 , claude-sonnet-5 , and claude-opus-5 . #75 , #76 Added server-side tools for WebSearch , WebFetch , CodeExecution , and AnthropicMCP , available through LLM's -T interface or… 6 Simon Willison community 9d ago llm-anthropic 0.26 Release: llm-anthropic 0.26 Includes new features enabled by LLM 0.32 : New models: claude-fable-5 , claude-sonnet-5 , and claude-opus-5 . #75 , #76 Added server-side tools for WebSearch , WebFetch , CodeExecution , and AnthropicMCP , available through LLM's -T interface or… 24 r/LocalLLaMA community 9d ago GPT-OSS has turned one year old today! It is one of the best local models ever released, in both 20B and 120B versions. I always come back to it, especially the 120B version. Its only competition is, in my opinion, Qwen 3.5 122B, but that model is much slower (A10B) and has not been released in a local-friendly QAT… 9 r/LocalLLaMA community 9d ago A 2.6B model with tool calling and 128K context now runs at 30 tok/s on a phone Liquid AI released LFM2.5-2.6B today, and this might be more relevant to local AI than another massive model most people cannot run. The model is only 2.69B parameters, has 128K context, supports tool calling and was post-trained specifically for multi-step agent workflows. The… 23 Hacker News — AI on Front Page community 9d ago I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel https://twitter.com/willdepue/status/2084750925013434768 , https://xcancel.com/willdepue/status/2084750925013434768 https://gwern.net/guardian-angel Comments URL: https://news.ycombinator.com/item?id=49174900 Points: 209 # Comments: 127 31 r/LocalLLaMA community 9d ago Local LLM 35B MoE — Real-world coding benchmarks (Qwen vs Ornith vs KAT) I’ve been running a fairly opinionated evaluation loop on ~35B A3B/MoE-class models for coding over the past few months. Not synthetic benchmarks: actual dev workflows, iterative debugging, refactoring passes, and failure recovery. Here’s where things stand for me: Qwen 3.6 (35B… 9 Simon Willison community 9d ago PipeNetwork/minimax-h3-mlx PipeNetwork/minimax-h3-mlx MiniMax released MiniMax-H3 two days ago - they describe it as a "a general-purpose, omni-modal generative system", which in practice means it accepts text, images, audio and video and can use them to generate up to 15 second video clips with audio… 28 Simon Willison community 9d ago PipeNetwork/minimax-h3-mlx PipeNetwork/minimax-h3-mlx MiniMax released MiniMax-H3 two days ago - they describe it as a "a general-purpose, omni-modal generative system", which in practice means it accepts text, images, audio and video and can use them to generate up to 15 second video clips with audio… 26 r/LocalLLaMA community 9d ago Introducing Shieldstral. | Mistral AI   submitted by   /u/tengo_harambe [link]   [comments] 28 r/LocalLLaMA community 9d ago Has anyone tried Mach-1 Additive? 95% of performance of Qwen 3.6 35B while being 10x smaller Why nobody is talking about this? Seems pretty significant to the community   submitted by   /u/MuzafferMahi [link]   [comments] 6 llama.cpp releases dev-tools 9d ago b10270 mtmd: support Qwen3-TTS (note: breaking change to llama-tts binary) ( #26254 ) convert text model main model load ok convert encoder ok speaker encoder loading ok speaker enc graph adapt vocab for backbone (with some tricks) add suppress_tokens poc new mtmd gen api convert… 17 r/LocalLLaMA community 9d ago LFM2.5-2.6B is out Released today, with emphasis on agentic capabilities. I really like their models for simple, high volume tasks ("summarize these gazillion documents") and their 8b-a1b was my go-to for certain tasks so I'm excited to see how this one performs. There's not enough love for tiny… 18 Simon Willison community 9d ago llm 0.32 Release: llm 0.32 See my detailed blog post about this release . Tags: llm 18 Simon Willison community 9d ago llm 0.32 Release: llm 0.32 See my detailed blog post about this release . Tags: llm 29 r/LocalLLaMA community 9d ago Deepseek V4 flash 0731 ranks #21 on Agent Arena https://preview.redd.it/522fsdwvtdhh1.png?width=1200&format=png&auto=webp&s=6a6cf7a467514167a8193029dbd20fb3a9ba4f6c It ranks lower than both Sonnet 4.6 and Luna. I'd wager Luna costs in the same ballpark as DS4F considering Luna’s token efficiency. DeepSeek being open source is… 30 r/LocalLLaMA community 9d ago Decrease the power limit of your 5090 to at least 480W - the performance penalty for inference is negligible. I run my inference machine in the living room, so noise and heat output are a significant concern. Ran a quick test using my daily driver model (Qwen 3.6-27b) and at 480W, the card outputs only 2.1% less t/s in decode and 8.8% in prefill (which is already very fast). Well worth… 6 r/LocalLLaMA community 9d ago DeepSeek V4 Flash 0731 (Q4) now reaches 1,328 tok/s prefill and ~29 tok/s decode on one RTX PRO 6000 I've been working on speeding up DeepSeek-V4-Flash-0731 in Krasis and have now got the long-prompt prefill quite a bit faster on a single RTX PRO 6000 96GB. These are timing-disabled internal Krasis results using INT4 experts. They aren't HTTP round-trip speeds: Prompt size… 15 r/LocalLLaMA community 9d ago inclusionAI/Ling-3.0-flash · Hugging Face The Ling-3.0-flash MoE is now open-weighted at 124B A5B params. I know the original announcements were before the Kimi K3, DeepSeek-V4-Flash and Qwen3.8 hype, but this model might still have a good niche for itself due to its sizing. Discussion on the benchmarks are here:… 12 r/LocalLLaMA community 9d ago Deepseek V4 Flash 2-bit quant is the first model I can run locally that achieves 100% in this SQL benchmark I really like to use this one SQL benchmark when testing new models. I had another post some time ago with my benchmarks, but I decided to post a new one because of how well Deepseek did. I like the benchmark because it's quick to run, is pretty "real-world" and requires good… 37 r/LocalLLaMA community 9d ago [Deepseek-V4-Flash-0731] Full 1M context on a single RTX5090 + DDR5 Desktop Setup with VLLM CPU/Ram Offloading, ~800 tps pp & 15+ tps decode [Agentic Coding] First of all, obviously I took some help from AI to type this post and this is the topic that enabled me to accomplish all that: https://old.reddit.com/r/LocalLLaMA/comments/1veow4b/deepseek_v4flash_284b_moe_at_33_toks_single_68/ This post of mine is based on the link above. My… 11 r/LocalLLaMA community 10d ago I built a DwarfStar-inspired Vulkan/Metal inference engine for Qwen3.6-35B-A3B on 16 GB machines Disclosure: I’m the author and maintainer of QuarkStar. I built QuarkStar , a small native inference engine inspired by Antirez’s DwarfStar. QuarkStar currently supports: Qwen3.6-35B-A3B , using the same Antirez-inspired Q2 and Q2/Q4 quantization recipes KAT-Coder-V2.5-Dev , the… 6 TechCrunch — AI news-outlet 10d ago Is the future of data centers portable? Runware builds a pod to find out On Tuesday, AI infrastructure company Runware announced the launch of its own modular data center called Sonic Inference Pod. 18 r/LocalLLaMA community 10d ago Llama.cpp PR 8% speed boost Llama.cpp currently uses cpu based sampling for user with mtp enabled. The PR moves sampling to the gpu, which on a 5090 boasts an 8% increase in tok/s for qwen3.6:35b. I tested it on my P40 and observed a 4% increase inference speed boost. Pretty exciting to see 84 tok/s max on… 19 TechCrunch — AI news-outlet 10d ago EON wants to move the data superhighway from ocean fiber to space lasers Endeavour Optical Networks is planning to launch the fastest space laser communications system yet built. 35 r/LocalLLaMA community 10d ago DeepSeek V4 Flash 0731GGUFs with updated template (supports reasoning levels)   submitted by   /u/tarruda [link]   [comments] 10 Hacker News — AI on Front Page community 10d ago DeepSeek V4 Flash on a Single AMD MI300X Article URL: https://github.com/ryanzhou/deepseek-v4-flash-mi300x Comments URL: https://news.ycombinator.com/item?id=49166386 Points: 290 # Comments: 64 32 Hacker News — AI on Front Page community 10d ago FFmpeg 9.0 Article URL: https://github.com/FFmpeg/FFmpeg/blob/n9.0/RELEASE_NOTES Comments URL: https://news.ycombinator.com/item?id=49166202 Points: 219 # Comments: 41 21 llama.cpp releases dev-tools 10d ago b10258 llama : move n_vocab from llama_sampler_data to penalty_sampler ( #26520 ) This matches how it is done for logit_bias and mirostat samplers, see #25262 (comment) Website: https://llama.app macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled)… 13 Page 7 of 10 · 500 articles ← Newer Older →
