News / #model-release Tag Model releases 500 articles archived under #model-release · RSS Sign in to follow r/LocalLLaMA community 3d ago Best open-source harness like Claude Code? Avid claude code user here looking to do equivalent things with local models. Just want to plug in something like Qwen and have the interface be 1:1 with claude code. Any suggestion?   submitted by   /u/Neighbor_ [link]   [comments] 36 r/LocalLLaMA community 3d ago I compared GGUF quants of Qwen3.6 27B to NVFP4, AWQ, AutoRound, and FP8 There's an interactive chart and some extra data in the blog post if you're interested. There are plenty of KL-divergence benchmarks for GGUF models, but most of them compare one GGUF quant against another. I wanted to know how those quants stack up against other commonly used… 28 r/LocalLLaMA community 3d ago Glimmer: 233.4 tps on 5090 with Dflash That's insane yo! I haven't had a chance yet to test it on my 4090 at home but it sounds so promising. And read here that 256k CTX is easily reachable on 24gb unlike Qwen. Super excited!   submitted by   /u/YetAnotherAnonymoose [link]   [comments] 24 Vercel — AI dev-tools 3d ago Vercel Sandbox now runs on Vercel Managed Images Today we are introducing Vercel Managed Images (VMI), a set of versioned, open-source base images you can use as-is or extend. The source for every image lives in the public vercel/sandbox repository. Managed images replace Sandbox runtimes, which are now deprecated. Starting… 15 r/MachineLearning community 3d ago Transformers are famously bad at arithmetic, so I set one's weights by hand (no training) and it multiplies with 100% accuracy [P] Obviously nobody needs a transformer that's good at multiplication. I wanted to know whether a stock transformer could do exact arithmetic if I chose its weights directly. I implemented the grade-school algorithm as a computation graph and compiled it into an ordinary Phi-3… 27 Hacker News — AI on Front Page community 3d ago Show HN: Needle2: 14MB agentic LLM for phones, wearables, smart home and robots Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the… 17 r/LocalLLaMA community 3d ago Needle 2: 14MB agentic LLM for phones, wearables, smart home and robots. Hey LocalLlaMa, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now… 15 r/LocalLLaMA community 3d ago inclusionAI/Ling-3.0-tiny · 8B A1.3B MoE· Hugging Face Looks like the Ling team open weighted a much smaller version of the Ling-3.0-flash they open weighted a few days ago. It's 8B params with 1.3B active, and seems to fall between the 4B and 8-12B Qwen and Gemma models in terms of performance. Should have a massive tokens/sec on… 33 r/LocalLLaMA community 3d ago DeepSeek V4 Flash 0731 is the ‘killer app’ that is going to sell A LOT of DGX Sparks Having a ‘Killer Application’ that everyone wants to use helps sell hardware, plain and simple. DeepSeek V4 Flash 0731 isn’t an app of course, but I think it’s going to be the major catalyst for getting a lot of people to buy a couple of NVIDIA GB10-based systems because: It is… 33 r/MachineLearning community 3d ago How to file a complaint about a published CVPR paper? [R] Hi, I would like to file a complaint about an accepted and published CVPR 2026 paper that its main contribution is a dataset but it was never released, and honestly I don’t know who to contact. The dataset was never released prior to the conference, or during the conference or… 9 r/LocalLLaMA community 3d ago Best Local LLMs - August 2026 Wowee!! Just when you thought it couldn't get better for open weight models, we probably have had our best period yet!?!?! Models that rival the closed frontier, Opus level models on non-insane hardware and more. A massive industry alliance coming out in support of open AI in… 25 r/LocalLLaMA community 3d ago Muse Glimmer ACTUALLY fits on a single RTX 3090 I did some testing this morning, and I was surprised to find that Muse Glimmer actually comfortably fits on a single RTX 3090 with full context + DFlash + mmproj at Q4_K_XL, unlike Qwen3.6-27B and Gemma-4-31B. Muse Glimmer supports up to 256k context according to Unsloth. Here… 14 Hacker News — AI on Front Page community 3d ago Mistral Patent for “Code implemented tool calls” Article URL: https://patentsgazette.uspto.gov/week26/OG/html/1547-5/US12670045-20260630.html Comments URL: https://news.ycombinator.com/item?id=49243397 Points: 201 # Comments: 169 28 NVIDIA Developer Blog official-blog 3d ago Run Local Agentic AI Workflows with Meta’s Muse Glimmer on NVIDIA Meta returns to the open source ecosystem with the release of Muse Glimmer, a 30B open-weight dense model with a 120K+ context window built for local AI... 37 LangChain releases dev-tools 3d ago langchain-openai==1.4.3 Changes since langchain-openai==1.4.2 release(openai): 1.4.3 ( #39485 ) fix(openai): filter invalid tool calls from content ( #39366 ) chore(openai): update guidance for responses API for OpenAI-compatible providers ( #39327 ) chore(openai): update docstring for… 22 r/LocalLLaMA community 3d ago Mark Zuckerberg on releases https://x.com/i/status/2086755195535413696   submitted by   /u/jacek2023 [link]   [comments] 9 Hacker News — AI on Front Page community 3d ago Squeak 6.1 Article URL: https://squeak.org/release_notes/6.1/ Comments URL: https://news.ycombinator.com/item?id=49242653 Points: 202 # Comments: 101 10 OpenAI official-blog 3d ago Model ML completes finance work more efficiently with GPT-5.6 Sol Model ML uses GPT-5.6 Sol to carry finance work from research and analysis through editable, traceable PowerPoint decks and Excel workbooks. 32 Ollama releases dev-tools 4d ago v0.32.7 Muse Glimmer Note: Muse Glimmer is currently available via initial support via Ollama's MLX engine on Apple Silicon. Support for NVIDIA, AMD, and other platforms will be available in the coming days. Muse Glimmer , Meta's newest open model and the first released by Meta… 33 r/LocalLLaMA community 4d ago Comparing how Cline, Kilo, and Qwen Code handle long-task context/state (and why context loops keep happening) I've been comparing Cline / Kilo / Qwen Code lately since they all handle long-task state differently. Cline: has Focus Chain, a markdown file kept outside the conversation that gets reinjected on a cadence, plus Memory Bank for project context, plus a standalone gRPC server so… 31 r/LocalLLaMA community 4d ago Introducing Muse Glimmer: an open-weight model optimized for always-on local agent workflows Hi r/LocalLLaMA 👋 Today we’re excited to release Muse Glimmer, a 30B open-weight model built specifically for local agent workflows. We’re releasing the weights to the community under a permissive Apache 2.0 license. A few specs 30B params, dense Multimodal: interleaved text +… 35 Hacker News — AI on Front Page community 4d ago Meta Muse Glimmer – open weights 30B local coding model Article URL: https://research.meta.ai/blog/introducing-muse-glimmer-open-agentic-model Comments URL: https://news.ycombinator.com/item?id=49241679 Points: 267 # Comments: 105 11 OpenAI official-blog 4d ago Expanding Daybreak as the Cyber Defense Window Narrows Meet GPT-5.6-Cyber, OpenAI’s cybersecurity-specific model available through Daybreak Red for authorized vulnerability research, exploit validation, and security testing. 9 Smol AI News news-outlet 4d ago not much happened today **Meta** re-enters the open-weight frontier with the release of **Muse Glimmer**, a **30B dense**, multimodal, agent-focused model under **Apache 2.0**, optimized for always-on local agents and consumer hardware. It features **quantization** to keep the model under **20GB**, a… 20 Hugging Face Daily Papers research 4d ago Can MLLMs Decode the Creative Leap? Introducing C4 for Cross-Concept Understanding Abstract Creative capabilities of MLLMs matter in design, communication, education, and human--AI collaboration, yet remain difficult to evaluate because explicit targets and reward signals are scarce compared with accuracy-oriented tasks. Cross-concept understanding is a core… 17 r/LocalLLaMA community 4d ago Running Qwen 3.5 35B A3B-Q8_0 gguf on a cheap radeon 7600 at 18 token/s I also have 64 gb ddr4 ryzen 5600 Using llama.cpp Ubuntu distro Settings are as follows --n-gpu-layers 999 \ --n-cpu-moe 37 \ --no-mmap \ -ctk q8_0 \ -ctv q8_0 \ -fa 1 \ -c 9000 \   submitted by   /u/Sweaty_Perception655 [link]   [comments] 30 arXiv — Machine Learning research 4d ago Beyond Attention: Signed Integrated Gradients Attribution in a BiomeGPT-Style Microbiome Transformer arXiv:2608.06486v1 Announce Type: new Abstract: In a feature-tokenized transformer (arXiv:2106.11959) such as BiomeGPT (doi:10.64898/2026.01.05.697599), each input token is built by fusing a fixed identity with a sample-specific measurement: a fixed species and a variable… 13 arXiv — NLP / Computation & Language research 4d ago Can MLLMs Decode the Creative Leap? Introducing C4 for Cross-Concept Understanding arXiv:2608.06501v1 Announce Type: cross Abstract: Creative capabilities of MLLMs matter in design, communication, education, and human--AI collaboration, yet remain difficult to evaluate because explicit targets and reward signals are scarce compared with accuracy-oriented… 34 Hacker News — AI on Front Page community 4d ago Auto mode is now the default in Claude Code Article URL: https://claude.com/blog/auto-mode-default-in-claude-code Comments URL: https://news.ycombinator.com/item?id=49239021 Points: 211 # Comments: 213 4 Simon Willison community 4d ago Quoting OpenClaw (running Opus 4.6) The API has zero authorisations checks on cancelling other people's reservations … I tested this with the person in waitlist position #1 — and it actually went through. So you've moved from #4 to #3 already. — OpenClaw (running Opus 4.6) , hacking an Australian gym-booking… 37 Simon Willison community 4d ago Quoting Claude Opus 5 system prompt Claude Fable 5 and Claude Mythos 5 were first released on June 9, 2026. On June 12, 2026, Anthropic suspended access to both models to comply with U.S. Department of Commerce export controls; the Department lifted those controls on June 30, 2026, and Anthropic restored access on… 11 Simon Willison community 4d ago Quoting Claude Opus 5 system prompt Claude Fable 5 and Claude Mythos 5 were first released on June 9, 2026. On June 12, 2026, Anthropic suspended access to both models to comply with U.S. Department of Commerce export controls; the Department lifted those controls on June 30, 2026, and Anthropic restored access on… 30 r/LocalLLaMA community 4d ago [NEW MODEL] SupraElegans-500K *SupraLabs released a new experimental model!\ * SupraElegans-500K is a ~500,000-parameter causal language model built around a sparse, signed, recurrent neural graph. No Transformer, no attention mechanism, no positional encoding, no KV cache. Context is carried by a persistent… 28 r/LocalLLaMA community 4d ago KLQ: Training-free measured rotation quantization. Beats all training-free rotation-based quantization methods on W4A4KV4-bits. Llama 3.2 1B KLQ-quantized beats SpinQuant and gets close to ReSpinQuant without GPTQ/LDLQ rounding. First of all, I'm not a lab, this was a solo summer research project that finally culminated into the github repo and the writeup. The repo includes a much deeper dive with methods, findings about quantization and geometry, limitations, and proposed experiments. I'll also… 32 r/LocalLLaMA community 4d ago endless-frontier/BigBang-v1 - qwen 3.5 finetunes table bench https://huggingface.co/bartowski/endless-frontier_BigBang-v1-GGUF I'm downloading this model only because Bartowski converted it to .gguf, so it might be interesting. Doubts : The headline number is basically meaningless. "Performance between DeepSeek Flash (old one)… 26 r/LocalLLaMA community 4d ago The Gemma team will host a special event on August 20 Tweet by u/hackerllama Could be copium, but I would love to see Gemma 4.1 there with unified audio input for all model sizes perhaps even up to 120B, much improved tool calling (even with the latest template there are still bugs ), higher precision QAT from the start and… 20 TechCrunch — AI news-outlet 4d ago Anthropic is turning Claude Code’s auto mode on by default Programming with Claude Code will soon require even less human oversight. 29 r/LocalLLaMA community 4d ago DeepSeek-V4-Flash-0731 Q8_K_XL sometimes stops mid-task in OpenCode - anyone else seeing this? Hey everyone, I've been experimenting with the new DeepSeek-V4-Flash-0731 release locally using the Unsloth Studio Q8_K_XL GGUF with OpenCode. Overall, it's been working really well, but I've noticed a strange behavior during longer agentic coding sessions. Once the context gets… 38 r/LocalLLaMA community 4d ago DeepSeek v4 Flash 0731 locally on CPU After seeing the benchmark results for the full release of DS v4 Flash 0731, I replaced my 2 x 16GB DDR4 ram sticks with 2 x 32GB DDR4 ram sticks to get a max supported of 128 GB RAM, in hope to be able to run GLM 5.2 equivalent model locally i.e. DS v4 Flash 0731 I also have… 25 r/LocalLLaMA community 5d ago AMD llama.cpp: reducing MTP buffer overhead gave me 64K → 149K context for Qwen 27B Available context length with and without the patch: Model: QWEN 27B ROCm stock patched Vulkan stock patched IQ4_XS Pure, single 16GB GPU 19.456 76.032 68,352 78,592 Q6_K_L on 16GB + 12GB 64,256 149,248 68,864 151,296 The issue is that llama.cpp overestimates the memory needed… 6 r/LocalLLaMA community 5d ago DeepSeek V4 Flash 0731 hits 82.7% on Terminal-Bench 2.1 in an independent public-harness run (445 trials) Disclosure: I’m the author of Ante. DeepSeek recently reported an 82.7% score on Terminal-Bench 2.1 for DeepSeek V4 Flash 0731. Its evaluation used “DeepSeek Harness minimal mode,” which hasn’t been released yet. We wanted to see whether the reported result could be… 14 r/LocalLLaMA community 5d ago Updated benchmark: Deepseek V4 Flash on SlopCodeBench (local) Howdy - I posted a benchmark here - https://www.reddit.com/r/LocalLLaMA/comments/1vbtiy7/deepseek_v4_flash_on_slopcodebench/ This was using the hosted API - since then I've been playing around with quants Here is the lastest benchmark -… 20 r/LocalLLaMA community 5d ago Memory Bandwidth problems with Intel Sapphire Rapids I have a Xeon w7-3465 and 4 sticks of RDIMM DDR5-4800 with a theoretical max bandwidth of 153GB/s. I am trying to run DeepSeek-V4-Flash-0731 as it is an MoE and the weights are in MXFP4, so I should roughly process 150GB/6.5GB tokens per second as it has 13B Experts. The problem… 11 r/LocalLLaMA community 5d ago No wonder Qwen and Gemma are so different Pasted the same HTML/JS code (330 lines) into Qwen 35B A3B and Gemma 26B A4B. Qwen: tokenized the input to 1609 tokens Gemma: tokenized the input to 4258 tokens. Damn. I've never noticed this before and I haven't seen people mention it. That alone helps explain why Qwen is… 4 Simon Willison community 5d ago Auto mode is now the default in Claude Code for Pro, Max, and Team plans Auto mode is now the default in Claude Code for Pro, Max, and Team plans Anthropic are really confident in Claude Code's auto mode , to the point that they are making it the default setting for new sessions in most Claude Code plans starting on August 14th. This was one of the… 15 Simon Willison community 5d ago Auto mode is now the default in Claude Code for Pro, Max, and Team plans Auto mode is now the default in Claude Code for Pro, Max, and Team plans Anthropic are really confident in Claude Code's auto mode , to the point that they are making it the default setting for new sessions in most Claude Code plans starting on August 14th. This was one of the… 11 r/LocalLLaMA community 5d ago Extremely slow DSpark draft model performance (1-2 t/s) with DeepSeek-V4-Flash on llama-server compared to MTP? Hey everyone, I could use some advice on setting up speculative decoding correctly with llama-server . My Hardware: GPUs: RTX 4090 + RTX 6000 Pro (120GB total VRAM) RAM: 32GB I am currently testing the DeepSeek-V4-Flash-0731 unsloth model using the 137GB Q4 UD-IQ4-NL quant. When… 17 r/LocalLLaMA community 5d ago Is Microsoft-Phi dead? Phi was one of my favorite models with a bit of a mixed reputation with some claiming it's benchmaxxed and others seeing its potential and usecases. I was a big fan of Phi but the last major release was in december 2024 with every other release being a Phi 4 iteration (like Phi… 9 r/LocalLLaMA community 5d ago Comparing 4bit quants for MLX Curious what people think are the ideal 4-bit quantization types on MLX These quants seem to be the most popular, at least for Gemma4 and Qwen3.6: - OptiQ 4bit ( mlx-community/Qwen3.6-27B-OptiQ-4bit ) - Unsloth dynamic 2.0 MLX ( unsloth/Qwen3.6-27B-UD-MLX-4bit ) - oQ (… 4 r/LocalLLaMA community 5d ago any reasonably fast public benchmarks I should run quants of deepseek flash 0731 on? I have various quants of this model and am curious how they perform. can anyone recommend which benchmark would be a good test case for quantization effects? Maybe that can be completed with about 1 million tokens?   submitted by   /u/nomorebuttsplz [link]  … 35 Page 4 of 10 · 500 articles ← Newer Older →
