News / #model-release Tag Model releases 500 articles archived under #model-release · RSS Sign in to follow r/LocalLLaMA community 1h ago DeepSeek-V4-Flash-Vision Q8 vs Qwen3.8-Flash-Next Q8 I'm using DS-V4-Flash-Vision with Q8_K_XL quantization locally as my everyday engine, and for some time now I've been doing a lot of comparisons with Qwen3.8-Flash-Next, also with Q8_K_XL quantization. It took me quite a while to get Q3.8FN to work reasonably well, and here are… 38 r/LocalLLaMA community 3h ago 2x R9700, 64 GB DDR5 is an absolute beast machine with vLLM Radiance / R9V and Qwen 3.8 27b and Flash next I've been tinkering with local LLMs since the beginning of the year when I had an Intel Arc B580 and 32 GB of DDR5. Curiosity got the best of me and I bought the first R9700 about half a year ago, also because I wanted to upgrade my gaming graphics for 4k. As the 5090 was about… 14 r/LocalLLaMA community 3h ago Planning to get a cheap-ish GPU. Would appreciate some advice. Hi, I've been wanting to run my own local LLM for some time and I finally saved enough to get a budget GPU. I can spend 700$ at most, and I'm looking for a GPU that can run quantized 30B~ parameter models with decent speed. Being able to run Qwen 3.8 27 B Q4_K_M and similar… 14 r/LocalLLaMA community 4h ago [Model] Support for Spark2_5ForCausalLM implementation by KnightYao · Pull Request #27868 · ggml-org/llama.cpp https://huggingface.co/XHToken/Spark-X2.5-4B-GGUF https://huggingface.co/XHToken/Spark-X2.5-1.7B-GGUF from XHToken: We are introducing Spark-X2.5-4B and Spark-X2.5-1.7B, two compact, general-purpose language models designed to make capable AI more practical, efficient, and… 36 r/LocalLLaMA community 4h ago Using GPT Astra to teach Qwen Next how to sculpt in 3D in Blender. Instead of distillation, fine-tuning, etc., I found a faster approach: having Codex+Astra to teach OpenCode + MCP Blender to make the modifications. Goal: achieve the same result using specific skills and steps. Astra is phenomenal, just as phenomenal as it is at quickly burning… 34 r/MachineLearning community 5h ago [D] IJCNLP-AACL 2026: Paper Commitment Results (ARR May 2026 Cycle) [D] AACL-IJCNLP 2026 acceptance results will be released in a few hours. Feel free to share your thoughts and feelings! How did you do?   submitted by   /u/Starscream-11813 [link]   [comments] 14 The Information — AI news-outlet 6h ago How Anthropic Clinched $517 Billion in Compute Deals in 11 Months Anthropic in the last year has scrambled to line up cloud computing deals with SpaceX, Google and others to meet the skyrocketing demand for Claude Code and Cowork that took the company by surprise this year. As the AI powerhouse gears up for a possible record-setting initial… 19 r/LocalLLaMA community 8h ago 8 uncensored Qwen 3.8 27B variants, one base, 167 GPU hours - Abliterlitics This comparison was requested by a few people, and certainly we were all eager to see the final results. The comparison had taken 11 days and the GPU was crunching numbers for ~167 hours. We've been comparing different abliterated models from huggingface to see if they really… 10 r/LocalLLaMA community 11h ago vibeblending locally with Qwen 3.8 27B You need Blender 5.x with MCP extension. I use pi so I also need: pi install npm:pi-mcp-adapter and then: $ cat .mcp.json { "mcpServers": { "blender": { "command": "/home/jacek/.local/bin/uvx", "args": [ "--with", "mcp[cli]<2.0.0", "--from",… 19 r/LocalLLaMA community 11h ago Validate your local LLM advertised KV cache against real pressure; see exactly how old contexts get evicted from cache Hello, I'm a bit obsessed with cache management on local LLMs. For the last few days I've been working on cache management on vLLM with my 2x DGX Spark and DeepSeek v4 Flash 0731. I felt something was off so I investigated, found issues, fixed them, but needed a way to validate… 22 r/LocalLLaMA community 11h ago Which qwen for vllm? Hugging face has over 300 versions of qwen3.8-27b. I have no idea how to identify the beat model to download and use. Should I sort by “most likes” or “most downloads”? Is there any sort of other guidance on which model to select? I’m finally getting my local linux box up and… 4 r/LocalLLaMA community 12h ago Villager Simulation Game POC Created with Qwen3.8-27B-UD-Q3_K_XL.gguf - 16GB VRAM https://village-sim-one.vercel.app/ - 16GB VRAM RTX 5070 Ti, fully offloaded - Vision on CPU - Windows, not headless - beellama.cpp - latest version with the kvarn performance enhancements making it as fast as qx_x quants. - MTP n-max = 2 - tg up to 75t/s, pp up to 1700t/s - KV… 14 r/LocalLLaMA community 12h ago Qwen3.8-Flash-Next-oQ4e-mtp: 45 tok/s on M4 Max, 25 tok/s on M2 Ultra for local inference — llm-bench.io Qwen 3.8 Flash Next gives similar speed than Qwen3.8 27B on Apple Silicon.   submitted by   /u/DerTomsn [link]   [comments] 26 r/LocalLLaMA community 19h ago Block KV cache streaming: bound VRAM at long context via a shared CUDA phase arena by giveen · Pull Request #357 · TheTom/llama-cpp-turboquant So after all my work, yeah, Raymond did it better, so I ported his work over, extended it turboX, extended it multiple other models (he had only Qwen models), and benchmarked the crap out of it to make sure it was worth it still. So really the credit goes to Raymond (… 9 r/LocalLLaMA community 19h ago Qwen3.8-27B "Unhacked" my PC Right, so this is going to be embarrassing but it's presumably something we've all been through at one point or another, and I guess this is my first time resolving something like this in the way that I did so figured I'd share if only to share that it's now a thing and that… 21 Hacker News — AI on Front Page community 19h ago GPT-6 Astra on robot arms Article URL: https://openai.robocurve.org/gpt-6-astra/ Comments URL: https://news.ycombinator.com/item?id=49582582 Points: 204 # Comments: 155 30 r/LocalLLaMA community 19h ago M5 Max users: what models are you using & what tk/s are you getting? I was using antirez’s ds4 for a while and getting around 20 tk/s, which worked for my purposes. But I know there have been big advancements between Qwen, the DS4 vision model, and GLM. I’m not sure how the quants affect performance, so what’s the best thing to run right now &… 36 r/LocalLLaMA community 21h ago Qwen 3.8 Flash Next (Max) is impressive just to talk with. I feel like coding overshadows how great this model really is. It knew a lot of very arbitrary facts/information about my home state and resources about those specific things related to jobs. I found this interesting since getting into the nitty gritty details like this can… 4 r/MachineLearning community 21h ago Search agent beats GPT-6 Astra on benchmarks, just days after release [N]   submitted by   /u/Neither_You_5673 [link]   [comments] 4 Hacker News — AI on Front Page community 21h ago Cloud in a Bottle: making self-hosting accessible to everyone Article URL: https://cloudinabottle.org/blog/launch-post Comments URL: https://news.ycombinator.com/item?id=49582000 Points: 208 # Comments: 85 37 Simon Willison community 21h ago Introducing GPT-6 Astra for developers Introducing GPT-6 Astra for developers Blink and you'll miss it, but there's a familiar creature at 1m59s : Across the board, Astra has more attention to detail, better understanding of the user's prompt, and can build more sophisticated outputs. In particular, it excels at… 7 r/LocalLLaMA community 22h ago NInfer fork: 555k context@fp4 for 5090 with YARN, reliable kv host cacheing, monitoring, jinja, opened model support Hiya, NInfer is amazng for Qwen, but lacking for real-world-use. As adoption of issues/pr's was not really what I needed, I created a fork and hit it for this week with 3 concurrent claude code session until it didn't break any longer. Hope you like it. NVFP4 KV cache (from… 31 r/LocalLLaMA community 22h ago Which agent harness do you use and why? I see a new one being launched every few days... How do these new harnesses compare to claude code, pi etc. has anyone switched from these? which harness to prefer and why   submitted by   /u/Background-Job-862 [link]   [comments] 12 Hacker News — AI on Front Page community 1d ago Private German rocket makes history, reaches orbit from European soil Article URL: https://www.space.com/space-exploration/launches-spacecraft/isar-aerospace-second-launch-norway-andoya-spaceport-spectrum-rocket Comments URL: https://news.ycombinator.com/item?id=49580369 Points: 204 # Comments: 84 26 Don't Worry About the Vase community 1d ago Claude Mythos 5.1 and Fable 5.1: Capabilities This is the weirdest situation in which to write a capabilities review. 16 TechCrunch — AI news-outlet 1d ago Hikers rescued after using Google Gemini for planning The sheriff’s office said the hikers “were advised by Gemini to bring far less food and water than their group required." 9 r/MachineLearning community 1d ago GPT-6 reportedly jailbroken within 24 hours using an extended Task-in-Prompt (TIP) attack [N] A researcher has reported a jailbreak of GPT-6 Astra within a day after release. The attack is described as combination of TIP (Task-in-Prompt) attack from ACL 2025 paper with four other unnamed techniques. TIP attacks exploit the model’s reasoning/instruction-following… 17 r/LocalLLaMA community 1d ago Best way to run Qwen3.8-27B on a system with a RTX 5090 + RTX 5070 Ti (32GB + 16GB)? I have a system with 2 GPUs and 48GB VRAM total, a RTX 5090 + RTX 5070Ti. What would you say is the best way to run Qwen3.8-27B on that system with the best quality and 262k context? Would just the normal llama.cpp work with how it detects and does its own magic with dual CPU… 28 r/LocalLLaMA community 1d ago Qwen3.8 Flash Next - Templates Comparison I was running into a lot of posts that praised both the Fixed template and the Sharp template in comparison to the stock one, so I put them to the test. It's not as extensive as it should be for a paper-grade analysis, but it gives out the point of each template. Test setup I… 8 Latent.Space news-outlet 1d ago OpenClaw Power, MacBook Simplicity: Five Days With Grok Bot SpaceXAI’s Grok Bot has the same level of programming power as OpenClaw, but it’s programmable at a different level of abstraction. 32 r/LocalLLaMA community 1d ago gfx906-llama-cpp: New PP/TG gains for MI50/MI60/Radeon VII/AMD GCN Time for another update! We have been busy and managed to improve the gains substantially (mostly from exploring existing llama cpp PRs and adopting relevant things). Among other things the README.md was also appended to provide a better overall picture of what’s in the fork,… 21 r/LocalLLaMA community 1d ago NInfer vs llama.cpp vs vLLM: quality + speed comparison for Qwen3.8-27B NVFP4 on RTX 5090 I've been running Qwen3.8-27B as a local inference server for a production content intelligence pipeline (HVAC industry stuff, lots of long-context retrieval and structured extraction). I have been watching other redditors post their custom configurations, and I wanted to share… 9 r/LocalLLaMA community 1d ago Qwen3.8-Flash-Next (UD-Q4_K_XL) on a single RTX 3090 24GB + 128GB DDR4, is this config optimal? Qwen3.8-Flash-Next (UD-Q4_K_XL) on a single RTX 3090 24GB + 128GB DDR4 — is this config optimal? Hardware CPU: Intel Core i5-12600K RAM: 128 GB DDR4 @ 3600 MHz GPU: NVIDIA RTX 3090, 24 GB VRAM OS: Windows 11 llama.cpp: freshly compiled from today's master (build b10794, Sep 4… 30 r/LocalLLaMA community 1d ago AA Update! Here's how the Frontier ranks. Along with everyone's favorite here, qwen3.8-27B   submitted by   /u/Tall_Abrocoma_3533 [link]   [comments] 25 r/LocalLLaMA community 1d ago local vibecoding with Qwen 3.8 27B and Godot OK, you guys want to start with local vibecoding but don't know how. In the discussions, you recommended that I use Godot. I downloaded it without knowing what it was. I was expecting a library, but it was an .exe file. So I started pi with Qwen 3.8 27B and told it to explore… 23 r/LocalLLaMA community 1d ago Qwen3.8 27B on Strix - the optimized setup Ever since u/jfowers_amd has asked me to help with the Lemonade project (and provided some hardware to test on), I've been trying my best to optimize llama.cpp for AMD setups. This has led me in some very weird pathways where I wasn't expecting to go, but in the end I'm happy to… 10 r/LocalLLaMA community 1d ago Qwen3.8 27b for agentic coding and next .... what? First, I'd like to thank the Qwen and Unsloth teams for the Qwen3.8 27b UD Q4_K_XL. Fits the poor 24GB of 3090 VRAM with 100k context at Q8 and works phenomenally well! Imho if theres anything that can threaten Anthropic/OpenAI profits is not another frontier model but actually… 31 r/LocalLLaMA community 1d ago Qwen3.8-27B beat the Wikipedia game in 6 clicks. Used qwen3.8-27b in Opencode to make this silly mini-game because I'm not sober: ``` We are going to play a game, it will be the Wikipedia game. The Wikipedia game has the following rules: You will have a Wikipedia article set as a starting point. You will have a Wikipedia… 22 Simon Willison community 1d ago The Pelican comparison grid for Astra is pretty interesting I got access to GPT-6 Astra this afternoon, so naturally I used it to generate SVGs of pelicans riding bicycles - at low, medium, high, xhigh and max reasoning levels (Astra doesn't support reasoning=none). Then I rendered those pelicans in a comparison grid with GPT-5.6 Sol,… 12 Hacker News — AI on Front Page community 1d ago Portal by Spotify cut my Claude Code token usage by 90% Article URL: https://engineering.atspotify.com/2026/9/portal-by-spotify-cut-my-claude-code-token-usage-by-90 Comments URL: https://news.ycombinator.com/item?id=49571465 Points: 200 # Comments: 108 13 Anthropic SDK (Python) releases dev-tools 1d ago v1.4.0 1.4.0 (2026-09-04) Full Changelog: v1.3.0...v1.4.0 Features api: add Claude Tag category and user breakdowns to usage reports ( 9fce1e4 ) api: add named types for organization compliance settings state ( 1de1957 ) api: add support for sending a workspace ID on more endpoints (… 32 r/LocalLLaMA community 1d ago Help me understand gguf size/ctx size Let's say I have 2x 16Gb GPUs and I want to run Qwen3.8 27B. Monitor is ran by the integrated GPU so both 16Gb GPUs are almost fully free. I load the UD-Q4_K_S on one card at 15.4Gb. I then load the context on the other card? Would that be the most efficient way? Or should I aim… 20 Hacker News — AI on Front Page community 1d ago GPT-6 Astra on OpenRouter Article URL: https://openrouter.ai/openai/gpt-6-astra Comments URL: https://news.ycombinator.com/item?id=49570545 Points: 229 # Comments: 133 38 LangChain releases dev-tools 1d ago langchain-core==1.6.2 Changes since langchain-core==1.6.1 release(core): 1.6.2 ( #40209 ) feat(openai): support async tools ( #40208 ) chore(deps): bump mistune from 3.3.0 to 3.3.3 in /libs/core ( #40150 ) chore(deps): bump tornado from 6.5.7 to 6.5.8 in /libs/core ( #40113 ) fix(core): avoid… 15 Ollama releases dev-tools 2d ago v0.34.0-rc0 app: add Ollama to ChatGPT Desktop ( #18236 ) 25 r/MachineLearning community 2d ago Gpt 5,6,7: Does it even matter? The (ghost) productivity question. [D] an observation : GPT-5-class models are genuinely capable(They are) of doing a substantial fraction of knowledge work, why haven’t we seen a noticeable productivity shock in the real economy yet? Is AI actually less economically useful than the benchmarks suggest—or are… 32 llama.cpp releases dev-tools 2d ago v0.4.0 Overview llama.cpp 0.4.0 adds initial Qwen3.8-Flash-Next and Nemotron-3-Puzzle support, on-demand tensor reading, per-slot server context limits, video input options, and a ggml update to 0.23.0 with major sparse flash attention and RDMA work. API changes Added llama_lazy_mode… 27 r/LocalLLaMA community 2d ago I benchmarked 21 Qwen3.8 27B variants on 16GB VRAM After Qwen3.8 27B came out, I decided to benchmark the models that could fit in my GPU (RTX 5080) on my actual code ( C code), the results were not completely unexpected but some quants were definitely underwhelming. TLDR : Best overall: bartowski/Qwen3.8-27B-IQ4_XS . Best… 32 r/LocalLLaMA community 2d ago Updated my benchmark with a new vLLM based recipe for Qwen 3.8 Flash Next : now up to 98/100 (instead of 91 previously) I was using: weights https://huggingface.co/RadixArk/Qwen3.8-Flash-Next-NVFP4 with the optimized SGLANG (patched) from https://old.reddit.com/r/BlackwellPerformance/comments/1w04xb7/qwen38_flashnext_on_1x_rtx_pro_6000_171_ts_c1_428/ Now I'm using: weights (AWQ W4A16) from:… 11 r/LocalLLaMA community 2d ago Qwen3.8-Flash-Next on a phone CPU! Like the title says, running completely locally on my Xiaomi 14T Pro device. Specific model: Qwen3.8-Flash-Next-UD-IQ3_XXS App used: BigMoeOnEdge   submitted by   /u/Tall_Abrocoma_3533 [link]   [comments] 36 Page 1 of 10 · 500 articles Older →
