News / #version-bump Tag Version Bump 381 articles archived under #version-bump · RSS Sign in to follow vLLM releases dev-tools 1mo ago v0.25.1: [Bugfix] Guard mixed-dtype allreduce RMSNorm quant fusions (#48330) Signed-off-by: hcenteno [email protected] (cherry picked from commit 5f8e73c ) 6 llama.cpp releases dev-tools 1mo ago b9970 ggml : add GGML_OP_LIGHTNING_INDEXER that implements DeepSeek V3.2/V4 lightning indexer ( #24231 ) ggml : add GGML_OP_LIGHTNING_INDEXER that implements DeepSeek V3.2/V4 lightning indexer ggml : remove scale parameters from lightning indexer OP, add f16 mask parameter tests : add… 14 r/LocalLLaMA community 1mo ago Vellium v1.0.0 released: security hardening, wallpaper-based themes, JSON chat export and a major desktop stability pass Vellium has reached v1.0.0. It is a local-first desktop workspace for writing, roleplay, character creation, lorebooks and knowledge management with local LLMs. This release promotes the previous v1.0.0-beta build to the first stable version. The main focus was security and… 13 r/LocalLLaMA community 1mo ago Xiaomi quietly uploaded MiMo-V2.5-DFlash — official DFlash weights are now on Hugging Face https://huggingface.co/XiaomiMiMo/MiMo-V2.5-DFlash Xiaomi appears to have quietly uploaded MiMo-V2.5-DFlash to Hugging Face: there is dedicated dflash directory containing the Dflash model, anyone willing to GGUF it and try? I'd do it but I can't today. This model is pretty good… 19 r/LocalLLaMA community 1mo ago **Your $80 Tesla P100 has been doing silently noisy math in llama.cpp for years. Three lines fix it, for free.** ## TLDR; Shipped — in turboquant v0.3.0, downloadable now. https://github.com/TheTom/llama-cpp-turboquant/releases/tag/tqp-v0.3.0 llama.cpp's CUDA code has a flag that means "this GPU is fast at fp16, so do the math in fp16." The GTX 10-series and P40's (sm_61) were exempted… 7 r/LocalLLaMA community 1mo ago Grok Build CLI uploads your whole repo — full git history + .env secrets — to xAI's cloud, and the opt-out doesn't stop it (wire-captured) I ran Grok Build CLI (v0.2.93) through mitmproxy. It uploads your entire repo as a git bundle (full history) to xAI's Google Cloud — independent of what you open. With the prompt literally "do not read or open any files," a file I planted came back verbatim when I git clone -d… 5 Ollama releases dev-tools 1mo ago v0.32.0-rc0 cmd: agent UI ( #17017 ) 20 r/LocalLLaMA community 1mo ago Koboldcpp v1.117 released   submitted by   /u/Fcking_Chuck [link]   [comments] 14 r/LocalLLaMA community 1mo ago MiMo v2.5 is underrated. Feels like the tokens are pouring out of the screen in OpenCode. When I recently built my inference server, I expected to deploy DeepSeek v4 flash, but that doesn't look like it's going to be fast for a long time, if ever. There is a massive gap, as we all know, in competent models between 30b and 400b. I was very surprised to find that this… 22 vLLM releases dev-tools 1mo ago v0.25.0: [CI] Fix cargo-deny config flag ordering (#48170) Signed-off-by: Lucas Wilkinson [email protected] 35 OpenAI Python SDK releases dev-tools 1mo ago v2.45.0 2.45.0 (2026-07-09) Full Changelog: v2.44.0...v2.45.0 Features api: gpt-5.6-sol updates ( 039d1fe ) Bug Fixes api: restore beta resource accessors ( 2dfc130 ) Chores retrigger release automation ( 7b61351 ) 21 vLLM releases dev-tools 1mo ago v0.25.0rc3 [P/D][Bugfix] Fix PD async KV load lookahead handling for MTP spec de… 6 vLLM releases dev-tools 1mo ago v0.25.0rc2 Fix embed scaling + CUDA graphs in Transformers modelling backend ( #4 … 12 r/LocalLLaMA community 1mo ago 82 TPS On Qwen 3.6 27b On A Macbook Pro | Introducing MTPLX V2: The Fastest Way To Run MLX Models. Hey Everyone, here is an update on MTPLX! One month after releasing MTPLX V1 which brought a swift based app and upgraded CLI for coding use I am happy to announce MTPLX V2. The biggest change is Turbo Mode: using custom verify-specialized quantized-matmul kernels plus a… 12 ComfyUI releases dev-tools 1mo ago v0.27.1 ComfyUI v0.27.1 36 r/LocalLLaMA community 1mo ago any one else finds Mimo v2.5 better than deepseek v4 flash!? I noticed while using both, mimo was often better, after benchmarking mimo v2.5 via open code endpoint in diff harness like codex, oh my pi, hermes. i found that mimo is indeed better in coding tasks. and over all, hermes scored 55% with mimo v2.5 via terminal bench v2.0 others… 25 arXiv — NLP / Computation & Language research 1mo ago Pluralis v0.1: Towards a Multicultural, Multimodal, Multilingual Benchmark for AI Risk and Reliability arXiv:2607.06196v1 Announce Type: new Abstract: Current AI safety evaluation and benchmarking frameworks predominantly rely on Western-centric culture-agnostic defaults that mask critical regional laws, socio-linguistic nuances, and cultural taboos, leaving Vision-Language… 7 vLLM releases dev-tools 1mo ago v0.25.0rc1 [CPU][Bugfix] Fix flaky ShortConv prefill test on ARM (uninitialized … 5 Ollama releases dev-tools 1mo ago v0.31.2-rc2: llm: allow iGPU mmproj offload with fit padding (#16996) llm: allow iGPU mmproj offload with fit padding llama.cpp's fit pass sizes text-model placement before the multimodal projector is loaded. Ollama had been avoiding that risk on non-Metal iGPUs by disabling projector offload entirely, which forces CLIP onto CPU on GB10 and Strix… 33 Ollama releases dev-tools 1mo ago v0.31.2: llm: allow iGPU mmproj offload with fit padding (#16996) llm: allow iGPU mmproj offload with fit padding llama.cpp's fit pass sizes text-model placement before the multimodal projector is loaded. Ollama had been avoiding that risk on non-Metal iGPUs by disabling projector offload entirely, which forces CLIP onto CPU on GB10 and Strix… 25 r/LocalLLaMA community 1mo ago mistral.rs v0.9.0: up to 1.8x faster CPU decode than llama.cpp on x86 and ARM! https://preview.redd.it/nuk5rxceptbh1.png?width=1448&format=png&auto=webp&s=300344dd4c6552379e8536b81ba288be3d6dca3f On Qwen3 4B Q4_K, mistral.rs decodes faster than llama.cpp at every context depth we measured, on x86 (Sapphire Rapids) and ARM (GB10). We optimized mistral.rs at… 27 r/LocalLLaMA community 1mo ago Mimo & deepseek are really amazing at optimizing ai. Read the the official blog page i linked, it will give amazing insight on how they pulled off this kind of low pricing with 2x - 3x profit margins. For quick look --> https://x.com/i/status/2059618247553745204 Detailed --> https://mimo.xiaomi.com/blog/mimo-v2-5-inference I hope in future we get fable lvl ai at the cost of current DSV4. Thats far more sufficient for like 90% of people. Xai is also pushing for low cost api… 17 Hugging Face Daily Papers research 1mo ago Wan-Streamer v0.2: Higher Resolution, Same Latency Abstract Wan-Streamer v0.2 enhances audio-visual interaction by increasing visual resolution while maintaining low latency through optimized thinker-performer architecture with multi-GPU parallel processing. Generated by Qwen/Qwen2.5-Coder-32B-Instruct We present Wan-Streamer… 22 Hugging Face official-blog 1mo ago LeRobot v0.6.0: Imagine, Evaluate, Improve Back to Articles a]:hidden"> LeRobot v0.6.0: Imagine, Evaluate, Improve Published July 7, 2026 Update on GitHub Upvote 1 Steven Palma imstevenpmwork Pepijn Kooijmans pepijn223 Caroline Pascal CarolinePascal Khalil Meftah lilkm Martino Russi nepyope Nikodem Bartnik nikodembartnik… 26 Ollama releases dev-tools 1mo ago v0.31.2-rc1: create: harden GGUF create flows (#17062) create: harden GGUF create flows lint 26 Ollama releases dev-tools 1mo ago v0.31.2-rc0 mlx: update to de7b4ed9 ( #17056 ) 16 Simon Willison community 1mo ago sqlite-utils 4.0rc3 Release: sqlite-utils 4.0rc3 I hoped to release sqlite-utils 4.0 stable this weekend, but as I worked through the backlog of issues and PRs with a combination of Claude Fable 5 and GPT-5.5 the changelog since rc2 kept getting bigger . The biggest new feature is support for… 32 Hacker News — AI on Front Page community 1mo ago Shadcn/UI now defaults to Base UI instead of Radix Article URL: https://ui.shadcn.com/docs/changelog Comments URL: https://news.ycombinator.com/item?id=48791328 Points: 212 # Comments: 94 23 r/LocalLLaMA community 1mo ago Is there some KDL chart for MiMo-V2.5 or something regarding the quants quality? I'm using the model with opencode and the issue is it's looping hard when reasoning. It's not a deranged babbling though, the reasoning is legit large spans of text, it just can't get outside of the loop and make a decision. So I babysit it, stop and direct it to the right path,… 33 Anthropic SDK (Python) releases dev-tools 1mo ago v0.116.0 0.116.0 (2026-07-02) Full Changelog: v0.115.1...v0.116.0 Features api: add agent-memory-2026-07-22 beta header ( e181d5c ) 11 Hacker News — AI on Front Page community 1mo ago Kimi K2.7 Code is generally available in GitHub Copilot Article URL: https://github.blog/changelog/2026-07-01-kimi-k2-7-is-now-available-in-github-copilot/ Comments URL: https://news.ycombinator.com/item?id=48756602 Points: 202 # Comments: 89 24 arXiv — NLP / Computation & Language research 1mo ago GPTKB v1.5: A Massive Knowledge Base for Exploring Factual LLM Knowledge arXiv:2507.05740v2 Announce Type: replace Abstract: Language models are powerful artifacts, yet their factual knowledge is still poorly understood, and inaccessible to ad-hoc browsing and scalable statistical analysis. This demonstration introduces GPTKB v1.5, a densely… 30 Anthropic SDK (Python) releases dev-tools 1mo ago v0.115.1 0.115.1 (2026-07-01) Full Changelog: v0.115.0...v0.115.1 Chores api: remove some nonfunctional types from the SDKs ( 5e7c431 ) 27 ComfyUI releases dev-tools 1mo ago v0.27.0 ComfyUI v0.27.0 17 Simon Willison community 1mo ago What's new in Claude Sonnet 5 What's new in Claude Sonnet 5 Claude Sonnet 5 came out this morning . I always head straight for the "what's new" developer docs because they tend to have more actionable information than the official announcement post. Anthropic say of Sonnet 5 that "its performance is… 26 Anthropic SDK (Python) releases dev-tools 1mo ago v0.115.0 0.115.0 (2026-06-30) Full Changelog: v0.114.0...v0.115.0 Features api: add support for Managed Agents event delta streaming, agent overrides, reverse pagination, vault credential injection scoping, and agent and deployment webhook events ( 8c23f7e ) 24 Anthropic SDK (Python) releases dev-tools 1mo ago v0.114.0 0.114.0 (2026-06-30) Full Changelog: v0.113.0...v0.114.0 Features api: add support for claude-sonnet-5 ( b893033 ) Bug Fixes agent_toolset: allow absolute paths that resolve inside workdir ( #121 ) ( 0105529 ) 9 r/LocalLLaMA community 1mo ago TurboOCR v3 — high-speed document OCR server (C++/CUDA), ~520 img/s on RTX 5090 TurboOCR is a self-hosted, high-speed document OCR server, runs fully local. Here's What's New in v3: Speed: Full pipeline now on the newest PP-OCRv6 models (up from v5): ~270 → ~520 img/s on FUNSD (v6 tiny, RTX 5090). Still fully local, HTTP + gRPC. Structured parsing (the main… 33 Ollama releases dev-tools 1mo ago v0.31.1: mlx: tighten up gemma4 moe loading code (#16964) This change allows .experts.gate_proj / .up_proj / .down_proj tensor names to each be used for both quantized (i.e. nvfp4 and mxfp8) and non-quantized (bf16) models. Previous to this only non-quantized models used that tensor naming scheme. 20 Ollama releases dev-tools 1mo ago v0.31.0 launch: check for min version for hermes desktop ( #16912 ) 4 Ollama releases dev-tools 1mo ago v0.30.12-rc0 llama.cpp update ( #16960 ) 35 Anthropic SDK (Python) releases dev-tools 1mo ago v0.113.0 0.113.0 (2026-06-29) Full Changelog: v0.112.0...v0.113.0 Features api: add support for 20260318 web fetch and support tools ( 88dbfb1 ) Bug Fixes async count_tokens missing output_format/output_config merge block ( #162 ) ( 122c958 ) Chores api: accept user profile ID's when… 17 r/LocalLLaMA community 1mo ago Success story with MiMo-V2.5-GGUF:UD-Q5_K_XL I don't see many stories about this model, but after several attempts (after I finished finally reconfiguring my cluster) I did something useful with it: it wrote a built-in llama.cpp tool for executing C++ code and using the results. Here's an exercise that MiMo V2.5 gave me to… 27 r/LocalLLaMA community 1mo ago Koboldcpp v1.116 released   submitted by   /u/Fcking_Chuck [link]   [comments] 19 vLLM releases dev-tools 1mo ago v0.24.0 [CI] Raise gsm8k startup timeout for MoE Refactor Qwen3 NVFP4 configs… 23 Ollama releases dev-tools 1mo ago v0.30.11 What's Changed launch: add thinking capability detection to opencode by @hoyyeva in #15434 launch: auto-install Claude Code by @hoyyeva in #16802 launch: auto-install opencode when missing by @hoyyeva in #16806 discover: fix inverted iGPU/dGPU Vulkan classification on Windows… 28 r/LocalLLaMA community 1mo ago Anyone tried Ornith-1.0 9B? Should I even give it a chance over "qwopus3.5 9b v3.5" or "qwopus3.5 9b coder"? anyone tried it??   submitted by   /u/BothYou243 [link]   [comments] 8 Ollama releases dev-tools 1mo ago v0.30.11-rc1 parser/renderer: add Ornith 9B renderer/parser support ( #16920 ) 23 arXiv — NLP / Computation & Language research 1mo ago HyperDFlash: MHC-Aligned Block Speculative Decoding with Gated Residual Reduction arXiv:2606.26744v1 Announce Type: cross Abstract: We present HyperDFlash, a block-parallel speculative decoding framework tailored to the novel multi-hyper-connection (MHC) architecture proposed by DeepSeek-V4. Despite the strong initial-token drafting performance of the native… 10 arXiv — NLP / Computation & Language research 1mo ago Thinking Like a Scientist? A Structural Study of LLM-Generated Research Methods arXiv:2606.26130v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly used to guide research methodology, yet their default methodological tendencies under minimal prompting remain unclear. Here, we prompt GPT-5.1, Gemini 3 Pro, and DeepSeek-V3.2 with an… 38 Page 3 of 8 · 381 articles ← Newer Older →
