News / #open-source Tag Open source 500 articles archived under #open-source · RSS Sign in to follow r/LocalLLaMA community 1mo ago OvisOCR2 (0.8B): first end-to-end model to top OmniDocBench - I threw 827 real scanned medical docs at it, here's everything I learned What it is: ATH-MaaS/OvisOCR2 - a 0.8B document-parsing VLM post-trained from Qwen3.5-0.8B (SFT + RL + OPD), Apache 2.0, runs on vLLM 0.22.1. One prompt per page image -> complete markdown (HTML tables, LaTeX formulas, bbox stubs for figures). It scores 96.58 on OmniDocBench… 9 Smol AI News news-outlet 1mo ago not much happened today **Thinking Machines Lab** launched **Inkling**, its first fully released open-weights foundation model family, featuring **975B parameters** with **41B active parameters** in a **Mixture-of-Experts** architecture. Inkling supports **multimodality** with text, image, and audio… 20 TechCrunch — AI news-outlet 1mo ago Reflection inks $1B compute deal with Nebius Reflection AI has signed a $1 billion deal to access Nebius's compute. Reflection was founded in 2024 and is developing open source AI technology. 17 r/LocalLLaMA community 1mo ago I RL-trained Qwen3.6-35B-A3B to RL-train small task-specific Qwen models. Fully open source! 🤓 👋 Training my first RL model last year was super fun, now I've RL-trained a model that RL-trains other models... wild times! The agent gets a task, writes the full training job (environment, reward, dataset, hyperparameters), and submits it to real GPUs. When the model it… 13 r/LocalLLaMA community 1mo ago Good podcasts I'm heading on vacation soon and want to download a few good podcasts about local LLMs, open-weight models, inference, tooling and the broader open-source AI ecosystem. Which podcasts or specific episodes do you genuinely recommend? I'm especially interested in technical… 18 r/MachineLearning community 1mo ago [N] AMA Reminder: Raffi Krikorian (CTO, Mozilla) Hello community, just a short reminder that Raffi Krikorian (CTO @ Mozilla) is live today for an AMA to discuss Mozilla's inaugural State of Open Source AI report. Topics include enterprise adoption, the real cost of "free"models, developer trust, Chinese open models and their… 28 arXiv — NLP / Computation & Language research 1mo ago Robust, Scalable Detection of Text Containment in Large Web-Crawled Corpora arXiv:2607.10020v1 Announce Type: new Abstract: We present FindMyText, an open-source Python package designed to efficiently assess whether a given text appears, in part or in full, within a text corpus. The tool builds on prior techniques for document fingerprinting, but… 25 arXiv — NLP / Computation & Language research 1mo ago CAFE: A Compound-AI Factorial Evaluation Framework arXiv:2607.10380v1 Announce Type: new Abstract: We introduce CAFE (Compound-AI Factorial Evaluation), an open-source platform that brings design of experiments to the evaluation of compound AI systems (CAIS). Such systems expose many interchangeable choices - e.g. which… 6 arXiv — NLP / Computation & Language research 1mo ago Demographic Prompting at Scale: When More Attributes Hurt LLM--Human Agreement arXiv:2607.10590v1 Announce Type: new Abstract: We investigate how annotator demographic attributes, supplied as prompt cues, shape the alignment between large language model (LLM) predictions and human annotations across five tasks. Using five open-source LLMs, we… 26 arXiv — NLP / Computation & Language research 1mo ago Anamnesis: An Open-Source Platform for Large-Scale Backstory-Conditioned Survey Simulation arXiv:2607.10628v1 Announce Type: new Abstract: We present Anamnesis, an interactive system for demographically controllable survey simulation using large language models. Open-source, and designed for non-technical users/researchers, Anamnesis enables the prototyping and… 19 r/LocalLLaMA community 1mo ago Why aren't any American open-source AI labs even close to Chinese ones on benchmarks yet? I know there are a few american labs working on open-source AI but none of them show up in the benchmarks like Chinese open source does, why haven't any American labs been able to reach top open source benchmarks yet?   submitted by   /u/Lost_Foot_6301 [link]  … 28 r/LocalLLaMA community 1mo ago Self-hosted voice for any agent/harness of your choice (open-source) For a while now I've been maintaining tts-bench ( https://github.com/5uck1ess/tts-bench ) and a blind voting arena ( https://5uck1ess-tts-arena.hf.space ) where people A/B test open text-to-speech (TTS) models without knowing which is which. One problem I've always wanted to… 31 r/LocalLLaMA community 1mo ago If Frontier AI is so Dangerous, Why should private companies be allowed to develop it? There's a push by openAI and anthropic primarily. Well more than a push just straight fear mongering about open source ai and its dangers. If it's so dangerous why would the US gov. in particular continue to allow private industry to develop and release. If I had a company… 22 r/MachineLearning community 1mo ago GPUHedge: Hedging serverless GPU providers improves cold start p95 latency from 117s to 30s [P] Disclosure: I built it, it is open source, Apache-2.0 licensed, and currently alpha. Repository: https://github.com/mireklzicar/gpuhedge I started working on it after benchmarking a 17 GB AI model across several serverless GPU providers. On the primary provider, requests usually… 30 r/MachineLearning community 1mo ago Hundreds of papers hit arXiv every day and maybe 3 matter to my research, so I built an open-source tool that finds them [P] Left: Telegram digest (optional); Right: detailed digest on HTML Like probably everyone here, my to-read list only grows. Skimming arXiv listings or my feeds takes 30-60 minutes a day, 95% of it is irrelevant to what I actually work on, and newsletters don't really help: they… 8 r/LocalLLaMA community 1mo ago Zhipu founder backs open-source AI as global security debate intensifies   submitted by   /u/computeruser420 [link]   [comments] 25 Hugging Face Daily Papers research 1mo ago A Sovereign, Open-Source Foundation Model for German and English Abstract We present Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mamba Transformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps the inference cache near-constant as context grows,… 27 r/LocalLLaMA community 1mo ago Compressed Version of Qwen-3.6-27B coming from PrismML - Khosla-Backed Startup Claims Breakthrough With Largest-Ever AI Model on an iPhone The startup, PrismML, said it has shrunk down Qwen 3.6 , an open-source large language model developed by Chinese internet giant Alibaba , to run on an iPhone 17 Pro. The model has 27 billion parameters , which are roughly similar to the synapses in a brain and can help… 33 arXiv — NLP / Computation & Language research 1mo ago A Sovereign, Open-Source Foundation Model for German and English arXiv:2607.09424v1 Announce Type: new Abstract: We present Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mamba Transformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps the inference… 15 Hacker News — AI on Front Page community 1mo ago Show HN: Juggler – an open-source GUI coding agent, by the creator of JUCE Hello HN, I don't post on here much, but wanted to get some eyes on a new project I'm just launching. I think we definitely need one more AI code agent.. I'm a long-term C++ dev, and over 30+ years I've created some successful audio dev tools (JUCE, the Tracktion DAW, the Cmajor… 11 Interconnects (Nathan Lambert) research 1mo ago 6 months to live for open models The most serious test to date of open source AI’s viability is happening right now. 32 r/LocalLLaMA community 1mo ago How is Codex as a harness for local models? I was surprised to see that Codex is actually open source, so to my understanding, if you use a local model, it works fully locally. How does it compare to the other popular harnesses like Pi Code and Open Code?   submitted by   /u/A_Wild_Entei [link]   [comments] 4 r/LocalLLaMA community 1mo ago I mapped Anthropic’s J-Space Hallucination signal across 7 datasets on Qwen3-4B to find out where it works and where it breaks Anthropic recently published their paper on "Global Workspaces" (J-Space) inside language models, showing that looking at internal "workspace noise" (entropy) can catch hallucinations better than just looking at output logprobs. `solarkyle` followed up with a great open-source… 37 r/LocalLLaMA community 1mo ago Built EverFern, an alternative to cowork open-source(LangGraph + Electron). Tested it against Qwen3-8B, looking for feedback I built EverFern, an open-source (MIT) desktop agent that does computer use, browser control, and file/code tasks, aimed at people who don't want to pay $20–200/mo for Claude Cowork or Manus and send everything to the cloud. Everything runs locally, config and history live in… 29 r/LocalLLaMA community 1mo ago The U.S. tech industry is increasingly anxious about the rising power and competitive price of open-source AI models from China — and whether the Trump administration will respond with yet another executive order | Politico Politico: Wall Street’s new obsession: Which CEOs have Trump’s ear?: https://www.politico.com/newsletters/politico-influence/2026/07/10/wall-streets-new-obsession-which-ceos-have-trumps-ear-00993324   submitted by   /u/Nunki08 [link]   [comments] 29 r/LocalLLaMA community 1mo ago MIT LLM Serve Dashboard I am making open source A single-file, dependency-free live dashboard for your local LLM serving box — GPU utilization, per-model throughput, KV/context fill, and system stats for llama.cpp and vLLM , in one green terminal-styled page. No framework, no build step, no external requests. The frontend is… 31 r/LocalLLaMA community 1mo ago Tencent-HY3 is the real deal on 128GB! I'm really impressed with HY3. If you haven't heard of this model, it's a new 295B-A21B MoE release from Tencent that competes directly on the frontier of open weights models, at a significantly smaller size , comparable to DeepSeek v4 Flash but with better benchmarks. I was… 24 TechCrunch — AI news-outlet 1mo ago Open source AI matters more than ever, according to Hugging Face’s Clem Delangue Open source AI is booming, according to Hugging Face CEO Clem Delangue. The company has grown into something like a GitHub for AI in recent years, where AI builders can share and download open models and datasets, now used by roughly half the Fortune 500. Delangue… 20 r/LocalLLaMA community 1mo ago I made a simple tool to manage llamacpp instances (Metallama) *Disclaimer*: This post showcase a personnal project. (Free Open Source). Hopefully im not bothering by posting this. I was tired of juggling terminals, manual GGUF downloads and changing inference parameters, so I made a web UI tool for helping doing all that. Here is some cool… 7 TechCrunch — AI news-outlet 1mo ago Hugging Face’s CEO on why companies are done renting their AI Open source AI is booming, according to Hugging Face CEO Clem Delangue. The company has grown into something like a GitHub for AI in recent years, where AI builders can share and download open models and datasets, now used by roughly half the Fortune 500. Delangue… 20 r/LocalLLaMA community 1mo ago Initial ET backend by marty1885 · Pull Request #24179 · ggml-org/llama.cpp This PR is developed by AINekko and by members of AIFoundry (AINekko's OSS community) and adds the ET backend that supports the ET-SOC-1 processor. ET-SOC-1 was originally created by Esperanto Technologies which AINekko later open sourced under Apache 2.0 and would like to… 9 r/LocalLLaMA community 1mo ago Meta are apparently working on an open source variant of Muse Spark. No real details or timescales yet, but this article has confirmation from Alexandr Wang that Meta are working on an open source variant of Muse Spark. One to keep an eye on. https://www.cnbc.com/2026/07/09/meta-jumps-into-ai-coding-market-to-chase-anthropic-and-openai.html  … 6 TechCrunch — AI news-outlet 1mo ago Popular open source AI developer tool Ollama raises $65M, grows to nearly 9M users Benchmark-backed Ollama has amassed 176,000 stars, and nearly 17,000 forks on Github by helping developers easily run AI on their PCs. 12 r/LocalLLaMA community 1mo ago GLM-5.2 fearmongering in the press I don't know where this is headed, but I don't like it. https://futurism.com/artificial-intelligence/open-source-ai-model-scary-mythos GLM-5.2 can be downloaded by anybody, can be run on virtually any hardware, and unlike Mythos or Fable, there’s no vendor playing the middle man… 38 arXiv — NLP / Computation & Language research 1mo ago Simulstream: Open-Source Toolkit for Evaluation and Demonstration of Streaming Speech-to-Text Translation Systems arXiv:2512.17648v2 Announce Type: replace Abstract: Streaming Speech-to-Text Translation (StreamST) requires producing translations concurrently with incoming speech under strict latency constraints, demanding models that balance low latency with high translation quality.… 7 r/LocalLLaMA community 1mo ago What China Said at the UN’s First Global Dialogue on AI Governance Open source AI is a shared asset for all humanity. Chinese open source models such as DeepSeek and Qwen have significantly lowered the barriers and costs of AI adoption. China is committed to further promoting open source AI for industry, academia and research institutions,… 20 r/MachineLearning community 1mo ago Reducing drift in interactive world-model rollouts: a mixed bidirectional/autoregressive attention mask + distillation over long self-rollouts[R] Read through the method behind an open-weights interactive world model whose weights just went public. The backbone is a causal DiT generating frames live, conditioned on user input. To stop it from over-relying on its own recent frames, the usual source of drift, they use a… 28 r/LocalLLaMA community 1mo ago AI has completely revolutionized how I play RPGs Crossposting this here because I thought you guys might appreciate it. When ChatGPT and other open source LLMs first came out, there was a lot of speculation as to how these technologies could change gaming. I recall there being posts and comments about when we could have AI… 32 Hugging Face Daily Papers research 1mo ago AlayaWorld: Long-Horizon and Playable Video World Generation Abstract AlayaWorld is an open-source framework for creating interactive generative worlds that enables real-time user interaction and supports diverse actions within a modular architecture. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Game worlds have traditionally been built… 34 NVIDIA Developer Blog official-blog 1mo ago Running Low-Latency Analytical Workloads with GPU-Accelerated Presto on NVIDIA GB200 NVL72 Presto is an open source, distributed SQL engine for running fast, interactive queries on very large datasets. On NVIDIA GPUs, Presto delivers peak performance... 31 Hacker News — AI on Front Page community 1mo ago Chatto is now Open Source Article URL: https://www.hmans.dev/blog/chatto-is-open-source Comments URL: https://news.ycombinator.com/item?id=48833116 Points: 240 # Comments: 47 27 r/LocalLLaMA community 1mo ago Introducing Horus Hiero | A Hieroglyphic Language Translation Model Our new open-source AI model for Ancient Egyptian hieroglyph translation. Available in two versions: Horus Hiero 9B Horus Hiero Mini 4B (optimized for CPUs and mobile devices) Built on Qwen 3.5 , Horus Hiero supports ~150 languages , understands text, images, and video , and is… 7 arXiv — Machine Learning research 1mo ago Life Cycle Assessment of Pre-training the Lucie 7B Open-Source Large Language Model on the Jean Zay Supercomputer arXiv:2607.05408v1 Announce Type: cross Abstract: The environmental impact of training large language models (LLMs) is increasingly scrutinised, yet most published estimates focus on operational energy and disclose little about manufacturing (embodied) emissions, water… 13 arXiv — NLP / Computation & Language research 1mo ago Measuring the practice of shared-decision making (OPTION12): An Investigation into Open-sourced Smaller LLMs (OS-sLLMs) for Better Privacy and Sustainability arXiv:2607.06127v1 Announce Type: new Abstract: We present LLM4SDM, the first study of open-source smaller language models (OS-sLLMs) for automated assessment of shared decision making (SDM) using the Observer OPTION12 framework. Unlike previous work that relies on large… 27 TechCrunch — AI news-outlet 1mo ago Why the rise of open source AI isn’t hurting Anthropic … yet Open source models’ success isn’t coming at the expense of frontier labs. Instead, they each seem to capture two phases of the same life cycle. 21 r/LocalLLaMA community 1mo ago Gepard : 0.6B streaming TTS built for real-time dialogue - 20× realtime factor, ~50ms time-to-first-audio, vLLM-native, Apache 2.0 We just open-sourced Gepard 1.0 , a TTS model built for real-time conversation. It’s streaming-first: audio starts the moment text arrives, generated frame by frame instead of waiting for a full sentence. - ~555M params : Qwen3.5 0.8B backbone (14 layers) + Nemo NanoCodec (FSQ,… 36 r/LocalLLaMA community 1mo ago Liquid AI - Antidoom (the doom loop remover) https://x.com/liquidai/status/2074494130126811473 Today we release Antidoom, an open-source method that removes a common failure mode in reasoning models: the doom loop. Doom-loop rates before and after, with eval scores up across the board: > Early LFM2.5-2.6B checkpoint: 10.2%… 10 r/MachineLearning community 1mo ago Raffi Krikorian (CTO, Mozilla) — AMA on the State of Open Source AI (July 14 @ 1pm EDT) [D] Hi r/MachineLearning , i’m Raffi, CTO at Mozilla. on Tuesday July 14 we publish our inaugural State of Open Source AI report, and i'll be here live answering whatever questions you throw at me! AMA time: 1pm ET / 10am PT / 6pm BST. the report is about what's actually happening… 11 r/LocalLLaMA community 1mo ago Mozilla's Otari: The Open Source LLM Control Plane   submitted by   /u/nunodonato [link]   [comments] 36 r/LocalLLaMA community 1mo ago Are there any local ASR models that surpass Whisper right now? Hey everyone, I'm currently using faster-whisper(medium/large turbo) for local speech recognition, running it on an 8GB VRAM GPU. It works great, but I was wondering if there are any new open-source/local models that outright beat Whisper at this point? Here is exactly what I'm… 18 Page 5 of 10 · 500 articles ← Newer Older →
