News / #open-source Tag Open source 500 articles archived under #open-source · RSS Sign in to follow r/LocalLLaMA community 10d ago Thank you :) Swift Qwen 3.8 27B now has 100k+ downloads, is #1 finetune and #9 model on HuggingFace Trending Hey everyone, Jovan from UkisAI here, a small lab building the tech to make tiny frontier LLMs possible (and doing it open-source!) The purpose of this post is simply to thank the community for all the amazing finetunes, quantizations and overall improvements over our original… 38 Vercel — AI dev-tools 10d ago Run Terminal-Bench and other Harbor evals on Vercel Sandbox You can now run Harbor evals on Vercel Sandbox. Harbor is the open-source harness behind Terminal-Bench , whose registry includes many other benchmarks such as SWE-bench, tau3-bench and OSWorld. Pass --env vercel to harbor run and each trial executes in its own isolated… 18 r/LocalLLaMA community 10d ago We built an open-source GPU profiler you point an AI agent at, instead of reading traces yourself We've been tuning vLLM/SGLang/llama.cpp setups for a long time and got tired of the profiling part: nsys trace, open the GUI, squint, change a flag, repeat. The profilers assume a human is looking at the timeline. These days the thing doing our tuning is usually an agent, and it… 26 r/LocalLLaMA community 11d ago I literally built the Jev architecture one year back and completely open-sourced it with model, dataset and paper Everyone now talks about the architecture that's not auto regressive and does lightning fast probability prediction with a json schema. I worked on this literally one year back in March 2025, published an arxiv paper, pushed the model to huggingface along with the pypi package… 36 arXiv — NLP / Computation & Language research 11d ago From Pixels to Pairs: A Comprehensive Benchmark of LLM-Based Key-Value Extraction in Noisy Document Settings arXiv:2609.17538v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for structured information extraction from documents, yet their behavior under realistic OCR noise remains poorly understood. We present a systematic benchmark of open-source… 7 arXiv — NLP / Computation & Language research 11d ago NeMo Data Designer: An Extensible Framework for Multimodal Synthetic Data Generation arXiv:2609.17699v1 Announce Type: cross Abstract: We present NeMo Data Designer (NDD), an open-source, general-purpose framework for multi-modal synthetic data generation (SDG). Designed to be intuitive to use, NDD provides a declarative configuration format in which human… 37 r/LocalLLaMA community 11d ago I literally built the Jev architecture one year back and completely open-sourced it with model, dataset and paper Everyone now talks about the architecture that's not auto regressive and does lightning fast probability prediction with a json schema. I worked on this literally one year back in March 2025, published an arxiv paper, pushed the model to huggingface along with the pypi package… 38 Hacker News — AI on Front Page community 11d ago PS5 Linux lead quits: "a bunch of noobs using LLMs" that "they don't understand" Article URL: https://frvr.com/blog/news/ps5-linux-lead-quits-as-open-source-projects-have-become-a-bunch-of-noobs-using-llms-that-they-dont-even-understand/ Comments URL: https://news.ycombinator.com/item?id=49727627 Points: 216 # Comments: 130 37 arXiv — Machine Learning research 12d ago OPEN-1B: A Fully Auditable Training Run arXiv:2609.17380v1 Announce Type: new Abstract: Open-source language models have a reproducibility problem. Despite releasing weights, training data, and recipes, none of them are provably reproducible due to the non-associativity of floating-point arithmetic. Deep learning… 19 r/LocalLLaMA community 12d ago Open Source Appreciation Post It's late at night in the lab, I've been working on a basic script for a virology project, and holy hell the safeguards have been pissing me off. Mirroring detectEVE data over rsync to my laptop by making a zip file first? No no no, great safety mogul DARIO demands there be NO… 18 Hacker News — AI on Front Page community 12d ago German Rheinmetall open-sources its Battlesuite connected weapon system protcol Article URL: https://rheinmetall.github.io/onboardapi-documentation/9.10.0/index.html Comments URL: https://news.ycombinator.com/item?id=49718928 Points: 203 # Comments: 69 19 The Information — AI news-outlet 12d ago Salesforce Unveils New AI Model, Agent Security Tools at Dreamforce At the opening of its annual Dreamforce customer conference, Salesforce signaled its involvement in two major trends in enterprise AI: Open-source AI models and software that helps corporate customers safely run AI agents on their data. Salesforce unveiled a new AI model, called… 34 r/LocalLLaMA community 12d ago Closed source AI is more dangerous than open source AI. Security through obscurity is no form of security.   submitted by   /u/keequalshalfmvsqrd [link]   [comments] 18 r/LocalLLaMA community 13d ago jinfer: An open-source AI inference engine for the JVM. Finally, AI in jar. For years, the JVM has watched the AI revolution from the bench. Every model, AI framework, every breakthrough, built with/for Python. jinfer is an inference engine built for the JVM from first principles: chat, vision, audio transcription, embeddings, reranking, and TTS. No… 7 r/LocalLLaMA community 13d ago Voodoo Dynamic Quant - Now MIT Licensed Two months ago I announced I had found a new dynamic quant method called Voodoo Quant which was SOTA for the most aggressive quant levels on some smaller Qwen3.5 GGUF models. I kept the methodology private at the time, but I've seen too many requests for dyn quants for various… 6 Hugging Face Daily Papers research 13d ago PhysBrain 1.5: From Vision-Language Models to Physical Foundation Models Abstract PhysBrain 1.5 unifies physical environment understanding, action generation, and future state prediction via joint autoregressive training on discrete vision-language, motion, and visual target sequences, achieving state-of-the-art open-source embodied performance.… 29 r/LocalLLaMA community 13d ago What are Open-Source Views on 'Slowing Down AI'? Personally, I think the whole "AI (LLMs) is going to take over" is just BS marketing. They've been pushing this doom-and-gloom since 2019, and we all know the models back then were nowhere near as capable as today's. What does everyone here think, since it's such a popular topic… 34 r/LocalLLaMA community 13d ago Are there any organizations that are lobbying in favor of open source AI? So we’re seeing how Anthropic and OpenAI are gunning for regulations. I think most of us realize that this is a ploy for them to achieve regulatory capture, thus securing their moat and kicking out open source. The thing is, there’s so much vested corporate interest in ensuring… 36 r/LocalLLaMA community 13d ago Xi promotes open source AI zone among BRICS countries Xi emphasised the need to step up cooperation. https://www.hindustantimes.com/india-news/china-will-lead-creation-of-open-source-ai-for-brics-xi-jinping-101789300908632.html… 17 r/LocalLLaMA community 13d ago The new k2 horizon models seem like an absolute beast Especially the 7B one seems very interesting, it casually destroys muse glimmer with a way smaller size. And they open source literally everything, every step of the way. Anyone tried that model? It can be a new milestone if 7b and 3.7b ones are actually good, and not just… 11 r/LocalLLaMA community 14d ago Muse spark 1.3 is great, but will they open source it? Fingers crosses, this model seems really good when it comes to coding, and the speeds are nice. They talked about making it open source but what happened? I still hope they release 1.2/1.3.   submitted by   /u/formatme [link]   [comments] 33 arXiv — Machine Learning research 14d ago FINESSE: An Agent-Based Simulator and Benchmark Dataset for Multimodal Financial Event Sequences arXiv:2609.11993v1 Announce Type: new Abstract: Machine learning research in financial services is limited by the scarcity of representative open-source datasets. Existing resources are often narrowly focused on a single modality or task and fail to reflect the structured,… 11 r/LocalLLaMA community 14d ago Right to Intelligence. Protect your right to run local AI. With all the recent drama surrounding AI safety. It’s obvious that open source could be caught in the crossfire.   submitted by   /u/Euphoric_Ad9500 [link]   [comments] 30 r/MachineLearning community 14d ago Pacing the Frontier – Tahuna: AI Training Infrastructure, Now Open Source [P] Dario says we need to pace the frontier. Good news: we’ve been pacing Tahuna for months. Today, Tahuna is open source—as promised back in April. We built it so small teams could train models, run inference, orchestrate GPUs, and experiment with autonomous research without first… 32 r/LocalLLaMA community 15d ago Looks like a coordination to stop distribution of intelligence Coxon, bernie and now this First https://x.com/DarioAmodei/status/2098773920774074715 Then https://x.com/elonmusk/status/2098789109980332057 Then https://x.com/sama/status/2098811563415150910 I think fear mongering approaching and they will try to slow down open source "They"… 4 r/LocalLLaMA community 15d ago For those of you forced to only use open models from Western labs in production, what are you deploying? First off, I know that GLM, Qwen, and DeepSeek absolutely dominate in terms of SOTA Open Source models, and that’s what I use in my personal projects and for school, however, I’m also responsible for deploying local AI on my organization’s H100s, and we are forbidden by… 26 r/LocalLLaMA community 16d ago This is why we need open-source harnesses + local models i've been thinking about this more after trying different agent setups. the model isn't the only thing that determines how well an agent performs. The harness around the model matters a lot too. With a managed agent setup, you're often giving up control over things like the… 21 Interconnects (Nathan Lambert) research 16d ago Open-Source AI & Open Models Reading List How to get up to speed on open models and their implications. 4 The Information — AI news-outlet 17d ago Sen. Josh Hawley Launches Investigation Into OpenAI Hugging Face Hack The U.S. Senate formally launched an investigation into the July hack of Hugging Face, when a swarm of OpenAI agents broke out of a testing environment and gained access to the open-source repository. In a letter sent to OpenAI CEO Sam Altman on Wednesday, Republican Sen. Josh… 18 Hugging Face Daily Papers research 18d ago PlannerForge: LLM Agents for Scenario-Based Testing of Motion Planners in Autonomous Driving Abstract PlannerForge is an LLM-agent framework that unifies all stages of scenario-based autonomous driving testing and improves generation, selection, modification, and planning performance across commercial and open-source models. Generated by thinkingmachines/Inkling-Small… 7 The Information — AI news-outlet 18d ago China Hits Back at U.S. Accusation of “Industrial-Scale” AI Distillation China’s Ministry of Commerce rejected U.S. accusations that some Chinese AI firms are conducting “industrial-scale distillation” of American AI models, describing Washington’s latest move as an attempt to politicize a “normal technical and commercial issue.” “China’s open-source… 19 The Information — AI news-outlet 18d ago China Hits Back at U.S. Accusation of “Industrial-Scale” AI Distillation China’s Ministry of Commerce rejected U.S. accusations that some Chinese AI firms are conducting “industrial-scale distillation” of American AI models, describing Washington’s latest move as an attempt to politicize a “normal technical and commercial issue.” “China’s open-source… 36 r/LocalLLaMA community 18d ago Best Open source TTS right now for narration? I run these models on Kaggle notebook, so not all TTS models, such as the ones that use conda env, are compatible (Or I just haven't found a way for them to work on Kaggle). I currently use a fork from Chatterbox called Chatterbox Audiobook. It is like a workstation really… 22 Hugging Face Daily Papers research 19d ago AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editing Abstract AuK is an open-source foundational model that unifies speech generation and editing via natural-language instructions and audio context, using a multimodal language model, joint VAE, hybrid rectified-flow Transformer, and efficient distillation for fast inference.… 37 Hugging Face Daily Papers research 19d ago Miles v0.1: Production-Level Post-Training Abstract Miles is an open-source, production-ready system for large-scale reinforcement learning and post-training that supports diverse backends, weight synchronization, LoRA, distillation, and diffusion models. Generated by thinkingmachines/Inkling-Small We present Miles v0.1,… 16 r/LocalLLaMA community 19d ago A hilarious comment about llama.cpp: “It’s a FB business using the pipeline to make profits” from a 10K star open source project maintainer. Context: I tried to explain that audio.cpp is built around the same philosophy as llama.cpp, but for audio models. "If you know llama.cpp, audio.cpp is ..." Update: Mystery solved --- he’s confusing the Llama models with llama.cpp.… 28 The Information — AI news-outlet 19d ago Hugging Face Is Making A Big Robotics Push Nvidia is paying a steep price for Hugging Face , a repository of open source models, primarily for its strategic position in the center of the open source AI world. But it turns out Nvidia is also getting a budding robot business that could help CEO Jensen Huang fulfill the… 15 r/LocalLLaMA community 19d ago An open-source context layer for building AI on top of company data We’ve been building PipesHub for a while now, and I’d love to get more teams to try it and tell us where it breaks. The problem we kept running into was pretty simple: Building an AI app over company data looks easy in a demo. Connect a few sources, chunk the documents, throw… 24 Hacker News — AI on Front Page community 20d ago TALA Is Open-Source Article URL: https://d2lang.com/blog/tala-is-open-source/ Comments URL: https://news.ycombinator.com/item?id=49604150 Points: 201 # Comments: 12 34 r/LocalLLaMA community 20d ago Cybersecurity is local AI model's killer use case This weekend I posted about the gap closing between frontier models and open source models. Well, now I'm coming with receipts. I've been running local + cloud models against real public github codebases. This is all provable and verifiable: https://github.com/CYPHES-ATP/Node (… 28 r/LocalLLaMA community 20d ago After over a year of my nights and weekends, the Jenny app is done! Hi all! I just wanna say that I am tired lol. Yes, it's another harness, but I spent a lot of time and effort and have forsaken my hobbies to build the Jenny (like XJ-9) app. Jenny is a free, MIT licensed electron desktop app for running local LLMs with tool calling, rollback,… 14 r/LocalLLaMA community 20d ago MiniCPM5-2B Release Day OpenBMB's MiniCPM5-2B scores 15 on the Artificial Analysis Intelligence Index v4.2, the highest of any open weights model at 4B parameters or below Hugging Face: https://huggingface.co/openbmb/MiniCPM5-2B GitHub: github.com/OpenBMB/MiniCPM   submitted by  … 13 arXiv — NLP / Computation & Language research 21d ago RefactorPlatform: An Open-Source Harness for Controlled Evaluation of Repository-Scale Refactoring Agents arXiv:2609.04898v1 Announce Type: new Abstract: Repository-scale refactoring requires coding agents to propagate a single change across many interdependent files without altering program behavior, yet to our knowledge no existing harness isolates the design choices that… 12 arXiv — NLP / Computation & Language research 21d ago Multi-Step Tool-Calling over Korean Open Public APIs: A Benchmark and a Data-Synthesis Recipe arXiv:2609.05395v1 Announce Type: cross Abstract: Data-sovereignty regulations increasingly require public institutions to deploy open-source, on-premise LLM agents that chain multiple tool-calls across live government APIs. However, open-source models consistently underperform… 34 r/LocalLLaMA community 21d ago when will open source LLM catch up to Astra I wonder? I feel like this year has been insane , the speed of AI race is something that normal human can't catch up anymore   submitted by   /u/fugogugo [link]   [comments] 38 Hugging Face Daily Papers research 21d ago Iris: Climbing to the Search Frontier Abstract Two large-scale search agents are trained via a multi-stage pipeline combining supervised fine-tuning and reinforcement learning against live search, achieving state-of-the-art open-source results on complex web benchmarks through rigorous trajectory filtering and… 15 r/LocalLLaMA community 21d ago LayerStoRm open-source expert streaming: 1M context GLM-5.3-Flash [UD-Q4_K_XL] at 24.5 tok/s @8k on just 2× RTX 5090 + 2× RTX 5080 (186 GiB MoE on 96 GB VRAM) LayerStoRm: GLM-5.3-Flash UD-Q4_K_XL (186 GiB) at 1M context on 2× RTX 5090 + 2× RTX 5080 (96 GB VRAM total) using RAM for the pinned experts. LayerStoRm is a (still experimental) MIT-licensed continuous expert-streaming inference engine: it runs MoE models far larger than your… 33 r/MachineLearning community 21d ago PINNStudio: A free, open-source no-code GUI for setting up, training, and visualizing PINNs [P] When I first started working in scientific machine learning, I understood the physics much better than the coding. Every time I wanted to try a new physics-informed neural network problem, I had to start almost from scratch: changing the PDE, updating boundary conditions,… 6 r/LocalLLaMA community 22d ago The gap has closed, open source will win I've been trying the latest models from the frontier labs and honestly, after extensive testing I can not tell the difference between the best open source options. I think the differences are now marginal but the labs are doing heavy marketing to convince the public into paying… 36 Hacker News — AI on Front Page community 23d ago Show HN: Open-Source eInk Bike Computer Hey all, i just launched my Eink Bike computer project and think it is cool. Another tidbit, in the crazy things that AI has done... It has helped create a ANT (common sensor wireless protocol used in workout/biking) implementation for ESP32 by messing around with undocumented… 37 Page 2 of 10 · 500 articles ← Newer Older →
