News / #open-source Tag Open source 500 articles archived under #open-source · RSS Sign in to follow r/LocalLLaMA community 1h ago NVIDIA shipped OpenShell, an open source sandbox that gives local and open agents real runtime limits instead of prompt rules. Over 100 firms joined the safety stack. OpenAI did not. https://x.com/JensenHuang/status/2104499465055023424   submitted by   /u/InternationalGap3698 [link]   [comments] 14 r/MachineLearning community 5h ago Free, open-source AI engineering course where you build each algorithm by hand: 523 lessons, now as EPUB/PDF books [P] AI Engineering from Scratch is an MIT-licensed curriculum: 523 lessons across 20 phases, from linear algebra and backprop to transformers, LLMs, agents, and production serving. The code is stdlib-first, so you see every step instead of calling a library. This month's edition: -… 37 arXiv — NLP / Computation & Language research 7h ago THA: Weighted Finite-State Text Normalization and Inverse Text Normalization for Khmer arXiv:2609.30984v1 Announce Type: new Abstract: Text-to-speech needs written text in spoken form, and speech recognition output needs the reverse. For Khmer, neither direction has a maintained open-source tool, and the script makes both harder: words are not separated by spaces,… 8 r/LocalLLaMA community 11h ago Qwen company already rushed out a Jev competitor. No open weights yet. It's called decision-model-preview. There is only a docs page. No announcement or anything. I can't post a link because reddit's filters just deletes posts that contain a link to the cloud platform that hosts it. But you'll find the page if you Google the model name.  … 28 r/LocalLLaMA community 20h ago We released VeriLoop E2 (27B, Apache-2.0). The design question behind it: should an LLM be allowed to commit its own state? Disclosure: I’m one of the authors of VeriLoop E2, a 27B model post-trained from Qwen3.8-27B. The weights are Apache-2.0; the harness we evaluate it in is not open source (details at the bottom). This is a release post, but rather than a benchmark dump I want to talk about the… 28 r/LocalLLaMA community 20h ago What if open-source AI focused less on giant models and more on reusable capabilities? Instead of everyone building another general-purpose model, the community could distill open models into domain specialists—biology, Python, accounting, OCR, and more. Developers could combine these capabilities into local tools: small model + OCR + accounting → local accounting… 13 r/MachineLearning community 22h ago ClashRoyaleAi: an open-source, deterministic Clash Royale simulator for RL, with recurrent PPO, lookahead search and expert iteration [P] The opponent plans by simulation: every second it scores each candidate play by running the match 10 seconds ahead in the engine. Our PPO agent learned to park its Cannon behind its own King. Losing a building in a fight cost reward, and letting it decay cost nothing, so it… 8 r/LocalLLaMA community 1d ago SupersonicLabs/Julia-1 · Hugging Face New open source Jev like model for running on local devices from a group called Supersonic Labs. It's a 144M param local non-generative local classifier. From their site : Julia 1 opens our research into compact decision models. It builds on mmBERT-small , a multilingual… 15 r/LocalLLaMA community 1d ago I added Qwen-Image 2.1 + LoRA support to TensorSharp (GGUF, local inference) I maintain TensorSharp , an open-source inference engine. It can now run Qwen-Image 2.1 locally for text-to-image generation and image editing, with support for its LoRA adapters. I’ve added configs for regular style and editing LoRAs, plus accelerated adapters with their own… 14 Hacker News — AI on Front Page community 2d ago Ollaya – Ollama for open-source, Jev-style decision models Article URL: https://ollaya.dev/ Comments URL: https://news.ycombinator.com/item?id=49848269 Points: 255 # Comments: 81 30 r/LocalLLaMA community 2d ago Jev vs. Kev: open-source Jev alternative tested side by side We hosted Kev 4B (Jared Palmer's Apache-2.0 fine-tune of Qwen3.5-4B) and ran it side by side with Jev on the same endpoint to see how it compares. We built a fresh set of 362 items published after both models shipped (new arXiv papers, Stack Exchange questions, GitHub issues),… 9 arXiv — NLP / Computation & Language research 3d ago ChunkRank: Model-Aware Text Chunking and Abstention-Aware Answer Selection for LLM Pipelines arXiv:2609.29828v1 Announce Type: new Abstract: We present ChunkRank, an open-source Python library that derives chunk boundaries from a target model's tokenizer and context window, and selects an answer among candidates produced independently per chunk. It ships a validated… 38 Hacker News — AI on Front Page community 3d ago Show HN: Whiteboard (YC W26) – An open-source IDE for thoughtful software design Hello! We’re Sid, Alex, Ketan, and Milan. We’re building Whiteboard ( https://whiteboard.dev.fast/ ), an open-source desktop app where humans and agents can architect software together in a common workspace. Here’s our repo: https://github.com/devdotfast/whiteboard . We were… 4 The Information — AI news-outlet 4d ago Open Source, Model Price Cuts Keep AI Costs Under Control Open-source models as well as cheaper model releases from Anthropic and OpenAI are helping business customers rein in costs while getting as much or more out of AI, said speakers at The Information’s AI Agenda Live conference in San Francisco Wednesday. “The existence of open… 34 arXiv — Machine Learning research 4d ago TNLearn: An Open Source Python Package for Task-based Neurons arXiv:2609.27564v1 Announce Type: new Abstract: The brain does not rely on a single type of neuron to perform all kinds of tasks; instead, it designs different neurons for different tasks. The concept of task-based neurons represents a paradigm shift compared to task-based… 36 Hacker News — AI on Front Page community 4d ago Ideas on modernizing the open-source desktop Article URL: https://lwn.net/SubscriberLink/1095425/2d9f411252325784/ Comments URL: https://news.ycombinator.com/item?id=49825642 Points: 301 # Comments: 349 30 r/LocalLLaMA community 4d ago RSI ACHIEVED at Reef(Rumours again lol) and it's open source   submitted by   /u/Muhlwa_Sholanke [link]   [comments] 29 r/LocalLLaMA community 5d ago Nathan Lambert's written Congressional testimony on the state of open models - Chinese open-weight downloads now 2x America's, >80% of OpenRouter open-model usage Worth a read if you track open weights. Nathan Lambert (interconnects) posted the written version of his Congressional testimony on where open models stand. The numbers that got me: Hugging Face downloads of Chinese open-weight models are about 3.2B vs 1.6B American since he… 12 r/LocalLLaMA community 5d ago The attack on open weights continues to grow. Illinois folks (like myself), write your governor, please. And if you live elsewhere, please pay attention to your local/state politics. https://wgntv.com/politics-3/pritzker-establishes-ai-cabinet-to-assess-risks-protect-illinoisans/ “Artificial Intelligence has enormous… 8 r/LocalLLaMA community 5d ago stuntd: a local Jev-compatible server on Laya that learns from your own traffic (no API key needed) What it is. stuntd is a local proxy for typed LLM decisions: choice, yes/no, score. Your app keeps calling its provider through it. stuntd records the decisions, trains a small head on top of Laya (the open-weights System One model; the encoder stays frozen), serves it in shadow… 7 r/LocalLLaMA community 5d ago New 6B image model coming, AntLing just open sourced the Ming-Image-0.1-Design family • Ming-Image-0.1-Design, 6B • Ming-Image-0.1-Design-Layer, 6B • Two open-source Agent Skills: the Ling UI Design Skill and the Image-to-Editable-PPT Skill Ming-Image-0.1-Design ranks #1 among open-weight models on Artificial Analysis’s UI/UX Design leaderboard.… 12 r/LocalLLaMA community 5d ago AntLing open sourced the Ming-Image-0.1-Design family AntLing open sourced the Ming-Image-0.1-Design family: • Ming-Image-0.1-Design, 6B • Ming-Image-0.1-Design-Layer, 6B • Two open-source Agent Skills: the Ling UI Design Skill and the Image-to-Editable-PPT Skill Ming-Image-0.1-Design ranks #1 among open-weight models on Artificial… 9 The Information — AI news-outlet 6d ago Z.ai Open-Sources ZCode After Data Uploading Scandal Z.ai said that it has open-sourced its coding tool, ZCode, after the Chinese AI firm faced intense backlash from developers who found out that their data was being uploaded to cloud servers without their consent. “In response to the ZCode product security issues reported by the… 19 Latent.Space news-outlet 6d ago [AINews] Xiaomi MiMo-V2.6-Pro 1T-A42B: the new top Open Weights model, trained for $3M crowning a new Chinese frontier lab 38 arXiv — NLP / Computation & Language research 6d ago Replicating the Geometry of Emotion Representations in a Base Open-Weights Model arXiv:2609.22208v1 Announce Type: new Abstract: Sofroniew et al. (2026) report that emotion concepts in Claude Sonnet 4.5 are represented as vectors whose geometry mirrors human affect psychology. We replicate the representational core of that study on the base pretrained model… 8 r/LocalLLaMA community 6d ago 50+ Hours and 100M+ Tokens Later, Open Source Autonomous Agent is GETTING CLOSER at Solving an Open Math problem This experiment is live, you can inspect all the internal reasoning, memories, attempts here: https://artificium-covering-experiment.gr.bio/ The problem that the agent is trying to solve is a covering design problem: https://en.wikipedia.org/wiki/Covering_design Known as… 19 arXiv — Machine Learning research 7d ago Talk to Me, Jarvis: An Open-Source Edge-Deployable Voice Assistant Framework for Autonomous Racecars arXiv:2609.21109v1 Announce Type: new Abstract: Recent advances in large language models have improved their effectiveness as back-end components for voice assistants, particularly in intent understanding and context-aware input classification. However, online-hosted models… 13 arXiv — NLP / Computation & Language research 7d ago COAL-SQL: Coverage-Guided Augmentation and Failure-Driven Learning for Text-to-SQL Post-Training arXiv:2609.20842v1 Announce Type: new Abstract: Text-to-SQL translates natural-language questions into executable SQL queries, but open-source large language models still require task-specific post-training for complex, real-world SQL generation. Effective post-training requires… 28 r/LocalLLaMA community 7d ago convaiinnovations/laya (multilingual, non-autoregressive System 1 decision model) Laya is an open-weight (Apache 2.0) "System 1" decision model from Convai Innovations, built by Nandakishor M as an open alternative to TypeSafe's closed Jev API. Instead of generating text, it takes a state (text, an email, a ticket, or JSON) plus typed questions (choice to… 15 r/LocalLLaMA community 7d ago ZCode is now open source ZCode is now open source , and the reported security issues have been addressed. Source code: https://github.com/zai-org/ZCode The repo includes its desktop app, web workspace, backend, Agent CLI, and runtime. Official announcement: In response to the ZCode product security… 24 r/LocalLLaMA community 7d ago Wow... thank goodness for open weights!!!   submitted by   /u/johnnyApplePRNG [link]   [comments] 38 r/MachineLearning community 7d ago Hemmingway-1, an Apache-2.0 27B creative-writing fine-tune (Qwen3.8-27B base, EQ-Bench 4 1330)[R] we're a small lab (switzerland + south africa) and just open-sourced our first model: a 27b fine-tune of qwen3.8-27b specialized for creative writing and short-form personal text (stories, dialogue, roleplay, texts, emails). apache-2.0, plain weights on huggingface, 54.7 gb… 34 r/LocalLLaMA community 7d ago laya.cpp: Optimized laya near-instant decision making After seeing u/Nandakishor_ml’s post introducing Laya , I wanted to see how fast it could run in a standalone C++ implementation. Credit to u/Nandakishor_ml for the architecture, training and open-source release. My contribution is the inference implementation: laya.cpp , built… 25 r/LocalLLaMA community 7d ago Qwen-Image-2.1 released! Meet Qwen-Image-2.1, the most balanced and cost-effective image generation model in the Qwen-Image series! Now open weights! 🎨 A unified model for both generation and editing, delivering top-tier quality in a lightweight package. Highlights: - Compact & exceptionally fast: A… 5 r/LocalLLaMA community 7d ago a local Jev-style decision head onto Qwen 2.5 1.5B Jev from TypeSafe AI got me thinking about non-autoregressive decision engines, so I built a small proof-of-concept called AES to test the concept locally on open weights. It uses Qwen/Qwen2.5-1.5B-Instruct as the base. Instead of generating tokens, it runs a single prefill… 8 r/MachineLearning community 8d ago ProgramAsWeights: compile English function descriptions into neural programs that run locally [R] Given the recent interest in tools like Jev, I wanted to share ProgramAsWeights (PAW), an open-source research project I'm working on at the University of Waterloo. You describe a text function in English, compile it into a reusable neural program, and run it locally, including… 13 r/LocalLLaMA community 8d ago “DeadGrid” now open source exclusively made with qwen 3.8 27b Q4KM Play it right in your browser, no download. Some of the GLB’s are messy, but overall I’ve enjoyed playing with it, and the last iteration made was the gun/weapon placement. Contributors are welcome, would like to see what can be made of this from local inference only.… 4 r/LocalLLaMA community 8d ago Von: Open-source 395M "System One" model Took me a while since I'm on a family trip and have limited hardware, but here it is! Von: Open-source "System One" drop-in replacement for TypeSafe's JEV. https://github.com/wfzyx/von https://huggingface.co/wfzyx/von-1.0 It runs entirely on a CPU with 1–2 GB of memory (I… 21 Hacker News — AI on Front Page community 9d ago Laya the open source version of Jev Article URL: https://laya.convaiinnovations.com/ Comments URL: https://news.ycombinator.com/item?id=49765348 Points: 330 # Comments: 64 15 r/LocalLLaMA community 9d ago Qwen3.8-27B at 144 tok/s on an M5 Max MacBook Pro Meet Inco Splash, open-source inference engine, built around the model and around Apple silicon. Up to 3× the decode speed of Ollama, 2× oMLX, and almost 4× when an agent fans out into sub-agents. Requirements: M3 or newer, macOS 26.4+, 36 GB Get started with a single command:… 32 r/LocalLLaMA community 9d ago Alibaba open-sources medical AI model that can detect cancer and nearly 150 conditions Hopefully things like this let people understand there is good things that can come out of AI.   submitted by   /u/giveen [link]   [comments] 14 r/LocalLLaMA community 9d ago I truly think every major AI lab is purposefully making fear-mongering headlines to get regulations that hurt open-source models   submitted by   /u/Fusseldieb [link]   [comments] 35 r/LocalLLaMA community 9d ago ProgramAsWeights: describe an AI function in English, compile it once, and run it locally on CPU With the recent interest in Jev, especially in open-source and locally executable alternatives, I wanted to share a related project we've been building at the University of Waterloo: ProgramAsWeights (PAW). The idea is simple: describe a function in English, compile it once,… 9 Ars Technica — AI news-outlet 9d ago US government website used Chinese model the FBI called "malicious" The Federal Register website briefly used an open source Chinese AI search tool. 12 r/LocalLLaMA community 9d ago MiniMax Code is now open source. Maybe M3.1 is the next thing to watch. MiniMax has released the source code for MiniMax Code’s terminal agent: https://github.com/MiniMax-AI/minimax-code https://preview.redd.it/st9izmm8zaqh1.png?width=3016&format=png&auto=webp&s=5853bc316ea0b1823e42fd5574a4e713b47e3441 For those unfamiliar with it, MiniMax Code is… 35 r/LocalLLaMA community 9d ago MiniMax Code goes open source MiniMax has open-sourced the terminal version of MiniMax Code: https://github.com/MiniMax-AI/minimax-code How can developers verify the content that encoding proxies read, send, and store? This is a topic that has been widely discussed recently. Open sourcing the agent doesn’t… 4 r/LocalLLaMA community 9d ago China’s mysterious AI company Naive AI is valued at over $1.4 billion and could release its first open-source llm model as early as this month. According to people familiar with the matter, Naive AI, an AI startup founded in February this year by Tsinghua University professor Dai Jifeng, has completed three funding rounds totaling $400 million, bringing its valuation to more than $1.4 billion and earning it unicorn… 5 r/LocalLLaMA community 10d ago Flyweight: open-source C++/CUDA engine for running MoE models bigger than your VRAM on one GPU + system RAM. First PyPI release, looking for contributors. Been building this for a few months, mostly for myself, and it just got a proper release so figured I'd post it. It's a native GGUF inference runtime with OpenAI/Anthropic-compatible APIs and a chat UI. The whole point is one consumer NVIDIA card + lots of RAM: MoE models that… 21 r/LocalLLaMA community 10d ago Made the horizontal open-source model for Jev with RLCD, and it surpasses all the Jev benchmarks. HF space, benchmark, model, repo Thanks for the exceptional support ( https://www.reddit.com/r/LocalLLaMA/comments/1wijo3e/i_literally_built_the_jev_architecture_one_year/ ) and for the dozens of requests to make a generic model, run benchmarks, and create an HF space so anyone can test it. So here you go,… 30 arXiv — NLP / Computation & Language research 10d ago BurnRiSc: Toward Non-Invasive Burnout Screening in Open Source from Public Repository Signals arXiv:2609.19422v1 Announce Type: cross Abstract: Burnout is a chronic occupational syndrome, and open source is close to a worst case for it: maintainers absorb unbounded demand with no manager to reallocate work and no organization to notice decline. The cost is not only… 7 Page 1 of 10 · 500 articles Older →