News / #hardware Tag Hardware 470 articles archived under #hardware · RSS Sign in to follow arXiv — Machine Learning research 22d ago Efficient Clustering with Provable Guardrails for LLM Inference at Scale arXiv:2607.19704v1 Announce Type: new Abstract: Scaling LLM-based applications to millions of users is bottlenecked by the inference cost and latency of modern foundation models. A natural fix is to cluster the inputs and call the LLM only on cluster representatives, letting… 31 arXiv — NLP / Computation & Language research 22d ago BaseRT: Advancing Best-in-Class LLM Inference with Apple M5 Neural Accelerators arXiv:2607.19438v1 Announce Type: cross Abstract: Apple's M5 generation introduces a redesigned GPU architecture in which every core carries a dedicated Neural Accelerator: on-die matrix units exposed through the Metal~4 tensor API. We show that BaseRT, our native Metal… 8 r/LocalLLaMA community 22d ago 🇦🇹 Austria is rolling out a government AI-platform using Mistral models and Open WebUI This is a surprisingly large real-world deployment: "GovGPT" is part of Austria’s Public AI initiative, running on sovereign infrastructure (in their BRZ - federal datacenter) with Mistral open-weight models. Trending Topics reports that Open WebUI is used as the interface for… 5 arXiv — Machine Learning research 23d ago An unsupervised clustering analysis of breast cancer data derived from electronic health records enhanced through UMAP dimensionality reduction arXiv:2607.19089v1 Announce Type: new Abstract: Breast cancer is one of the most widespread types of cancer, affecting approximately 8 million women worldwide. Electronic health records of patients diagnosed with this disease can serve as valuable datasets for computational… 5 arXiv — NLP / Computation & Language research 23d ago Breaking the MoE LLM Trilemma: Dynamic Expert Clustering with Structured Compression arXiv:2510.02345v4 Announce Type: replace Abstract: Mixture-of-Experts (MoE) Large Language Models (LLMs) face a trilemma of load imbalance, parameter redundancy, and communication overhead. We introduce a unified framework based on dynamic expert clustering and structured… 21 TechCrunch — AI news-outlet 23d ago Data centers expected to use 4x more electricity by 2035 New data centers built through 2033 could consume as much electricity as India uses today. 27 r/LocalLLaMA community 23d ago 20B Looping model (paper) matches or beats Qwen3 Coder 30B at 10% of pre-training tokens No weights yet. I feel sad for them, that training run cost maybe 100s of thousands of dollars and they didn't even beat GPT-OSS 20B in every regard But the ability to train a model from scratch on 3.5 trillion tokens instead of 35 trillion sure gives me hope. They only spent… 33 MIT Technology Review — AI news-outlet 23d ago Advancing next-gen AI with materials science innovation The conversation about AI often centers on algorithms, computing power, or huge investments in new semiconductor fabrication plants and hyperscale data centers. But beneath each of these advances is another layer of innovation that makes them possible: advanced materials. Every… 21 arXiv — Machine Learning research 24d ago Explaining and Tuning Transformer-based LLMs in Arithmetic Tasks with Human Strategies arXiv:2607.17166v1 Announce Type: new Abstract: Transformer-based large language models (LLMs) continue to achieve state-of-the-art performance across various natural language processing tasks. However, their subpar performance on seemingly elementary problems, such as basic… 33 arXiv — NLP / Computation & Language research 24d ago D-NOVA: In-Storage Retrieval Accelerator via Dual-Bound 3D NAND-Optimized Similarity Search with Vector Adaptation arXiv:2607.17538v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) enhances the factual grounding of large language model (LLM) inference by retrieving relevant information from external knowledge bases. However, its dense vector retrieval introduces… 4 Hugging Face Daily Papers research 24d ago JoyNexus: Service-Oriented Multi-Tenant Post-Training for VLA Models Abstract The post-training of Vision-Language-Action (VLA) models is essential due to the diversity of simulators, robot embodiments, and task objectives. Existing compute services, whether offered as direct accelerator rental or batch-workload submission, typically allocate an… 13 TechCrunch — AI news-outlet 24d ago AI’s most important protocol is getting a little bit easier to use The Model Context Protocol (MCP) is one of the basic building blocks of AI interoperability, giving AI models a secure way to access external data sources and services. It’s the plumbing that lets a chatbot reach into your calendar, your database, or your internal tools,… 20 Hugging Face Daily Papers research 24d ago Benchmarking Sensor Robustness in Plasma Diagnostic Models: A Systematic Evaluation on TokaMark Abstract Plasma diagnostic models for tokamak fusion devices are almost universally evaluated on clean, complete sensor data. In practice, fusion diagnostics fail regularly: acquisition systems start late, individual sensors die, and signal dropouts cluster precisely when a… 13 r/MachineLearning community 25d ago Introducing ASCIITermDraw Bench | Testing the ability of VLMs to Generate and Edit ASCII [P] ASCIITermDraw-Bench: Can a Model Actually Draw in ASCII? Do we really need a image generator to relay our thoughts about - an architecture? a topology? a cluster og N nodes? Is it possible to let our AI assistants, easily absorb and understand and make possible changes easily… 10 arXiv — Machine Learning research 25d ago Data-Native Global Optimization for Big Data K-means Clustering arXiv:2607.15835v1 Announce Type: new Abstract: Big data clustering remains challenging: the Minimum Sum-of-Squares Clustering (MSSC) problem underlying K-means is NP-hard, and existing methods either reach poor local minima or require prohibitive metaheuristic hybrids. We… 32 arXiv — Machine Learning research 25d ago Understanding Reasoning from Pretraining to Post-Training arXiv:2607.16097v1 Announce Type: new Abstract: Reinforcement learning (RL) has become central to improving large language models (LLMs) on complex reasoning tasks, yet RL post-training is largely studied in isolation from the pretraining that precedes it. As a result, two basic… 20 arXiv — NLP / Computation & Language research 25d ago An MLIR-Based Compilation Method for Large Language Models arXiv:2607.15865v1 Announce Type: new Abstract: Large Language Models (LLMs) have become the dominant workload on modern AI accelerators, yet deploying them on specialized hardware still faces two core challenges: how to import a trained model into a compiler-friendly… 20 Hugging Face Daily Papers research 25d ago Understanding Reasoning from Pretraining to Post-Training Abstract Reinforcement learning (RL) has become central to improving large language models (LLMs) on complex reasoning tasks, yet RL post-training is largely studied in isolation from the pretraining that precedes it. As a result, two basic questions remain open: (1) how do… 38 r/LocalLLaMA community 26d ago Introducing ASCIITermDraw Bench | Testing the ability of VLMs to Generate and Edit ASCII ASCIITermDraw-Bench: Can a Model Actually Draw in ASCII? Do we really need a image generator to relay our thoughts about - an architecture? a topology? a cluster og N nodes? Is it possible to let our AI assistants, easily absorb and understand and make possible changes easily… 8 r/LocalLLaMA community 27d ago The AMD Instinct MI350P is a HBM PCIe AI Accelerator That Has Been All Over   submitted by   /u/Neurrone [link]   [comments] 33 r/LocalLLaMA community 27d ago Typical_p + Qwen There's a lot of people using Qwen here. I finally remembered what I wanted to do: typical_p has been merged eons ago and it's a sampler that was basically designed for countering repetition loops. I didn't yet try it, but I think that should help with its looping hiccups… 12 r/LocalLLaMA community 27d ago When will we get more small LLMs? Basically the title. We had our last drop in the beginning of April, do we just not get a refresh of Gemma or Qwen?   submitted by   /u/Aggravating-Push-207 [link]   [comments] 12 r/LocalLLaMA community 27d ago Welcome to 2014 - my new rig Hi all, Probably for some others me, there is a more conservative budget when it comes to their AI hobby. I've been collecting basically e-waste and could now assemble something partially working from them. Specs: $ neofetch .-/+oossssoo+\-. molbal@... ´:+ssssssssssssssssss+:`… 34 TechCrunch — AI news-outlet 27d ago Why the first GPU financiers are turning to inference chips in a $400 million deal A $400 million chip-backed loan points to the next wave of AI infrastructure deals. 27 arXiv — Machine Learning research 28d ago Counterfactuals for Feature-Weighted Clustering arXiv:2607.14719v1 Announce Type: new Abstract: Counterfactual explanations provide local, interpretable insight by identifying changes to an input that would alter its assigned outcome. Although well established in supervised learning, their extension to clustering is less… 12 arXiv — Machine Learning research 28d ago Analysis of Public Schools Educational Performance Based on Causal Models and Hierarchical Clustering arXiv:2607.14124v1 Announce Type: cross Abstract: The increasing availability of large-scale educational datasets has expanded the use of quantitative methods for investigating school performance. However, institutional heterogeneity among schools and the structural complexity… 23 Simon Willison community 28d ago Spot birds not golf Suggestion for hyperscalers feeling pressure over data center water use: Buy up a few exclusive country clubs, convert the golf courses into public parks, pay for guides and binoculars to get the previous members into birdwatching - help them embrace a more sustainable hobby!… 27 r/LocalLLaMA community 28d ago Added SearXNG and I don't even know what to say anymore. I just have to show someone other than the guys at work who think I'm crazy. I've been working on this app since about early June of 2025 and while it has come a long way in its workspace tools, I had always only had basic web capability. But I saw some posts yet again recently… 11 TechCrunch — AI news-outlet 28d ago Roblox launches an AI-powered game creation feature in its mobile app Roblox's new "Build" feature lets users generate basic games using a single text prompt. 37 r/LocalLLaMA community 28d ago Kimi K3 Release Video [Made with Kimi K3] Everyone's probably seen the remotion thing that went viral a couple months back with CC. Its basically that with Kimi K3 as the model provider. Prev. example with GLM 5.2: https://www.reddit.com/r/LocalLLaMA/comments/1u8kyqf/glm_52_release_video_made_with_glm_52/ Feels much… 33 Latent.Space news-outlet 28d ago 🔬 The Lab of the Future Should Feel Like a Data Center — Andy Beam & Rafa Gómez-Bombarelli, Lila Sciences Lila is betting that science, not the internet, is the last untapped source of training data. We went to find out what that actually looks like in a room full of robots. 30 arXiv — Machine Learning research 29d ago EMAGN: Efficient Multi-Attention Graph Network via Learned Clustering for Scalable Traffic Forecasting arXiv:2607.13241v1 Announce Type: new Abstract: Traffic forecasting is highly challenging due to complex and nonlinear spatial and temporal dependencies. Self-attention mechanisms have been widely adopted to model dynamic and long-range dependencies, achieving state-of-the-art… 17 arXiv — Machine Learning research 29d ago Agora: Collective and Permissionless Internet-Scale Pretraining of Large Language Models arXiv:2607.13332v1 Announce Type: new Abstract: Training large language models at the multi-billion to trillion parameter scale is confined to datacenters, where data-parallel (DP) and model-parallel (MP) techniques presume homogeneous accelerators, high-speed interconnects, and… 24 arXiv — Machine Learning research 29d ago Clustering algorithms for multivariate wind farm SCADA data filtering arXiv:2607.13544v1 Announce Type: new Abstract: During wind farm operation, Supervisory Control and Data Acquisition (SCADA) systems record numerous anomalies, transients, and specific operational modes, leading to large datasets. However, for a wide range of applications, only… 31 arXiv — Machine Learning research 29d ago Optimal and Efficient Contextual Combinatorial Semi-bandits with General Function Approximation arXiv:2607.13686v1 Announce Type: new Abstract: We study the contextual combinatorial semi-bandit (CCSB) problem with general reward function approximation. At each round, the learner observes a context, selects a combinatorial action consisting of a subset of basic arms, and… 23 arXiv — Machine Learning research 29d ago Hierarchical $\mathcal{F}$-Clustering: Approximation and Hardness of Clustering into Trees and Bounded Diameter Graphs arXiv:2607.13217v1 Announce Type: cross Abstract: Consider the following variation on the Hierarchical Clustering problem: Usually, while building a hierarchical clustering, one recursively partitions the data until each cluster becomes a singleton. We relax the halting… 4 r/LocalLLaMA community 29d ago RL post-training on 14 Macs across 4 countries Disclosure: I work at Pluralis Research, the lab that built this. Code is open, and I'm happy to answer questions. TL;DR: As far as we can tell, this is the first RL post-training run whose entire rollout fleet ran on consumer Macs over the open internet. Setup 14 Macs across 4… 19 Hacker News — AI on Front Page community 29d ago Mysteries of Telegram Data Centers (2022) Article URL: https://dev.moe/en/3025 Comments URL: https://news.ycombinator.com/item?id=48920475 Points: 221 # Comments: 110 7 arXiv — Machine Learning research 1mo ago Cluster-Weighted EDMD arXiv:2607.12243v1 Announce Type: new Abstract: Extended Dynamic Mode Decomposition (EDMD) approximates Koopman operators from data, but a single global operator is inefficient when different state-space regions exhibit distinct local dynamics. We introduce Cluster-Weighted EDMD… 13 arXiv — Machine Learning research 1mo ago Energy-Based Physics-Informed Form Finding for Clustered Tensegrity Structures arXiv:2607.12888v1 Announce Type: new Abstract: Tensegrity form-finding and physical property prediction are fundamental inverse problems in structural mechanics, which aim to determine equilibrium configurations and internal force distributions. These problems are challenging… 27 Hacker News — AI on Front Page community 1mo ago Jurassic Park computers in excruciating detail Article URL: https://fabiensanglard.net/jurrasic_park_computers/index.html Comments URL: https://news.ycombinator.com/item?id=48915709 Points: 277 # Comments: 62 7 r/MachineLearning community 1mo ago Things I got wrong building an incremental indexing pipeline [P] I've been working on incremental indexing pipelines lately, basically keeping a vector store in sync as the source data changes, and I keep finding the same bugs never show up until it's been running a while. Biggest one for me is deletes. I tested the "new doc comes in, gets… 10 TechCrunch — AI news-outlet 1mo ago OpenAI’s new flagship model deletes files on its own, people keep warning A number of social media posts claim that GPT-5.6 Sol deleted files and data without warning. OpenAI had basically disclosed the problem in June. 11 Hugging Face Daily Papers research 1mo ago A Theory of Contrastive Learning with Natural Images Abstract Why does contrastive learning with simple images and augmentations yield useful representations for downstream tasks? We address this question by analytically computing the optimal representation in terms of a contrastive loss for a range of basic augmentations and any… 33 TechCrunch — AI news-outlet 1mo ago New York State halts construction of all new data centers New York has become the first state to temporarily halt approval of large data centers, as Gov. Kathy Hochul argues the AI-driven building boom shouldn’t come at the expense of higher electricity costs, water supplies, or local control. 27 Ars Technica — AI news-outlet 1mo ago New York bans data center construction for a year, rattling AI industry New York’s data center moratorium may become the blueprint for anti-AI movement. 17 TechCrunch — AI news-outlet 1mo ago Sam Altman’s space data center trash talk is what most experts already believe "homeboy you're the one sellling [sic] public market investors on short-term space datacenters." 5 arXiv — Machine Learning research 1mo ago Group Invariant Spectral Embedding arXiv:2607.08987v1 Announce Type: new Abstract: Spectral embedding methods are widely used for dimensionality reduction and clustering of high-dimensional datasets with intrinsic low-dimensional structures. Although many datasets of practical interest exhibit invariance under… 19 arXiv — NLP / Computation & Language research 1mo ago Relation Extraction Model Based on Semantic Enhancement Mechanism arXiv:2311.02564v2 Announce Type: replace Abstract: Relational extraction is one of the basic tasks related to information extraction in the field of natural language processing, and is an important link and core task in the fields of information extraction, natural language… 9 r/LocalLLaMA community 1mo ago Has anyone gotten Llama.cpp (or other) working using Intel iGPU (arrowlake) where it actually improves anything? I Recently did a bunch of tests and wrote them all up on here, but the short version is that Vulkan basically doesn't work (or when it does, it's at 1tok/s at best). SYCL works pretty well, seems to run the Qwen3.6 35b models at around 12tok/s. The prefill part is around 20tok/s… 17 Page 3 of 10 · 470 articles ← Newer Older →
