News / #hardware Tag Hardware 500 articles archived under #hardware · RSS Sign in to follow arXiv — Machine Learning research 3mo ago RIS-Kernel: A Model-Agnostic Architecture for Long-Context LLM Inference via Sparse Attention arXiv:2607.21927v1 Announce Type: new Abstract: Full self-attention in large language models scales as O(N^2), which limits long-context document analysis to 65,536 tokens and requires costly GPU clusters. The Reduced Interaction Sampling (RIS) inference engine addresses this… 31 arXiv — NLP / Computation & Language research 3mo ago Data Quality over Capacity: Internalizing Documents into LoRA Adapters for Closed-Book QA arXiv:2607.21861v1 Announce Type: new Abstract: We study baking documents directly into the weights of a 4-bit Gemma-4-e4b model via LoRA, so a system can answer questions about a corpus closed-book: no retrieval and no context-window budget. Across roughly 100 training runs… 22 r/LocalLLaMA community 3mo ago Will prices finally go down? I am seeing more and more videos as posts about how OpenAI is in complete financial ruin, Anthropic isn't much better. Their expenses go with the revenue they make etc etc. Meta made big investments into AI data centers and had no use for then, had to rent them, same thing with… 38 r/LocalLLaMA community 3mo ago Harness showdown: Claude Code vs OpenCode vs Pi with DeepSeek V4 Flash I ran DeepSeek V4 Flash through Claude Code, OpenCode and Pi on my own benchmark, and the quality came out basically the same across all three while the time and tokens spent was wildly different. Claude code (with DS in CLIProxyAPI ) takes nearly 4 times longer than the fastest… 38 r/LocalLLaMA community 3mo ago 90 agentic bakeoff runs: ThinkingCap vs Fable Fusion vs stock Qwen3.6-27B Last week someone here said ThinkingCap and Fable Fusion "really do beat the OG" for agentic work, so I ran it: 6 self-grading tasks, 5 reps, 3 models, 90 isolated runs. Tooling, since that's half the story: each run was a fresh Coder workspace on my k8s cluster driving my own… 17 r/LocalLLaMA community 3mo ago World's First(?) Underwhelming AMD Ryzen AI Halo Cluster LTT Labs recently received the Linux version of the AMD Ryzen AI Halo for testing, but it turns out that AMD had intended to send the Windows version. Through this stroke of misfortunate, we were fortunate enough to have two Ryzen AI Halos for a short period of time and the… 14 TechCrunch — AI news-outlet 3mo ago One fallen power line exposed a growing AI data center problem. Here’s how to fix it. A close call in Northern Virginia revealed just how poorly data centers respond to grid disruptions. Here's how to fix the problem. 34 Ars Technica — AI news-outlet 3mo ago AI firms want more data centers; Trump's EPA may give neighbors less say Rule would allow states to decide how much—if any—public input there can be. 12 Hacker News — AI on Front Page community 3mo ago IRGC claims it destroyed Amazon's Bahrain data center Article URL: https://houseofsaud.com/irgc-claims-destroyed-amazon-bahrain-data-center/ Comments URL: https://news.ycombinator.com/item?id=49033240 Points: 262 # Comments: 332 8 arXiv — Machine Learning research 3mo ago External Clustering Validation by the Homogeneity-Parsimony Trade-off arXiv:2607.20799v1 Announce Type: new Abstract: Scalar metrics are often used to evaluate clusterings against known classes, but they can obscure a fundamental trade-off: clusterings should be informative about class labels while avoiding unnecessary fragmentation. Here we… 34 arXiv — Machine Learning research 3mo ago Regularized Optimization on Grassmann Manifold: Theory, Algorithm and Applications arXiv:2607.21039v1 Announce Type: new Abstract: Spectral methods are among the most widely used techniques for community detection, clustering, and graph learning. Their performance, however, critically depends on the accurate estimation of the underlying spectral subspace and… 7 arXiv — Machine Learning research 3mo ago CASC: Causal Adversarial Subspace Clustering for Multivariate Spatiotemporal Data arXiv:2607.21088v1 Announce Type: new Abstract: Deep subspace clustering plays a critical role in applications involving multivariate spatiotemporal data, such as sea ice monitoring, disease spread analysis, and tracking neuro-degeneration over time. Despite recent advances,… 29 arXiv — Machine Learning research 3mo ago Semantic-Aware Task Clustering for Constructive and Cooperative Multi-Tasking arXiv:2607.21426v1 Announce Type: new Abstract: Cooperative multi-task semantic communication (CMT-SemCom) improves task execution performance by leveraging shared representations. However, as we demonstrated in [1], cooperative multi-tasking can be either constructive or… 16 r/MachineLearning community 3mo ago NeurIPS E and D, Average rating 3 and average confidence 4, I can rebuttal and address all their concerns? Do I still have a decent shot or unlikely ?[R] NeurIPS E and D track review are out today and the average rating I received is a 3 and confidence is a 4. I can correct and address all their concerns. Do I still have a genuine shot of getting in or is it basically impossible at this point since none of my scores are a 4 or 5?… 37 arXiv — Machine Learning research 3mo ago SCPP: A Unified Python Library for Soft Clustering arXiv:2607.19620v1 Announce Type: new Abstract: In this paper, we present SCPP (Soft Clustering Python Package), an open-source Python framework for soft clustering. SCPP establishes a canonical, scikit-learn-compatible estimator interface that standardizes model training,… 8 arXiv — Machine Learning research 3mo ago Efficient Clustering with Provable Guardrails for LLM Inference at Scale arXiv:2607.19704v1 Announce Type: new Abstract: Scaling LLM-based applications to millions of users is bottlenecked by the inference cost and latency of modern foundation models. A natural fix is to cluster the inputs and call the LLM only on cluster representatives, letting… 31 arXiv — NLP / Computation & Language research 3mo ago BaseRT: Advancing Best-in-Class LLM Inference with Apple M5 Neural Accelerators arXiv:2607.19438v1 Announce Type: cross Abstract: Apple's M5 generation introduces a redesigned GPU architecture in which every core carries a dedicated Neural Accelerator: on-die matrix units exposed through the Metal~4 tensor API. We show that BaseRT, our native Metal… 8 r/LocalLLaMA community 3mo ago 🇦🇹 Austria is rolling out a government AI-platform using Mistral models and Open WebUI This is a surprisingly large real-world deployment: "GovGPT" is part of Austria’s Public AI initiative, running on sovereign infrastructure (in their BRZ - federal datacenter) with Mistral open-weight models. Trending Topics reports that Open WebUI is used as the interface for… 5 arXiv — Machine Learning research 3mo ago An unsupervised clustering analysis of breast cancer data derived from electronic health records enhanced through UMAP dimensionality reduction arXiv:2607.19089v1 Announce Type: new Abstract: Breast cancer is one of the most widespread types of cancer, affecting approximately 8 million women worldwide. Electronic health records of patients diagnosed with this disease can serve as valuable datasets for computational… 5 arXiv — NLP / Computation & Language research 3mo ago Breaking the MoE LLM Trilemma: Dynamic Expert Clustering with Structured Compression arXiv:2510.02345v4 Announce Type: replace Abstract: Mixture-of-Experts (MoE) Large Language Models (LLMs) face a trilemma of load imbalance, parameter redundancy, and communication overhead. We introduce a unified framework based on dynamic expert clustering and structured… 21 TechCrunch — AI news-outlet 3mo ago Data centers expected to use 4x more electricity by 2035 New data centers built through 2033 could consume as much electricity as India uses today. 27 r/LocalLLaMA community 3mo ago 20B Looping model (paper) matches or beats Qwen3 Coder 30B at 10% of pre-training tokens No weights yet. I feel sad for them, that training run cost maybe 100s of thousands of dollars and they didn't even beat GPT-OSS 20B in every regard But the ability to train a model from scratch on 3.5 trillion tokens instead of 35 trillion sure gives me hope. They only spent… 33 MIT Technology Review — AI news-outlet 3mo ago Advancing next-gen AI with materials science innovation The conversation about AI often centers on algorithms, computing power, or huge investments in new semiconductor fabrication plants and hyperscale data centers. But beneath each of these advances is another layer of innovation that makes them possible: advanced materials. Every… 21 arXiv — Machine Learning research 3mo ago Explaining and Tuning Transformer-based LLMs in Arithmetic Tasks with Human Strategies arXiv:2607.17166v1 Announce Type: new Abstract: Transformer-based large language models (LLMs) continue to achieve state-of-the-art performance across various natural language processing tasks. However, their subpar performance on seemingly elementary problems, such as basic… 33 arXiv — NLP / Computation & Language research 3mo ago D-NOVA: In-Storage Retrieval Accelerator via Dual-Bound 3D NAND-Optimized Similarity Search with Vector Adaptation arXiv:2607.17538v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) enhances the factual grounding of large language model (LLM) inference by retrieving relevant information from external knowledge bases. However, its dense vector retrieval introduces… 4 Hugging Face Daily Papers research 3mo ago JoyNexus: Service-Oriented Multi-Tenant Post-Training for VLA Models Abstract The post-training of Vision-Language-Action (VLA) models is essential due to the diversity of simulators, robot embodiments, and task objectives. Existing compute services, whether offered as direct accelerator rental or batch-workload submission, typically allocate an… 13 TechCrunch — AI news-outlet 3mo ago AI’s most important protocol is getting a little bit easier to use The Model Context Protocol (MCP) is one of the basic building blocks of AI interoperability, giving AI models a secure way to access external data sources and services. It’s the plumbing that lets a chatbot reach into your calendar, your database, or your internal tools,… 20 Hugging Face Daily Papers research 3mo ago Benchmarking Sensor Robustness in Plasma Diagnostic Models: A Systematic Evaluation on TokaMark Abstract Plasma diagnostic models for tokamak fusion devices are almost universally evaluated on clean, complete sensor data. In practice, fusion diagnostics fail regularly: acquisition systems start late, individual sensors die, and signal dropouts cluster precisely when a… 13 r/MachineLearning community 3mo ago Introducing ASCIITermDraw Bench | Testing the ability of VLMs to Generate and Edit ASCII [P] ASCIITermDraw-Bench: Can a Model Actually Draw in ASCII? Do we really need a image generator to relay our thoughts about - an architecture? a topology? a cluster og N nodes? Is it possible to let our AI assistants, easily absorb and understand and make possible changes easily… 10 arXiv — Machine Learning research 3mo ago Data-Native Global Optimization for Big Data K-means Clustering arXiv:2607.15835v1 Announce Type: new Abstract: Big data clustering remains challenging: the Minimum Sum-of-Squares Clustering (MSSC) problem underlying K-means is NP-hard, and existing methods either reach poor local minima or require prohibitive metaheuristic hybrids. We… 32 arXiv — Machine Learning research 3mo ago Understanding Reasoning from Pretraining to Post-Training arXiv:2607.16097v1 Announce Type: new Abstract: Reinforcement learning (RL) has become central to improving large language models (LLMs) on complex reasoning tasks, yet RL post-training is largely studied in isolation from the pretraining that precedes it. As a result, two basic… 20 arXiv — NLP / Computation & Language research 3mo ago An MLIR-Based Compilation Method for Large Language Models arXiv:2607.15865v1 Announce Type: new Abstract: Large Language Models (LLMs) have become the dominant workload on modern AI accelerators, yet deploying them on specialized hardware still faces two core challenges: how to import a trained model into a compiler-friendly… 20 Hugging Face Daily Papers research 3mo ago Understanding Reasoning from Pretraining to Post-Training Abstract Reinforcement learning (RL) has become central to improving large language models (LLMs) on complex reasoning tasks, yet RL post-training is largely studied in isolation from the pretraining that precedes it. As a result, two basic questions remain open: (1) how do… 38 r/LocalLLaMA community 3mo ago Introducing ASCIITermDraw Bench | Testing the ability of VLMs to Generate and Edit ASCII ASCIITermDraw-Bench: Can a Model Actually Draw in ASCII? Do we really need a image generator to relay our thoughts about - an architecture? a topology? a cluster og N nodes? Is it possible to let our AI assistants, easily absorb and understand and make possible changes easily… 8 r/LocalLLaMA community 3mo ago The AMD Instinct MI350P is a HBM PCIe AI Accelerator That Has Been All Over   submitted by   /u/Neurrone [link]   [comments] 33 r/LocalLLaMA community 3mo ago Typical_p + Qwen There's a lot of people using Qwen here. I finally remembered what I wanted to do: typical_p has been merged eons ago and it's a sampler that was basically designed for countering repetition loops. I didn't yet try it, but I think that should help with its looping hiccups… 12 r/LocalLLaMA community 3mo ago When will we get more small LLMs? Basically the title. We had our last drop in the beginning of April, do we just not get a refresh of Gemma or Qwen?   submitted by   /u/Aggravating-Push-207 [link]   [comments] 12 r/LocalLLaMA community 3mo ago Welcome to 2014 - my new rig Hi all, Probably for some others me, there is a more conservative budget when it comes to their AI hobby. I've been collecting basically e-waste and could now assemble something partially working from them. Specs: $ neofetch .-/+oossssoo+\-. molbal@... ´:+ssssssssssssssssss+:`… 34 TechCrunch — AI news-outlet 3mo ago Why the first GPU financiers are turning to inference chips in a $400 million deal A $400 million chip-backed loan points to the next wave of AI infrastructure deals. 27 arXiv — Machine Learning research 3mo ago Counterfactuals for Feature-Weighted Clustering arXiv:2607.14719v1 Announce Type: new Abstract: Counterfactual explanations provide local, interpretable insight by identifying changes to an input that would alter its assigned outcome. Although well established in supervised learning, their extension to clustering is less… 12 arXiv — Machine Learning research 3mo ago Analysis of Public Schools Educational Performance Based on Causal Models and Hierarchical Clustering arXiv:2607.14124v1 Announce Type: cross Abstract: The increasing availability of large-scale educational datasets has expanded the use of quantitative methods for investigating school performance. However, institutional heterogeneity among schools and the structural complexity… 23 Simon Willison community 3mo ago Spot birds not golf Suggestion for hyperscalers feeling pressure over data center water use: Buy up a few exclusive country clubs, convert the golf courses into public parks, pay for guides and binoculars to get the previous members into birdwatching - help them embrace a more sustainable hobby!… 27 r/LocalLLaMA community 3mo ago Added SearXNG and I don't even know what to say anymore. I just have to show someone other than the guys at work who think I'm crazy. I've been working on this app since about early June of 2025 and while it has come a long way in its workspace tools, I had always only had basic web capability. But I saw some posts yet again recently… 11 TechCrunch — AI news-outlet 3mo ago Roblox launches an AI-powered game creation feature in its mobile app Roblox's new "Build" feature lets users generate basic games using a single text prompt. 37 r/LocalLLaMA community 3mo ago Kimi K3 Release Video [Made with Kimi K3] Everyone's probably seen the remotion thing that went viral a couple months back with CC. Its basically that with Kimi K3 as the model provider. Prev. example with GLM 5.2: https://www.reddit.com/r/LocalLLaMA/comments/1u8kyqf/glm_52_release_video_made_with_glm_52/ Feels much… 33 Latent.Space news-outlet 3mo ago 🔬 The Lab of the Future Should Feel Like a Data Center — Andy Beam & Rafa Gómez-Bombarelli, Lila Sciences Lila is betting that science, not the internet, is the last untapped source of training data. We went to find out what that actually looks like in a room full of robots. 30 arXiv — Machine Learning research 3mo ago EMAGN: Efficient Multi-Attention Graph Network via Learned Clustering for Scalable Traffic Forecasting arXiv:2607.13241v1 Announce Type: new Abstract: Traffic forecasting is highly challenging due to complex and nonlinear spatial and temporal dependencies. Self-attention mechanisms have been widely adopted to model dynamic and long-range dependencies, achieving state-of-the-art… 17 arXiv — Machine Learning research 3mo ago Agora: Collective and Permissionless Internet-Scale Pretraining of Large Language Models arXiv:2607.13332v1 Announce Type: new Abstract: Training large language models at the multi-billion to trillion parameter scale is confined to datacenters, where data-parallel (DP) and model-parallel (MP) techniques presume homogeneous accelerators, high-speed interconnects, and… 24 arXiv — Machine Learning research 3mo ago Clustering algorithms for multivariate wind farm SCADA data filtering arXiv:2607.13544v1 Announce Type: new Abstract: During wind farm operation, Supervisory Control and Data Acquisition (SCADA) systems record numerous anomalies, transients, and specific operational modes, leading to large datasets. However, for a wide range of applications, only… 31 arXiv — Machine Learning research 3mo ago Optimal and Efficient Contextual Combinatorial Semi-bandits with General Function Approximation arXiv:2607.13686v1 Announce Type: new Abstract: We study the contextual combinatorial semi-bandit (CCSB) problem with general reward function approximation. At each round, the learner observes a context, selects a combinatorial action consisting of a subset of basic arms, and… 23 Page 9 of 10 · 500 articles ← Newer Older →
