News / #rag Tag Rag 500 articles archived under #rag · RSS Sign in to follow arXiv — NLP / Computation & Language research 3d ago Embedding Initialization for Unseen Low-resource Languages in Multilingual NMT: A Case Study on Limbum-English Translation arXiv:2608.07629v1 Announce Type: new Abstract: Multilingual neural machine translation models such as NLLB-200 cover 200 languages but leave thousands unsupported, including most Grassfields Bantu languages of Cameroon. When fine-tuning these models for an unseen language,… 18 arXiv — NLP / Computation & Language research 3d ago Prompt Embedding Probes (PEP): Hallucination Detection in LLMs from Hidden States arXiv:2608.08024v1 Announce Type: new Abstract: Large language models (LLMs) can generate fluent and useful responses but remain prone to hallucinations. We introduce Prompt Embedding Probes (PEP), a white-box method for answer-level hallucination detection from the hidden… 33 arXiv — NLP / Computation & Language research 3d ago Explicit Boundary Markers for Subword Vocabularies arXiv:2608.08847v1 Announce Type: new Abstract: Subword tokenizers represent many common words twice in space-using writing systems, once with a leading space and once without. The two entries have separate embeddings in models, so occurrences of one word are divided across rows… 37 arXiv — NLP / Computation & Language research 3d ago Verifiably grounded machine interpretation of lunar geology arXiv:2608.09276v1 Announce Type: new Abstract: Planetary geology relies on historical, interpretive reasoning to reconstruct past events from diverse observations. Here, we present a step toward an automated "machine intelligence geologist" by embedding this distinct… 33 arXiv — NLP / Computation & Language research 3d ago Temporal Misgrounding in Legal RAG: A Versioned-Corpus Benchmark for French Tax Law arXiv:2608.09393v1 Announce Type: new Abstract: We identify and quantify temporal misgrounding: the systematic retrieval and citation of the currently in-force version of a legal article when the applicable version is an earlier or future one. Standard legal RAG treats the… 17 arXiv — NLP / Computation & Language research 3d ago Pragmatic Attack Surface: Vulnerabilities of Implicit Context in Large Language Models arXiv:2608.09551v1 Announce Type: new Abstract: In the era of large language models (LLMs), attackers often manipulate natural language to elicit unsafe or harmful outputs, creating a new natural language attack surface unique to LLM-based systems, where attacks directly exploit… 26 arXiv — NLP / Computation & Language research 3d ago PragMatch: Separating Pragmatic Incongruity from Cross-Modal Mismatch in Large Vision-Language Models arXiv:2608.09772v1 Announce Type: new Abstract: Large Vision-Language Models (LVLMs) have demonstrated strong performance on multimodal benchmarks, yet it remains unclear whether they genuinely reason about relationships between images and text or rely on superficial… 8 arXiv — NLP / Computation & Language research 3d ago KGCaRe: Explainable Complex Conditional Question Answering using Automatic Knowledge Graph Construction and Context Retrieval with LLMs arXiv:2608.09779v1 Announce Type: new Abstract: Answering complex conditional questions using Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) remains a challenge, particularly in domain-specific contexts where general-purpose LLMs and RAG tend to… 9 Hugging Face Daily Papers research 3d ago RoMeRL: Balancing Feedback Coverage and the Memory-Reward Trap in Self-Evolving Agent Memory via Reduced-Order Utility States Abstract RoMeRL reduces trajectory-indexed memory utilities to fixed-dimensional per-task states to concentrate feedback, avoid reward contamination, and improve self-evolving LLM agent performance. Generated by thinkingmachines/Inkling-Small Learning-based memory systems for… 36 Hugging Face Daily Papers research 3d ago SPOT: Sparse Probing and Outcome Calibration for On-Policy Distillation Abstract SPOT improves on-policy distillation by selectively probing uncertain positions and calibrating targets to downstream outcomes, boosting reasoning quality and coverage. Generated by thinkingmachines/Inkling-Small On-policy distillation (OPD) provides dense teacher… 19 r/MachineLearning community 3d ago Comparing embedding models with synthetic query probing [R] Say you want to swap out your embedding models, for instance from ADA to Titan. Are these embedding models comparable? How do similarity score ranges compare? Where to put a threshold for minimum match when doing retrieval? Or more from a research point of view how can we relate… 11 arXiv — Machine Learning research 4d ago Risk-Aware Decision Policies for Agents Under Noisy Perception arXiv:2608.06420v1 Announce Type: new Abstract: Perception in biological systems is inherently noisy, requiring organisms to make decisions under uncertainty where misclassification can be costly or fatal. We present an Artificial Life predator-prey model of foraging under noisy… 23 arXiv — Machine Learning research 4d ago SNI-GNN: SmartNIC-Assisted Full-Graph GNN Training with In-Network Embedding Prediction arXiv:2608.06441v1 Announce Type: new Abstract: Full-graph GNN training delivers high accuracy but scales poorly on multi-server clusters due to heavy, irregular inter-node embedding exchanges. We present SNI-GNN, a SmartNIC-assisted full-graph training system that reduces… 21 arXiv — Machine Learning research 4d ago Robust Average-Reward Markov Decision Processes: Minimax-Optimal Learning via Plug-in Reductions arXiv:2608.06545v1 Announce Type: new Abstract: Distributionally robust Markov decision processes provide a principled framework for sequential decision making under model uncertainty. We study how many samples are necessary and sufficient to learn an $\varepsilon$-optimal… 12 arXiv — Machine Learning research 4d ago CrystalGRPO: Target-Aligned and Coverage-Preserving Reinforcement Learning for Flow-Based Crystal Structure Prediction arXiv:2608.06582v1 Announce Type: new Abstract: Flow-based generative models can efficiently produce candidate structures for crystal structure prediction (CSP), but their pretrained objectives do not directly optimize downstream target recovery. Reinforcement-learning… 33 arXiv — Machine Learning research 4d ago Sub-Quadratic Bisimulation Metrics via Approximate Nearest Neighbors: Coverage-Augmented Guarantees and Computable Two-Sided Certificates arXiv:2608.06762v1 Announce Type: new Abstract: Bisimulation metrics quantify behavioral similarity in Markov decision processes, but their Wasserstein fixed-point operator updates every state pair and incurs quadratic pairwise work. We give a certificate-carrying sub-quadratic… 18 arXiv — Machine Learning research 4d ago Understanding Differentiable Embeddings Through Differential and Integral Geometry arXiv:2608.06809v1 Announce Type: new Abstract: How can an analyst decide whether a nonlinear dimensionality reduction embedding can be trusted? Existing diagnostics provide only partial answers: projection glyphs characterize local sensitivity, map-continuity scores measure… 34 arXiv — Machine Learning research 4d ago MiCoPro: End-to-End Mixed Precision HW/SW Co-design with HW-aware Proxy Model arXiv:2608.06916v1 Announce Type: new Abstract: Quantized Neural Networks~(QNN) with low-bitwidth data have proven promising in efficient storage and computation on edge devices. To mitigate accuracy degradation while maximizing speedup, layer-wise mixed-precision… 31 arXiv — Machine Learning research 4d ago Every Cache Entry Earns Its Place: Global Allocation of Resolution and Coverage for KV Cache Compression arXiv:2608.07001v1 Announce Type: new Abstract: As large language models (LLMs) process increasingly long contexts, KV cache storage and repeated access have become a major bottleneck. Existing KV cache compression methods rely on predefined, fixed compression rules and are… 30 arXiv — Machine Learning research 4d ago Hyperbolic Graph Embedders for Link Prediction and Topology Reconstruction arXiv:2608.07029v1 Announce Type: new Abstract: Hyperbolic embeddings provide compact geometric representations of complex networks in hyperbolic spaces, but systematic comparisons of methods developed in machine learning, network science, and algorithmics remain rare. We… 18 arXiv — Machine Learning research 4d ago Capacity Confounds and Coverage Guarantees in Adaptive Sub-model Federated Learning arXiv:2608.07157v1 Announce Type: new Abstract: Sub-model federated learning lets resource-constrained clients train width-reduced versions of a global model, but existing methods allocate capacity by device resources alone. A natural next step, allocating capacity by each… 19 arXiv — Machine Learning research 4d ago TaskSense: Focusing on What Matters in World Models arXiv:2608.06544v1 Announce Type: cross Abstract: World models for visual control typically learn compact latent states by reconstructing observations, implicitly encouraging representations to preserve information across the entire visual input. However, task-relevant content… 9 arXiv — NLP / Computation & Language research 4d ago Separating Decision-Rule Misalignment from Readout-Coverage Limitations in Speech Language Models arXiv:2608.06409v1 Announce Type: new Abstract: Speech language models are increasingly evaluated on paralinguistic tasks by the accuracy of prompted answers, but answer accuracy combines failures at different stages of the audio-to-answer computation. We introduce a… 4 arXiv — NLP / Computation & Language research 4d ago Lost in Interpolation: Why Predictive Feedback Fails in Diffusion Language Models arXiv:2608.06529v1 Announce Type: new Abstract: Soft-masking accelerates the convergence of Masked Diffusion Language Models (MDLMs). Existing formulations build this blend with linear interpolation (LERP) in the raw embedding space, which implicitly treats that space as… 31 arXiv — NLP / Computation & Language research 4d ago TA-RAG: Tone Awareness as a Design Imperative for Retrieval-Augmented Generation arXiv:2608.06672v1 Announce Type: new Abstract: Retrieval-Augmented Generation (RAG) has become a robust architecture for grounding large language models (LLMs) in trusted knowledge. However, standard RAG systems exhibit a structural limitation: retrieved documents carry their… 34 arXiv — NLP / Computation & Language research 4d ago Calibrating WEAT Against Anisotropy: ZCA Whitening as a Geometric Pre-Processing Step for Embedding Association Tests arXiv:2608.06908v1 Announce Type: new Abstract: We propose Zero-phase Component Analysis (ZCA) whitening as a geometric pre-processing step for the Word Embedding Association Test (WEAT). WEAT is a bias measurement method widely used in both computational social science and AI… 27 arXiv — NLP / Computation & Language research 4d ago Does More Retrieved Evidence Help Visual Retrieval-Augmented Generation with Diffusion Language Models? arXiv:2608.07006v1 Announce Type: new Abstract: Visual retrieval-augmented generation (RAG) commonly expands the retrieved evidence set to improve answer-page coverage, implicitly assuming that all available evidence should be passed to the generator. We show that this… 35 arXiv — NLP / Computation & Language research 4d ago HNR-DAC: Hard-Negative Reranking and Distribution-Aligned Classification for Scientific Claim Verification arXiv:2608.07204v1 Announce Type: new Abstract: Scientific claim verification over a cited paper requires predicting the claim--paper relation and identifying the paragraphs that justify that prediction. This setting poses two linked challenges: within-paper distractors often… 10 arXiv — NLP / Computation & Language research 4d ago Measuring Concept Content in Text from LLM Activations: ESG Evidence from Concept Vectors and Linear Probes arXiv:2608.07208v1 Announce Type: new Abstract: Existing measures of how much a text is about a concept read the surface of the text: dictionary word shares, topic proportions, embedding similarities. They score the words a text uses, not the judgment a reader forms about it.… 11 arXiv — NLP / Computation & Language research 4d ago LitTraceQA: A Benchmark for Multi-Stage Grounding and Verification in Scientific Question Answering arXiv:2608.07370v1 Announce Type: new Abstract: Scientific literature is increasingly used as a knowledge source for language models, retrieval-augmented generation systems, and research assistants, but answering research questions from papers requires more than fluent… 15 arXiv — NLP / Computation & Language research 4d ago CoinRAG: Contextualized Information Nugget KV Cache Reuse for Long-Context RAG arXiv:2608.07458v1 Announce Type: new Abstract: Recent optimization studies on Retrieval-Augmented Generation (RAG) have exploited chunk-level KV cache reuse to avoid processing long retrieved contexts for higher efficiency, while significant information redundancy and noise… 35 arXiv — NLP / Computation & Language research 4d ago DocMemo: Dynamic Evidence Discovery via Probabilistic Memory-Guided Retrieval for Multi-Modal Document Understanding arXiv:2608.07067v1 Announce Type: cross Abstract: Long-document understanding requires locating sparse and heterogeneous evidence across hundreds of pages, yet existing systems remain limited by static retrieval and fragile cross-round memory. Mainstream single-round methods… 34 arXiv — NLP / Computation & Language research 4d ago Harnessing the Synergy between LLM Agents and Knowledge Graphs for Urban Socioeconomic Prediction arXiv:2411.00028v3 Announce Type: replace Abstract: Socioeconomic prediction aims to leverage various urban data to predict the socioeconomic indicators of regions such as population and commercial activity level, which plays an important role in understanding urban regions and… 8 arXiv — NLP / Computation & Language research 4d ago Skill-RAG: Failure-State-Aware Retrieval Augmentation via Hidden-State Probing and Skill Routing arXiv:2604.15771v4 Announce Type: replace Abstract: Retrieval-Augmented Generation (RAG) has emerged as a foundational paradigm for grounding large language models in external knowledge. While adaptive retrieval mechanisms have improved retrieval efficiency, existing approaches… 31 Hugging Face Daily Papers research 4d ago Douyin Multimodal Embedding Model Technical Report Abstract Multimodal representation learning is a cornerstone of modern AI. By encoding multimodal queries and targets into vectors, it powers industrial search and recommendation and underpins modern agents. Real-world platforms with complex modalities and massive-scale content,… 36 r/LocalLLaMA community 5d ago Best Embedding + Reranking Model What Local Embedding + Reranking Models are you guys running for RAG? I went down this rabbit hole because I wanted a Embedding Model + Reranker for a Translation Memory Server. Essentially, given X phrase/word/sentence/paragraph in English, can it find a similar… 26 r/LocalLLaMA community 6d ago Anyone else amped up over Qwen 3.8? I’ve been using 3.6 27B Q4, and that quant is fast on an M5. The code has been average, but consistently “good enough.” And, after a year, I can see home LLMs being served at home much like streaming music was introduced. A simple browser extension and all your queries go… 14 Hugging Face Daily Papers research 6d ago FactorJEPA: Factorizing Monolithic Futures into Layout-Agent-Interaction Channels for Crowded and Chaotic Global South Urban Worlds Abstract World models have attracted significant attention for their ability to capture and predict the structure and dynamics of the physical world. In this emerging landscape, Joint Embedding Predictive Architectures (JEPA) offer a particularly compelling direction. We study a… 29 llama.cpp releases dev-tools 6d ago b10306 sycl: *glu flat path ( #26354 ) tests: add SWIGLU perf cases perf mode had no GLU coverage. Adds SWIGLU at 17408 columns, 512 and 2048 tokens, f16 and f32, with the operands both fused and split. sycl: consolidate fused-GLU kernels They differed only in which op_* they called,… 14 Hugging Face Daily Papers research 6d ago Interpretable MEG Decoding of Perceived Speech: Cortical Sources and the Stimulus Features That Drive Retrieval Abstract Short segments of perceived speech can be retrieved from non-invasive magnetoencephalographic (MEG) recordings by deep networks trained with a CLIP-style objective against wav2vec 2.0 audio embeddings. Yet their weights do not map onto electrophysiological quantities,… 20 Hugging Face Daily Papers research 6d ago Task-Conditional Flow Matching for Balanced Multilingual Text Embedding Adaptation Abstract Multilingual text embedding models are commonly adapted using a single training objective across diverse tasks, despite different tasks requiring fundamentally different optimization strategies. We introduce Task-Conditional Flow Matching (TCFM), a multilingual… 33 Hugging Face Daily Papers research 7d ago Teaching Nemotron Greek: Mining a Corpus, Adapting Retrieval, and Grounding Generation for Modern Greek across Specialist Domains Abstract Modern Greek is absent from NVIDIA's Nemotron retrieval models and from major multilingual retrieval benchmarks, despite being important for retrieval-augmented generation (RAG) in legal, energy, financial, and medical applications. We present an end-to-end adaptation… 5 arXiv — Machine Learning research 7d ago PPDL: LLM-Based Flows as Probabilistic Programs arXiv:2608.05234v1 Announce Type: new Abstract: Building reliable applications that leverage large language models (LLMs) remains a significant challenge. While LLMs offer impressive capabilities across diverse tasks, their outputs often lack accuracy and provide no clear… 10 arXiv — Machine Learning research 7d ago Perturbation Sensitivity at Convergence: A Simple Signal for Identifying Spuriously Correlated Samples arXiv:2608.05419v1 Announce Type: new Abstract: Models trained by empirical risk minimization on data containing spurious correlations achieve high average accuracy while failing on subpopulations where the correlation does not hold. Existing methods for identifying the affected… 17 arXiv — Machine Learning research 7d ago IFlowNets: Extending Generative Samplers to Learn Strategies in Incomplete Information Games arXiv:2608.05422v1 Announce Type: new Abstract: While many algorithms blend reinforcement learning (RL) with counterfactual regret (CFR) methods to leverage tradeoffs in computational speed and performance, there are fewer investigations into generative sampling frameworks in… 38 arXiv — Machine Learning research 7d ago Align-RAG: Alignment Is All You Need for TSFM In-Context Learning arXiv:2608.05571v1 Announce Type: new Abstract: Retrieval-augmented forecasting promises to adapt frozen Time Series Foundation Models (TSFMs) to new domains without fine-tuning, but recent methods typically rely on learned fusion modules, i.e., trained adapters that merge… 11 arXiv — Machine Learning research 7d ago BioM-JEPA: joint-embedding prediction of graph-connected gene blocks in single cells arXiv:2608.05928v1 Announce Type: new Abstract: Single-cell transcriptomes are sparse observations of coordinated biological programmes, yet most self-supervised models learn by reconstructing individual genes. Here we present BioM-JEPA, a joint-embedding predictive architecture… 7 arXiv — Machine Learning research 7d ago How Far Do Simple Transformations Translate Across Text Embedding Models? arXiv:2608.05980v1 Announce Type: new Abstract: We investigate whether simple transformations can translate representations across heterogeneous text embedding models. Understanding how independently trained models organize semantic information is an enabler for AI-to-AI latent… 38 arXiv — Machine Learning research 7d ago Dynamic Graph Prompting via Topology-Routed Mixed-Curvature Experts arXiv:2608.06031v1 Announce Type: new Abstract: Dynamic graph prompting freezes a pre-trained temporal backbone and adapts it to label-scarce downstream tasks using lightweight prompts. However, existing methods operate within a single, fixed embedding space. In this work, we… 4 arXiv — NLP / Computation & Language research 7d ago Where Privacy Risk Lives in English-Source Multilingual RAG: A Stage-Decomposed Audit Across Five Query Languages arXiv:2608.05163v1 Announce Type: new Abstract: A common assumption holds that switching to a non-English language makes a multilingual RAG system easier to attack for personal information. We test this on an English-source synthetic-PII corpus with five query languages and a… 31 Page 2 of 10 · 500 articles ← Newer Older →
