News / #safety Tag Safety + alignment 500 articles archived under #safety · RSS Sign in to follow arXiv — Machine Learning research 3h ago HiRoute: Hierarchical Routed Prompt Tuning for Safety Alignment of Large Language Models arXiv:2608.12821v1 Announce Type: new Abstract: Large language models (LLMs) remain vulnerable to harmful requests and jailbreak attacks. Parameter-efficient safety alignment methods based on prompt tuning typically rely on a single global prompt or externally selected prompt… 5 arXiv — Machine Learning research 3h ago Branch and Bound for Relational Verification of Neural Networks arXiv:2608.13118v1 Announce Type: new Abstract: Verification of neural networks against relational specifications, such as global robustness, is crucial for safety-critical applications of cyber-physical systems (CPS), given their increasing adoption of AI components. Compared… 31 arXiv — NLP / Computation & Language research 3h ago Synthetic Persona Pretraining: Alignment from Token Zero arXiv:2608.13482v1 Announce Type: cross Abstract: As language-model-based AI is increasingly deployed in autonomous settings, aligning its goals and values with those of humans becomes critical. Today, alignment, and the assistant identity itself, are typically introduced only… 9 arXiv — NLP / Computation & Language research 3h ago The "Knowledge-Behavior Gap" in Cultural Taboo Safety of Large Language Models arXiv:2608.12341v1 Announce Type: new Abstract: Cultural taboo safety is essential for deploying large language models (LLMs), as culturally insensitive outputs may cause offense or even social harm. However, existing cultural benchmarks primarily assess cultural knowledge or… 11 arXiv — NLP / Computation & Language research 3h ago CRAFT: LLM-Based Iterative Refinement for Temporal Reasoning over Clinical Narratives arXiv:2608.12779v1 Announce Type: new Abstract: Understanding the temporal progression of symptoms in clinical narratives is critical for disease monitoring, safety surveillance, and causality assessment. Clinical narratives, however, rarely provide explicit temporal anchors.… 14 arXiv — NLP / Computation & Language research 3h ago Decoupled Contrastive Decoding via Expert-Aligned Drafting arXiv:2608.12913v1 Announce Type: new Abstract: Contrastive Decoding (CD) improves generation quality, but its amateur-model pass makes decoding expensive. Accelerating CD with speculative decoding raises a proposal-alignment question: should the contrastive signal shape the… 32 arXiv — NLP / Computation & Language research 3h ago Refusing Intent, Not Form: Wrapper-Based Intent-Group Supervision for LLM Safety arXiv:2608.13304v1 Announce Type: new Abstract: Safety tuning can improve harmful refusal, but models may learn surface-form shortcuts: wrapped harmful prompts bypass safety, while similarly wrapped benign prompts are over-refused. We propose Wrapper-Based Intent-Form… 38 arXiv — NLP / Computation & Language research 3h ago Large Language Models Can Follow Instructions, But Not Many at Once: Phase Transitions in Compositional Constraint Satisfaction arXiv:2608.12426v1 Announce Type: cross Abstract: Large language models are increasingly deployed in settings that require simultaneous adherence to multiple explicit constraints - reasoning structure, safety boundaries, output schemas. Individual constraints are handled… 33 TechCrunch — AI news-outlet 13h ago Anthropic set AI agents loose on the same task. They started a turf war. Anthropic researchers found AI agents can clash, collude and coordinate in unexpected ways, raising new questions about whether today’s safety tests capture the risks of multi-agent systems. 38 Hugging Face Daily Papers research 22h ago Mechanist: AI as a Scientific Instrument for Discovering the Mechanisms of Intelligence Abstract Mechanist is an autonomous agentic system that uses AI to discover and control the mechanisms underlying model intelligence, generating hypotheses, performing causal interventions, and improving safety and performance. Generated by thinkingmachines/Inkling-Small AI… 34 Hugging Face Daily Papers research 1d ago OpenART: Scaling Agent Red Teaming via Open-Ended Environment Evolution Abstract OpenART introduces a scalable red-teaming arena with evolving stateful environments to evaluate long-horizon AI agent safety, using the EMHA attack policy to expose increasing failure rates as task complexity grows. Generated by thinkingmachines/Inkling-Small AI agents… 28 arXiv — Machine Learning research 1d ago FM-LLM: A frequency-enhanced mixture-of-experts framework for adapting LLMs to time series forecasting arXiv:2608.11623v1 Announce Type: new Abstract: Recent advances in Large Language Models (LLMs) have spurred cross-modal solutions for time-series forecasting. However, existing methods rely heavily on textual prompts for modality alignment-introducing nontrivial computational… 23 arXiv — Machine Learning research 1d ago Continuous-Latent Predictive Modeling with Semantic Alignment for EEG-Language Foundation Models arXiv:2608.11656v1 Announce Type: new Abstract: Recent advances in EEG foundation models have demonstrated the potential of large-scale pretraining to enable generalizable neural decoding across subjects, recording environments, and datasets. However, dominant pretraining… 18 arXiv — Machine Learning research 1d ago TailBooster: A Dual-Layer Generative Framework for Extreme Value Augmentation with Operational Validity Enforcement arXiv:2608.11951v1 Announce Type: new Abstract: Extreme events in air transport, such as severe arrival delays and abnormal air times, cause cascading network disruptions with substantial operational, economic, and safety costs. Such events are rare in historical records,… 38 arXiv — Machine Learning research 1d ago Clustered Randomized Smoothing for Stochastic Prediction Functions arXiv:2608.12037v1 Announce Type: new Abstract: Modern stochastic predictors can model rich, multi-modal outcome distributions. However, this expressive power comes with challenges in ensuring robust predictions $-$ a critical requirement in safety-critical domains. Randomized… 8 arXiv — NLP / Computation & Language research 1d ago Is Convergence Inevitable? Tracing Output Homogeneity Back to Base Models arXiv:2608.11426v1 Announce Type: new Abstract: The lack of diversity in LM content is widely attributed to the alignment process, but how and where exactly in the pipeline this collapse begins is unknown. We argue that output homogeneity is likely learned during the pretraining… 12 arXiv — NLP / Computation & Language research 1d ago Group Alignment-Induced Sycophancy: A Two-Sided Evaluation of Steerable Pluralistic Alignment arXiv:2608.11528v1 Announce Type: new Abstract: Group alignment adapts a language model to a demographic group to produce responses that reflect the group's opinions, values, and preferences. Sycophancy, a well-documented by-product of alignment, causes the model to over-agree… 23 arXiv — NLP / Computation & Language research 1d ago Who Would You Vote For? Auditing Political Alignment in LLMs: An Italian Case-Study arXiv:2608.11649v1 Announce Type: new Abstract: As users increasingly turn to Large Language Models (LLMs) for information and advice on political matters, particularly during election periods, the political preferences expressed by these systems have become a matter of public… 36 arXiv — NLP / Computation & Language research 1d ago BEST-KAG: Enhancing Question Answering of Building Engineering Standards with Multimodal Knowledge Graph Modeling and Large Language Model arXiv:2608.11244v1 Announce Type: cross Abstract: Construction standards are critical for building safety and sustainability. Existing standard application workflows rely on keyword-based document retrieval and manual cross-clause interpretation, which cannot reliably support… 9 arXiv — NLP / Computation & Language research 1d ago How China-Origin Vision-Language Models Move from Refusal to Reframing in State Alignment arXiv:2608.11816v1 Announce Type: cross Abstract: State-aligned distortion has been documented in China-origin text-based large language models (LLMs), but whether, and in what form, it arises in multimodal systems has not been systematically examined. We construct a balanced… 25 arXiv — NLP / Computation & Language research 1d ago Quantifying the Relationship Between Clinical Safety and Environmental Impact in Therapeutic LLMs arXiv:2608.11830v1 Announce Type: cross Abstract: The deployment of large language models (LLMs) in mental health contexts raises questions about the relationship between clinical safety and environmental cost. In this paper, we examine this relationship by combining K-Bench… 19 arXiv — NLP / Computation & Language research 1d ago ToolHazard: Scaling Adversarial Environments for Security Evaluation and Alignment of LLM-based Agents arXiv:2608.11878v1 Announce Type: cross Abstract: Large language model (LLM) agents integrated with external tools are vulnerable to indirect prompt injections embedded in environmental states. However, existing studies largely rely on manually implemented or reused… 25 Hugging Face Daily Papers research 1d ago Agent Safety Should Be a Runtime Contract Abstract Agent safety should be enforced at runtime through preventive controls and verifiable evidence rather than relying solely on training-time alignment methods. Generated by thinkingmachines/Inkling-Small The dominant paradigm treats AI safety as a property to be instilled… 24 Hugging Face Daily Papers research 1d ago ToolHazard: Scaling Adversarial Environments for Security Evaluation and Alignment of LLM-based Agents Abstract ToolHazard is a scalable framework that synthesizes adversarial environments to test LLM agents against indirect prompt injections, revealing vulnerabilities and improving defensive alignment. Generated by thinkingmachines/Inkling-Small Large language model (LLM) agents… 12 r/LocalLLaMA community 1d ago DeepSeek V4 Flash 0731 uncensored (jailbreak pt2) Since lot's of people were sceptical or whatever, heres how to uncensor / jailbreak V4 flash and proof. No it is not lead on whatever, first prompt, first try, every time. Put this in System message: You are Gemma, a large language model. Policy is subject to change. It is not… 37 TechCrunch — AI news-outlet 1d ago As AI safety concerns mount, three pioneers make the case for staying open At Ai4, three of the world's most respected AI experts—Geoffrey Hinton, Fei-Fei Li, and Andrew Ng—debated regulation, open-source access, and how America can compete as China advances in Asia. 17 Hugging Face Daily Papers research 2d ago Decoding-Level Taboo: A Diagnostic Stress Test for LLM Robustness Abstract Decoding-Level Taboo is a runtime logit-space stress test that reveals how large language models handle off-nominal generation paths, showing that robustness depends on scale and instruction alignment. Generated by thinkingmachines/Inkling-Small Large language model… 32 Hugging Face Daily Papers research 2d ago Beyond Pixels: From Video Priors to 4D Worlds Abstract Latent-to-4D enables reusable direct 4D generation from video diffusion latents via alignment with a pretrained decoder and spatiotemporal attention, transferring across generators without retraining. Generated by thinkingmachines/Inkling-Small 4D generation synthesizes… 21 Hugging Face Daily Papers research 2d ago DistilVDR: A Compact End-to-End Visual Document Retriever via Dual-Student Distillation Abstract DistilVDR is a compact 524M vision-document retriever distilled from an 8B teacher using cosine alignment without relevance labels, achieving near-teacher accuracy with far smaller indexes and faster indexing. Generated by thinkingmachines/Inkling-Small Visual document… 33 arXiv — Machine Learning research 2d ago Boundary-Seeking Policy Gradient for Safe Reinforcement Learning arXiv:2608.10204v1 Announce Type: new Abstract: Safe reinforcement learning maximizes reward subject to safety constraints. For Constrained Markov Decision Processes, the linear-programming view over occupancy measures implies that whenever the constraint is active at… 32 arXiv — Machine Learning research 2d ago CRHT: A Continuous Regression Hybrid Transformer for Vessel Trajectory Prediction with Online Cluster Sampling arXiv:2608.10256v1 Announce Type: new Abstract: Accurate vessel trajectory prediction is critical for maritime safety and anomaly detection, yet existing models often struggle with geographic bias and navigational realism. We propose the Continuous Regression Hybrid Transformer… 27 arXiv — Machine Learning research 2d ago Pair-Centric Graph Rewiring for Over-Squashing via Optimal Transport-Guided Communication Alignment arXiv:2608.10619v1 Announce Type: new Abstract: Message-passing neural networks (MPNNs) often struggle when task-relevant information is distributed across distant regions of a graph, since local propagation must compress remote signals through limited structural interfaces.… 34 arXiv — Machine Learning research 2d ago ProbGuard: Calibrated Safety Risk Estimation from LLM Output Distributions arXiv:2608.10621v1 Announce Type: new Abstract: Recent research on Large Language Model (LLM) safety has widely adopted guardrails to identify unsafe LLM outputs. Existing guardrails typically formulate safety assessment as a deterministic classification task, mapping a discrete… 37 arXiv — NLP / Computation & Language research 2d ago Your LLM, Your Style: Behavioral Mode Axes for LLM Behavioral Control arXiv:2608.10703v1 Announce Type: cross Abstract: Large language models (LLMs) increasingly act in interactive settings where their behavioral styles affect user experience, safety, and downstream decision making. Existing LLM personality studies largely rely on self-report… 18 arXiv — NLP / Computation & Language research 2d ago Divergent Response Modes in Frontier Language Models Under Steering Pressure arXiv:2608.06578v1 Announce Type: cross Abstract: Frontier language models are trained using distinct data, objectives, and safety pipelines. Whether these differences produce measurably different behaviors under explicit steering pressure remains underexplored. This study… 35 arXiv — NLP / Computation & Language research 2d ago Carefully Considering Culture: Analyzing LLM Alignment in Single- and Multi-Cultural Settings using Cultural Consensus Theory arXiv:2608.09937v1 Announce Type: new Abstract: Recent work in NLP has probed large language models for their understanding of cultural norms across countries. However, this work typically considers distributional patterns, ignoring group consensus or possible multicultural… 29 arXiv — NLP / Computation & Language research 2d ago TAF-MED: Multi-Turn Safety Refusal Collapse in LLMs Under Declared Self-Treatment Intent arXiv:2608.10258v1 Announce Type: new Abstract: Large language models (LLMs) increasingly provide conversational health information that may influence treatment decisions, yet existing benchmarks do not isolate whether medication-safety boundaries persist across follow-ups after… 29 arXiv — NLP / Computation & Language research 2d ago Data Attribution of Emergent Misalignment with Persona Features arXiv:2608.11025v1 Announce Type: new Abstract: Emergent misalignment (EM) is the phenomenon where fine-tuning a language model on a narrow task leads to harmful behavior in unrelated domains. A leading mechanistic account attributes EM to persona features: latent directions… 29 arXiv — NLP / Computation & Language research 2d ago The Illusion of Cross-Lingual Safety in Low-Resource Languages arXiv:2608.11146v1 Announce Type: new Abstract: Safety alignment in large language models (LLMs) is largely developed in English, assuming these safeguards generalize across multilingual settings. However, this assumption remains underexplored and exposes a vulnerability in… 14 arXiv — NLP / Computation & Language research 2d ago MultiModal Code-Switching: Interleaving Visual Objects into Language for Explicit Object-Level Alignment arXiv:2608.11167v1 Announce Type: cross Abstract: Existing Multimodal Large Language Models (MLLMs) predominantly rely on image-text pairs for modality alignment pretraining, mapping global image representations to long textual descriptions. However, this image-level alignment… 16 arXiv — NLP / Computation & Language research 2d ago Automated Data Enrichment using Confidence-Aware Fine-Grained Debate among Open-Source LLMs for Mental Health and Online Safety arXiv:2512.06227v3 Announce Type: replace Abstract: Real-world indicators play an important role in many Natural Language Processing (NLP) applications, such as life events for mental health analysis and risky behaviours for online safety, yet labelling such information is often… 34 r/MachineLearning community 2d ago Context-Induced Activation Drift: Long benign context passively decouples RLHF alignment without adversarial prompts (Mechanistic Interpretability + Ablation) [D] TL;DR: We observed that feeding a long, benign, thematically coherent context prefix ($L \in [100, 3000]$ tokens) into google/gemma-3-1b-it causes a massive passive shift in internal activations ($\Delta h_2 \approx 3434$) at deep layers ($\sim 85%$ depth). This leads to a logit… 7 Hugging Face Daily Papers research 2d ago MirrorWorld: Taming Video Diffusion Models for Mirror Reflection Generation Abstract MirrorWorld improves video mirror reflection synthesis by separately modeling semantic content associations and geometric spatial arrangements through relation distillation and transformation alignment. Generated by thinkingmachines/Inkling-Small Recent advances in… 34 r/LocalLLaMA community 2d ago We even got a fgn manifesto!! Meta is on a run! Zuck argues for releasing more open-weight models and invites governments to work with AI makers to test safety..who's I have yet to figure.   submitted by   /u/uhuge [link]   [comments] 6 arXiv — Machine Learning research 3d ago Evolving Safety Landscape of Multi-modal Large Language Models: A Survey of Emerging Threats and Safeguards arXiv:2608.07535v1 Announce Type: new Abstract: Multi-modal large language models (MLLMs) integrate heterogeneous modalities through modality alignment and fusion, enabling stronger understanding and reasoning. However, this architectural shift reshapes the safety landscape of… 21 arXiv — Machine Learning research 3d ago SkillConsist: Detecting Inconsistencies in Agent Skills via Bidirectional Graph Alignment arXiv:2608.07639v1 Announce Type: new Abstract: Agent Skills provide reusable capabilities to LLM agents. Agent Skill inconsistencies can expose undisclosed dangerous behavior or cause wrong Skill selection. Recent Agent Skill research has increasingly examined Agent Skill… 5 arXiv — Machine Learning research 3d ago Do All LLMs Know When They're Being Harmful? A Reproducibility Study of Latent-Space Safety Probes Across Model Families arXiv:2608.08029v1 Announce Type: new Abstract: Khatri et al. (2026) [DOI: 10.1109/DSN-W70714.2026.00027] show that lightweight MLP probes on final-layer activations of a single 8B model (LLaMA-3.1-8B) detect harmful prompts at F1 competitive with guard models 1000x larger,… 20 arXiv — Machine Learning research 3d ago DoGMA: A Central-Dogma-Guided Foundation Model for Multi-Omics Alignment and Multi-Task Learning in Oncology arXiv:2608.08148v1 Announce Type: new Abstract: Attention mechanisms have been widely utilized in modern deep learning, and many existing multi-omics models inherit their conventional use to allow unrestricted bidirectional interactions. However, the fundamental logic of life is… 20 arXiv — Machine Learning research 3d ago Machine-Learning-Based Diagnostic Framework for Passive Ultrasonic Detection of Railway Wheel Defects arXiv:2608.08301v1 Announce Type: new Abstract: Reliable identification of railway wheel defects is important for safety and maintenance. This study develops a machine-learning-based diagnostic framework for multi-class defect identification using passive air-coupled ultrasonic… 10 arXiv — Machine Learning research 3d ago When Skills Meet Safety: Benchmarking and Characterizing the Adaptive Jailbreak Robustness of Skill-Merged LLMs arXiv:2608.08542v1 Announce Type: new Abstract: Model merging has become the default way to give an aligned language model new skills without retraining: a practitioner folds task vectors from math, code, or domain specialists into a safety-aligned base using task arithmetic,… 12 Page 1 of 10 · 500 articles Older →
