News / #music Tag Music 500 articles archived under #music · RSS Sign in to follow arXiv — NLP / Computation & Language research 4mo ago The Sound of Absence: Audio-Language Embedding Models Struggle with Negation arXiv:2607.12290v1 Announce Type: cross Abstract: Audio-language embedding models such as CLAP are widely evaluated on matching present sound events, but rarely on negation. We show this affirmation-only evaluation hides a key limitation: these models fail to encode negated… 5 arXiv — NLP / Computation & Language research 4mo ago Do We Really Need Multimodal Emotion Language Models Larger Than 1B Parameters? arXiv:2607.12787v1 Announce Type: cross Abstract: Recent advances in multimodal large language models (MLLMs) have significantly improved the performance of multimodal emotion recognition (MER) and enabled interpretable description generation by jointly modeling video, audio,… 18 r/LocalLLaMA community 4mo ago [audio.cpp] 10 hours of audio generated in 3 minutes on RTX 5090 (demo included)! C++/GGML based Supertonic 3, MOSS-TTS, IndexTTS2, and Irodori-TTS released audio.cpp again. Hopefully you are not sick of it yet :) Release 0.3 adds five new models: Supertonic 3, MOSS-TTS-Local, MOSS-TTS-Nano, IndexTTS2, and Irodori-TTS. The highlight is Supertonic 3. It can hit 200 ×+ real time on CUDA (RTX 5090), 6×+ on CPU, and around 47 ms TTFT in… 37 Vercel — AI dev-tools 4mo ago Inkling from Thinking Machines is now available on AI Gateway Inkling from Thinking Machines is now available on AI Gateway. Inkling is a broad generalist model, trained across agentic, reasoning, coding, instruction-following, factuality, vision, and audio tasks rather than optimized for a single domain. The model also supports… 12 r/LocalLLaMA community 4mo ago GLM-5.2-Int4-Int8 on 8× GB10: ~1,200 t/s prefill, 33–54 t/s avg decode GLM-5.2-Int4-Int8 on 8× GB10: ~1,200 t/s prefill, 33–54 t/s avg decode (generic - coding/structured) and memory remaining to run also a Mimo 2.5 in parallel for image/audio input, both tp 8. https://x.com/i/status/2077123292352204943   submitted by   /u/ciprianveg [link]… 9 TechCrunch — AI news-outlet 4mo ago The founder of Hinge raised $18M to build a new AI dating service, Overtone Overtone describes itself as "a voice- and audio-forward service, enabled by AI, that provides highly curated introductions." 26 TechCrunch — AI news-outlet 4mo ago Spotify expands its AI push with a ChatGPT-like music assistant Spotify is rolling out a new AI-powered conversational feature that lets Premium subscribers chat with the app to discover music, podcasts, audiobooks, and more. 8 arXiv — Machine Learning research 4mo ago Empowering Long-form Omni-modal Understanding with Robust Audio Perception arXiv:2607.10299v1 Announce Type: new Abstract: Recent advances in large-scale multimodal models have drivenremarkable progress in vision-language tasks; however, comprehensiveomni-modal understanding remains under-explored, largely due to thescarcity of datasets with rich,… 8 arXiv — NLP / Computation & Language research 4mo ago LightMem-Ego: Your AI Memory for Everyday Life arXiv:2607.11487v1 Announce Type: new Abstract: Personal AI assistants on mobile and wearable devices continuously perceive users' daily lives through visual and audio streams. However, answering queries about past experiences requires lightweight multimodal memory that can… 13 Hugging Face Daily Papers research 4mo ago LightMem-Ego: Your AI Memory for Everyday Life Abstract Personal AI assistants on mobile and wearable devices continuously perceive users' daily lives through visual and audio streams. However, answering queries about past experiences requires lightweight multimodal memory that can continuously accumulate, organize, and… 10 arXiv — Machine Learning research 4mo ago Clean2FX: Label-conditioned modeling for clean-to-effect guitar audio transformations arXiv:2607.08863v1 Announce Type: cross Abstract: We present Clean2FX, a study and demo of label-conditioned clean-to-effect transformation for electric guitar audio. Given a clean guitar input and a target effect label, the task is to synthesize the corresponding effected… 10 r/LocalLLaMA community 4mo ago Running Qwen3.5-122B on Mac Studio 96GB: Fixed 3 bugs that made long-context inference usable Hey everyone, I recently switched from DS4 Flash to Qwen3.5-122B on my M3 Ultra Mac Studio for long-context agentic coding. While the model fit better, I hit a wall where follow-up messages took 3-5 minutes to start generating (cold fills) despite having a "warm" context. Turns… 22 llama.cpp releases dev-tools 4mo ago b9980 server: Don't consider models with --no-mmproj-auto as multimodal ( #25590 ) If mmproj is explicitly disabled via the model preset or command-line parameters then the model won't be able to handle image/audio inputs and this shouldn't be declared as supported input modality on… 25 r/LocalLLaMA community 4mo ago LM Studio + Zoo + Qwen 3.6 issues I'm currently running an Unsloth quant of Qwen3.6-35B-A3B and I've managed to speed up my output to ~80 tk/s by offloading all experts to CPU. I'm on a Legion 7i laptop, 5080 with 16 GB VRAM. I mainly use the models for Zoo (formerly Roo) integration into VSCode. I'm running… 38 Hacker News — AI on Front Page community 4mo ago Show HN: Juggler – an open-source GUI coding agent, by the creator of JUCE Hello HN, I don't post on here much, but wanted to get some eyes on a new project I'm just launching. I think we definitely need one more AI code agent.. I'm a long-term C++ dev, and over 30+ years I've created some successful audio dev tools (JUCE, the Tracktion DAW, the Cmajor… 11 r/LocalLLaMA community 4mo ago If you use Open Code or other agenting programs you are leaving a lot of t/s if you don't actually use agents in parallel. Benchmark : RTX5090, Qwen3.6 35B loaded via LM studio with parallel tasks set to 8 As many of you know t/s is super important. It's how fast your stuff gets done. I create via open code benchtest and run it. Thanks to it i know that if i don't run at least 4 agents i basically leave HALF of performance. So whatever you do single project in open code that uses… 34 r/LocalLLaMA community 4mo ago Hy3 (295B MoE) and NVIDIA Nemotron-Labs-Audex-30B-A3B (audio-capable 30B MoE) GGUF quants Sharing two GGUF quant sets, both with the same treatment: imatrix quantization, KLD/PPL measured against BF16 reference logits, llama-bench throughput numbers, and all raw benchmark data included in the repos. No vibes-based "quality tested" claims — every number is… 16 r/LocalLLaMA community 4mo ago Second drive Do I really need to upgrade my main drive with OS or I just can save a little bit by keeping 480GB SSD for OS and LM Studio and just add SN7100 as second drive for models and other projects? Will it somehow affect inference speed or only Windows and LM Studio starting time?… 10 Hugging Face Daily Papers research 4mo ago A Quantized Native Runtime for On-Device Semantic Audio Generation Abstract A dependency-free runtime enables efficient text-to-music generation on embedded devices through quantization and activation steering while maintaining audio quality. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Semantic audio applications increasingly require… 22 arXiv — NLP / Computation & Language research 4mo ago Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks arXiv:2607.07907v1 Announce Type: cross Abstract: With the growing adoption of VLMs, DMs, LLMs, and AFMs, these multimodal foundation models can inadvertently encode sensitive, copyrighted, biased, or unsafe cross-modal associations that originate from their training data.… 4 arXiv — NLP / Computation & Language research 4mo ago A Reliability Assessment of LALM Audio Judges for Full-Duplex Voice Agents arXiv:2607.07985v1 Announce Type: new Abstract: We report the empirical reliability of Gemini models as audio judges that score full-duplex agent conversations directly from the raw stereo waveform, tested across three models in the Gemini family: 2.5 Flash, 3.5 Flash, and 3.1… 5 r/LocalLLaMA community 4mo ago OpenMOSS-Team/MOSS-Transcribe-Diarize · Hugging Face MOSS-Transcribe-Diarize 0.9B is an end-to-end audio understanding model for long-form multi-speaker transcription, diarization, timestamps, and acoustic event awareness. Given an audio or video file, the model generates a compact speaker-aware transcript in one pass, including… 7 arXiv — NLP / Computation & Language research 4mo ago Audio Sentiment Analysis via Distillation and Cross-Modal Integration of Generated Multilingual Transcripts arXiv:2607.06611v1 Announce Type: new Abstract: Automatically recognizing the sentiment, positive or negative, from speech is a challenging task, requiring both the analysis of vocal inflections and the interpretation of uttered words. Recent solutions rely on audio foundation… 10 arXiv — NLP / Computation & Language research 4mo ago Gradient-Based Speech-to-Text Alignment for Any ASR Model: From CTC to Speech LLMs arXiv:2607.06831v1 Announce Type: new Abstract: Speech-to-text alignment means finding the temporal boundaries of each word in the audio. Some models provide such an alignment directly and others do not. Connectionist temporal classification (CTC) and transducer models have an… 14 arXiv — NLP / Computation & Language research 4mo ago Omni-Embed-Audio: Leveraging Multimodal LLMs for Robust Audio-Text Retrieval arXiv:2604.18360v3 Announce Type: replace-cross Abstract: Audio-text retrieval systems based on Contrastive Language-Audio Pretraining (CLAP) achieve strong performance on traditional benchmarks; however, these benchmarks rely on caption-style queries that differ substantially… 6 r/LocalLLaMA community 4mo ago [audio.cpp] What Does the Fox Say: 4 ASR models (Nemotron 3.5 ASR, Higgs Audio STT, VibeVoice ASR, and Hviske ASR) in native C++/GGML, init streaming support, and 327s of audio transcribed in 2.17s. I just pushed a new audio.cpp update with streaming support and 4 ASR models: Nemotron 3.5 ASR, Higgs Audio STT, VibeVoice ASR, and Hviske ASR (da only). Overall 1.07x to 2.41x faster than Python. I decided to drop Parakeet-TDT since good implementations already exist, and I… 25 Vercel — AI dev-tools 4mo ago Muse Spark 1.1 is now available on AI Gateway Muse Spark 1.1 from Meta is now available on AI Gateway . It is a multimodal reasoning model with a 1M token context window built for agentic tasks, accepting text, image, video, PDF, and audio inputs. Muse Spark 1.1 plans and orchestrates work across tools and services,… 34 r/LocalLLaMA community 4mo ago Image Processing model and Audio Processing model on 32GB VRAM and 64GB RAM? I have been playing around with LLMs on a dual 5060ti (Windows) rig, and now want to change things up. I built a separate dual 5070ti (Debian) rig and now have that running Qwen 3.6 27b UD Q6 MTP @ 100k context, without any multimodal capacity. That's solid for the text… 4 r/LocalLLaMA community 4mo ago Distilled DeepSeek into Gemma 4 26B-A4B vs 12B. Not very useful, but I learned a lot. So I decided to learn how to fine-tune LLMs. Read a few guides from Unsloth, poked around, then stumbled on Unsloth Studio and wanted to test it out. The dataset I started from a set of relatively unrelated QA pairs — Natural Questions — and stripped the answers. Then I had… 38 Hugging Face Daily Papers research 4mo ago VIBE: Voice-Induced open-ended Bias Evaluation for Large Audio-Language Models via Real-World Speech Abstract Large Audio-Language Models exhibit systematic generative biases in realistic scenarios when evaluated through open-ended tasks using human-recorded speech, with bias magnitude varying significantly by task and triggered by gender and accent cues. Generated by… 21 arXiv — Machine Learning research 4mo ago Determinantal point process sampling for bioacoustic active learning arXiv:2607.06063v1 Announce Type: cross Abstract: Eco-acoustic monitoring generates vast volumes of audio data, making active learning a promising approach for reducing annotation effort while efficiently training reliable biodiversity classifiers. This report presents CARE-DPP,… 13 arXiv — NLP / Computation & Language research 4mo ago NAVER LABS System Re-implementation for the IWSLT 2026 Instruction-Following Task arXiv:2607.05623v1 Announce Type: new Abstract: We re-implement the NAVER LABS IWSLT 2025 instruction-following pipeline for the IWSLT 2026 Shared Task (constrained condition, short audio track), adapting it to the mandated components: SeamlessM4T-v2-large as the speech encoder… 27 arXiv — NLP / Computation & Language research 4mo ago Multi-Task Instruction Tuning via Data Scheduling for Low-Resource Arabic SpeechLLMs arXiv:2601.12494v3 Announce Type: replace-cross Abstract: Audio large language models (LLMs) enable unified speech understanding and generation, but adapting them to linguistically complex and dialect-rich settings such as Arabic-English remains challenging. We present a… 24 Hugging Face Daily Papers research 4mo ago MuseBench: Benchmarking Intent-Level Audiovisual Arts Understanding in MLLMs Abstract A comprehensive benchmark called Musebench is introduced to evaluate multimodal large language models on nuanced artistic understanding, revealing a significant gap between current models and human expert performance in creative domain expertise. Generated by… 19 Hugging Face official-blog 4mo ago From Hugging Face to Amazon SageMaker Studio in one click Back to Articles a]:hidden"> From Hugging Face to Amazon SageMaker Studio in one click Enterprise Article Published July 7, 2026 Upvote - Hazim Qudah hqudah amazon Today, we’re excited to announce a deep-link integration between Hugging Face and Amazon SageMaker AI . Developers… 27 r/LocalLLaMA community 4mo ago Gepard : 0.6B streaming TTS built for real-time dialogue - 20× realtime factor, ~50ms time-to-first-audio, vLLM-native, Apache 2.0 We just open-sourced Gepard 1.0 , a TTS model built for real-time conversation. It’s streaming-first: audio starts the moment text arrives, generated frame by frame instead of waiting for a full sentence. - ~555M params : Qwen3.5 0.8B backbone (14 layers) + Nemo NanoCodec (FSQ,… 36 r/LocalLLaMA community 4mo ago Running a vision + audio + reasoning on one Gemma 4 E2B locally on 4 GB VRAM — and keeping it real time. So I've had one Gemma 4 E2B running through llama-server as the only model in a local tool that watches my screen and lets me search/chat over it later. Same model does all three jobs: - looks at the screen and turns it into structured info (what app, what I'm doing, rough… 27 Hugging Face Daily Papers research 4mo ago Unified Audio Intelligence Without Regressing on Text Intelligence Abstract A unified audio-text large language model is presented that integrates audio and text processing through a shared transformer decoder, achieving superior performance across multiple audio and speech tasks while maintaining strong text reasoning capabilities. Generated… 33 Hugging Face Daily Papers research 4mo ago Taste-aware music retrieval from audio embeddings Abstract Audio encoders from HEAR families are evaluated for taste prediction, with gated late-fusion showing superior rank correlation and the best models achieving human-level accuracy on held-out music. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Crossmodal correspondences… 32 r/LocalLLaMA community 4mo ago nvidia/Nemotron-Labs-Audex-30B-A3B · Hugging Face Introduction We're excited to introduce Nemotron-Labs-Audex-30B-A3B , a unified audio-text LLM built on Nemotron-Cascade-2-30B-A3B , a strong text-only MoE LLM with 30B MoE model with 3B activated parameters. Audex-30B-A3B extends the vocabulary for discrete audio tokens used… 4 arXiv — Machine Learning research 4mo ago GRAFT: Grafted Reference Audio for Fine-grained Pronunciation in Zero-shot Text-to-Speech arXiv:2607.02633v1 Announce Type: new Abstract: We present GRAFT, a per-word pronunciation conditioning mechanism for text-to-speech neural codec language modeling. Existing systems reach high intelligibility and naturalness but inherit the ambiguity of text and mispronounce… 19 arXiv — Machine Learning research 4mo ago OmniFocus: Query-Guided Modality-Balanced Token Compression for Omni-Modal Large Language Models arXiv:2607.03050v1 Announce Type: new Abstract: Omni modal large language models (OmniLLMs) have attracted wide attention for their ability to jointly process audio and video, but they generate large token sequences under audio-visual inputs, leading to substantial inference… 12 arXiv — NLP / Computation & Language research 4mo ago Reinforcement Learning for Data-Efficient Code-Switched ASR arXiv:2607.02757v1 Announce Type: new Abstract: Audio-language models can be prompted for code-switched speech, but their decoding is not optimized for code-switching and often fails at language boundaries. We propose a practical reinforcement learning with verifiable rewards… 6 arXiv — NLP / Computation & Language research 4mo ago Unified Audio Intelligence Without Regressing on Text Intelligence arXiv:2607.05196v1 Announce Type: new Abstract: Audio intelligence involves understanding, reasoning about, and generating both audio and speech. In this work, we introduce Nemotron-Labs-Audex-30B-A3B (Audex), a unified audio-text LLM built on Nemotron-Cascade-2-30B-A3B, a… 7 Hugging Face Daily Papers research 4mo ago ResearchStudio-Reel: Automate the Last Mile of Research from Paper to Poster, Video, and Blog Abstract ResearchStudio-Reel automates research dissemination by composing specialized skills around a shared paper extractor, generating consistent and editable artifacts including posters, videos, and blogs with hard pass/fail quality gates. Generated by… 38 Hugging Face Daily Papers research 4mo ago Wan-Streamer v0.2: Higher Resolution, Same Latency Abstract Wan-Streamer v0.2 enhances audio-visual interaction by increasing visual resolution while maintaining low latency through optimized thinker-performer architecture with multi-GPU parallel processing. Generated by Qwen/Qwen2.5-Coder-32B-Instruct We present Wan-Streamer… 22 Hugging Face Daily Papers research 4mo ago ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomes Abstract ResearchStudio-Idea provides a skill suite for effective research ideation that combines literature search, novelty checking, and pattern-guided generation to produce traceable research proposals. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Large language models have… 5 r/LocalLLaMA community 4mo ago OpenComputer | An Open Source Computer Built For Agents. Open Computer running in an isolated VM with inference running M4 Pro via LM Studio Gemma 4 13B QAT Hey everyone, Tim from AnythingLLM , where we have been building productive an on-device agent and AI assistant experience for the past 2.5 years now. I want to talk about a new… 15 r/LocalLLaMA community 4mo ago Kyutai's Pocket TTS clones a voice from 5 seconds of audio, on CPU, under MIT. Benchmarked against Kokoro, Supertonic, and Inflect-Nano for Eng. TTS Kyutai dropped Pocket TTS a bit ago and I've been sitting on it for a benchmark. Finally ran it head to head against the three CPU TTS models that have been getting attention (Kokoro 82M, Supertonic 3, Inflect-Nano-v1). 180 timed runs, 36 audio samples, objective MOS scores via… 8 r/LocalLLaMA community 4mo ago I asked Codex to optimize DeepSeek V4 Flash 8-bit MLX on oMLX. Got ~1.6x prefill and ~3x decode speedup. Follow-up to my earlier posts: Should I sell my Mac Studio? https://www.reddit.com/r/MacStudio/s/GK7QP8Lg87 Kimi benchmark: https://www.reddit.com/r/LocalLLaMA/s/ujBsYLYmpd Short version: my Mac Studio was sitting mostly idle, and from those Reddit threads I learned about DS4… 21 Page 8 of 10 · 500 articles ← Newer Older →
