News / #music Tag Music 370 articles archived under #music · RSS Sign in to follow arXiv — Machine Learning research 1mo ago Determinantal point process sampling for bioacoustic active learning arXiv:2607.06063v1 Announce Type: cross Abstract: Eco-acoustic monitoring generates vast volumes of audio data, making active learning a promising approach for reducing annotation effort while efficiently training reliable biodiversity classifiers. This report presents CARE-DPP,… 13 arXiv — NLP / Computation & Language research 1mo ago NAVER LABS System Re-implementation for the IWSLT 2026 Instruction-Following Task arXiv:2607.05623v1 Announce Type: new Abstract: We re-implement the NAVER LABS IWSLT 2025 instruction-following pipeline for the IWSLT 2026 Shared Task (constrained condition, short audio track), adapting it to the mandated components: SeamlessM4T-v2-large as the speech encoder… 27 arXiv — NLP / Computation & Language research 1mo ago Multi-Task Instruction Tuning via Data Scheduling for Low-Resource Arabic SpeechLLMs arXiv:2601.12494v3 Announce Type: replace-cross Abstract: Audio large language models (LLMs) enable unified speech understanding and generation, but adapting them to linguistically complex and dialect-rich settings such as Arabic-English remains challenging. We present a… 24 Hugging Face Daily Papers research 1mo ago MuseBench: Benchmarking Intent-Level Audiovisual Arts Understanding in MLLMs Abstract A comprehensive benchmark called Musebench is introduced to evaluate multimodal large language models on nuanced artistic understanding, revealing a significant gap between current models and human expert performance in creative domain expertise. Generated by… 19 Hugging Face official-blog 1mo ago From Hugging Face to Amazon SageMaker Studio in one click Back to Articles a]:hidden"> From Hugging Face to Amazon SageMaker Studio in one click Enterprise Article Published July 7, 2026 Upvote - Hazim Qudah hqudah amazon Today, we’re excited to announce a deep-link integration between Hugging Face and Amazon SageMaker AI . Developers… 27 r/LocalLLaMA community 1mo ago Gepard : 0.6B streaming TTS built for real-time dialogue - 20× realtime factor, ~50ms time-to-first-audio, vLLM-native, Apache 2.0 We just open-sourced Gepard 1.0 , a TTS model built for real-time conversation. It’s streaming-first: audio starts the moment text arrives, generated frame by frame instead of waiting for a full sentence. - ~555M params : Qwen3.5 0.8B backbone (14 layers) + Nemo NanoCodec (FSQ,… 36 r/LocalLLaMA community 1mo ago Running a vision + audio + reasoning on one Gemma 4 E2B locally on 4 GB VRAM — and keeping it real time. So I've had one Gemma 4 E2B running through llama-server as the only model in a local tool that watches my screen and lets me search/chat over it later. Same model does all three jobs: - looks at the screen and turns it into structured info (what app, what I'm doing, rough… 27 Hugging Face Daily Papers research 1mo ago Unified Audio Intelligence Without Regressing on Text Intelligence Abstract A unified audio-text large language model is presented that integrates audio and text processing through a shared transformer decoder, achieving superior performance across multiple audio and speech tasks while maintaining strong text reasoning capabilities. Generated… 33 Hugging Face Daily Papers research 1mo ago Taste-aware music retrieval from audio embeddings Abstract Audio encoders from HEAR families are evaluated for taste prediction, with gated late-fusion showing superior rank correlation and the best models achieving human-level accuracy on held-out music. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Crossmodal correspondences… 32 r/LocalLLaMA community 1mo ago nvidia/Nemotron-Labs-Audex-30B-A3B · Hugging Face Introduction We're excited to introduce Nemotron-Labs-Audex-30B-A3B , a unified audio-text LLM built on Nemotron-Cascade-2-30B-A3B , a strong text-only MoE LLM with 30B MoE model with 3B activated parameters. Audex-30B-A3B extends the vocabulary for discrete audio tokens used… 4 arXiv — Machine Learning research 1mo ago GRAFT: Grafted Reference Audio for Fine-grained Pronunciation in Zero-shot Text-to-Speech arXiv:2607.02633v1 Announce Type: new Abstract: We present GRAFT, a per-word pronunciation conditioning mechanism for text-to-speech neural codec language modeling. Existing systems reach high intelligibility and naturalness but inherit the ambiguity of text and mispronounce… 19 arXiv — Machine Learning research 1mo ago OmniFocus: Query-Guided Modality-Balanced Token Compression for Omni-Modal Large Language Models arXiv:2607.03050v1 Announce Type: new Abstract: Omni modal large language models (OmniLLMs) have attracted wide attention for their ability to jointly process audio and video, but they generate large token sequences under audio-visual inputs, leading to substantial inference… 12 arXiv — NLP / Computation & Language research 1mo ago Reinforcement Learning for Data-Efficient Code-Switched ASR arXiv:2607.02757v1 Announce Type: new Abstract: Audio-language models can be prompted for code-switched speech, but their decoding is not optimized for code-switching and often fails at language boundaries. We propose a practical reinforcement learning with verifiable rewards… 6 arXiv — NLP / Computation & Language research 1mo ago Unified Audio Intelligence Without Regressing on Text Intelligence arXiv:2607.05196v1 Announce Type: new Abstract: Audio intelligence involves understanding, reasoning about, and generating both audio and speech. In this work, we introduce Nemotron-Labs-Audex-30B-A3B (Audex), a unified audio-text LLM built on Nemotron-Cascade-2-30B-A3B, a… 7 Hugging Face Daily Papers research 1mo ago ResearchStudio-Reel: Automate the Last Mile of Research from Paper to Poster, Video, and Blog Abstract ResearchStudio-Reel automates research dissemination by composing specialized skills around a shared paper extractor, generating consistent and editable artifacts including posters, videos, and blogs with hard pass/fail quality gates. Generated by… 38 Hugging Face Daily Papers research 1mo ago Wan-Streamer v0.2: Higher Resolution, Same Latency Abstract Wan-Streamer v0.2 enhances audio-visual interaction by increasing visual resolution while maintaining low latency through optimized thinker-performer architecture with multi-GPU parallel processing. Generated by Qwen/Qwen2.5-Coder-32B-Instruct We present Wan-Streamer… 22 Hugging Face Daily Papers research 1mo ago ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomes Abstract ResearchStudio-Idea provides a skill suite for effective research ideation that combines literature search, novelty checking, and pattern-guided generation to produce traceable research proposals. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Large language models have… 5 r/LocalLLaMA community 1mo ago OpenComputer | An Open Source Computer Built For Agents. Open Computer running in an isolated VM with inference running M4 Pro via LM Studio Gemma 4 13B QAT Hey everyone, Tim from AnythingLLM , where we have been building productive an on-device agent and AI assistant experience for the past 2.5 years now. I want to talk about a new… 15 r/LocalLLaMA community 1mo ago Kyutai's Pocket TTS clones a voice from 5 seconds of audio, on CPU, under MIT. Benchmarked against Kokoro, Supertonic, and Inflect-Nano for Eng. TTS Kyutai dropped Pocket TTS a bit ago and I've been sitting on it for a benchmark. Finally ran it head to head against the three CPU TTS models that have been getting attention (Kokoro 82M, Supertonic 3, Inflect-Nano-v1). 180 timed runs, 36 audio samples, objective MOS scores via… 8 r/LocalLLaMA community 1mo ago I asked Codex to optimize DeepSeek V4 Flash 8-bit MLX on oMLX. Got ~1.6x prefill and ~3x decode speedup. Follow-up to my earlier posts: Should I sell my Mac Studio? https://www.reddit.com/r/MacStudio/s/GK7QP8Lg87 Kimi benchmark: https://www.reddit.com/r/LocalLLaMA/s/ujBsYLYmpd Short version: my Mac Studio was sitting mostly idle, and from those Reddit threads I learned about DS4… 21 Hacker News — AI on Front Page community 1mo ago OpenPrinter Article URL: https://www.opentools.studio/ Comments URL: https://news.ycombinator.com/item?id=48797916 Points: 372 # Comments: 101 18 r/LocalLLaMA community 1mo ago is LM Link just too uncooked/experimental? Newbie here. Setup LM Studio with Gemma and QWen, setup a local SearXNG container, verified that it works in the browser, linked LM Studio and the SearXNG instance using rzk/searxng-search. Everything works locally and both models now retrieve data from the Internet. Enabled LM… 37 TechCrunch — AI news-outlet 1mo ago Midjourney wants Hollywood studios to reveal the details of their AI usage As part of an ongoing legal dispute with three Hollywood studios, Midjourney is seeking to compel those studios to reveal how they use AI themselves. 24 r/LocalLLaMA community 1mo ago RTX3060 12GB + Quadro RTX5000 16GB worth it? Found cheap one RTX5000 16GB is it worth to add to RTX3060? And is it difficult to make them work together in LM Studio? Do I need to use studio drivers and is RTX5000 still supported with driver updates? Or should I just go for 5060Ti instead? Thanks guys!   submitted by… 17 r/LocalLLaMA community 1mo ago Gemma4 with audio input: 16.8 tok/s on Macbook M2 Max 64GB Here's the setup I decided on for embedding gemma4-12b into a Tauri2 desktop app: Native Rust FFI into llama.cpp via llama-cpp-2 (Metal enabled) Model: gemma-4-12b-it-Q5_K_S quantized by Unsloth, Q5_K - Small Audio input is a 607 KB 16-bit mono 16 kHz PCM WAV. Prompt path: Gemma… 38 r/LocalLLaMA community 1mo ago How hot does your Mac get? Ok I now started testing different LLM on my MacStudio and I am just curious. I use Menubar to see the teperatures of the components - and yeah the CPU and Grafic are all quite hot. Average CPU cores are at 62 celsius and all Graphic cores are at over 80 celsius. Ok my mac is… 35 Google DeepMind official-blog 1mo ago Google DeepMind and A24 announce first-of-its-kind research partnership Today, Google DeepMind and A24 are announcing a first-of-its-kind partnership focused on research. The collaboration pairs a world-leading research lab with the industry’s most filmmaker-forward studio to help artists develop new workflows and techniques. This ensures the tools… 13 arXiv — NLP / Computation & Language research 1mo ago Audio-Based Understanding of Audiobook Narration Appeal arXiv:2607.02473v1 Announce Type: new Abstract: Narration is central to the audiobook listening experience, shaping how listeners engage with and understand the content. This work explores how narration qualities shape an audiobook's appeal, noting that their effects can vary by… 38 arXiv — NLP / Computation & Language research 1mo ago Self-Supervised Test-Time Tuning for Packet Loss Concealment arXiv:2607.01823v1 Announce Type: cross Abstract: Packet loss concealment (PLC) reconstructs audio packets that are missing at the receiver, usually with a trained model whose parameters remain fixed at deployment time. This treats the PLC model as static, even though each call… 30 r/LocalLLaMA community 1mo ago [audio.cpp] The Sound of GGML — C++/GGML native ACE-Step, Stable Audio, HeartMuLa, RoFormer, HTDemucs released. 10-Minute Music in 60 Seconds! https://preview.redd.it/yxa9dlzquxah1.png?width=2000&format=png&auto=webp&s=b07c74b8832b26b46531e2fddba19fd2437ce4c6 I just released a big music/audio expansion in audio.cpp . This batch adds music generation , SFX generation , and source separation to the released framework… 22 r/LocalLLaMA community 1mo ago [Benchmark] Kimi K2.7 Code Q3 on Mac Studio M3 Ultra + RTX PRO 6000 over llama.cpp RPC: prefill improves, no changes in token generation/decode I came across this interesting article https://blog.exolabs.net/nvidia-dgx-spark/ while I don't have the DGX spark but it made me curious will this kind of arch speed up my setup for LLMs? Mac can host large models but the prefill speed sucks, so I tested in it on my setup for… 25 Hacker News — AI on Front Page community 1mo ago Sony Deletes 551 Movies PlayStation Owners Paid For Article URL: https://reclaimthenet.org/sony-deletes-551-studiocanal-movies-playstation-owners-paid-for Comments URL: https://news.ycombinator.com/item?id=48747389 Points: 245 # Comments: 122 8 Hacker News — AI on Front Page community 1mo ago FFmpeg 9.1's new AAC encoder Article URL: https://hydrogenaudio.org/index.php/topic,129691.0.html Comments URL: https://news.ycombinator.com/item?id=48747116 Points: 260 # Comments: 89 18 arXiv — Machine Learning research 1mo ago BEST-RQ-2: Contextualize-Then-Predict, a Two-Step Approach for Self-Supervised Audio Representations arXiv:2606.30700v1 Announce Type: cross Abstract: Self-supervised learning enables audio representations that transfer across domains and tasks. We present BEST-RQ-2, an evolution of BEST-RQ that retains frozen randomprojection-based discrete targets while introducing a two-step… 19 arXiv — NLP / Computation & Language research 1mo ago Building a Multimodal Dataset of Academic Paper for Keyword Extraction arXiv:2606.31069v1 Announce Type: new Abstract: Up to this point, keyword extraction task typically relies solely on textual data. Neglecting visual details and audio features from image and audio modalities leads to deficiencies in information richness and overlooks potential… 14 Hugging Face Daily Papers research 1mo ago AVTok: 1D Unified Tokenization for Holistic Audio-Video Generation Abstract AVTok is a unified tokenizer for audio-video generation that uses a dual-stream transformer architecture with shared encoder-decoder and modal-specific queries to create compact one-dimensional latent representations. Generated by Qwen/Qwen2.5-Coder-32B-Instruct… 21 r/LocalLLaMA community 1mo ago [audio.cpp] VibeVoice 1.5B released — 90-min podcast in 22.95 min, 4.08x real-time, 2.86x faster than Python without quantization. Native C++/ggml I’m the author of audio.cpp, a C++/ggml runtime for local audio models. I just added VibeVoice 1.5B support and wanted to share the benchmark because long-form multi-speaker TTS is a good stress test for local inference runtimes. Result on RTX 5090: VibeVoice 1.5B Audio length:… 26 Simon Willison community 1mo ago Nano Banana 2 Lite Nano Banana 2 Lite Also known as Gemini 3.1 Flash Lite Image ( gemini-3.1-flash-lite-image in their API ), this is the "fastest and cheapest Gemini image model, engineered for velocity and scale". I used AI studio to run this prompt: Do a where's Waldo style image but it's where… 30 Ars Technica — AI news-outlet 1mo ago Trump's plan to redesign every .gov website leads to AI-designed horrors A year in, National Design Studio delays plan to update government web standards. 19 r/LocalLLaMA community 1mo ago What's the full local AI "doomsday prepper" kit for cold storage? 16-bit safetensors of LLMs (obv), copies/source codes of Llama.cpp, ComfyUI, vLLM, Kobold, LMStudio, etc, macOS, Linux OSes, Windows 10&11, etc, Rufus (including older ones), various VMs, P-E-W's Heretic/Grimoire,… For those who want to be as paranoid and maximally doomsday prepped as possible, I am curious what the most thorough "doomsday kit" is of things to store offline copies of "just in case", to still be able to use local AI if things go truly crazy to a super extreme level. So far… 23 Vercel — AI dev-tools 1mo ago Build realtime voice agents on AI Gateway AI Gateway now supports audio/voice. You can add realtime voice, text to speech, and speech to text with the same calls you already use for text, image, and video, routed through AI Gateway alongside every other modality. Audio launches with models from OpenAI and xAI . Each… 26 arXiv — Machine Learning research 1mo ago HybridCodec: Modeling Discrete and Continuous Representations for Efficient Speech Language Models arXiv:2606.27627v1 Announce Type: new Abstract: Discrete audio representations have become increasingly popular for building multimodal text-audio systems and integrating audio capabilities into Large Language Models (LLMs). However, numerous studies report performance… 7 arXiv — Machine Learning research 1mo ago A Comparison of Fusion Techniques for Multi-Modal Human Activity Recognition on the HARMES Dataset arXiv:2606.27886v1 Announce Type: new Abstract: Recent advances in Human Activity Recognition (HAR) from wearable sensors have shown that multi-modal deep learning models consistently outperform their uni-modal counterparts. Modalities can include IMUs, RGB cameras, audio… 27 arXiv — Machine Learning research 1mo ago Elastic Time: Dynamic Frame Rate Bottlenecks for Neural Audio Coding arXiv:2606.27320v1 Announce Type: cross Abstract: Neural audio autoencoders have become a core component of compression, feature extraction, and generation. However, while existing systems support variable bitrate, the vast majority of models still operate at a fixed latent… 38 Vercel — AI dev-tools 1mo ago Realtime voice, speech, and transcription now supported on AI Gateway AI Gateway now supports voice and audio models. You can build realtime voice agents, generate speech from text, and transcribe audio to text. This provides the same observability, spend controls, and bring-your-own-key support as text, image, and video models in AI Gateway, with… 17 Vercel — AI dev-tools 1mo ago xAI Grok audio models now available on Vercel AI Gateway xAI's audio models are now live on AI Gateway. Realtime voice, text to speech, and speech to text are all available through the AI SDK with the same routing, observability, and spend controls as your other models. These capabilities are available on the AI SDK 7 release.… 11 r/LocalLLaMA community 1mo ago Any better models in coding for single dgx spark in near future? I’m an owner of single dgx spark with 128 gb unified memory. and I’m hosting through all my local network my ppm over lmstudio. I’m mainly using it for coding,some long document sorting tasks and some sequruty testing. my favorite rn is stepfun step-3.7-flash q3 xxl it’s a bit… 32 r/LocalLLaMA community 1mo ago audio.cpp: 12 audio models (Qwen3-TTS, PocketTTS, VeVo2 etc) in 1 C++/ggml runtime — TTS up to 5x faster than Python on CUDA I’ve been working on audio.cpp , a native C++ inference framework for audio models built on top of ggml. The framework currently has 25 model families, but I want to be precise about its state: 12 are released in the repo now and ready for normal use. I’m not counting anything… 24 r/MachineLearning community 1mo ago Looking for arXiv endorsement (eess.AS or cs.SD) [R] Hi, I'm an undergrad researcher looking for an arXiv endorsement to submit my first paper in the audio/speech processing domain (keyword spotting on microcontrollers). I've submitted to a peer-reviewed IEEE conference and am awaiting results, but want to get a preprint up in the… 26 Vercel — AI dev-tools 1mo ago AI SDK 7 is now available AI SDK 7 is a major release for building production agents in TypeScript. The SDK has grown from model calls and chat primitives into a broader agent platform for developing, running, integrating, and observing agents across text, audio, realtime, image, and video. Every major… 8 Page 4 of 8 · 370 articles ← Newer Older →
