JoyAI-Video-Edit: Real-Time Open-Ended Video Editing with Autoregressive Diffusion
Mirrored from Hugging Face Daily Papers for archival readability. Support the source by reading on the original site.
JoyAI-Video-Edit: Real-Time Open-Ended Video Editing with Autoregressive Diffusion
Abstract
Real-time video editing requires low-latency causal generation with bounded computational resources while preserving source fidelity and long-term temporal consistency. We present JoyAI-Video-Edit, a 16B-parameter autoregressive diffusion framework for real-time, open-ended video editing without access to future frames or a predefined video duration. Our method combines chunk-wise autoregressive adaptation, Source-Anchored Distribution Matching Distillation (SA-DMD), and Long-Horizon Autoregressive Distillation to reduce train--inference mismatch, preserve source fidelity during two-step generation, and mitigate accumulated temporal drift. Extensive automatic and human evaluations show that JoyAI-Video-Edit substantially outperforms existing streaming editors and remains competitive with strong offline systems on both short and long videos. The complete system achieves end-to-end 720p video editing at approximately 30 FPS on a single Nvidia B200 GPU. Code is available at https://github.com/jd-opensource/JoyAI-Video-Edit.
Get this paper in your agent:
hf papers read 2608.03974 curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper
Datasets citing this paper
No dataset linking this paper
Spaces citing this paper
No Space linking this paper
Collections including this paper
No Collection including this paper
More from Hugging Face Daily Papers
-
Learning How the World Evolves: Extrapolative Video World Models via Latent Dynamics Reasoning
Aug 13
-
StateFlow: Building, Evolving, and Accessing 3D World States for Previsualization
Aug 13
-
AutoWorldModel-Bench: A State-Centric Benchmark for Automated World-Model Research
Aug 13
-
AVA-Encoder: Towards Agent-Native Video Representation Learning
Aug 13
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.