BLARM: Animating 3D Objects from Video via Blending Latent Rigid Motion Primitives
Mirrored from Hugging Face Daily Papers for archival readability. Support the source by reading on the original site.
BLARM: Animating 3D Objects from Video via Blending Latent Rigid Motion Primitives
Abstract
BLARM predicts temporally coherent 3D mesh animations from monocular video using learned rigid motion components and skinning weights without explicit rigs.
We introduce BLARM, a feed-forward method for video-driven 3D mesh animation. Given a monocular video and a static object mesh, BLARM predicts a temporally coherent animated mesh whose motion follows the video. Rather than relying on explicit rigs or directly regressing high-dimensional vertex motion, we represent animation using a compact set of learned, time-varying rigid motion components and time-invariant vertex-to-component skinning weights. This yields a low-dimensional deformation space without requiring skeletons, cages, skinning weights, or rig annotations. Our architecture conditions geometry-derived deformation latents on video features through factorized spatial-temporal attention, then decodes rigid transformations blended by predicted skinning weights. Trained with trajectory reconstruction, entropy regularization, and motion-aware contrastive learning, BLARM produces accurate and temporally stable animations while recovering compact, interpretable motion structure from monocular video.
Models citing this paper
No model linking this paper
Datasets citing this paper
No dataset linking this paper
Spaces citing this paper
No Space linking this paper
Collections including this paper
No Collection including this paper
More from Hugging Face Daily Papers
-
RenderFormer-V2: Neural Rendering with Heterogeneous Scene Primitives
Sep 9
-
VDiff-Bench: A Challenging Benchmark for Fine-Grained Image Difference Identification
Sep 9
-
NOAH: Learning the Full Patient Journey. A Longitudinal Multimodal Time-Aware Model for Representation and Forecasting
Sep 9
-
MasterControl Seventeen Every Time
Sep 9
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.