Hugging Face Daily Papers · · 3 min read

MetaphorVU: Towards Metaphorical Video Understanding

Mirrored from Hugging Face Daily Papers for archival readability. Support the source by reading on the original site.

• We propose MetaphorVU-Bench, which is the first benchmark dedicated to systematic and comprehensive evaluation for metaphorical video understanding.<br>• We conduct extensive experiments and analysis, reveal\u0002ing the deficiencies of current MLLMs and providing insights into the underlying causes of their failures.<br>• We construct MetaphorBoost, boosting metaphorical video understanding via inference-time mapping aug\u0002mentation based on a metaphorical knowledge graph.</p>\n<p>ICML 2026 spotlight</p>\n","updatedAt":"2026-05-26T01:47:19.591Z","author":{"_id":"63664c8fa2abcdf2fd6425ed","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63664c8fa2abcdf2fd6425ed/IywpB0DXZ_twkmZmVSCCD.jpeg","fullname":"Li Zhuoqun","name":"lzq2021","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":1,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8497735857963562},"editors":["lzq2021"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/63664c8fa2abcdf2fd6425ed/IywpB0DXZ_twkmZmVSCCD.jpeg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2605.25461","authors":[{"_id":"6a14fa8eb57a1823d57089ec","name":"Zhuoqun Li","hidden":false},{"_id":"6a14fa8eb57a1823d57089ed","name":"Boxi Cao","hidden":false},{"_id":"6a14fa8eb57a1823d57089ee","name":"Guiping Jiang","hidden":false},{"_id":"6a14fa8eb57a1823d57089ef","name":"Fangrui Lv","hidden":false},{"_id":"6a14fa8eb57a1823d57089f0","name":"Ruotong Pan","hidden":false},{"_id":"6a14fa8eb57a1823d57089f1","name":"Jianan Wang","hidden":false},{"_id":"6a14fa8eb57a1823d57089f2","name":"Xiangyu Wu","hidden":false},{"_id":"6a14fa8eb57a1823d57089f3","name":"Hongyu Lin","hidden":false},{"_id":"6a14fa8eb57a1823d57089f4","name":"Yaojie Lu","hidden":false},{"_id":"6a14fa8eb57a1823d57089f5","name":"Yong Du","hidden":false},{"_id":"6a14fa8eb57a1823d57089f6","name":"Ruyin Jia","hidden":false},{"_id":"6a14fa8eb57a1823d57089f7","name":"Liyan","hidden":false},{"_id":"6a14fa8eb57a1823d57089f8","name":"Tingting Gao","hidden":false},{"_id":"6a14fa8eb57a1823d57089f9","name":"Han Li","hidden":false},{"_id":"6a14fa8eb57a1823d57089fa","name":"Xianpei Han","hidden":false},{"_id":"6a14fa8eb57a1823d57089fb","name":"Le Sun","hidden":false}],"mediaUrls":["https://cdn-uploads.huggingface.co/production/uploads/63664c8fa2abcdf2fd6425ed/Tswo8M6WoMJBnuTAmj03V.png"],"publishedAt":"2026-05-25T00:00:00.000Z","submittedOnDailyAt":"2026-05-26T00:00:00.000Z","title":"MetaphorVU: Towards Metaphorical Video Understanding","submittedOnDailyBy":{"_id":"63664c8fa2abcdf2fd6425ed","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63664c8fa2abcdf2fd6425ed/IywpB0DXZ_twkmZmVSCCD.jpeg","isPro":false,"fullname":"Li Zhuoqun","user":"lzq2021","type":"user","name":"lzq2021"},"summary":"Metaphorical videos are prevalent across various real-world scenarios to convey complex ideas, and understanding them typically requires high-order cognitive capabilities. The lack of systematic studies on metaphorical video understanding not only constrains the real-world applicability of MLLMs but also impedes the thorough assessment of their high-order cognitive capabilities. To bridge this gap, we propose MetaphorVU-Bench, the first systematic and comprehensive benchmark dedicated to metaphorical video understanding. Through experiments, we find current MLLMs struggle with accurate metaphorical video understanding, lagging far behind human level, primarily due to defective cross-domain mapping. Motivated by this finding, we construct a metaphor knowledge graph as mapping augmentation and propose MetaphorBoost, an inference-time enhancement framework achieving consistent performance improvement. Our benchmark, analysis, and method provide useful insights and a foundation for future research on advancing MLLMs.","upvotes":4,"discussionId":"6a14fa8eb57a1823d57089fc","projectPage":"https://huggingface.co/datasets/lzq2021/MetaphorVU-Bench","githubRepo":"https://github.com/icip-cas/MetaphorVU","githubRepoAddedBy":"user","ai_summary":"Current multimodal large language models struggle with metaphorical video understanding due to poor cross-domain mapping, prompting the development of a new benchmark and enhancement framework.","ai_keywords":["multimodal large language models","metaphorical video understanding","cross-domain mapping","metaphor knowledge graph","MetaphorBoost","inference-time enhancement"],"githubStars":3},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"63664c8fa2abcdf2fd6425ed","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63664c8fa2abcdf2fd6425ed/IywpB0DXZ_twkmZmVSCCD.jpeg","isPro":false,"fullname":"Li Zhuoqun","user":"lzq2021","type":"user"},{"_id":"68d66ad3e690f3f546768c50","avatarUrl":"/avatars/cdd80f9a76c0e433d6685725b80aafb3.svg","isPro":false,"fullname":"Ke Bao","user":"ispobock1","type":"user"},{"_id":"5fc052241160c47d1d438556","avatarUrl":"/avatars/f508707fc92f1b42f7897b12b727754c.svg","isPro":false,"fullname":"Boxi Cao","user":"Bowieee","type":"user"},{"_id":"643b62ac065961b2252abb7a","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/643b62ac065961b2252abb7a/6F140r2GfdpItuvSk8GNc.jpeg","isPro":false,"fullname":"zuijiang","user":"zuijiang","type":"user"}],"acceptLanguages":["en"],"dailyPaperRank":0,"markdownContentUrl":"https://huggingface.co/buckets/huggingchat/papers-content/resolve/2605/2605.25461.md"}">
Papers
arxiv:2605.25461

MetaphorVU: Towards Metaphorical Video Understanding

Published on May 25
· Submitted by
Li Zhuoqun
on May 26
Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,

Abstract

Current multimodal large language models struggle with metaphorical video understanding due to poor cross-domain mapping, prompting the development of a new benchmark and enhancement framework.

AI-generated summary

Metaphorical videos are prevalent across various real-world scenarios to convey complex ideas, and understanding them typically requires high-order cognitive capabilities. The lack of systematic studies on metaphorical video understanding not only constrains the real-world applicability of MLLMs but also impedes the thorough assessment of their high-order cognitive capabilities. To bridge this gap, we propose MetaphorVU-Bench, the first systematic and comprehensive benchmark dedicated to metaphorical video understanding. Through experiments, we find current MLLMs struggle with accurate metaphorical video understanding, lagging far behind human level, primarily due to defective cross-domain mapping. Motivated by this finding, we construct a metaphor knowledge graph as mapping augmentation and propose MetaphorBoost, an inference-time enhancement framework achieving consistent performance improvement. Our benchmark, analysis, and method provide useful insights and a foundation for future research on advancing MLLMs.

Community

Paper submitter about 6 hours ago

• We propose MetaphorVU-Bench, which is the first benchmark dedicated to systematic and comprehensive evaluation for metaphorical video understanding.
• We conduct extensive experiments and analysis, revealing the deficiencies of current MLLMs and providing insights into the underlying causes of their failures.
• We construct MetaphorBoost, boosting metaphorical video understanding via inference-time mapping augmentation based on a metaphorical knowledge graph.

ICML 2026 spotlight

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.
Tap or paste here to upload images

· Sign up or log in to comment

Get this paper in your agent:

hf papers read 2605.25461
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2605.25461 in a model README.md to link it from this page.

Datasets citing this paper 1

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2605.25461 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from Hugging Face Daily Papers