Project page: <a href=\"https://zju-xyc.github.io/1D-Fusion-Project-Page/\" rel=\"nofollow\">https://zju-xyc.github.io/1D-Fusion-Project-Page/</a></p>\n","updatedAt":"2026-06-12T08:48:38.050Z","author":{"_id":"646c77911ee398a4e9404b8b","avatarUrl":"/avatars/05d1ea421dd4f3e2fd47cbe99fc52933.svg","fullname":"Yunqiu Xu","name":"Yunqiu","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.2750855088233948},"editors":["Yunqiu"],"editorAvatarUrls":["/avatars/05d1ea421dd4f3e2fd47cbe99fc52933.svg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2606.12303","authors":[{"_id":"6a2bc524ca6c5360cc7cfa9a","name":"Yuchen Xian","hidden":false},{"_id":"6a2bc524ca6c5360cc7cfa9b","name":"Yunqiu Xu","hidden":false},{"_id":"6a2bc524ca6c5360cc7cfa9c","name":"Yang He","hidden":false},{"_id":"6a2bc524ca6c5360cc7cfa9d","name":"Yi Yang","hidden":false}],"publishedAt":"2026-06-10T00:00:00.000Z","submittedOnDailyAt":"2026-06-12T00:00:00.000Z","title":"From 2D Grids to 1D Tokens: Reforming Shared Representations for Multimodal Image Fusion","submittedOnDailyBy":{"_id":"646c77911ee398a4e9404b8b","avatarUrl":"/avatars/05d1ea421dd4f3e2fd47cbe99fc52933.svg","isPro":false,"fullname":"Yunqiu Xu","user":"Yunqiu","type":"user","name":"Yunqiu"},"summary":"Multimodal image fusion aims to integrate complementary information from different modalities into a fused image that preserves rich local details while maintaining globally consistent appearance. Existing approaches build shared representations on 2D feature grids, which excel at modeling local structures but offer limited leverage over image-level global appearance factors. To balance these objectives, we introduce a compact 1D token interface based on a frozen pretrained image tokenizer for modeling non-local appearance/base factors. Rather than using the tokenizer as a reconstruction backbone, our design uses the 1D token space as a global carrier while retaining the 2D spatial pathway for local structure restoration. Specifically, we introduce Selective Token Editing (STE), which sparsely updates/replaces a small set of critical tokens, providing a lightweight mechanism to steer global appearance coherence while keeping the fusion backbone unchanged and avoiding extra losses. Experiments on four commonly used benchmarks show that our method achieves the best overall performance, with consistent, multi-metric improvements in both global coherence and local fidelity. Project page: https://zju-xyc.github.io/1D-Fusion-Project-Page/","upvotes":9,"discussionId":"6a2bc524ca6c5360cc7cfa9e","projectPage":"https://zju-xyc.github.io/1D-Fusion-Project-Page/","ai_summary":"A multimodal image fusion approach uses a 1D token interface from a pretrained image tokenizer to enhance global appearance coherence while preserving local details through selective token editing.","ai_keywords":["multimodal image fusion","2D feature grids","1D token interface","pretrained image tokenizer","selective token editing","global appearance coherence","local structure restoration"],"ai_summary_model":"Qwen/Qwen2.5-Coder-32B-Instruct"},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"646c77911ee398a4e9404b8b","avatarUrl":"/avatars/05d1ea421dd4f3e2fd47cbe99fc52933.svg","isPro":false,"fullname":"Yunqiu Xu","user":"Yunqiu","type":"user"},{"_id":"6640c647acae6bb179eedff5","avatarUrl":"/avatars/bcaafaaa1d4b4c241d72a886401772e3.svg","isPro":false,"fullname":"Yuetong Liu","user":"YuetongLiu","type":"user"},{"_id":"67b82b97701171142716c63c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/3nnH8ryAm8BFwV0F17I2S.png","isPro":false,"fullname":"Yi_Zhou","user":"YiZhou123","type":"user"},{"_id":"68306b65bf7369913aab8b36","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/65nIvbHPcUr1k2j301Wa0.png","isPro":false,"fullname":"Lee","user":"Julien0123","type":"user"},{"_id":"6724e8dff0e98abd46c6319f","avatarUrl":"/avatars/9ac7018cd00dd44490e079b511413d02.svg","isPro":false,"fullname":"Yunze Wang","user":"unimodular","type":"user"},{"_id":"65e59ecc63fb03ea72ef974b","avatarUrl":"/avatars/fad6bb396a9c35d3091f350842dfd418.svg","isPro":false,"fullname":"Liulei Li","user":"LLL-UTS","type":"user"},{"_id":"69b116035e5605678c754787","avatarUrl":"/avatars/9e8d7b89fbb74f8ce186d2d52e399753.svg","isPro":false,"fullname":"as","user":"WZLWLM0913","type":"user"},{"_id":"68301c11b80bb1d6863d2f42","avatarUrl":"/avatars/eea4d0756c5a3bd2f792629a41a26f45.svg","isPro":false,"fullname":"Wendong Huang","user":"donglongzi1","type":"user"},{"_id":"67f4f412504263bce12cb140","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/Oe5Rnme38v5yAruD0vOmG.png","isPro":false,"fullname":"ding","user":"Yixuan-Ding-ZJU","type":"user"}],"acceptLanguages":["en"],"dailyPaperRank":0,"markdownContentUrl":"https://huggingface.co/buckets/huggingchat/papers-content/resolve/2606/2606.12303.md","query":{}}">
From 2D Grids to 1D Tokens: Reforming Shared Representations for Multimodal Image Fusion
Abstract
A multimodal image fusion approach uses a 1D token interface from a pretrained image tokenizer to enhance global appearance coherence while preserving local details through selective token editing.
Multimodal image fusion aims to integrate complementary information from different modalities into a fused image that preserves rich local details while maintaining globally consistent appearance. Existing approaches build shared representations on 2D feature grids, which excel at modeling local structures but offer limited leverage over image-level global appearance factors. To balance these objectives, we introduce a compact 1D token interface based on a frozen pretrained image tokenizer for modeling non-local appearance/base factors. Rather than using the tokenizer as a reconstruction backbone, our design uses the 1D token space as a global carrier while retaining the 2D spatial pathway for local structure restoration. Specifically, we introduce Selective Token Editing (STE), which sparsely updates/replaces a small set of critical tokens, providing a lightweight mechanism to steer global appearance coherence while keeping the fusion backbone unchanged and avoiding extra losses. Experiments on four commonly used benchmarks show that our method achieves the best overall performance, with consistent, multi-metric improvements in both global coherence and local fidelity. Project page: https://zju-xyc.github.io/1D-Fusion-Project-Page/
Community
Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.
Tap or paste here to upload images
Cite arxiv.org/abs/2606.12303 in a model README.md to link it from this page.
Cite arxiv.org/abs/2606.12303 in a dataset README.md to link it from this page.
Cite arxiv.org/abs/2606.12303 in a Space README.md to link it from this page.
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.