DataSet: <a href=\"https://huggingface.co/datasets/hkuzxc/StreamArena\">https://huggingface.co/datasets/hkuzxc/StreamArena</a></p>\n","updatedAt":"2026-08-10T02:40:55.483Z","author":{"_id":"6617c1de028adf787611adf9","avatarUrl":"/avatars/387ceeca152ae19ce574edffecf7f23c.svg","fullname":"Xichen Zhang","name":"hkuzxc","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":5,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.5023903250694275},"editors":["hkuzxc"],"editorAvatarUrls":["/avatars/387ceeca152ae19ce574edffecf7f23c.svg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2608.05703","authors":[{"_id":"6a75a8b4e1228e04b3238437","name":"Xichen Zhang","hidden":false},{"_id":"6a75a8b4e1228e04b3238438","name":"Guankai Li","hidden":false},{"_id":"6a75a8b4e1228e04b3238439","name":"Yinghao Zhu","hidden":false},{"_id":"6a75a8b4e1228e04b323843a","name":"Shijian Wang","hidden":false},{"_id":"6a75a8b4e1228e04b323843b","name":"Sitong Wu","hidden":false},{"_id":"6a75a8b4e1228e04b323843c","name":"Shaozuo Yu","hidden":false},{"_id":"6a75a8b4e1228e04b323843d","name":"Meng Chu","hidden":false},{"_id":"6a75a8b4e1228e04b323843e","name":"Yuan Lu","hidden":false},{"_id":"6a75a8b4e1228e04b323843f","name":"Jiaya Jia","hidden":false}],"publishedAt":"2026-08-06T00:00:00.000Z","submittedOnDailyAt":"2026-08-10T00:00:00.000Z","title":"StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding","submittedOnDailyBy":{"_id":"6617c1de028adf787611adf9","avatarUrl":"/avatars/387ceeca152ae19ce574edffecf7f23c.svg","isPro":false,"fullname":"Xichen Zhang","user":"hkuzxc","type":"user","name":"hkuzxc"},"summary":"Deploying autonomous multimodal agents in continuous, real-world environments requires them to ingest unbounded audio-visual streams and maintain hour-scale memory. However, current evaluations predominantly rely on brief clips and multiple-choice formats. This design allows minimal baselines that process only the last four frames to match or surpass complex streaming models, while answer options also expose language shortcuts. We introduce StreamArena, a benchmark for hour-scale, interactive streaming video understanding. StreamArena contains 243 full-length videos averaging 88.8 minutes and 3,646 rigorously annotated, open-ended question-answer pairs that evaluate real-time perception, historical retrospection, proactive interaction, and multimodal tool utilization. Evaluation across diverse systems exposes a tension between continuous interaction and long-horizon multimodal comprehension. Methods that retain only recent frames cannot recover distant events, methods that convert past observations into text lose visual evidence, and methods that repeatedly compress visual memory struggle to preserve fine-grained details over time. We address this tension with StreamMind, a two-tier architecture that assigns latency-critical interaction and proactive monitoring to independently scheduled frontend workers, while backend workers asynchronously construct persistent multimodal memory and perform historical recall and external search. StreamMind outperforms existing streaming baselines across all four capabilities and reduces query-to-answer latency by reusing persistent state.","upvotes":4,"discussionId":"6a75a8b4e1228e04b3238440","projectPage":"https://hkuzxc.github.io/StreamArena_web/","githubRepo":"https://github.com/JIA-Lab-research/StreamArena","githubRepoAddedBy":"user","githubStars":0,"organization":{"_id":"69ce852c60ebe7dbe05b298a","name":"XiaohongshuAI","fullname":"Xiaohongshu ","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/67e199e97f6b4386bad07cc7/D34CUuaTAGDqRwF8ultZu.png"}},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"672375d96fd07447bf58517e","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/lQDPK6Z9GI4XO5ZWZ9uIo.png","isPro":false,"fullname":"li","user":"gengengenkai","type":"user"},{"_id":"6617c1de028adf787611adf9","avatarUrl":"/avatars/387ceeca152ae19ce574edffecf7f23c.svg","isPro":false,"fullname":"Xichen Zhang","user":"hkuzxc","type":"user"},{"_id":"63ac5701c21e60a3e9b58aa7","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63ac5701c21e60a3e9b58aa7/g6EX7diOpuA94R2ab-rZC.png","isPro":true,"fullname":"Dipankar Sarkar","user":"dipankarsarkar","type":"user"},{"_id":"620783f24e28382272337ba4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/620783f24e28382272337ba4/zkUveQPNiDfYjgGhuFErj.jpeg","isPro":false,"fullname":"GuoLiangTang","user":"Tommy930","type":"user"}],"acceptLanguages":["en"],"dailyPaperRank":3,"organization":{"_id":"69ce852c60ebe7dbe05b298a","name":"XiaohongshuAI","fullname":"Xiaohongshu ","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/67e199e97f6b4386bad07cc7/D34CUuaTAGDqRwF8ultZu.png"},"markdownContentUrl":"https://huggingface.co/buckets/huggingchat/papers-content/resolve/2608/2608.05703.md","query":{}}">
StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding
Abstract
Deploying autonomous multimodal agents in continuous, real-world environments requires them to ingest unbounded audio-visual streams and maintain hour-scale memory. However, current evaluations predominantly rely on brief clips and multiple-choice formats. This design allows minimal baselines that process only the last four frames to match or surpass complex streaming models, while answer options also expose language shortcuts. We introduce StreamArena, a benchmark for hour-scale, interactive streaming video understanding. StreamArena contains 243 full-length videos averaging 88.8 minutes and 3,646 rigorously annotated, open-ended question-answer pairs that evaluate real-time perception, historical retrospection, proactive interaction, and multimodal tool utilization. Evaluation across diverse systems exposes a tension between continuous interaction and long-horizon multimodal comprehension. Methods that retain only recent frames cannot recover distant events, methods that convert past observations into text lose visual evidence, and methods that repeatedly compress visual memory struggle to preserve fine-grained details over time. We address this tension with StreamMind, a two-tier architecture that assigns latency-critical interaction and proactive monitoring to independently scheduled frontend workers, while backend workers asynchronously construct persistent multimodal memory and perform historical recall and external search. StreamMind outperforms existing streaming baselines across all four capabilities and reduces query-to-answer latency by reusing persistent state.
Community
Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.
Tap or paste here to upload images
Cite arxiv.org/abs/2608.05703 in a model README.md to link it from this page.
Cite arxiv.org/abs/2608.05703 in a Space README.md to link it from this page.
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.