Hugging Face Daily Papers · July 14, 2026 · 2 min read

LightMem-Ego: Your AI Memory for Everyday Life

Mirrored from Hugging Face Daily Papers for archival readability. Support the source by reading on the original site.

Like Read original ↗

LightMem-Ego: Bringing lifelong memory to AI assistants on smartphones and AI glasses, enabling them to see, remember, and help with your daily life.</p>\n","updatedAt":"2026-07-14T03:20:30.337Z","author":{"_id":"620b3bbb0668e435407c8d0a","avatarUrl":"/avatars/e0fccbb2577d76088e09f054c35cffbc.svg","fullname":"Ningyu Zhang","name":"Ningyu","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":51,"isUserFollowing":false}},"numEdits":0,"editors":["Ningyu"],"editorAvatarUrls":["/avatars/e0fccbb2577d76088e09f054c35cffbc.svg"],"reactions":[{"reaction":"❤️","users":["ChenPiPiPi","ZiqianChen","Interstellar174"],"count":3},{"reaction":"🔥","users":["Interstellar174"],"count":1}],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2607.11487","authors":[{"_id":"6a55a5c4a9d74d6e65bbd1e6","name":"Yijun Chen","hidden":false},{"_id":"6a55a5c4a9d74d6e65bbd1e7","name":"Boyi Xiao","hidden":false},{"_id":"6a55a5c4a9d74d6e65bbd1e8","name":"Yixian Zhao","hidden":false},{"_id":"6a55a5c4a9d74d6e65bbd1e9","name":"Haoting Xia","hidden":false},{"_id":"6a55a5c4a9d74d6e65bbd1ea","name":"Buqiang Xu","hidden":false},{"_id":"6a55a5c4a9d74d6e65bbd1eb","name":"Jizhan Fang","hidden":false},{"_id":"6a55a5c4a9d74d6e65bbd1ec","name":"Yanya Li","hidden":false},{"_id":"6a55a5c4a9d74d6e65bbd1ed","name":"Yaqi Zheng","hidden":false},{"_id":"6a55a5c4a9d74d6e65bbd1ee","name":"Xuehai Wang","hidden":false},{"_id":"6a55a5c4a9d74d6e65bbd1ef","name":"Zirui Xue","hidden":false},{"_id":"6a55a5c4a9d74d6e65bbd1f0","name":"Liuxin Zhang","hidden":false},{"_id":"6a55a5c4a9d74d6e65bbd1f1","name":"Hui Li","hidden":false},{"_id":"6a55a5c4a9d74d6e65bbd1f2","name":"Ningyu Zhang","hidden":false}],"mediaUrls":["https://cdn-uploads.huggingface.co/production/uploads/620b3bbb0668e435407c8d0a/CDpgUpejvf93MONPdpRFl.mp4"],"publishedAt":"2026-07-13T12:40:17.000Z","submittedOnDailyAt":"2026-07-14T00:00:00.000Z","title":"LightMem-Ego: Your AI Memory for Everyday Life","submittedOnDailyBy":{"_id":"620b3bbb0668e435407c8d0a","avatarUrl":"/avatars/e0fccbb2577d76088e09f054c35cffbc.svg","isPro":true,"fullname":"Ningyu Zhang","user":"Ningyu","type":"user","name":"Ningyu"},"summary":"Personal AI assistants on mobile and wearable devices continuously perceive users' daily lives through visual and audio streams. However, answering queries about past experiences requires lightweight multimodal memory that can continuously accumulate, organize, and retrieve long-term experiences, which remains challenging. To address this challenge, we present LightMem-Ego, a lightweight streaming multimodal memory system for everyday-life assistance. The system continuously captures egocentric visual and audio streams, aligns them on a shared timeline, and organizes them into a hierarchical memory consisting of current, short-term, and long-term memory. Given a user query, LightMem-Ego dynamically routes retrieval to the appropriate memory level and generates answers grounded in multimodal evidence. The demonstration can be deployed on smartphones and AI glasses, supporting object finding, conversation recall, life summarization, routine discovery, and personalized assistance. Code is available at https://github.com/zjunlp/LightMem-Ego.","upvotes":33,"discussionId":"6a55a5c4a9d74d6e65bbd1f3","organization":{"_id":"620a6fcd8d5e5dfed284bc91","name":"zjunlp","fullname":"ZJUNLP","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/1644851027419-620a61cba53066560e226d30.png"}},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"620b3bbb0668e435407c8d0a","avatarUrl":"/avatars/e0fccbb2577d76088e09f054c35cffbc.svg","isPro":true,"fullname":"Ningyu Zhang","user":"Ningyu","type":"user"},{"_id":"68cf5be0b7aa7d5b93d5b7fe","avatarUrl":"/avatars/4d1cd4a398833ed79d04e9e72433890f.svg","isPro":false,"fullname":"Xenon Z","user":"ZYXenon","type":"user"},{"_id":"6190ab805ca89a28e9f66873","avatarUrl":"/avatars/3c7ecc398fbf851acd2a132e947a92be.svg","isPro":false,"fullname":"Xin Xu","user":"XinXuNLPer","type":"user"},{"_id":"68d8fc00ff474874c83a1c99","avatarUrl":"/avatars/17e3a2f5197274536bf68d949c5416db.svg","isPro":false,"fullname":"huminclu","user":"huminclu","type":"user"},{"_id":"6a0c1e5139d601217d9b3e8e","avatarUrl":"/avatars/bc27ca94a598dd902d591cbdee597f0c.svg","isPro":false,"fullname":"Leonardo Garate","user":"Opaquing","type":"user"},{"_id":"63a942dd2e05ca32e35335df","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63a942dd2e05ca32e35335df/kuKfBLEXfWnvnoUUmoXW6.jpeg","isPro":false,"fullname":"haoming xu","user":"haomingx","type":"user"},{"_id":"66abc6da92b9eb71fe476118","avatarUrl":"/avatars/6d1618f45cc76da80335ad926ad24552.svg","isPro":false,"fullname":"xy.r","user":"ShawnRu","type":"user"},{"_id":"693aef4db77129ec989db549","avatarUrl":"/avatars/997dc41982b5ed889a6081352e3fb153.svg","isPro":false,"fullname":"Chen Jiang","user":"1CARUS0419","type":"user"},{"_id":"68dfc153e40157d9bc864745","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/-i_5FfKFVBS58nlj8Ohgi.png","isPro":false,"fullname":"Chen Pi","user":"ChenPiPiPi","type":"user"},{"_id":"671e503ecb1c682e0272f2e9","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/iqcVV5VYCBcH18OdTt97n.png","isPro":false,"fullname":"chen","user":"sunnywcx","type":"user"},{"_id":"6a2b93a71066613b7ce7fcfe","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/2KLlpiLTu75PaCW6SjXPT.jpeg","isPro":false,"fullname":"An Yixuan","user":"Orange-Ice","type":"user"},{"_id":"6969fb4409d42480a057262b","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/S-dhzncuQD0Dj6mk-QWNz.png","isPro":false,"fullname":"Yanshuo Liu","user":"Lou1s05","type":"user"}],"acceptLanguages":["en"],"dailyPaperRank":0,"organization":{"_id":"620a6fcd8d5e5dfed284bc91","name":"zjunlp","fullname":"ZJUNLP","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/1644851027419-620a61cba53066560e226d30.png"},"query":{}}">

Papers

arxiv:2607.11487

LightMem-Ego: Your AI Memory for Everyday Life

Published on Jul 13

· Submitted by

Ningyu Zhang on Jul 14

ZJUNLP

Upvote

Authors:

Abstract

Personal AI assistants on mobile and wearable devices continuously perceive users' daily lives through visual and audio streams. However, answering queries about past experiences requires lightweight multimodal memory that can continuously accumulate, organize, and retrieve long-term experiences, which remains challenging. To address this challenge, we present LightMem-Ego, a lightweight streaming multimodal memory system for everyday-life assistance. The system continuously captures egocentric visual and audio streams, aligns them on a shared timeline, and organizes them into a hierarchical memory consisting of current, short-term, and long-term memory. Given a user query, LightMem-Ego dynamically routes retrieval to the appropriate memory level and generates answers grounded in multimodal evidence. The demonstration can be deployed on smartphones and AI glasses, supporting object finding, conversation recall, life summarization, routine discovery, and personalized assistance. Code is available at https://github.com/zjunlp/LightMem-Ego.

View arXiv page View PDF Add to collection