Hugging Face Daily Papers · · 4 min read

N_0-TWAM: Scaling Tactile-Native World-Action Model for Contact-Rich Manipulation

Mirrored from Hugging Face Daily Papers for archival readability. Support the source by reading on the original site.

Hi everyone — author here! 👋</p>\n<p>Excited to share N₀-TWAM, a tactile-native world-action model for contact-rich manipulation. Code and pretrained checkpoints are already out:</p>\n<p>Code: <a href=\"https://github.com/neoteai/N0-TWAM\" rel=\"nofollow\">https://github.com/neoteai/N0-TWAM</a><br>Project page: <a href=\"https://research.neoteai.com/n0-twam/\" rel=\"nofollow\">https://research.neoteai.com/n0-twam/</a></p>\n<p>Instead of treating touch as an auxiliary input channel, we make the model predict future contact together with future vision, under the same objective and at the same causal step, and read actions off that jointly predicted future.</p>\n<p>Tactile-native world model! To our knowledge the first tactile world-action model trained at scale — visuo-tactile joint pre-training on tactile-rich demos spanning 6 embodiments and 450 tasks.</p>\n<p>Happy to answer questions here or at github, and feedback or criticism is very welcome, especially from people working on tactile sensing, VLA, or world models. 🙌</p>\n","updatedAt":"2026-08-03T07:25:11.462Z","author":{"_id":"64eadcb03d76028d805a7818","avatarUrl":"/avatars/528e4fded4419caf08589b2ed40437bc.svg","fullname":"Li Kang","name":"FACEONG","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":5,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8769235610961914},"editors":["FACEONG"],"editorAvatarUrls":["/avatars/528e4fded4419caf08589b2ed40437bc.svg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2607.23783","authors":[{"_id":"6a697c289d3a1231d492b8bb","name":"NeoteAI Team","hidden":false},{"_id":"6a697c289d3a1231d492b8bc","name":"Fudan TEAI Team","hidden":false}],"publishedAt":"2026-07-26T00:00:00.000Z","submittedOnDailyAt":"2026-08-03T00:00:00.000Z","title":"N_0-TWAM: Scaling Tactile-Native World-Action Model for Contact-Rich Manipulation","submittedOnDailyBy":{"_id":"64eadcb03d76028d805a7818","avatarUrl":"/avatars/528e4fded4419caf08589b2ed40437bc.svg","isPro":false,"fullname":"Li Kang","user":"FACEONG","type":"user","name":"FACEONG"},"summary":"We present N_0-TWAM, a tactile-native world-action model for contact-rich manipulation that predicts both future vision and future contact. To our knowledge, it is the first tactile world-action model trained at large scale, and it shows strong capability on contact-rich tasks. We pre-train N_0-TWAM at large scale with visuo-tactile joint training over tactile-rich demonstrations spanning six embodiments and 450 tasks. We use NeoForce, a unified force-based tactile representation, to form a physically grounded contact signal that conditions action generation. To improve long-horizon and multi-stage manipulation, we introduce tactile contact events for task staging and advance through them during execution. For real-time efficiency, we adopt an asymmetric Mixture-of-Transformers architecture that pairs a full-width expert for video prediction with slim experts for downstream action and tactile prediction. Evaluations on both real and simulated benchmarks justify the capabilities of N_0-TWAM across a range of contact-rich tasks, and demonstrate the benefit of data scaling for precise tactile and action prediction. In summary, N_0-TWAM endows a world-action model with predictive capabilities to foresee vision, touch and action, building a solid foundation for fine-grained manipulation on open contact-rich tasks. The codebase and model checkpoints will be made publicly available to foster further research and development in tactile-enabled robotic manipulation.","upvotes":23,"discussionId":"6a697c289d3a1231d492b8bd","projectPage":"https://research.neoteai.com/n0-twam","githubRepo":"https://github.com/neoteai/N0-TWAM","githubRepoAddedBy":"user","githubStars":48,"organization":{"_id":"6a28f192fff7a3f4f2589b29","name":"NeoteAIEmbodied","fullname":"NeoteAI","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/6a27afdfd205b09ba5dce236/UsQK_CJO_GwMdMcVp8g2f.png"}},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"64eadcb03d76028d805a7818","avatarUrl":"/avatars/528e4fded4419caf08589b2ed40437bc.svg","isPro":false,"fullname":"Li Kang","user":"FACEONG","type":"user"},{"_id":"660d17d6c9be0dcd31a30b3d","avatarUrl":"/avatars/3743fe9b695c488ebe33f0d8fd607a8a.svg","isPro":false,"fullname":"Zhou Heng","user":"henggg","type":"user"},{"_id":"64f5f8dd9b17cd59c453c57f","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64f5f8dd9b17cd59c453c57f/MulhwLcePFUWUQel8LQZ8.jpeg","isPro":false,"fullname":"Xinyu Fang","user":"nebulae09","type":"user"},{"_id":"64858110b28e374571bbc550","avatarUrl":"/avatars/62c169a3149d5a7942c960753df3a673.svg","isPro":false,"fullname":"Mi Boyu","user":"miboyu5","type":"user"},{"_id":"6752dcb6ec430bad7a26c83e","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6752dcb6ec430bad7a26c83e/F685Ij72H1gIve4s9pcup.jpeg","isPro":true,"fullname":"Chen Yicheng","user":"yichengchen24","type":"user"},{"_id":"6a27afdfd205b09ba5dce236","avatarUrl":"/avatars/5e802f600654b7ac73f207ec2be9249a.svg","isPro":false,"fullname":"NeoteAI","user":"NeoteAI","type":"user"},{"_id":"6798ab698c6b6dc728c67826","avatarUrl":"/avatars/29d1474632bbc6659dfa521722d4d513.svg","isPro":false,"fullname":"Nok Yau Bruno Chen","user":"nybchen","type":"user"},{"_id":"6372813520a58a5e14c596a3","avatarUrl":"/avatars/9135151259db3e5b9c8969e1d00c949d.svg","isPro":false,"fullname":"XuHao Hu","user":"Foreshhh","type":"user"},{"_id":"6547686ce3486f8a5eb230a1","avatarUrl":"/avatars/b03e6440ead154c35142f971c3af880d.svg","isPro":false,"fullname":"fanyutao","user":"qifengle-fan","type":"user"},{"_id":"658a6c1399ed106ac8c822b1","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/658a6c1399ed106ac8c822b1/Wk2KXCcK39rUvXx6mpmGD.jpeg","isPro":false,"fullname":"yiranqin","user":"IranQin","type":"user"},{"_id":"620783f24e28382272337ba4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/620783f24e28382272337ba4/zkUveQPNiDfYjgGhuFErj.jpeg","isPro":false,"fullname":"GuoLiangTang","user":"Tommy930","type":"user"},{"_id":"69b287f2fc571673017f1afd","avatarUrl":"/avatars/5ad12a2a32f9e2ae4ba286cddfde3d06.svg","isPro":false,"fullname":"LU","user":"jiongwei","type":"user"}],"acceptLanguages":["en"],"dailyPaperRank":0,"organization":{"_id":"6a28f192fff7a3f4f2589b29","name":"NeoteAIEmbodied","fullname":"NeoteAI","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/6a27afdfd205b09ba5dce236/UsQK_CJO_GwMdMcVp8g2f.png"},"markdownContentUrl":"https://huggingface.co/buckets/huggingchat/papers-content/resolve/2607/2607.23783.md","query":{}}">
Papers
arxiv:2607.23783

N_0-TWAM: Scaling Tactile-Native World-Action Model for Contact-Rich Manipulation

Published on Jul 26
· Submitted by
Li Kang
on Aug 3
Authors:
,

Abstract

We present N_0-TWAM, a tactile-native world-action model for contact-rich manipulation that predicts both future vision and future contact. To our knowledge, it is the first tactile world-action model trained at large scale, and it shows strong capability on contact-rich tasks. We pre-train N_0-TWAM at large scale with visuo-tactile joint training over tactile-rich demonstrations spanning six embodiments and 450 tasks. We use NeoForce, a unified force-based tactile representation, to form a physically grounded contact signal that conditions action generation. To improve long-horizon and multi-stage manipulation, we introduce tactile contact events for task staging and advance through them during execution. For real-time efficiency, we adopt an asymmetric Mixture-of-Transformers architecture that pairs a full-width expert for video prediction with slim experts for downstream action and tactile prediction. Evaluations on both real and simulated benchmarks justify the capabilities of N_0-TWAM across a range of contact-rich tasks, and demonstrate the benefit of data scaling for precise tactile and action prediction. In summary, N_0-TWAM endows a world-action model with predictive capabilities to foresee vision, touch and action, building a solid foundation for fine-grained manipulation on open contact-rich tasks. The codebase and model checkpoints will be made publicly available to foster further research and development in tactile-enabled robotic manipulation.

Community

Paper submitter about 6 hours ago

Hi everyone — author here! 👋

Excited to share N₀-TWAM, a tactile-native world-action model for contact-rich manipulation. Code and pretrained checkpoints are already out:

Code: https://github.com/neoteai/N0-TWAM
Project page: https://research.neoteai.com/n0-twam/

Instead of treating touch as an auxiliary input channel, we make the model predict future contact together with future vision, under the same objective and at the same causal step, and read actions off that jointly predicted future.

Tactile-native world model! To our knowledge the first tactile world-action model trained at scale — visuo-tactile joint pre-training on tactile-rich demos spanning 6 embodiments and 450 tasks.

Happy to answer questions here or at github, and feedback or criticism is very welcome, especially from people working on tactile sensing, VLA, or world models. 🙌

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.
Tap or paste here to upload images

· Sign up or log in to comment

Get this paper in your agent:

hf papers read 2607.23783
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper

No model linking this paper

Cite arxiv.org/abs/2607.23783 in a model README.md to link it from this page.

Datasets citing this paper

No dataset linking this paper

Cite arxiv.org/abs/2607.23783 in a dataset README.md to link it from this page.

Spaces citing this paper

No Space linking this paper

Cite arxiv.org/abs/2607.23783 in a Space README.md to link it from this page.

Collections including this paper

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from Hugging Face Daily Papers