Generative world renderer AlayaRenderer receives structured world states exported from physics engines and synthesizes RGB frames. Unlike models that generate frames from text/control-hints prompts, AlayaRenderer preserves scene structure without altering the underlying world dynamics. This demonstrates an alternative path toward interactive world modeling and user-controllable play. However, the original AlayaRenderer is too computationally expensive for real-time deployment. This technical report introduces AlayaRenderer-Flash, a real-time-oriented generative forward world renderer that pushes AlayaRenderer from 0.56 FPS to 31.54 FPS, reaching the speed of play. AlayaRenderer-Flash reformulates the original renderer as a few-step autoregressive streaming model and introduces lightweight distilled codecs for efficient latent encoding and frame reconstruction. It retains the teacher model's G-buffer and text-prompt interfaces while enabling continuous rendering over input streams of unbounded length. We evaluate AlayaRenderer-Flash on G-buffer streams across content preservation, temporal consistency, cross-window stability, prompt controllability, and runtime efficiency. Our results show that AlayaRenderer-Flash substantially reduces inference cost while preserving the core rendering capabilities of the teacher model. By integrating AlayaRenderer-Flash with a physics engine, we build a fully playable generative world running at 30 FPS.</p>\n","updatedAt":"2026-07-22T05:31:29.101Z","author":{"_id":"6307a98795b2ab342fec0cf7","avatarUrl":"/avatars/85b261bcdda4717a6e40491f6c7b7a89.svg","fullname":"Zhixiang Wang","name":"wangzx1994","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8286207914352417},"editors":["wangzx1994"],"editorAvatarUrls":["/avatars/85b261bcdda4717a6e40491f6c7b7a89.svg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2607.18703","authors":[{"_id":"6a60334b7e7f152167e470d6","name":"Guixu Lin","hidden":false},{"_id":"6a60334b7e7f152167e470d7","name":"Zheng-Hui Huang","hidden":false},{"_id":"6a60334b7e7f152167e470d8","name":"Siqi Yang","hidden":false},{"_id":"6a60334b7e7f152167e470d9","name":"Ming-Hsuan Yang","hidden":false},{"_id":"6a60334b7e7f152167e470da","user":{"_id":"65f1713552c38a91e0a445e8","avatarUrl":"/avatars/47ab3ada51c9b9976ac1cd0c4301c373.svg","isPro":false,"fullname":"kaipeng","user":"kpzhang996","type":"user","name":"kpzhang996"},"name":"Kaipeng Zhang","status":"claimed_verified","statusLastChangedAt":"2026-07-22T07:40:40.563Z","hidden":false},{"_id":"6a60334b7e7f152167e470db","user":{"_id":"6307a98795b2ab342fec0cf7","avatarUrl":"/avatars/85b261bcdda4717a6e40491f6c7b7a89.svg","isPro":false,"fullname":"Zhixiang Wang","user":"wangzx1994","type":"user","name":"wangzx1994"},"name":"Zhixiang Wang","status":"admin_assigned","statusLastChangedAt":"2026-07-22T07:41:22.340Z","hidden":false}],"mediaUrls":["https://cdn-uploads.huggingface.co/production/uploads/6307a98795b2ab342fec0cf7/ig-BJzrK-5OFq4Yj_Lsf2.png","https://cdn-uploads.huggingface.co/production/uploads/6307a98795b2ab342fec0cf7/pmYq7DbrydTVRNM_0N_Yr.png"],"publishedAt":"2026-07-21T04:54:24.000Z","submittedOnDailyAt":"2026-07-22T00:00:00.000Z","title":"Generative World Renderer at the Speed of Play","submittedOnDailyBy":{"_id":"6307a98795b2ab342fec0cf7","avatarUrl":"/avatars/85b261bcdda4717a6e40491f6c7b7a89.svg","isPro":false,"fullname":"Zhixiang Wang","user":"wangzx1994","type":"user","name":"wangzx1994"},"summary":"Generative world renderer AlayaRenderer receives structured world states exported from physics engines and synthesizes RGB frames. Unlike models that generate frames from text/control-hints prompts, AlayaRenderer preserves scene structure without altering the underlying world dynamics. This demonstrates an alternative path toward interactive world modeling and user-controllable play. However, the original AlayaRenderer is too computationally expensive for real-time deployment. This technical report introduces AlayaRenderer-Flash, a real-time-oriented generative forward world renderer that pushes AlayaRenderer from 0.56 FPS to 31.54 FPS, reaching the speed of play. AlayaRenderer-Flash reformulates the original renderer as a few-step autoregressive streaming model and introduces lightweight distilled codecs for efficient latent encoding and frame reconstruction. It retains the teacher model's G-buffer and text-prompt interfaces while enabling continuous rendering over input streams of unbounded length. We evaluate AlayaRenderer-Flash on G-buffer streams across content preservation, temporal consistency, cross-window stability, prompt controllability, and runtime efficiency. Our results show that AlayaRenderer-Flash substantially reduces inference cost while preserving the core rendering capabilities of the teacher model. By integrating AlayaRenderer-Flash with a physics engine, we build a fully playable generative world running at 30 FPS.","upvotes":49,"discussionId":"6a60334c7e7f152167e470dc","projectPage":"https://alaya-renderer-flash.alayalab.ai/","githubRepo":"https://github.com/AlayaLab/AlayaRenderer-Flash","githubRepoAddedBy":"user","githubStars":16,"organization":{"_id":"689f08c50df4fcf7fddc0b08","name":"AlayaLab","fullname":"Alaya Lab","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/63342778d92c5842ae728aef/dNCvNz9MMshksG2xspIbM.png"}},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"6307a98795b2ab342fec0cf7","avatarUrl":"/avatars/85b261bcdda4717a6e40491f6c7b7a89.svg","isPro":false,"fullname":"Zhixiang Wang","user":"wangzx1994","type":"user"},{"_id":"65f1713552c38a91e0a445e8","avatarUrl":"/avatars/47ab3ada51c9b9976ac1cd0c4301c373.svg","isPro":false,"fullname":"kaipeng","user":"kpzhang996","type":"user"},{"_id":"66040e5acfb9b90f95a31d76","avatarUrl":"/avatars/bd5b8a4c38aac0531126fd036debb5ed.svg","isPro":false,"fullname":"Zheng-Hui Huang","user":"Brian9999","type":"user"},{"_id":"6511689bcac39a7d888fa6ce","avatarUrl":"/avatars/1d8ed283b8474b0ea211f349d06926d8.svg","isPro":false,"fullname":"Ruicong Liu","user":"MickeyLLG","type":"user"},{"_id":"67d91432fcb289e3f21c881b","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/EIyAq-ta-GLP6QkN7kf1n.png","isPro":false,"fullname":"Jiaming Tan","user":"oneandonly211","type":"user"},{"_id":"66d94f2a36aa5055694dfe04","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/grAN83brH0E4_S0__yLdv.jpeg","isPro":false,"fullname":"fun(SII)","user":"finyorko","type":"user"},{"_id":"621ebba3b4b193696d470642","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1646181255277-noauth.jpeg","isPro":false,"fullname":"SII-Kang He","user":"Kangverse","type":"user"},{"_id":"63342778d92c5842ae728aef","avatarUrl":"/avatars/888eb265643633c5fdd7048be9bfe98f.svg","isPro":false,"fullname":"Fengbo Lan","user":"fblan","type":"user"},{"_id":"673b0410f8ab29550b7c1a60","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/U2XLW46W1rRbiOEWtLTIr.png","isPro":false,"fullname":"Yifan Zhan","user":"SUDOKISUI","type":"user"},{"_id":"69e73ad3d2e8af27eadced83","avatarUrl":"/avatars/839f9d6f064a6163bee161e60c0324fb.svg","isPro":false,"fullname":"TobyLin","user":"TobyLin000","type":"user"},{"_id":"65e71ef39cf349af2940b317","avatarUrl":"/avatars/fc1cd8d3510946fc947d67b16b51834b.svg","isPro":false,"fullname":"Yuran Wang","user":"Ryann829","type":"user"},{"_id":"64467077ae3b240562e1201f","avatarUrl":"/avatars/249d4176a9a3582fc733bb16f2ab0c6f.svg","isPro":false,"fullname":"Gaozihui","user":"ZihuiGao","type":"user"}],"acceptLanguages":["en"],"dailyPaperRank":2,"organization":{"_id":"689f08c50df4fcf7fddc0b08","name":"AlayaLab","fullname":"Alaya Lab","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/63342778d92c5842ae728aef/dNCvNz9MMshksG2xspIbM.png"},"markdownContentUrl":"https://huggingface.co/buckets/huggingchat/papers-content/resolve/2607/2607.18703.md","query":{}}">
Generative World Renderer at the Speed of Play
Abstract
Generative world renderer AlayaRenderer receives structured world states exported from physics engines and synthesizes RGB frames. Unlike models that generate frames from text/control-hints prompts, AlayaRenderer preserves scene structure without altering the underlying world dynamics. This demonstrates an alternative path toward interactive world modeling and user-controllable play. However, the original AlayaRenderer is too computationally expensive for real-time deployment. This technical report introduces AlayaRenderer-Flash, a real-time-oriented generative forward world renderer that pushes AlayaRenderer from 0.56 FPS to 31.54 FPS, reaching the speed of play. AlayaRenderer-Flash reformulates the original renderer as a few-step autoregressive streaming model and introduces lightweight distilled codecs for efficient latent encoding and frame reconstruction. It retains the teacher model's G-buffer and text-prompt interfaces while enabling continuous rendering over input streams of unbounded length. We evaluate AlayaRenderer-Flash on G-buffer streams across content preservation, temporal consistency, cross-window stability, prompt controllability, and runtime efficiency. Our results show that AlayaRenderer-Flash substantially reduces inference cost while preserving the core rendering capabilities of the teacher model. By integrating AlayaRenderer-Flash with a physics engine, we build a fully playable generative world running at 30 FPS.
Community
Generative world renderer AlayaRenderer receives structured world states exported from physics engines and synthesizes RGB frames. Unlike models that generate frames from text/control-hints prompts, AlayaRenderer preserves scene structure without altering the underlying world dynamics. This demonstrates an alternative path toward interactive world modeling and user-controllable play. However, the original AlayaRenderer is too computationally expensive for real-time deployment. This technical report introduces AlayaRenderer-Flash, a real-time-oriented generative forward world renderer that pushes AlayaRenderer from 0.56 FPS to 31.54 FPS, reaching the speed of play. AlayaRenderer-Flash reformulates the original renderer as a few-step autoregressive streaming model and introduces lightweight distilled codecs for efficient latent encoding and frame reconstruction. It retains the teacher model's G-buffer and text-prompt interfaces while enabling continuous rendering over input streams of unbounded length. We evaluate AlayaRenderer-Flash on G-buffer streams across content preservation, temporal consistency, cross-window stability, prompt controllability, and runtime efficiency. Our results show that AlayaRenderer-Flash substantially reduces inference cost while preserving the core rendering capabilities of the teacher model. By integrating AlayaRenderer-Flash with a physics engine, we build a fully playable generative world running at 30 FPS.
Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.
Tap or paste here to upload images
Cite arxiv.org/abs/2607.18703 in a model README.md to link it from this page.
Cite arxiv.org/abs/2607.18703 in a dataset README.md to link it from this page.
Cite arxiv.org/abs/2607.18703 in a Space README.md to link it from this page.
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.