DanceOPD uses hard routing to select one frozen capability field, queries it on a low-noise on-policy student state, and matches the selected velocity with a local velocity MSE loss.</p>\n<p><a href=\"https://cdn-uploads.huggingface.co/production/uploads/62df78222d89ce551ce0f71d/4kn6iq2kdCgtq8riCR9DJ.png\" rel=\"nofollow\"><img src=\"https://cdn-uploads.huggingface.co/production/uploads/62df78222d89ce551ce0f71d/4kn6iq2kdCgtq8riCR9DJ.png\" alt=\"danceopd (1)\"></a></p>\n","updatedAt":"2026-06-26T02:04:10.611Z","author":{"_id":"62df78222d89ce551ce0f71d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/62df78222d89ce551ce0f71d/JnRDRMfQQFRUajOevmvHg.jpeg","fullname":"Lingdong Kong","name":"ldkong","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":10,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7487632632255554},"editors":["ldkong"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/62df78222d89ce551ce0f71d/JnRDRMfQQFRUajOevmvHg.jpeg"],"reactions":[{"reaction":"🔥","users":["ldkong","drive-bench","E-Deflare","WeiChow","drive-with-vlms","anonymous-demo","LiDARCrafter","Bin923","Uber23","phys123","linfeng23","worldbench","TruemanV5","nihao23","zhuxw","yingda14","sugar2024","mouda1314","taesiri"],"count":19},{"reaction":"🚀","users":["ldkong","drive-bench","E-Deflare","drive-with-vlms","anonymous-demo","LiDARCrafter","Bin923","Uber23","phys123","linfeng23","worldbench","TruemanV5","nihao23","zhuxw","yingda14","sugar2024","mouda1314","taesiri"],"count":18},{"reaction":"😎","users":["ldkong","drive-bench","E-Deflare","drive-with-vlms","anonymous-demo","LiDARCrafter","Bin923","Uber23","phys123","linfeng23","worldbench","TruemanV5","nihao23","zhuxw","yingda14","sugar2024","mouda1314","taesiri"],"count":18},{"reaction":"👍","users":["ldkong","drive-bench","E-Deflare","drive-with-vlms","anonymous-demo","LiDARCrafter","Bin923","Uber23","phys123","linfeng23","worldbench","TruemanV5","nihao23","zhuxw","yingda14","sugar2024","mouda1314","taesiri"],"count":18},{"reaction":"🤗","users":["drive-bench","E-Deflare","drive-with-vlms","anonymous-demo","LiDARCrafter","Bin923","Uber23","phys123","linfeng23","worldbench","TruemanV5","nihao23","zhuxw","yingda14","sugar2024","mouda1314","taesiri"],"count":17},{"reaction":"❤️","users":["drive-bench","E-Deflare","drive-with-vlms","anonymous-demo","LiDARCrafter","Bin923","Uber23","phys123","linfeng23","worldbench","TruemanV5","nihao23","zhuxw","yingda14","sugar2024","mouda1314","taesiri"],"count":17},{"reaction":"👀","users":["drive-with-vlms","anonymous-demo","LiDARCrafter","Bin923","Uber23","phys123","linfeng23","worldbench","TruemanV5","nihao23","yingda14","sugar2024","mouda1314"],"count":13},{"reaction":"🤯","users":["Bin923","Uber23","phys123","linfeng23","worldbench","TruemanV5","nihao23","zhuxw","yingda14","sugar2024"],"count":10},{"reaction":"🤝","users":["worldbench","nihao23","yingda14","sugar2024","WeiChow"],"count":5},{"reaction":"➕","users":["sugar2024"],"count":1}],"isReport":false}},{"id":"6a3de366ec98903bee824d57","author":{"_id":"644b71ddb2e7823a76abcf91","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/644b71ddb2e7823a76abcf91/JPF7Eqeq2jx8i79nQ962K.jpeg","fullname":"Wei Chow","name":"WeiChow","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":11,"isUserFollowing":false},"createdAt":"2026-06-26T02:26:46.000Z","type":"comment","data":{"edited":true,"hidden":false,"latest":{"raw":"**Image-generation post-training is increasingly becoming a process of training specialized experts and absorbing their capabilities into one unified model.** T2I, local editing, global editing, style control, realism enhancement, and CFG-like guidance are all desirable in the same checkpoint. Yet in practice, data mixing and weight merging often cause interference: new skills improve, while existing ones degrade.\n\n**DanceOPD addresses this problem through on-policy field distillation for flow-matching models.** We view each expert capability as a **velocity field in a shared latent flow space**. The student rolls out its own trajectory, queries the corresponding teacher at a low-noise semantic state, and learns with a simple velocity-MSE loss. Remarkably, **a single teacher query is sufficient** for effective capability absorption.\n\nOn T2I + Edit composition, DanceOPD reaches **5.347 on GEditBench**, outperforming the best reproduced OPD baseline by **8.1%**, while maintaining **0.849 on GenEval**. On the more conflicting Local + Global Edit setting, it achieves **5.498 on GEditBench**, improving over the strongest baseline by **16.1%**, with **0.848 GenEval**. The same framework also supports **realism absorption and CFG absorption**.\n\nCompared with recent DiffusionOPD and FlowOPD, our focus is not merging RL-trained models from different reward models, but studying **how generative capabilities themselves can be stably absorbed and composed in a shared flow space**. We further analyze teacher routing, query states, KL-style objectives, and dense vs. single-query designs, showing about **10× training efficiency over DiffusionOPD**.\n\nWe hope DanceOPD offers a cleaner path for visual-generation post-training: **not forcing data or weights together, but letting the model learn expert capabilities on its own distribution**.\n\n📄 **Paper:** [https://arxiv.org/abs/2606.27377](https://arxiv.org/abs/2606.27377) \n🌐 **Project:** [https://danceopd.github.io/](https://danceopd.github.io/) \n\nPlease consider upvoting 🙏 \n\n🛠️ **Code is still under approval; pseudocode is provided in the paper.**\n\n\nhttps://cdn-uploads.huggingface.co/production/uploads/644b71ddb2e7823a76abcf91/gre5QSNTVB7GeFOaxXIPr.mp4\n","html":"<p><strong>Image-generation post-training is increasingly becoming a process of training specialized experts and absorbing their capabilities into one unified model.</strong> T2I, local editing, global editing, style control, realism enhancement, and CFG-like guidance are all desirable in the same checkpoint. Yet in practice, data mixing and weight merging often cause interference: new skills improve, while existing ones degrade.</p>\n<p><strong>DanceOPD addresses this problem through on-policy field distillation for flow-matching models.</strong> We view each expert capability as a <strong>velocity field in a shared latent flow space</strong>. The student rolls out its own trajectory, queries the corresponding teacher at a low-noise semantic state, and learns with a simple velocity-MSE loss. Remarkably, <strong>a single teacher query is sufficient</strong> for effective capability absorption.</p>\n<p>On T2I + Edit composition, DanceOPD reaches <strong>5.347 on GEditBench</strong>, outperforming the best reproduced OPD baseline by <strong>8.1%</strong>, while maintaining <strong>0.849 on GenEval</strong>. On the more conflicting Local + Global Edit setting, it achieves <strong>5.498 on GEditBench</strong>, improving over the strongest baseline by <strong>16.1%</strong>, with <strong>0.848 GenEval</strong>. The same framework also supports <strong>realism absorption and CFG absorption</strong>.</p>\n<p>Compared with recent DiffusionOPD and FlowOPD, our focus is not merging RL-trained models from different reward models, but studying <strong>how generative capabilities themselves can be stably absorbed and composed in a shared flow space</strong>. We further analyze teacher routing, query states, KL-style objectives, and dense vs. single-query designs, showing about <strong>10× training efficiency over DiffusionOPD</strong>.</p>\n<p>We hope DanceOPD offers a cleaner path for visual-generation post-training: <strong>not forcing data or weights together, but letting the model learn expert capabilities on its own distribution</strong>.</p>\n<p>📄 <strong>Paper:</strong> <a href=\"https://arxiv.org/abs/2606.27377\" rel=\"nofollow\">https://arxiv.org/abs/2606.27377</a><br>🌐 <strong>Project:</strong> <a href=\"https://danceopd.github.io/\" rel=\"nofollow\">https://danceopd.github.io/</a> </p>\n<p>Please consider upvoting 🙏 </p>\n<p>🛠️ <strong>Code is still under approval; pseudocode is provided in the paper.</strong></p>\n<p><a href=\"https://cdn-uploads.huggingface.co/production/uploads/644b71ddb2e7823a76abcf91/Q3A7JE79y4xLMBtSUWsEV.png\" rel=\"nofollow\"><img src=\"https://cdn-uploads.huggingface.co/production/uploads/644b71ddb2e7823a76abcf91/Q3A7JE79y4xLMBtSUWsEV.png\" alt=\"宣发1\"></a></p>\n<p><video src=\"https://cdn-uploads.huggingface.co/production/uploads/644b71ddb2e7823a76abcf91/gre5QSNTVB7GeFOaxXIPr.mp4\" controls=\"\" class=\"max-w-full!\"></video></p>\n","updatedAt":"2026-06-26T02:29:24.144Z","author":{"_id":"644b71ddb2e7823a76abcf91","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/644b71ddb2e7823a76abcf91/JPF7Eqeq2jx8i79nQ962K.jpeg","fullname":"Wei Chow","name":"WeiChow","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":11,"isUserFollowing":false}},"numEdits":2,"identifiedLanguage":{"language":"en","probability":0.8291085958480835},"editors":["WeiChow"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/644b71ddb2e7823a76abcf91/JPF7Eqeq2jx8i79nQ962K.jpeg"],"reactions":[{"reaction":"🤗","users":["WeiChow","Bin923","Uber23","phys123","linfeng23","zhuxw","LiDARCrafter","worldbench","TruemanV5","nihao23","yingda14","sugar2024","mouda1314","taesiri"],"count":14},{"reaction":"❤️","users":["WeiChow","Bin923","Uber23","phys123","linfeng23","zhuxw","LiDARCrafter","worldbench","TruemanV5","nihao23","yingda14","sugar2024","mouda1314","taesiri"],"count":14},{"reaction":"🚀","users":["WeiChow","Bin923","Uber23","phys123","linfeng23","zhuxw","LiDARCrafter","worldbench","TruemanV5","nihao23","yingda14","sugar2024"],"count":12},{"reaction":"🔥","users":["WeiChow","Bin923","Uber23","phys123","linfeng23","zhuxw","LiDARCrafter","worldbench","TruemanV5","nihao23","yingda14","sugar2024"],"count":12},{"reaction":"🤝","users":["WeiChow","Bin923","Uber23","phys123","linfeng23","zhuxw","LiDARCrafter","worldbench","TruemanV5","nihao23","yingda14","sugar2024"],"count":12},{"reaction":"👀","users":["WeiChow","Bin923","Uber23","phys123","linfeng23","LiDARCrafter","worldbench","TruemanV5","nihao23","yingda14","sugar2024","mouda1314"],"count":12},{"reaction":"👍","users":["Uber23","phys123","linfeng23","zhuxw","LiDARCrafter","worldbench","TruemanV5","nihao23","yingda14","sugar2024","mouda1314"],"count":11},{"reaction":"😎","users":["LiDARCrafter","worldbench","TruemanV5","nihao23","yingda14","sugar2024","mouda1314"],"count":7},{"reaction":"🧠","users":["sugar2024"],"count":1}],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2606.27377","authors":[{"_id":"6a3dda9a3b43e283349ec108","user":{"_id":"644b71ddb2e7823a76abcf91","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/644b71ddb2e7823a76abcf91/JPF7Eqeq2jx8i79nQ962K.jpeg","isPro":false,"fullname":"Wei Chow","user":"WeiChow","type":"user","name":"WeiChow"},"name":"Wei Zhou","status":"claimed_verified","statusLastChangedAt":"2026-06-27T15:23:55.173Z","hidden":false},{"_id":"6a3dda9a3b43e283349ec109","name":"Xiongwei Zhu","hidden":false},{"_id":"6a3dda9a3b43e283349ec10a","name":"Zelin Xu","hidden":false},{"_id":"6a3dda9a3b43e283349ec10b","name":"Bo Dong","hidden":false},{"_id":"6a3dda9a3b43e283349ec10c","name":"Lixue Gong","hidden":false},{"_id":"6a3dda9a3b43e283349ec10d","name":"Yongyuan Liang","hidden":false},{"_id":"6a3dda9a3b43e283349ec10e","user":{"_id":"63f57aadb51da4d61daaff09","avatarUrl":"/avatars/c558638d08dd4e564880979e5c90cf67.svg","isPro":false,"fullname":"meng chu","user":"TruemanV5","type":"user","name":"TruemanV5"},"name":"Meng Chu","status":"claimed_verified","statusLastChangedAt":"2026-06-27T15:23:57.095Z","hidden":false},{"_id":"6a3dda9a3b43e283349ec10f","name":"Leigang Qu","hidden":false},{"_id":"6a3dda9a3b43e283349ec110","user":{"_id":"62df78222d89ce551ce0f71d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/62df78222d89ce551ce0f71d/JnRDRMfQQFRUajOevmvHg.jpeg","isPro":true,"fullname":"Lingdong Kong","user":"ldkong","type":"user","name":"ldkong"},"name":"Lingdong Kong","status":"claimed_verified","statusLastChangedAt":"2026-06-27T15:23:58.852Z","hidden":false},{"_id":"6a3dda9a3b43e283349ec111","name":"Wei Liu","hidden":false},{"_id":"6a3dda9a3b43e283349ec112","name":"Tat-Seng Chua","hidden":false}],"mediaUrls":["https://cdn-uploads.huggingface.co/production/uploads/6039478ab3ecf716b1a5fd4d/T73l6bcCjjqWVVvz1mioW.qt"],"publishedAt":"2026-06-25T00:00:00.000Z","submittedOnDailyAt":"2026-06-26T00:00:00.000Z","title":"DanceOPD: On-Policy Generative Field Distillation","submittedOnDailyBy":{"_id":"6039478ab3ecf716b1a5fd4d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6039478ab3ecf716b1a5fd4d/_Thy4E7taiSYBLKxEKJbT.jpeg","isPro":true,"fullname":"taesiri","user":"taesiri","type":"user","name":"taesiri"},"summary":"Modern image generation demands a single model that unifies diverse capabilities, including text-to-image (T2I), local editing, and global editing. However, these capabilities are rarely naturally aligned and often conflict. For instance, editing tends to degrade T2I performance, while global and local editing interfere with each other. Consequently, effectively composing these capabilities has become a central challenge for image generation model training. To tackle this, we introduce DanceOPD, an on-policy generative field distillation framework for flow-matching models that routes each sample to one capability field, queries one low-noise student-induced state, and trains with a simple velocity MSE objective. With each capability source defined as a velocity field over the shared flow state space, the student learns from fields queried on its own rollout states to compose expert capabilities. This formulation also absorbs operator-defined fields such as classifier-free guidance. Comprehensive experiments on T2I, editing, realism-field absorption, and CFG absorption show that our approach improves multi-capability composition, strengthening target capabilities while preserving anchor generation quality. We believe this work establishes a practical route for generative field distillation in flow-matching models.","upvotes":66,"discussionId":"6a3dda9a3b43e283349ec113","projectPage":"https://danceopd.github.io/","ai_summary":"A novel on-policy generative field distillation framework called DanceOPD is proposed to unify text-to-image generation, local editing, and global editing capabilities in flow-matching models through capability-specific routing and velocity-based training.","ai_keywords":["generative field distillation","flow-matching models","on-policy","velocity MSE objective","velocity field","classifier-free guidance","text-to-image","local editing","global editing","student model","expert capabilities"],"ai_summary_model":"Qwen/Qwen2.5-Coder-32B-Instruct","organization":{"_id":"67d1140985ea0644e2f14b99","name":"ByteDance-Seed","fullname":"ByteDance Seed","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/6535c9e88bde2fae19b6fb25/flkDUqd_YEuFsjeNET3r-.png"}},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"644b71ddb2e7823a76abcf91","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/644b71ddb2e7823a76abcf91/JPF7Eqeq2jx8i79nQ962K.jpeg","isPro":false,"fullname":"Wei Chow","user":"WeiChow","type":"user"},{"_id":"62df78222d89ce551ce0f71d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/62df78222d89ce551ce0f71d/JnRDRMfQQFRUajOevmvHg.jpeg","isPro":true,"fullname":"Lingdong Kong","user":"ldkong","type":"user"},{"_id":"67675e1cea47e27b4a8ca08e","avatarUrl":"/avatars/383f0491d674f34cd6d08af686b4069c.svg","isPro":false,"fullname":"DriveBench","user":"drive-bench","type":"user"},{"_id":"69366c84028e81e0b22f5f24","avatarUrl":"/avatars/34fcbab2426cf891652846e6a440552c.svg","isPro":false,"fullname":"E-Deflare Benchmark","user":"E-Deflare","type":"user"},{"_id":"6758f3bfacfd817f09825b2e","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/Y43w6tUKlnvDJxHiKM7tM.png","isPro":false,"fullname":"Drive with VLMs","user":"drive-with-vlms","type":"user"},{"_id":"62f659fc05ca68c0e0fd97dc","avatarUrl":"/avatars/b29c9f5f2f378ea3dfc38ed4b6d442ac.svg","isPro":false,"fullname":"Anonymous Demo","user":"anonymous-demo","type":"user"},{"_id":"68ddd9a702812725d5e3939c","avatarUrl":"/avatars/8a44bcea05db2018e212ca9c6a654c0a.svg","isPro":false,"fullname":"LiDARCrafter","user":"LiDARCrafter","type":"user"},{"_id":"6a0befa38ddd0eace87d8dae","avatarUrl":"/avatars/d20be9cb033517d674c283c0204fb412.svg","isPro":false,"fullname":"Xian Sun","user":"langlangSun","type":"user"},{"_id":"65405d5d149161da416eeca5","avatarUrl":"/avatars/b99d595dbb8d8e0f7af2117f8ac8f809.svg","isPro":false,"fullname":"Chen","user":"YuxiangChen","type":"user"},{"_id":"67c952eb648c10bac4b0f5a2","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/67c952eb648c10bac4b0f5a2/Da2XIF3Pvt3T2tLFVg6GZ.jpeg","isPro":false,"fullname":"Yolox","user":"linfengup","type":"user"},{"_id":"6463554dd2044cd1d7c6e0bf","avatarUrl":"/avatars/d7653623117268c545a7063fec69664b.svg","isPro":false,"fullname":"Bingzheng Wei","user":"Bingzheng","type":"user"},{"_id":"67b68fda9ed44eb836bdc5a0","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/dOCAq1415CecsxunmdCIk.png","isPro":false,"fullname":"Bin923","user":"Bin923","type":"user"}],"acceptLanguages":["en"],"dailyPaperRank":1,"organization":{"_id":"67d1140985ea0644e2f14b99","name":"ByteDance-Seed","fullname":"ByteDance Seed","avatar":"https://cdn-avatars.huggingface.co/v1/production/uploads/6535c9e88bde2fae19b6fb25/flkDUqd_YEuFsjeNET3r-.png"},"markdownContentUrl":"https://huggingface.co/buckets/huggingchat/papers-content/resolve/2606/2606.27377.md","query":{}}">
DanceOPD: On-Policy Generative Field Distillation
Abstract
A novel on-policy generative field distillation framework called DanceOPD is proposed to unify text-to-image generation, local editing, and global editing capabilities in flow-matching models through capability-specific routing and velocity-based training.
Modern image generation demands a single model that unifies diverse capabilities, including text-to-image (T2I), local editing, and global editing. However, these capabilities are rarely naturally aligned and often conflict. For instance, editing tends to degrade T2I performance, while global and local editing interfere with each other. Consequently, effectively composing these capabilities has become a central challenge for image generation model training. To tackle this, we introduce DanceOPD, an on-policy generative field distillation framework for flow-matching models that routes each sample to one capability field, queries one low-noise student-induced state, and trains with a simple velocity MSE objective. With each capability source defined as a velocity field over the shared flow state space, the student learns from fields queried on its own rollout states to compose expert capabilities. This formulation also absorbs operator-defined fields such as classifier-free guidance. Comprehensive experiments on T2I, editing, realism-field absorption, and CFG absorption show that our approach improves multi-capability composition, strengthening target capabilities while preserving anchor generation quality. We believe this work establishes a practical route for generative field distillation in flow-matching models.
Community
DanceOPD uses hard routing to select one frozen capability field, queries it on a low-noise on-policy student state, and matches the selected velocity with a local velocity MSE loss.

Image-generation post-training is increasingly becoming a process of training specialized experts and absorbing their capabilities into one unified model. T2I, local editing, global editing, style control, realism enhancement, and CFG-like guidance are all desirable in the same checkpoint. Yet in practice, data mixing and weight merging often cause interference: new skills improve, while existing ones degrade.
DanceOPD addresses this problem through on-policy field distillation for flow-matching models. We view each expert capability as a velocity field in a shared latent flow space. The student rolls out its own trajectory, queries the corresponding teacher at a low-noise semantic state, and learns with a simple velocity-MSE loss. Remarkably, a single teacher query is sufficient for effective capability absorption.
On T2I + Edit composition, DanceOPD reaches 5.347 on GEditBench, outperforming the best reproduced OPD baseline by 8.1%, while maintaining 0.849 on GenEval. On the more conflicting Local + Global Edit setting, it achieves 5.498 on GEditBench, improving over the strongest baseline by 16.1%, with 0.848 GenEval. The same framework also supports realism absorption and CFG absorption.
Compared with recent DiffusionOPD and FlowOPD, our focus is not merging RL-trained models from different reward models, but studying how generative capabilities themselves can be stably absorbed and composed in a shared flow space. We further analyze teacher routing, query states, KL-style objectives, and dense vs. single-query designs, showing about 10× training efficiency over DiffusionOPD.
We hope DanceOPD offers a cleaner path for visual-generation post-training: not forcing data or weights together, but letting the model learn expert capabilities on its own distribution.
📄 Paper: https://arxiv.org/abs/2606.27377
🌐 Project: https://danceopd.github.io/
Please consider upvoting 🙏
🛠️ Code is still under approval; pseudocode is provided in the paper.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.
Tap or paste here to upload images
Cite arxiv.org/abs/2606.27377 in a model README.md to link it from this page.
Cite arxiv.org/abs/2606.27377 in a dataset README.md to link it from this page.
Cite arxiv.org/abs/2606.27377 in a Space README.md to link it from this page.
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.