The Ingredients for Robotic Diffusion Transformers

[00:00] Intro

[00:33] Combining transformers & diffusion models

[01:12] Key design: Scalable attention blocks (AdaLN)

[02:30] Efficient observation tokenization

[03:45] DiT Block policy architecture overview

[04:20] BiPlay dataset introduction

[04:53] Performance improvements over baselines

[05:30] Key findings from ablations

[06:08] Generalization to different robot types

[06:43] Simulation vs real-world performance

[07:13] Takeaways and future research directions

Authors: Sudeep Dasari, Oier Mees, Sebastian Zhao, Mohan Kumar Srirama, Sergey Levine

Affiliations: Carnegie Mellon…