基本信息
views: 446
Career Trajectory
Bio
My research is driven by the goal of developing intelligent embodied agents that interact in the physical world. My research has primarily focused on the use of generative AI as an approach towards this goal. A major challenge in applying generative AI in this setting is the lack of available decision-making data and the necessity to generalize well to previously unseen situations. My work addresses this by constructing composable generative models using the idea of learning energy landscapes (EBMs) as a means to generalize beyond the narrow amount of data that is available, and some of my early work on EBMs led to the resurgence of diffusion models in 2020. EBMs enable compositional visual generation and compositional scene understanding. My work has further focused on how such compositional models can enable the synthesis of new trajectories in trajectory planning, enabling flexible adaptation to novel goals and rewards across both synthesized videos and on real robots. Finally, an energy optimization perspective on prediction enables us to combine the strengths of large pre-trained models together at prediction time, enabling both hierarchical planning and multimodal perception. More broadly, I am interested in constructing a decentralized generative architecture for decision-making, consisting of a society of different multimodal models, each with separate responsibilities such as 3D perception, memory, and auditory understanding, which jointly cooperate to make decisions in an environment. I am also interested in additional techniques to improve generative models such as reinforcement learning training as well as broader applications of my research in domains in science such as computational biology.
Research Interests
Papers共 103 篇Author StatisticsCo-AuthorSimilar Experts
By YearBy Citation主题筛选期刊级别筛选合作者筛选合作机构筛选
时间
引用量
主题
期刊级别
合作者
合作机构
2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)pp.4118-4127, (2024)
ICML 2024 (2024)
Cited275Views0Bibtex
275
0
ICLR 2024 (2024)
Cited0Views0EIBibtex
0
0
Robert McCarthy,Daniel C. H. Tan, Dominik Schmidt,Fernando Acero, Nathan Herr,Yilun Du, Thomas G. Thuruthel,Zhibin Li
CoRR (2024)
Cited0Views0EIBibtex
0
0
Robotics Science and Systems XX (2024)
CoRR (2024)
Cited0Views0EIBibtex
0
0
Hongxin Zhang,Weihua Du, Jiaming Shan,Qinhong Zhou,Yilun Du,Joshua B. Tenenbaum,Tianmin Shu,Chuang Gan
Cited50Views0EIBibtex
50
0
CoRR (2024)
Cited0Views0EIBibtex
0
0
Load More
Author Statistics
#Papers: 103
#Citation: 3414
H-Index: 25
G-Index: 58
Sociability: 6
Diversity: 0
Activity: 3
Co-Author
Co-Institution
D-Core
- 合作者
- 学生
- 导师
Data Disclaimer
The page data are from open Internet sources, cooperative publishers and automatic analysis results through AI technology. We do not make any commitments and guarantees for the validity, accuracy, correctness, reliability, completeness and timeliness of the page data. If you have any questions, please contact us by email: report@aminer.cn