基本信息
views: 71
Career Trajectory
Bio
My research is in machine learning systems. I am fascinated by how foundation models are changing the ways we build data management systems. Recently, I've been excited about:
Systems: Enabling users to scalably and reliably incorporate challenging data types into ML Systems - e.g., private, semi-structured, knowledge-intensive, and long-sequence data.
AI: Understanding the fundamentals of foundation model pre-training to build simple and efficient building blocks for ML systems. Lately, we find certain prompting formats are prevalent in pre-training data and design a simple, efficient prompting method. We study how architectures gain the skills to perform in-context learning and design a simple, efficient architecture. We study the benefits of contextual embeddings and ask when we can get away with simple, efficient random embeddings.
Systems: Enabling users to scalably and reliably incorporate challenging data types into ML Systems - e.g., private, semi-structured, knowledge-intensive, and long-sequence data.
AI: Understanding the fundamentals of foundation model pre-training to build simple and efficient building blocks for ML systems. Lately, we find certain prompting formats are prevalent in pre-training data and design a simple, efficient prompting method. We study how architectures gain the skills to perform in-context learning and design a simple, efficient architecture. We study the benefits of contextual embeddings and ask when we can get away with simple, efficient random embeddings.
Research Interests
Papers共 26 篇Author StatisticsCo-AuthorSimilar Experts
By YearBy Citation主题筛选期刊级别筛选合作者筛选合作机构筛选
时间
引用量
主题
期刊级别
合作者
合作机构
ICLR 2024 (2024)
Cited0Views0Bibtex
0
0
Simran Arora,Aman Timalsina, Aaryan Singhal, Benjamin Spector,Sabri Eyuboglu, Xinyi Zhao, Ashish Rao,Atri Rudra,Christopher Ré
CoRR (2024)
Cited0Views0EIBibtex
0
0
Michael Zhang,Simran Arora, Rahul Chalamala, Alan Wu, Benjamin Spector, Aaryan Singhal, Krithik Ramesh,Christopher Ré
arxiv(2024)
Cited0Views0Bibtex
0
0
arXiv (Cornell University) (2023)
arXiv (Cornell University) (2023)
PROCEEDINGS OF THE VLDB ENDOWMENTno. 2 (2023): 92-105
CoRR (2023)
Cited0Views0EIBibtex
0
0
Load More
Author Statistics
#Papers: 26
#Citation: 597
H-Index: 9
G-Index: 11
Sociability: 5
Diversity: 1
Activity: 19
Co-Author
Co-Institution
D-Core
- 合作者
- 学生
- 导师
Data Disclaimer
The page data are from open Internet sources, cooperative publishers and automatic analysis results through AI technology. We do not make any commitments and guarantees for the validity, accuracy, correctness, reliability, completeness and timeliness of the page data. If you have any questions, please contact us by email: report@aminer.cn