Carlos Riquelme

基本信息

Career Trajectory

Bio

My focus are models that handle multimodal data (language, vision, audio) and how to speed up inference with tools such as sparsity, distillation, pruning, model cascades, early exits, or quantization.

Research Interests

Papers共 35 篇Author StatisticsCo-AuthorSimilar Experts

By YearBy Citation主题筛选期刊级别筛选合作者筛选合作机构筛选

Routers in Vision Mixture of Experts: an Empirical Study

Tianlin Liu,Mathieu Blondel,Carlos Riquelme,Joan Puigcerver

Trans Mach Learn Res (2024)

Cited0Views0EIBibtex

Rephrasing Natural Text Data with Different Languages and Quality Levels for Large Language Model Pre-Training

Michael Pieler,Marco Bellagente,Hannah Teufel,Duy Phung,Nathan Cooper,Jonathan Tow, Paulo Rocha, Reshinth Adithyan,Zaid Alyafeai,Nikhil Pinnaparaju,Maksym Zhuravinskyi,Carlos Riquelme

arxiv（2024）

Cited0Views0Bibtex

From Sparse to Soft Mixtures of Experts

Joan Puigcerver,Carlos Riquelme Ruiz,Basil Mustafa,Neil Houlsby

ICLR 2024（2024）

Cited63Views0EIBibtex

Scaling Laws for Sparsely-Connected Foundation Models

Elias Frantar,Carlos Riquelme Ruiz,Neil Houlsby,Dan Alistarh,Utku Evci

arXiv (Cornell University)（2023）

Cited0Views0EIBibtex

Sparse MoEs Meet Efficient Ensembles

James Urquhart Allingham,Florian Wenzel,Zelda E Mariet,Basil Mustafa,Joan Puigcerver,Neil Houlsby,Ghassen Jerfel,Vincent Fortuin,Balaji Lakshminarayanan,Jasper Snoek,Dustin Tran,Carlos Riquelme Ruiz,Rodolphe Jenatton

Trans Mach Learn Res (2022)

Cited2Views0EIBibtex

Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts

Basil Mustafa,Carlos Riquelme,Joan Puigcerver,Rodolphe Jenatton,Neil Houlsby

arXiv (Cornell University) (2022)

Cited72Views0Bibtex

Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Aran Komatsuzaki,Joan Puigcerver,James Lee-Thorp,Carlos Riquelme Ruiz,Basil Mustafa,Joshua Ainslie,Yi Tay,Mostafa Dehghani,Neil Houlsby

ICLR 2023（2022）

Cited11Views0EIBibtex

Which Model to Transfer? Finding the Needle in the Growing Haystack

Cedric Renggli,Andre Susano Pinto,Luka Rimanic,Joan Puigcerver,Carlos Riquelme,Ce Zhang,Mario Lucic

2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)（2022）

Cited3Views0EIWOSBibtex

Author Statistics

Co-Author

Co-Institution

D-Core

合作者
学生
导师

No result temporarily, you can search similar Scholar with the same research interest

Data Disclaimer

The page data are from open Internet sources, cooperative publishers and automatic analysis results through AI technology. We do not make any commitments and guarantees for the validity, accuracy, correctness, reliability, completeness and timeliness of the page data. If you have any questions, please contact us by email: report@aminer.cn

Lead of Language Models Team

Papers共 35 篇Author StatisticsCo-AuthorSimilar Experts