I’m always interested to hear about research opportunities (currently considering starting a PhD). I’ve worked in Chinese, English, Japanese, French & German, but I don’t have enough parameters so I forgot much of the last two

I’m interested in creating better, more general language models. To do so, I’ve had the chance to work with amazing collaborators on:

(a) large language models: Developing data-constrained scaling laws, building the largest open-source models (BLOOMZ/mT0 & BLOOM) & large code models (SantaCoder & StarCoder)

(b) language embeddings: Building the largest embedding benchmark (MTEB) & state-of-the-art retrieval models (SGPT)

(c) multimodal models: Won 2nd/3300 in Meta’s Hateful Memes Challenge (Blog, Paper)