My research is focused on deep learning, AI safety and alignment, and more specifically, with understanding how to communicate or “specify” what behavior is desired. I’m pursuing the three research directions I view as most promising in this area:

Learning what humans want from human feedback (e.g. via reward modelling).
Managing the incentives an AI system has to influence the world (e.g. to prevent user manipulation in content recommendation systems).
Getting deep nets to understand the world the same way people do (e.g. so that they can solve out-of-distribution generalization problems).