My main research goal is to build large neural models that are applicable to real-world scenarios, by addressing inherent limitations of current neural models. Specifically, I am interested in allowing neural models to be lifelong learners [C1, C2, C5], providing privacy and security guarantees for neural models [C7], and enabling neural models to follow the given instruction via prompt [W1, C3, C4, P1].