My current research interests include speech processing, analysis, synthesis and recognition, dialog and multi-modal systems, lexical semantics, natural language understanding, large language models, general artificial intelligence, behavioral informatics, affective analysis, modeling and recognition, machine learning and representation learning, cognitive semantics, nonlinear signal processing, and multimodal child-computer interaction. I am especially interested on how cognitive semantic representations can motivate us to create computational models that are robust, accurate and rapid learners of multimodal information with application to deep learning.
I have authored or co-authored over 210 papers in professional journals and conferences (citations: 8954, h-index: 50, i10-index: 134, source google scholar - Apr 2024). I was a co-author of the paper "Creating conversational interfaces for children" that received a 2005 IEEE Signal Processing Society Best Paper Award, and the co-editor of the book "Multimodal Processing and Interaction: Audio, Video, Text" , Springer, 2008. A list of my patents can be found here. I have been a member of the IEEE Signal Processing Society since 1992, an IEEE fellow since 2016 and an ISCA fellow since 2023. I have served three terms at the IEEE Speech and Language Technical Committee and one term at the IEEE Multimedia Signal Processing Committee.