Distilled non-semantic speech embeddings with binary neural networks for low-resource devices

PATTERN RECOGNITION LETTERS(2024)

引用 0|浏览4
暂无评分
摘要
This work introduces BRILLsson, a novel binary neural network-based representation learning model for a broad range of non-semantic speech tasks. We train the model with knowledge distillation from a large and real-valued TRILLsson model with only a fraction of the dataset used to train TRILLsson. The resulting BRILLsson models are only 2MB in size with a latency less than 8 ms, making them suitable for deployment in low-resource devices such as wearables. We evaluate BRILLsson on eight benchmark tasks (including but not limited to spoken language identification, emotion recognition, human vocal sounds, and keyword spotting), and demonstrate that our proposed ultra-light and low-latency models perform as well as large-scale models.
更多
查看译文
关键词
Speech representations,Knowledge distillation,Paralinguistic tasks,Binary neural networks,Digital health,Internet-of-things
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要