HoloSound: Combining Speech and Sound Identification for Deaf or Hard of Hearing Users on a Head-mounted Display

Ru Guo
Ru Guo
Yiru Yang
Yiru Yang
Johnson Kuang
Johnson Kuang
Xue Bin
Xue Bin
Steven Goodman
Steven Goodman

ASSETS '20: The 22nd International ACM SIGACCESS Conference on Computers and Accessibility Virtual Event Greece October, 2020, pp. 1-4, 2020.

Cited by: 0|Bibtex|Views21|DOI:https://doi.org/10.1145/3373625.3418031
EI
Other Links: dl.acm.org|dblp.uni-trier.de|academic.microsoft.com

Abstract:

Head-mounted displays can provide private and glanceable speech and sound feedback to deaf and hard of hearing people, yet prior systems have largely focused on speech transcription. We introduce HoloSound, a HoloLens-based augmented reality (AR) prototype that uses deep learning to classify and visualize sound identity and location in ad...More

Code:

Data:

Full Text
Your rating :
0

 

Tags
Comments