Non-contact Human Computer Interaction System Design and Implementation

Tongue has been proved to be effective in substituting human sensory system. Tongue supported human-computer interaction can help people with motor disability to operate assistive devices and computers. Previous research and applications focus on implementing such an interface by using mechanical or electromagnetic hardware which raises safety issues and hygiene concerns. This paper presents the process of developing a tongue interface by using computer vision so that people with dexterity impairment can interact with assistive devices and computers without relying on mechanical or electromagnetic hardware. An evaluation of the system is conducted and suggests that the novel interaction technique is effective in pointing and text entry for people with dexterity impairment.