Motion history to improve communication and switch access for people with severe and multiple disabilities

ABSTRACTIn this study, a computer-vision based technique called Motion History that visualizes the history of movement of the user, was applied to support communication and switch access for people with severe and multiple disabilities. Seven non-speaking children with severe physical and intellectual disabilities participated in the study, and Motion History successfully helped to investigate their voluntary movement and cognition. In addition, based on the feedback comments of the study, a new system was developed, which used the built-in camera of the tablet PC to observe Motion History, and made the system easier and more mobile to use. One of the features of the system could convert the recognized body movement into a switch control, where a good switch fitting was automatically established based on the motion history.