Multi-modal Sensing-Based Interactive Glove System for Teleoperation and VR/AR

Haptic interaction is a fundamental approach to our perception surrounding people; at this stage, haptic interaction is mainly used in virtual reality (VR) and remote medical procedures (teleoperation). The traditional large volume, complex operation seriously affects the function of immersive. This paper develops a multi-modal sensing interactive glove system for teleoperation and VR/AR. The device is small in size and convenient to wear; we integrate temperature sensing and tactile sensing into our glove system and deliver real-time and accurate environmental signals to the wearer through the acquisition and processing of information and program-controlled regulation to better realize the fusion of virtual and real. This paper first introduces the structure and working principle of the system and analyzes its performance. Then a sensory experiment based on human hand skin was designed, and volunteers were selected to experience it.