Toward the manipulation of time and space in extended reality: a preliminary study on multimodal Tau and Kappa illusions in the visual-tactile domain

In the last few years, Extended reality (XR) has enabled novel forms of sensory experiences and social interplay, which can be hardly experienced in real life. However, the full potential of XR has not been exploited yet, since vision remains the main interaction modality, and the time- and space-modulation of the sense of self - which could open interesting perspectives in several scenarios - is still largely unexplored. To pave the path to a multi-modal manipulation of the sense of time and space in immersive XR, in this work we discuss the preliminary outcomes of the first investigation in the visual-tactile domain of two well known perceptual illusions affecting spatial and temporal perception, i.e. Tau and Kappa effects, respectively. We compared the effects originated from unimodal stimulation (i.e., only visual or tactile) with the same effects induced by convergent bimodal stimulation (i.e., visual and tactile), delivered to the forearm. Results show that both Tau and Kappa effects are affected by the multi-modality of the stimulation, and that the perceptual bias differently affects time-or space-perception based on the modality used for stimulus delivery. Our results, although preliminary, seem to suggest that multimodal perceptual illusions could be a viable solution for time- and space-modulation of the sense of self in immersive XR and advanced social human-robot interaction.