Bringing Real Body as Self-Avatar into Mixed Reality: A Gamified Volcano Experience

In this work we showcase a Mixed Reality experience able to bring users' own body as a self-avatar. This is mainly based on an algorithm that segment in real time the egocentric full body placing a regular stereo camera in front of a commercial Virtual Reality device. The work behind this paper is divided into: i) Data Acquisition; ii) Algorithm training and iii) Integration into a Mixed Reality environment. To the best of our knowledge, this is the first work that integrates real body as self-avatar both meeting real-time and segmentation quality in real-life conditions beyond benchmarking, We conclude the paper with some preliminary subjective evaluation measuring Presence and Embodiment Factors, that suggests the potential of using your own body as self-avatar in Mixed Reality.