Mediating Movement-Based Interaction Through Semiotically Enhanced Shadow Representations

Whole-body interaction can help to motivate by-passers to interact with public displays as it enables reaction to passive users and immediate touch-less applicability. We introduce our approach of mediating movement-based interaction techniques to the user allowing spontaneous interaction within walk-up-and-use scenarios. Our concept of semiotically enhanced shadow representations combines abstract user representations with meaningful symbols, visual accentuations and animations to emphasize body parts and explain movements that are relevant for the interaction with the system. The MeetingMirror is used as an example application for implementing this approach.