Social events such as cocktail parties are valuable opportunities to build and sustain interpersonal relationships. However, meeting new people, the self-mixing of cocktails, and tracking one's beverage consumption can be difficult and intimidating. To support users during social events, we introduce CheersMate, a smart drinking glass that enables the simultaneous use of a private and a public wearable display. The private display provides cocktail mixing guidance to the user and shows personal consumption statistics during conversations, while the public display encourages social interaction by revealing the user's name and current drink. By clinking two CheersMates, the user can transfer additional information from the private to the public display, for example, showing the number of people the user has toasted with and the number of already consumed drinks. A pilot study with eight participants provides first insights on the acceptance of our concept and on the perceived usefulness as a social catalyst.

Consistent hydration is paramount for health and well-being. For knowledge workers, it also has an impact on overall productivity. Unfortunately, many knowledge workers experience insufficient hydration during busy working hours. We conducted interviews (N = 10) to investigate the causes of inconsistent hydration during work and explore the expectations of knowledge workers regarding intervention systems to improve their hydration habits. Based on the results of the interview study we designed the H2Office system, a comprehensive approach comprising a water gauge and a smartwatch app. A comparative field study over 10 days (N = 7) of the H2Office system shows its effectiveness in motivating knowledge workers to increase their water intake substantially (by 61

On the skin, a small distance between two actuators can result in the perception of a single, centralized stimulus rather than two distinct stimuli - this phenomenon is known as the funneling illusion. In this work, we explore the electrotactile funneling illusion on the forearm in a user study with 16 participants. We placed an electrode strip with 9 electrode pairs along their forearm - from wrist to elbow. The calibration of the same perceived intensity of each electrode pair for each participant shows that the calibrated intensities near the wrist are significantly higher compared to the intensities calibrated near the elbow. A linear regression corresponds to this behavior as well as the qualitative feedback of our participants. Based on this, we created an equation that helps to reduce the calibration time considerably. The results of our study show that the funneling illusion can be reliably evoked at distances of up to 7.2 cm. Further, we provide detailed information on occurrence frequency and precision and explored whether an approach adapted for electrotactile feedback can create an apparent tactile motion.

With an ever-increasing reliance on machine learning (ML) models in the real world, adversarial examples threaten the safety of AI-based systems such as autonomous vehicles. In the image domain, they represent maliciously perturbed data points that look benign to humans (i.e., the image modification is not noticeable) but greatly mislead state-of-the-art ML models. Previously, researchers ensured the imperceptibility of their altered data points by restricting perturbations via $\ell_p$ norms. However, recent publications claim that creating natural-looking adversarial examples without such restrictions is also possible. With much more freedom to instill malicious information into data, these unrestricted adversarial examples can potentially overcome traditional defense strategies as they are not constrained by the limitations or patterns these defenses typically recognize and mitigate. This allows attackers to operate outside of expected threat models. However, surveying existing image-based methods, we noticed a need for more human evaluations of the proposed image modifications. Based on existing human-assessment frameworks for image generation quality, we propose SCOOTER - an evaluation framework for unrestricted image-based attacks. It provides researchers with guidelines for conducting statistically significant human experiments, standardized questions, and a ready-to-use implementation. We propose a framework that allows researchers to analyze how imperceptible their unrestricted attacks truly are.

Prior research has designed and evaluated Voice Assistance (VA) for different settings such as the home, school, and public spaces. Office environments have been relatively understudied, leaving a gap in understanding the essential factors for designing a VA specifically for work settings. In this study, we developed the WorkFit VA specific for the office environment, focusing on the health and well-being of knowledge workers. WorkFit was designed to monitor knowledge workers for sedentary behavior, inconsistent hydration, and stress, and to deliver proactive voice interventions followed by a health recommendation to mitigate those issues. We evaluated WorkFit in a field study with 15 knowledge workers for 5 working days. In the study, we determined challenges and opportunities for voice interactions in work settings. We identified contextual factors for identifying inopportune moments for voice interactions in an office setting. We found that 92% of knowledge workers accepted WorkFit’s hydration interventions while 79% of them engaged in walking breaks. Moreover, breathing exercises recommended by WorkFit significantly stabilized the heart rate of knowledge workers during stress. Based on our findings, we propose five design recommendations for the development of VA customized to office settings.

Iterative design cycles for tangible user interfaces and wearable devices require efficient prototyping techniques to optimize development and to elevate the overall design efficacy. A key challenge for rapid prototyping techniques such as cardboard prototyping, 3D printing, or laser cutting is the integration of conductive surfaces. Additional wiring, conductive paint, or special materials like conductive filament often lack the necessary high conductivity and sufficient durability for designing on-skin wearables to measure muscle activity or to electrically stimulate the skin and muscles. To solve this problem we propose to combine spraying and electroplating to create surfaces that exhibit high conductivity, are solderable, corrosion-resistant and skin-friendly, and embody both practical functionality and aesthetic value. In this paper, we describe an effective spraying and electroplating process for rapid prototyping and demonstrate its applicability using several examples of tangible user interfaces. Further, we discuss advantages and disadvantages and describe limitations of the approach.

Operating small touchscreens with the finger occludes a large part of the screen. We propose using the watch case as the input space, without enlarging the smartwatch. Therefore, we created two prototypes, one with a touch surface on the watch case (CASE) and one with touch surfaces on the watch case and the wristband (CASE+BAND). In a comparative study, we analyze their suitability in a 1D list scrolling task and 2D map navigation task. The results show that occlusion is less of a problem for the list scrolling task, as visibility is sufficient. In the map navigation task, participants reached task completion times with CASE+BAND that are comparable to touch input. CASE was significantly slower, but only requires minimal additional hardware. However, the results of a subsequent longitudinal study demonstrates the learnability of CASE, which led to task completion times comparable to touch input, and provides insights in the gradual development of expert performance.

Cycling navigation is a complex and stressful task as the cyclist needs to focus simultaneously on the navigation, the road, and other road users. We propose directional electrotactile feedback at the wrist to reduce the auditory and visual load during navigation-aided cycling. We designed a custom electrotactile grid with 9 electrodes that is clipped under a smartwatch. In a preliminary study we identified suitable calibration settings and gained first insights about a suitable electrode layout. In a subsequent laboratory study we showed that a direction can be encoded with a mean error of 19.28\,° (σ = 42.77°) by combining 2 adjacent electrodes. Additionally, by interpolating with 3 electrodes a direction can be conveyed with a similar mean error of 22.54° (σ = 43.57°). We evaluated our concept of directional electrotactile feedback for cyclists in an outdoor study, in which 98.8% of all junctions were taken correctly by eight study participants. Only one participant deviated substantially from the optimal path, but was successfully navigated back to the original route by our system.

In the domain of health and well-being, proactive voice interventions have demonstrated their efficacy. However, users often encounter privacy concerns and social embarrassment due to the lack of control over these proactive interventions, especially in formal and social settings. This study introduces a novel approach called “dual-mode intervention.” It begins with primary interventions using different modalities (like graphical, tactile, or auditory). If users do not respond to these primary interventions, the system delivers voice interventions after a short interval. We conducted a study employing a within-subjects design, which involved 15 participants. The study compared dual-mode interventions with direct voice interventions in office settings, focusing on addressing health and well-being issues. Our findings indicate that knowledge workers preferred dual-mode interventions over direct voice interventions. Moreover, direct voice interventions received significantly lower ratings compared to dual-mode interventions. Also, we identify user preferences for different dual-intervention modalities. Our findings reveal that the user preferences depend on the type of health intervention. Vibration emerged as the preferred modality, followed by graphical output, auditory icons, and ringing interventions.

The earlobe is a well-known location for wearing jewelry, but might also be promising for electronic output, such as presenting notifications. This work elaborates the pros and cons of different notification channels for the earlobe. Notifications on the earlobe can be private (only noticeable by the wearer) as well as public (noticeable in the immediate vicinity in a given social situation). A user study with 18 participants showed that the reaction times for the private channels (Poke, Vibration, Private Sound, Electrotactile) were on average less than 1 s with an error rate (missed notifications) of less than 1 %. Thermal Warm and Cold took significantly longer and Cold was least reliable (26 % error rate). The participants preferred Electrotactile and Vibration. Among the public channels the recognition time did not differ significantly between Sound (738 ms) and LED (828 ms), but Display took much longer (3175 ms). At 22 % the error rate of Display was highest. The participants generally felt comfortable wearing notification devices on their earlobe. The results show that the earlobe indeed is a suitable location for wearable technology, if properly miniaturized, which is possible for Electrotactile and LED. We present application scenarios and discuss design considerations. A small field study in a fitness center demonstrates the suitability of the earlobe notification concept in a sports context.

Smart speakers are increasingly adopted by diverse user groups across globe. One such user group rapidly adopting the latest technology is emergent user group. Emer-gent users generally have minimal formal education, less technological experience, and are resource constrained. In our previous research, we designed a smart speaker for emergent users and combined human and AI response to minimize error rate and deliver efficient and elaborate response to them. Based on our observations and findings in this study, we found essential factors for emergent users in smart speaker design and interaction. We recommend the following ten factors; multilingualism, accents and di-alects, data consumption, energy consumption, useful and functional use cases, design and space, mental model, cognitive load during an interaction, error tolerance, and accessibility to different demographics and gender.

The earlobe is a well-known location for wearing jewelry, but might also be promising for electronic output, such as presenting notifications. This work elaborates the pros and cons of different notification channels for the earlobe. Notifications on the earlobe can be private (only noticeable by the wearer) as well as public (noticeable in the immediate vicinity in a given social situation). A user study with 18 participants showed that the reaction times for the private channels (Poke, Vibration, Private Sound, Electrotactile) were on average less than 1 s with an error rate (missed notifications) of less than 1 %. Thermal Warm and Cold took significantly longer and Cold was least reliable (26 % error rate). The participants preferred Electrotactile and Vibration. Among the public channels the recognition time did not differ significantly between Sound (738 ms) and LED (828 ms), but Display took much longer (3175 ms). At 22 % the error rate of Display was highest. The participants generally felt comfortable wearing notification devices on their earlobe. The results show that the earlobe indeed is a suitable location for wearable technology, if properly miniaturized, which is possible for Electrotactile and LED. We present application scenarios and discuss design considerations. A small field study in a fitness center demonstrates the suitability of the earlobe notification concept in a sports context.

Providing rich feedback on small devices, like smartwatches, can be difficult. We propose colorful electrotactile feedback on the back of a smartwatch. Colorful electrotactile feedback provides private notifications, is energy efficient, and can express various sensations in different qualities. In a first study, 13 participants explored 49 different combinations of frequency and pulse width regarding the perceived "colorfulness" of electrotactile feedback. We investigated what sensations can be expressed with electrotactile feedback and which qualities of these sensations are conveyed. To describe the sensations, participants chose the best fitting terms from a list of 21 terms. The three most frequently selected terms were prickling (177), vibrating (163), and irritating (112). The three least frequently selected ones were twitching (31), tickling (29), and itching (28). In a second study with 17 participants we evaluated a reduced set of 9 sensations that we selected and refined based on the results of study 1. We evaluated these sensations regarding recognition rates and achieved recognition rates of up to 84% without prior learning. Furthermore, we investigated the acceptance of colorful electrotactile feedback and present a method for an easier and faster calibration of electrotactile feedback.

Abstract Urban environments are often characterized by loud and annoying sounds. Noise-cancelling headphones can suppress negative influences and superimpose the acoustic environment with audio-augmented realities (AAR). So far, AAR exhibited limited interactivity, e. g., being influenced by the location of the listener. In this paper we explore the superimposition of synchronized, augmented footstep sounds in urban AAR environments with noise-cancelling headphones. In an online survey, participants rated different soundscapes and sound augmentations. This served as a basis for selecting and designing soundscapes and augmentations for a subsequent in-situ field study in an urban environment with 16 participants. We found that the synchronous footstep feedback of our application EnvironZen contributes to creating a relaxing and immersive soundscape. Furthermore, we found that slightly delaying footstep feedback can be used to slow down walking and that particular footstep sounds can serve as intuitive navigation cues.

AbstractA common problem of touch-based smartwatch interaction is the occlusion of the display. Although some models provide solutions like the Apple "digital crown" or the Samsung rotatable bezel, these are limited to only one degree of freedom (DOF). Performing complex tasks like navigating on a map is still problematic as the additional input option helps to zoom, but touching the screen to pan the map is still required. In this work, we propose using a trackball as an additional input device that adds two DOFs to prevent the occlusion of the screen. We created several prototypes to find a suitable placement and evaluated them in a typical map navigation scenario. Our results show that the participants were significantly faster (15.7%) with one of the trackball setups compared to touch input. The results also show that the idle times are significantly higher with touch input than with all trackball prototypes, presumably because users have to reorient themselves after panning with finger occlusion.

The need for online meetings increased drastically during the COVID-19 pandemic. Wearing headphones for this purpose makes it difficult to know when a headphone wearing person is available or in a meeting. In this work, we explore the design possibilities of headphones as wearable public displays to show the current status or additional information of the wearer to people nearby. After two brainstorming sessions and specifying the design considerations, we conducted an online survey with 63 participants to collect opinions of potential users. Besides the preference of the colors red and green as well as using text to indicate availability, we found that only 54 % of our participants would actually wear headphones with public displays attached. The benefit of seeing the current availability status of a headphone-wearing person in an online meeting or phone call scenario were nonetheless mentioned even by participants that would not use such headphones.

Although in many cases contracts can be made or ended digitally, laws require handwritten signatures in certain cases. Forgeries are a major challenge with digital contracts, as their validity is not always immediately apparent without forensic methods. Illiteracy or disabilities may result in a person being unable to write their full name. In this case x-mark signatures are used, which require a witness for validity. In cases of suspected fraud, the relationship of the witnesses must be questioned, which involves a great amount of effort. In this paper we use audio and motion data from a digital pen to identify users via handwritten symbols. We evaluated the performance our approach for 19 symbols in a study with 30 participants. We found that x-marks offer fewer individual features than other symbols like arrows or circles. By training on three samples and averaging three predictions we reach a mean F1-score of F1 = 0.87, using statistical and spectral features fed into SVMs.

Recent research in Human-Computer Interaction for work has shown that conversational agents (CA) are beneficial for supporting focused work and well-being while at work. Knowledge workers struggle in maintaining focus, work schedule, and well-being. Typically, they rely on multiple tools and services for work productivity, scheduling tasks, and reminding breaks. With the goal of tackling these problems, we propose the concept of a ubiquitous work assistant (UWA), which consists of two components: a stationary CA (S-CA) and a wearable CA (W-CA). S-CA is meant to be placed on user’s work desk while W-CA is fixed on the user’s wrist. The UWA interface is distributed between S-CA and W-CA. We initiated our study by conducting semi-structured interviews with knowledge workers (N = 14). We identified their expectations from conversational agents (CAs) that would assist them in their daily work life. From the interview findings, we developed an UWA prototype that could assist users by briefing their daily schedule, monitoring their schedule, and reminding breaks. We conducted a lab study simulating a home-office environment. The findings of the study show that the knowledge workers see potential in the UWA system. Further, we discuss implications of distributed user interface (DUI) for UWA design.