Using the Experience Sampling Method to Evaluate Ubicomp Applications

Mobile phones and PDAs are examples of ubiquitous computing devices that accompany a variety of users through different tasks, in changing contexts and environments. Designing for and evaluating this class of device is particularly challenging, given the variability of users, uses, and environments involved. A technique from the field of psychology, called the Experience Sampling Method, addresses several evaluation needs for ubiquitous computing. The Experience Sampling Method is conducted in situ, involves many participants, takes place over time, and collects quantitative and qualitative data. In addition to discussing the advantages and disadvantages of the Experience Sampling Method and how to use it, the authors share some of their first experiences in conducting an information use study with the Experience Sampling Method.