When using the experience sampling method (ESM), researchers must navigate a delicate balance between obtaining fine-grained snapshots of phenomena of interest and avoiding undue respondent burden, which can lead to disengagement and compromise data quality. To guide that process, we investigated how questionnaire length and sampling frequency impact careless and insufficient effort responding (C/IER) as an important yet understudied aspect of ESM data quality. To this end, we made use of existing experimental ESM data (Eisele et al., 2022) from 163 students randomly assigned to one of two questionnaire lengths (30/60 items) and one of three sampling frequencies (3/6/9 assessments per day). We employed a novel mixture modeling approach (Ulitzsch, Nestler, et al., 2024) that leverages screen time data to disentangle attentive responding from C/IER and allows investigating how the occurrence of C/IER evolved within and across ESM study days. We found sampling frequency, but not questionnaire length, impacted C/IER, with higher frequencies resulting in higher overall C/IER proportions and sharper increases of C/IER across, but not within days. These effects proved robust across various model specifications. Further, we found no substantial relationships between model-implied C/IER and other engagement measures, such as self-reported attentiveness, attention checks, response-pattern-based attentiveness indicators, and compliance. Our findings contrast previous studies on noncompliance, suggesting that respondents may employ different strategies to lower the different types of burden imposed by questionnaire length and sampling frequency. Implications for designing ESM studies are discussed. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

The Experience Sampling Method (ESM) is increasingly used by researchers from various disciplines to answer novel questions about individuals’ daily lives. Measurement best practices have long been overlooked in ESM research, and recent reviews show that item quality is often not reported in ESM studies. The absence of information about item quality may partly be explained by the lack of consensus on how ESM item quality should be evaluated. As part of the ESM Item Repository project (esmitemrepository.com) — an international open science initiative that collects ESM items in an open item bank and evaluates their quality — we brought together 42 international ESM experts to develop an ESM item quality assessment tool. In four Delphi phases, experts suggested 57 item quality criteria, rated the criteria, provided arguments for and against the criteria, and rated the criteria again, considering reflections from other experts. The result of the Delphi process is ESM-Q: A quality assessment tool consisting of 10 core criteria, as well as an additional 15 supplementary criteria, to be used depending on the type of items being rated and the availability of supplementary information. The criteria cover topics ranging from construct validity to the optimal wording of items. ESM-Q can aid ESM researchers in selecting existing ESM items, developing new high-quality ESM items, and evaluating the quality of ESM items in systematic reviews. Expert reflections also highlight open research questions surrounding ESM item design that form a research agenda for ESM measurement.

Anhedonia is a lack or loss of pleasure in daily life and is common across many mental health disorders (i.e., transdiagnostic). This is the first systematic review to investigate: 1) How is anhedonia conceptualized and explicitly measured using experience sampling methodology (ESM) in psychiatry and mental health?; 2) What is the experience of anhedonia in daily life at the between-person level and at the within-person level?; and 3) What is the quality of reporting in ESM studies assessing anhedonia in daily life? We searched PsychARTICLES, MEDLINE, Psychology Databases, EMBASE, Web of Science Core Collection, and Europe PMC (last search 6th May 2024). We identified 102 unique articles that satisfied inclusion criteria (i.e., assessed anhedonia via ESM). Anhedonia was typically conceptualized in terms of diminished pleasure, enjoyment, or liking, with emphasis on consummatory rather than anticipatory experiences. Measurement was heterogeneous and approaches differed across mental health research traditions. Anticipatory and consummatory anhedonia were present in samples that experienced mental health symptoms or diagnoses (between-person) and varied across different daily contexts and across time (within-person). Compliance with a composite reporting quality assessment tool for ESM studies was generally low. Results suggest that there is benefit in exploring anhedonia in daily life from a transdiagnostic perspective to identify whether different components of anhedonia relate to one another in a similar way across disorders. Future research would benefit from standardized and validated ESM items of anhedonia, exploration of moment-to-moment changes over shorter time-scales, and increased transparency in methodological reporting.

Narcissistic traits are traditionally viewed as consistent like the mirrorlike self-reflection of Narcissus in the water. However, evidence suggests that state levels of narcissism are more dynamic than previously believed. The current research explored fluctuations within and between grandiose and vulnerable narcissism in daily life. We investigated whether individuals’ levels of grandiosity and vulnerability (i) vary, (ii) are instable, and (iii) display inertia and cross-lagged effects in their daily narcissistic expressions. Participants (N = 253; Mage= 22, 85% female) completed grandiose and vulnerable narcissistic trait questionnaires. Using ecological momentary assessment, they further completed up to 60 grandiose and vulnerable narcissistic state questionnaires over six days. Results showed that higher grandiose and vulnerable narcissistic traits led to more within-person variability within their corresponding states. Additionally, higher grandiose leadership/authority and exploitativeness/entitlement traits related to greater vulnerable within-person variability, while self-absorption/self-admiration reduced this. Similarly, all narcissistic traits, except for exploitativeness/entitlement, were positively related to increased instability in their corresponding state. Further, both grandiose and vulnerable narcissistic states demonstrated significant inertia, i.e., lingering narcissistic endorsements within their own states. Overall, the results showed that grandiosity and vulnerability include time-variant states that are intertwined and need to be acknowledged as additional moving, dimensional constructs.

Contextual factors influence how people regulate their everyday emotions. While daily life is rich with situations that evoke emotion regulation, few studies have broadly investigated the role of context in regulating emotions in response to naturally occurring negative events. In this study, we use a structured diary technique—the Experience Sampling Method—to test how different types of contextual factors are associated with using reappraisal and distraction to regulate daily emotions in N = 74 young adults from the general population. The following contextual factors were assessed: time of the day, weekday, tiredness, event stressfulness, and event type. We found that higher stressfulness of negative events was associated with using more distraction within- and between-person and using more reappraisal between persons. Time of day and weekday were not associated with reappraisal or distraction use, suggesting that variation in people’s external environments due to temporal patterns does not influence reappraisal or distraction use. However, tiredness was positively associated with distraction and reappraisal use within persons. Exploratory analyses suggested that experiencing time pressure affords less distraction use, and that experiencing physical discomfort affords less reappraisal use. These findings underscore the dynamic nature of emotion regulation, and the importance of context in everyday emotion regulation.

Since the introduction of the experience sampling method (ESM), there have been concerns that the repeated assessments typically related to this method may alter the behavior, thoughts, or feelings of participants. Previous studies have offered mixed results with some studies reporting reactive changes while others failed to find such effects. Our aim was to investigate under which circumstances ESM induces reactive effects.Students (N = 151) were randomly assigned to receive a questionnaire containing 30 or 60 items 3, 6, or 9 times per day for 14 days. A random sample of 50 participants took part in qualitative interviews after the end of the data collection. We investigated changes over time in the data, while taking into account the sampling protocol and characteristics of participants, and analyzed qualitative reports of measurement reactivity.Decreases in completion time, within-person variance of ratings and subjective reports of habituation point towards the existence of a habituation period. While participants also reported increases in emotional awareness in interviews, ESM measures indicated a decrease in emotional awareness over time. Changes in behavior were rare in quantitative and qualitative reports. Positive affect was found to decrease over time in the ESM data and various changes in affect, emotion regulation, and thoughts were reported in interviews. Individual characteristics and sampling protocol had inconsistent effects on changes over time.The current results suggest that ESM induces reactivity. These reactive changes may be particularly relevant to researchers investigating within-person variability, completion times, affect, or emotional awareness.

The experience sampling method (ESM) has revolutionized our ability to conduct psychological research in the natural environment. However, researchers have a large degree of freedom when preprocessing ESM data, which may hinder scientific progress. This study illustrates the use of multiverse analyses regarding preprocessing choices related to data exclusion (i.e., based on various levels of compliance and exclusion of the first assessment day) and the calculation of constructs (i.e., composite scores calculated as the mean, median, or mode) by reanalyzing established group differences in negative affect, stress reactivity, and emotional inertia between individuals with and without psychosis. Data came from five studies and included 233 individuals with psychosis and 223 healthy individuals (in total, 26,892 longitudinal assessments). Preprocessing choices related to data exclusion did not affect conclusions. For both stress reactivity and emotional inertia of negative affect, group differences were affected when negative affect was calculated as the mean compared to the median or mode. Further analyses revealed that this could be attributed to considerable differences in the within- and between-factor structure of negative affect. While these findings show that observed differences in affective processes between individuals with and without psychosis are robust to preprocessing choices related to data exclusion, we found disagreement in conclusions between different central tendency measures. Safeguarding the validity of future experience sampling research, scholars are advised to use multiverse analysis to evaluate the robustness of their conclusions across different preprocessing scenarios.

While affect is frequently measured with experience sampling methodology (ESM),the affective structure at the between- and within-person level has not been thoroughly investigated. We investigated the affective structure at the between- and within-person level, its invariance across different ESM protocols, and its reliability. Participants (N = 147) were randomly assigned to receive either a 30 or 60 item questionnaire three, six, or nine times per day, resulting in 72 to 75 participants per questionnaire length and 48 to 50 participants per sampling frequency. Momentary affect was assessed with 8 or 18 items. At both levels, a structure with two correlated factors showed the best fit compared to an orthogonal and a unidimensional model. A structure with additional freed residual correlations was invariant across protocols at the within-person level and showed high reliability. We observed indications of a more discrete affective structure within than between persons.

Delayed responses are a common phenomenon in experience sampling studies. Yet no consensus exists on whether they should be excluded from the analysis or what the threshold for exclusion should be. Delayed responses could introduce bias, but previous investigations of systematic differences between delayed and timely responses have offered unclear results. To investigate differences as a function of delay, we conducted secondary analyses of nine paper and pencil based experience sampling studies including 1,528 individuals with different clinical statuses. In all participants, there were significant decreases in positive and increases in negative affect as a function of delay. In addition, delayed answers of participants without depression showed higher within-person variability and an initial strengthening in the relationships between contextual stress and affect. Participants with depression mostly showed the opposite pattern. Delayed responses seem qualitatively different from timely responses. Further research is needed to understand the mechanisms underlying these differences.

Currently, little is known about the association between assessment intensity, burden, data quantity, and data quality in experience sampling method (ESM) studies. Researchers therefore have insufficient information to make informed decisions about the design of their ESM study. Our aim was to investigate the effects of different sampling frequencies and questionnaire lengths on burden, compliance, and careless responding. Students ( n = 163) received either a 30- or 60-item questionnaire three, six, or nine times per day for 14 days. Preregistered multilevel regression analyses and analyses of variance were used to analyze the effect of design condition on momentary outcomes, changes in those outcomes over time, and retrospective outcomes. Our findings offer support for increased burden and compromised data quantity and quality with longer questionnaires, but not with increased sampling frequency. We therefore advise against the use of long ESM questionnaires, while high-sampling frequencies do not seem to be associated with negative consequences.

Open materials are a cornerstone of open science and facilitate the evaluation and replication of published research.While sharing exact measurement instruments is increasingly standard practice in cross-sectional selfreport research, this practice is not yet established in ambulatory self-report studies, particularly those employing the Experience Sampling Method (ESM; also referred to as Ecological Momentary Assessment).In fact, recent reviews found that exact items are only reported in a fraction of published ESM studies.This lack