Scientific evidence regularly guides policy decisions 1 , with behavioural science increasingly part of this process 2 . In April 2020, an influential paper 3 proposed 19 policy recommendations (‘claims’) detailing how evidence from behavioural science could contribute to efforts to reduce impacts and end the COVID-19 pandemic. Here we assess 747 pandemic-related research articles that empirically investigated those claims. We report the scale of evidence and whether evidence supports them to indicate applicability for policymaking. Two independent teams, involving 72 reviewers, found evidence for 18 of 19 claims, with both teams finding evidence supporting 16 (89%) of those 18 claims. The strongest evidence supported claims that anticipated culture, polarization and misinformation would be associated with policy effectiveness. Claims suggesting trusted leaders and positive social norms increased adherence to behavioural interventions also had strong empirical support, as did appealing to social consensus or bipartisan agreement. Targeted language in messaging yielded mixed effects and there were no effects for highlighting individual benefits or protecting others. No available evidence existed to assess any distinct differences in effects between using the terms ‘physical distancing’ and ‘social distancing’. Analysis of 463 papers containing data showed generally large samples; 418 involved human participants with a mean of 16,848 (median of 1,699). That statistical power underscored improved suitability of behavioural science research for informing policy decisions. Furthermore, by implementing a standardized approach to evidence selection and synthesis, we amplify broader implications for advancing scientific evidence in policy formulation and prioritization.
In response to the COVID-19 pandemic, the Psychological Science Accelerator coordinated three large-scale psychological studies to examine the effects of loss-gain framing, cognitive reappraisals, and autonomy framing manipulations on behavioral intentions and affective measures. The data collected (April to October 2020) included specific measures for each experimental study, a general questionnaire examining health prevention behaviors and COVID-19 experience, geographical and cultural context characterization, and demographic information for each participant. Each participant started the study with the same general questions and then was randomized to complete either one longer experiment or two shorter experiments. Data were provided by 73,223 participants with varying completion rates. Participants completed the survey from 111 geopolitical regions in 44 unique languages/dialects. The anonymized dataset described here is provided in both raw and processed formats to facilitate re-use and further analyses. The dataset offers secondary analytic opportunities to explore coping, framing, and self-determination across a diverse, global sample obtained at the onset of the COVID-19 pandemic, which can be merged with other time-sampled or geographic data.
Economic inequality is associated with extreme rates of temporal discounting, which is a behavioral pattern where individuals choose smaller, immediate financial gains over larger, delayed gains. Such patterns may feed into rising global inequality, yet it is unclear if they are a function of choice preferences or norms, or rather absence of sufficient resources to meet immediate needs. It is also not clear if these reflect true differences in choice patterns between income groups. We test temporal discounting and five intertemporal choice anomalies using local currencies and value standards in 61 countries. Across a diverse sample of 13,629 participants, we found highly consistent rates of choice anomalies. Individuals with lower incomes were not significantly different, but economic inequality and broader financial circumstances impact population choice patterns.
Classic findings from psychology and the behavioural sciences are increasingly being revisited. Methodological and technological advances provide opportunities to replicate studies across a wide range of countries and settings to investigate whether these findings are universally applicable, limited to specific countries, or vary in magnitude depending on settings. Researchers from around the world connect to revisit such findings collaboratively, adapt the original design to the Zeitgeist, integrate new knowledge to improve statistical analyses, and broaden the scope by testing effects globally – or at least in as many countries, as budget and feasibility allow. We currently observe multiple international consortia conducting large-scale multi-country replications. How do such collaborations form and how do they approach these complex investigations? This paper brings together researchers from different initiatives that conduct replications on an international scale to outline approaches and summarises what we have learned in applying them: Junior Researcher Programme (JRP), Psychological Science Accelerator (PSA), ManyBabies, Collaborative Open-science REsearch (CORE), and International Study of Metanorms (ISMN). We describe different ways for study selection, methodological approaches, statistical analyses, ethical issues, and most importantly, how the different collaborations formed and how team communication worked. We look in detail at challenges of including typically underrepresented countries in psychological science, not only in terms of data collection but also in making it possible for local researchers to contribute. This paper provides a structured insight into how different collaborations work and issues to consider for anyone who seeks to conduct a multi-country replication in psychology, or looking for additional perspectives to their existing plan. We close the article with a checklist built as a helpful tool for colleagues putting together their study protocols for such efforts – and invite them to collaboratively expand it in the future.
The COVID-19 pandemic (and its aftermath) highlights a critical need to communicate health information effectively to the global public. Given that subtle differences in information framing can have meaningful effects on behavior, behavioral science research highlights a pressing question: Is it more effective to frame COVID-19 health messages in terms of potential losses (e.g., “If you do not practice these steps, you can endanger yourself and others”) or potential gains (e.g., “If you practice these steps, you can protect yourself and others”)? Collecting data in 48 languages from 15,929 participants in 84 countries, we experimentally tested the effects of message framing on COVID-19-related judgments, intentions, and feelings. Loss- (vs. gain-) framed messages increased self-reported anxiety among participants cross-nationally with little-to-no impact on policy attitudes, behavioral intentions, or information seeking relevant to pandemic risks. These results were consistent across 84 countries, three variations of the message framing wording, and 560 data processing and analytic choices. Thus, results provide an empirical answer to a global communication question and highlight the emotional toll of loss-framed messages. Critically, this work demonstrates the importance of considering unintended affective consequences when evaluating nudge-style interventions.
Finding communication strategies that effectively motivate social distancing continues to be a global public health priority during the COVID-19 pandemic. This cross-country, preregistered experiment (n = 25,718 from 89 countries) tested hypotheses concerning generalizable positive and negative outcomes of social distancing messages that promoted personal agency and reflective choices (i.e., an autonomy-supportive message) or were restrictive and shaming (i.e. a controlling message) compared to no message at all. Results partially supported experimental hypotheses in that the controlling message increased controlled motivation (a poorly-internalized form of motivation relying on shame, guilt, and fear of social consequences) relative to no message. On the other hand, the autonomy-supportive message lowered feelings of defiance compared to the controlling message, but the controlling message did not differ from receiving no message at all. Unexpectedly, messages did not influence autonomous motivation (a highly-internalized form of motivation relying on one’s core values) or behavioral intentions. Results supported hypothesized associations between people’s existing autonomous and controlled motivations and self-reported behavioral intentions to engage in social distancing: Controlled motivation was associated with more defiance and less long-term behavioral intentions to engage in social distancing, whereas autonomous motivation was associated with less defiance and more short- and long-term intentions to social distance. Overall, this work highlights the potential harm of using shaming and pressuring language in public health communication, with implications for the current and future global health challenges.
Pervading global narratives suggest that political polarization is increasing, yet the accuracy of such group meta-perceptions has been drawn into question. A recent US study suggests that these beliefs are inaccurate and drive polarized beliefs about out-groups. However, it also found that informing people of inaccuracies reduces those negative beliefs. In this work, we explore whether these results generalize to other countries. To achieve this, we replicate two of the original experiments with 10,207 participants across 26 countries. We focus on local group divisions, which we refer to as fault lines. We find broad generalizability for both inaccurate meta-perceptions and reduced negative motive attribution through a simple disclosure intervention. We conclude that inaccurate and negative group meta-perceptions are exhibited in myriad contexts and that informing individuals of their misperceptions can yield positive benefits for intergroup relations. Such generalizability highlights a robust phenomenon with implications for political discourse worldwide.
The COVID-19 pandemic has increased negative emotions and decreased positive emotions globally. Left unchecked, these emotional changes might have a wide array of adverse impacts. To reduce negative emotions and increase positive emotions, we tested the effectiveness of reappraisal, an emotion-regulation strategy that modifies how one thinks about a situation. Participants from 87 countries and regions (n = 21,644) were randomly assigned to one of two brief reappraisal interventions (reconstrual or repurposing) or one of two control conditions (active or passive). Results revealed that both reappraisal interventions (vesus both control conditions) consistently reduced negative emotions and increased positive emotions across different measures. Reconstrual and repurposing interventions had similar effects. Importantly, planned exploratory analyses indicated that reappraisal interventions did not reduce intentions to practice preventive health behaviours. The findings demonstrate the viability of creating scalable, low-cost interventions for use around the world. The stage 1 protocol for this Registered Report was accepted in principle on 12 May 2020. The protocol, as accepted by the journal, can be found at https://doi.org/10.6084/m9.figshare.c.4878591.v1 This Registered Report presents evidence from 87 countries and regions showing that brief emotion-regulation interventions consistently reduced negative emotions and increased positive emotions during the COVID-19 pandemic.