BackgroundThe volume of digital drug promotion has grown over time, and social media has become a source of information about prescription drugs for many consumers. Pharmaceutical companies currently present risk information about prescription drugs they promote in a variety of ways within and across social media platforms. There is scarce research on consumers’ interactions with prescription drug promotion on social media, particularly on which features may facilitate or inhibit consumers’ ability to find, review, and comprehend drug information. This is concerning because it is critical for consumers to know and weigh drug benefits and risks to be able to make informed decisions regarding medical treatment. ObjectiveWe aimed to develop an understanding of the user interface (UI) and user experience (UX) of social media pages and posts created by pharmaceutical companies to promote drugs and how UI or UX design features impact consumers’ interactions with drug information. MethodsWe conducted in-person interviews with 54 consumers segmented into groups by device type (laptop or mobile phone), social media platform (Facebook or Instagram), and age. Interviewers asked participants to navigate to and review a series of 4 pages and 3 posts on their assigned device and platform. Interviewers encouraged participants to “think aloud,” as they interacted with the stimuli during a brief observation period. Following each observation period, participants were asked probing questions. An analyst reviewed video recordings of the observation periods to abstract quantitative interaction data on whether a participant clicked on or viewed risk information at each location it appeared on each page. Participants’ responses were organized in a metamatrix, which we used to conduct thematic analysis. ResultsObservational data revealed that 59% of participants using Facebook and 70% of participants using Instagram viewed risk information in at least 1 possible location on average across all pages tested during the observation period. There was not a single location across the Facebook pages that participants commonly clicked on to view risk information. However, a video with scrolling risk information attracted more views than other features. On Instagram, at least half of the participants consistently clicked on the highlighted story with risk information across the pages. Although thematic analysis showed that most participants were able to identify the official pages and risk information for each drug, auto-scrolling text and text size posed barriers to identification and comprehensive review for some participants. Participants generally found it more difficult to identify the drugs’ indications than risks. Participants using Instagram more frequently reported challenges identifying risks and indications compared to those using Facebook. ConclusionsUI or UX design features can facilitate or pose barriers to users’ identification, review, and comprehension of the risk information provided on prescription drugs’ social media pages and posts.
Background In-depth interviews are a common method of qualitative data collection, providing rich data on individuals’ perceptions and behaviors that would be challenging to collect with quantitative methods. Researchers typically need to decide on sample size a priori. Although studies have assessed when saturation has been achieved, there is no agreement on the minimum number of interviews needed to achieve saturation. To date, most research on saturation has been based on in-person data collection. During the COVID-19 pandemic, web-based data collection became increasingly common, as traditional in-person data collection was possible. Researchers continue to use web-based data collection methods post the COVID-19 emergency, making it important to assess whether findings around saturation differ for in-person versus web-based interviews. Objective We aimed to identify the number of web-based interviews needed to achieve true code saturation or near code saturation. Methods The analyses for this study were based on data from 5 Food and Drug Administration–funded studies conducted through web-based platforms with patients with underlying medical conditions or with health care providers who provide primary or specialty care to patients. We extracted code- and interview-specific data and examined the data summaries to determine when true saturation or near saturation was reached. Results The sample size used in the 5 studies ranged from 30 to 70 interviews. True saturation was reached after 91% to 100% (n=30-67) of planned interviews, whereas near saturation was reached after 33% to 60% (n=15-23) of planned interviews. Studies that relied heavily on deductive coding and studies that had a more structured interview guide reached both true saturation and near saturation sooner. We also examined the types of codes applied after near saturation had been reached. In 4 of the 5 studies, most of these codes represented previously established core concepts or themes. Codes representing newly identified concepts, other or miscellaneous responses (eg, “in general”), uncertainty or confusion (eg, “don’t know”), or categorization for analysis (eg, correct as compared with incorrect) were less commonly applied after near saturation had been reached. Conclusions This study provides support that near saturation may be a sufficient measure to target and that conducting additional interviews after that point may result in diminishing returns. Factors to consider in determining how many interviews to conduct include the structure and type of questions included in the interview guide, the coding structure, and the population under study. Studies with less structured interview guides, studies that rely heavily on inductive coding and analytic techniques, and studies that include populations that may be less knowledgeable about the topics discussed may require a larger sample size to reach an acceptable level of saturation. Our findings also build on previous studies looking at saturation for in-person data collection conducted at a small number of sites.
Direct-to-consumer prescription-drug television advertisements often contain superimposed text (supers) to convey information about the advertised product. This randomized experiment examined three size levels of supers and two levels of background contrast in direct-to-consumer advertisements. Participants (N = 1,272) watched different versions of a television advertisement for a fictitious asthma drug on either a flat-screen television or a tablet computer. Larger supers were more noticeable and memorable than smaller supers. High-contrast supers were less noticeable. Tablet users had more favorable views of the advertisement. Results have implications for the communication of important medical information in direct-to-consumer advertisements.
Prescription drug broadcast advertisements in the United States are required to present the product's major risks in at least the audio portion of the ad (21 CFR 202.1(e)(1)). This can result in a lengthy list of risks and side effects. The U.S. Food and Drug Administration has been studying the effects of limiting the major statement to those risks that are serious and actionable. We explore the level of agreement between consumers and experts regarding what risks and side effects are serious and actionable, and how variations in the content of major risk statement as well as other factors such as demographic variables, perceived accuracy of direct-to-consumer advertising, illness knowledge, and knowledge of prescription drug regulations, predict perceptions of risk and actionability. Participants (N = 1,000) self-diagnosed with depression or insomnia were randomly assigned to view a television ad for their respective condition that presented the full major statement or an edited version that included only serious and actionable risks. Results indicated consumers' perceptions of risk severity generally matched experts' assessment, but there was relatively less agreement about risk actionability. Results also varied as a function of income and gender.
During the 2014-2016 Ebola epidemic in West Africa, the US Centers for Disease Control and Prevention (CDC) developed the CARE+ program to help travelers arriving to the United States from countries with Ebola outbreaks to meet US government requirements of post-arrival monitoring. We assessed 2 outcomes: (1) factors associated with travelers’ intention to monitor themselves and report to local or state public health authority (PHA) and (2) factors associated with self-reported adherence to post-arrival monitoring and reporting requirements. We conducted 1195 intercept in-person interviews with travelers arriving from countries with Ebola outbreaks at 2 airports between April and June 2015. In addition, 654 (54.7%) of these travelers participated in a telephone interview 3 to 5 days after intercept, and 319 (26.7%) participated in a second telephone interview 2 days before the end of their post-arrival monitoring. We used regression modeling to examine variance in the 2 outcomes due to 4 types of factors: (1) programmatic, (2) perceptual, (3) demographic, and (4) travel-related factors. Factors associated with the intention to adhere to requirements included clarity of the purpose of screening (B = 0.051, 95% confidence interval [CI], 0.011-0.092), perceived approval of others (B = 0.103, 95% CI, 0.058-0.148), perceived seriousness of Ebola (B = 0.054, 95% CI, 0.031-0.077), confidence in one’s ability to perform behaviors (B = 0.250, 95% CI, 0.193-0.306), ease of following instructions (B = 0.053, 95% CI, 0.010-0.097), and trust in CARE Ambassador (B = 0.056, 95% CI, 0.009-0.103). Respondents’ perception of the seriousness of Ebola was the single factor associated with adherence to requirements (odds ratio [OR] = 0.81, 95% CI, 0.673-0.980, for non-adherent vs adherent participants and OR = 0.86, 95% CI, 0.745-0.997, for lost to follow-up vs adherent participants). Results from this assessment can guide public health officials in future outbreaks by identifying factors that may affect adherence to public health programs designed to prevent the spread of epidemics.
Objectives: We explored the language of adult ENDS users and examined if and how language differs by primary device type. Methods: In 2016, we conducted 23 focus groups in 4 US cities with a total of 156 participants who were current adult ENDS users. We segmented the groups by primary ENDS device type (eg, "tank," "cigalike"). Data were triangulated from 3 sources: responses to an open-ended question on a pre-discussion questionnaire, group discussion on terms used to describe ENDS, and an ENDS device image sorting task. Results: When asked to write-in "the type of electronic nicotine product"they used most often, cigalike users commonly supplied brand names (eg, "blu") or used "e-cigarette" (or derivation). Tank users, on the other hand, reported a more diverse set of terms, including e-cigarette, tank, and vape. During the device image sorting task, focus group participants almost always were able to agree on a label, and there was a high level of consensus across groups. Conclusions: Findings suggest that although adult ENDS users may vary in their preferred terms for their device, they agree on general terms to describe device categories. Understanding the terms used by consumers is important for informing survey items and other ENDS research.
Objective: Electronic nicotine delivery systems (ENDS), commonly referred to as "e-cigarettes", have grown in popularity, features and device types. This study explores how device type influences users' experiences and how experiences shape use behaviors, beliefs, and attitudes about ENDS. Methods: In 2016, we conducted 23 focus groups in 4 US cities with a total of 156 participants who were current adult ENDS users. We segmented participants by age, geographic location, and device type used. A moderator's guide was used to gather data on attitudes, beliefs, and use behaviors. Results: Discussions revealed commonalities between cigalike and tank users such as use to quit or cut down on cigarette smoking as a primary motivation and difficulty describing frequency and quantity of use. Distinctions between device users also emerged. Features that appealed to cigalike users included the simplicity of the device (eg, small size, ease of use); conversely, tank users described as benefits their ability to modify devices and customize experiences (eg, adjust the battery, nicotine level, and flavor). Importantly, users of both types expressed satisfaction with their device. Conclusion: The study found notable differences in attitudes and behaviors between device users such as valued device attributes, knowledge about nicotine concentration, and importance of flavors, providing further evidence that device type affects user experience.
Background: Summary of findings tables in systematic reviews are highly informative but require epidemiological training to be interpreted correctly. The usage of fishbone diagrams as graphical displays could offer researchers an effective approach to simplify content for readers with limited epidemiological training. In this paper we demonstrate how fishbone diagrams can be applied to systematic reviews and present the results of an initial user testing. Methods: Findings from two systematic reviews were graphically depicted in the form of the fishbone diagram. To test the utility of fishbone diagrams compared with summary of findings tables, we developed and pilot-tested an online survey using Qualtrics. Respondents were randomized to the fishbone diagram or a summary of findings table presenting the same body of evidence. They answered questions in both open-ended and closed-answer formats; all responses were anonymous. Measures of interest focused on first and second impressions, the ability to find and interpret critical information, as well as user experience with both displays. We asked respondents about the perceived utility of fishbone diagrams compared to summary of findings tables. We analyzed quantitative data by conducting t-tests and comparing descriptive statistics. Results: Based on real world systematic reviews, we provide two different fishbone diagrams to show how they might be used to display complex information in a clear and succinct manner. User testing on 77 students with basic epidemiological training revealed that participants preferred summary of findings tables over fishbone diagrams. Significantly more participants liked the summary of findings table than the fishbone diagram (71.8% vs. 44.8%; p < .01); significantly more participants found the fishbone diagram confusing (63.2% vs. 35.9%, p < .05) or indicated that it was difficult to find information (65.8% vs. 45%; p < .01). However, more than half of the participants in both groups were unable to find critical information and answer three respective questions correctly (52.6% in the fishbone group; 51.3% in the summary of findings group). Conclusions: Fishbone diagrams are compact visualizations that, theoretically, may prove useful for summarizing the findings of systematic reviews. Initial user testing, however, did not support the utility of such graphical displays.
Carbon monoxide (CO) poisonings in the United States consistently occur when residents improperly use portable gasoline-powered generators and other tools following severe storms and power outages. However, protective behaviors-such as installing CO alarms and placing generators more than 20 feet away from indoor structures-can prevent these poisonings. This study identified knowledge, attitudes, and beliefs that lead consumers to adopt risk and protective behaviors for storm-related CO poisoning and post-storm generator use. Four focus groups (32 participants in total) were conducted with generator owners in winter and summer storm-prone areas to explore home safety, portable generator use, CO poisoning knowledge, and generator safety messages. Discussions were transcribed, and findings analyzed using an ordered meta-matrix approach. Although most generator owners were aware of CO poisoning, many were unsure what constitutes a safe location for generator operation and incorrectly stated that enclosed areas outside the home-such as attached garages, sheds, and covered porches-were safe. Convenience and access to appliances often dictated generator placement. Participants were receptive to installing CO alarms in their homes but were unsure where to place them. These findings suggest a deficit in understanding how to operate portable generators safely and a need to correct misconceptions around safe placement. In terms of behavioral price, the simple installation and maintenance of inexpensive CO alarms may be the most important strategy for ultimately protecting homes from both storm-related and other CO exposures.
This article describes a process evaluation conducted as part of a proof-of-concept study to develop, implement, and test a text messaging program to promote medication and appointment adherence, sexual and substance use risk reduction, general health and well-being, social support, and patient involvement. The text-messaging program was implemented in Chicago, Illinois, at an outpatient medical clinic that promotes the well-being of gay, lesbian, bisexual, and transgender persons. We collected and analyzed qualitative data from patients, providers, and research staff to answer the following questions: (1) What factors of the organizational context were important for implementation? (2) How are implementation policies and practices, organizational climate, and perceptions of implementation effectiveness described by intervention stakeholders? (3) What types of issues related to fidelity occurred during implementation? (4) What recommendations for improvement do stakeholders suggest? The study coordinator, providers, and the patients themselves confirmed that patients liked the messages and program overall. The program was implemented with high fidelity. The primary recommendations for improvements were to enhance confidentiality and implement strategies to lessen message fatigue. The findings from this process evaluation demonstrate the feasibility and acceptability of the intervention from the perspectives of patients, providers, and research staff. A larger-scale intervention study that incorporates these stakeholders' suggestions for improvement is warranted.
T his article describes a process evaluation conducted as part of a proof-of-concept study to develop, implement, and test a text messaging program to promote medication and appointment adherence, sexual and substance use risk reduction, general health and well-being, social support, and patient involvement. The text-messaging program was implemented in Chicago, Illinois, at an outpatient medical clinic that promotes the well-being of gay, lesbian, bisexual, and transgender persons. We collected and analyzed qualitative data from patients, providers, and research staff to answer the following questions: (1) What factors of the organizational context were important for implementation? (2) How are implementation policies and practices, organizational climate, and perceptions of implementation effectiveness described by intervention stakeholders? (3) What types of issues related to fidelity occurred during implementation? (4) What recommendations for improvement do stakeholders suggest? The study coordinator, providers, and the patients themselves confirmed that patients liked the messages and program overall. The program was implemented with high fidelity. The primary recommendations for improvements were to enhance confidentiality and implement strategies to lessen message fatigue. The findings from this process evaluation demonstrate the feasibility and acceptability of the intervention from the perspectives of patients, providers, and research staff. A larger-scale intervention study that incorporates these stakeholders’ suggestions for improvement is warranted.
Carbon monoxide (CO) poisonings in the United States consistently occur when residents improperly use portable gasoline-powered generators and other tools following severe storms and power outages. However, protective behaviors—such as installing CO alarms and placing generators more than 20 feet away from indoor structures—can prevent these poisonings. This study identified knowledge, attitudes, and beliefs that lead consumers to adopt risk and protective behaviors for storm-related CO poisoning and post-storm generator use. Four focus groups (32 participants in total) were conducted with generator owners in winter and summer storm-prone areas to explore home safety, portable generator use, CO poisoning knowledge, and generator safety messages. Discussions were transcribed, and findings analyzed using an ordered meta-matrix approach. Although most generator owners were aware of CO poisoning, many were unsure what constitutes a safe location for generator operation and incorrectly stated that enclosed areas outside the home—such as attached garages, sheds, and covered porches—were safe. Convenience and access to appliances often dictated generator placement. Participants were receptive to installing CO alarms in their homes but were unsure where to place them. These findings suggest a deficit in understanding how to operate portable generators safely and a need to correct misconceptions around safe placement. In terms of behavioral price, the simple installation and maintenance of inexpensive CO alarms may be the most important strategy for ultimately protecting homes from both storm-related and other CO exposures.
Background Unintentional, non-fire-related carbon monoxide (CO) poisoning is a leading cause of poisoning death and injury in the USA. Residential poisonings caused by faulty furnaces are the most common type of CO exposure. However, these poisonings are largely preventable with annual furnace inspections and CO alarm installation.Objective This study aimed to identify the knowledge, attitudes and beliefs that might lead consumers to adopt these protective behaviours.Methods In August 2009, four focus groups (n=29) were conducted with homeowners in Chicago, Illinois, USA, to identify the knowledge, attitudes and beliefs that lead consumers to adopt risk and protective behaviours. Discussions were transcribed and the findings were analysed using an ordered meta-matrix.Results Focus group participants were aware of CO poisoning and supported the idea of regular furnace inspections. However, few participants consistently scheduled professional inspections for fear of costly repairs and unscrupulous contractors. Participants often owned CO alarms, but many did not locate them properly, nor maintain them. Some participants confused CO and natural gas and were unsure how to react if a CO alarm sounds. Participants stated that incentives, such as discounts and inspector selection tips, would make them more likely to schedule furnace inspections. Participants also identified trustworthy sources for CO education, including realtors, fire departments, home insurance agents and local media outlets.Conclusions Participants' residential CO risk behaviours are not random but driven by underlying knowledge, attitudes and beliefs. Correcting misperceptions, providing incentives and partnering with trustworthy sources might encourage greater consumer adoption of protective behaviours.
Background: Men who have sex with men (MSM) continue to be severely and disproportionately affected by the HIV/AIDS (human immunodeficiency virus/acquired immune deficiency syndrome) epidemic in the United States. Effective antiretroviral therapy has altered the HIV epidemic from being an acute disease to a chronic, manageable condition for many people living with HIV. The pervasiveness, low cost, and convenience of Short Message Service (SMS) suggests its potential suitability for supporting the treatment of conditions that must be managed over an extended period.Objective: The purpose of this proof-of-concept study was to develop, implement, and test a tailored SMS-based intervention for HIV-positive MSM. Prior studies do not routinely provide sufficiently detailed descriptions of their technical implementations, restricting the ability of subsequent efforts to reproduce successful interventions. This article attempts to fill this gap by providing a detailed description of the implementation of an SMS-based intervention to provide tailored health communication messages for HIV-positive MSM.Methods: We used archives from the SMS system, including participant responses to messages and questions sent via SMS, as the data sources for results reported in this article. Consistent with the purpose of this article, our analysis was limited to basic descriptive statistics, including frequency distributions, means and standard deviations.Results: During the implementation period, we sent a total of 7,194 messages to study participants, received 705 SMS responses to our two-way SMS questions of participants, and 317 unprompted SMS message acknowledgements from participants. Ninety two percent of participants on antiretroviral therapy (ART) responded to at least one of the weekly medication adherence questions administered via SMS, and 27% of those had their medication adherence messages changed over the course of the study based on their answers to the weekly questions. Participants who responded to items administered via SMS to assess satisfaction with and use of the messages reported generally positive perceptions, although response rates were low overall.Conclusions: Results confirm the technical feasibility of deploying a dynamically tailored, SMS-based intervention designed to provide ongoing behavioral reinforcement for HIV-positive MSM. Lessons learned related to text programming, message delivery and study logistics will be helpful to others planning and implementing similar interventions.
Background: Health communication increasingly has been recognized as an important part of public health practice that can help raise awareness of potential health risks, influence attitudes and beliefs, and motivate individuals to change unhealthy behaviors. Yet, few health communication messages exist that target people with disabilities. An evaluation was conducted to assess the relevance and usefulness of health communication materials developed by or disseminated in, or both, three state disability and health programs.Methods: Health care providers and people with a variety of physical and sensory disabilities participated in the evaluation. Qualitative and quantitative data were collected in each of the three states using key informant interviews, focus groups, and a Web-based provider survey.Results: State program staff reported that health communication strategies and messages should be developed to improve access and remove barriers to health care, provide access to facilities, empower consumers, and educate health care providers about the needs of people with disabilities. Several of these needs are consistent with the needs identified by consumers in the focus groups. Consumers indicated that improvements to the overall content and design of the state-developed health communication materials are needed, yet health care and human service providers who participated in the Web-based survey were generally satisfied with the materials. Nearly all providers reported being aware of the materials; however, consumers were not familiar with the state-developed materials reviewed by the focus groups.Conclusions: Improvements in the content and dissemination of health promotion materials designed by states are indicated. Implications for public health practice, including recommendations for improving future health communication materials, are addressed in this article. (C) 2010 Elsevier Inc. All rights reserved.
Social networking websites (SNSs) focus on building online social networks or communities of people who share interests and activities and provide ways for users to interact with each other online. Our exploratory pilot study gauged users' receptivity to receiving health information via the SNSs they use. We presented several hypothetical scenarios and explored respondents' reactions to each of them. Consistent with other research, we found that most respondents reported using SNSs to interact with people they already know as opposed to using SNSs to meet new people. Overall, respondents were generally receptive to the scenarios we explored. Spending more time on the Internet, spending a higher percentage of one's Internet time on SNSs, and currently participating in online discussion groups were significantly associated with receptivity across several of the scenarios. These reactions suggest an association between heavier Internet use and receptivity to getting health information through this channel. The rapid growth of SNSs presents a significant opportunity to reach individuals with health communication and social marketing messages.