Importance Rapid digitalization of health care and a dearth of digital health education for medical students and junior physicians worldwide means there is an imperative for more training in this dynamic and evolving field. Objective To develop an evidence-informed, consensus-guided, adaptable digital health competencies framework for the design and development of digital health curricula in medical institutions globally. Evidence Review A core group was assembled to oversee the development of the Digital Health Competencies in Medical Education (DECODE) framework. First, an initial list was created based on findings from a scoping review and expert consultations. A multidisciplinary and geographically diverse panel of 211 experts from 79 countries and territories was convened for a 2-round, modified Delphi survey conducted between December 2022 and July 2023, with an a priori consensus level of 70%. The framework structure, wordings, and learning outcomes with marginal percentage of agreement were discussed and determined in a consensus meeting organized on September 8, 2023, and subsequent postmeeting qualitative feedback. In total, 211 experts participated in round 1, 149 participated in round 2, 12 participated in the consensus meeting, and 58 participated in postmeeting feedback. Findings The DECODE framework uses 3 main terminologies: domain, competency, and learning outcome. Competencies were grouped into 4 domains: professionalism in digital health, patient and population digital health, health information systems, and health data science. Each competency is accompanied by a set of learning outcomes that are either mandatory or discretionary. The final framework comprises 4 domains, 19 competencies, and 33 mandatory and 145 discretionary learning outcomes, with descriptions for each domain and competency. Six highlighted areas of considerations for medical educators are the variations in nomenclature, the distinctiveness of digital health, the concept of digital health literacy, curriculum space and implementation, the inclusion of discretionary learning outcomes, and socioeconomic inequities in digital health education. Conclusions and Relevance This evidence-informed and consensus-guided framework will play an important role in enabling medical institutions to better prepare future physicians for the ongoing digital transformation in health care. Medical schools are encouraged to adopt and adapt this framework to align with their needs, resources, and circumstances.

Importance:Rapid digitalization of health care and a dearth of digital health education for medical students and junior physicians worldwide means there is an imperative for more training in this dynamic and evolving field. Objective:To develop an evidence-informed, consensus-guided, adaptable digital health competencies framework for the design and development of digital health curricula in medical institutions globally. Evidence Review:A core group was assembled to oversee the development of the Digital Health Competencies in Medical Education (DECODE) framework. First, an initial list was created based on findings from a scoping review and expert consultations. A multidisciplinary and geographically diverse panel of 211 experts from 79 countries and territories was convened for a 2-round, modified Delphi survey conducted between December 2022 and July 2023, with an a priori consensus level of 70%. The framework structure, wordings, and learning outcomes with marginal percentage of agreement were discussed and determined in a consensus meeting organized on September 8, 2023, and subsequent postmeeting qualitative feedback. In total, 211 experts participated in round 1, 149 participated in round 2, 12 participated in the consensus meeting, and 58 participated in postmeeting feedback. Findings:The DECODE framework uses 3 main terminologies: domain, competency, and learning outcome. Competencies were grouped into 4 domains: professionalism in digital health, patient and population digital health, health information systems, and health data science. Each competency is accompanied by a set of learning outcomes that are either mandatory or discretionary. The final framework comprises 4 domains, 19 competencies, and 33 mandatory and 145 discretionary learning outcomes, with descriptions for each domain and competency. Six highlighted areas of considerations for medical educators are the variations in nomenclature, the distinctiveness of digital health, the concept of digital health literacy, curriculum space and implementation, the inclusion of discretionary learning outcomes, and socioeconomic inequities in digital health education. Conclusions and Relevance:This evidence-informed and consensus-guided framework will play an important role in enabling medical institutions to better prepare future physicians for the ongoing digital transformation in health care. Medical schools are encouraged to adopt and adapt this framework to align with their needs, resources, and circumstances.

Health care is changing rapidly due to advances in biomedical science and technology, as well as an expanding body of medical knowledge. This transformation necessitates a reevaluation of medical education models. The medical school accreditation process, administered through the Liaison Committee on Medical Education (LCME) for MD-granting schools in the United States and Canada, plays a crucial role in maintaining educational standards. However, current LCME accreditation standards sometimes conflict with innovative educational practices, potentially hindering necessary progress. This Commentary considers how the accreditation process could better support medical education as it advances and adapts to the evolving needs of the health care environment. The authors propose strategies to enhance the accreditation process and better serve medical schools: align accreditation with competency-based education, share best practices identified during the accreditation process, encourage innovation, address financial burdens associated with preparing for accreditation, support institutional missions, embrace advances in science and technology, and facilitate rapid curriculum changes. Balancing compliance with innovation would help schools optimize the educational journey for future physicians and advance the shared goals of improved medical education and patient care.

The goal of medical education is to produce a physician workforce capable of delivering high-quality equitable care to diverse patient populations and communities. To achieve this aim amidst explosive growth in medical knowledge and increasingly complex medical care, a system of personalized and continuous learning, assessment, and feedback for trainees and practicing physicians is urgently needed. In this perspective, the authors build on prior work to advance a conceptual framework for such a system: precision education (PE). PE is a system that uses data and technology to transform lifelong learning by improving personalization, efficiency, and agency at the individual, program, and organization levels. PE "cycles" start with data inputs proactively gathered from new and existing sources, including assessments, educational activities, electronic medical records, patient care outcomes, and clinical practice patterns. Through technology-enabled analytics, insights are generated to drive precision interventions. At the individual level, such interventions include personalized just-in-time educational programming. Coaching is essential to provide feedback and increase learner participation and personalization. Outcomes are measured using assessment and evaluation of interventions at the individual, program, and organizational levels, with ongoing adjustment for repeated cycles of improvement. PE is rooted in patient, health system, and population data; promotes value-based care and health equity; and generates an adaptive learning culture. The authors suggest fundamental principles for PE, including promoting equity in structures and processes, learner agency, and integration with workflow (harmonization). Finally, the authors explore the immediate need to develop consensus-driven standards: rules of engagement between people, products, and entities that interact in these systems to ensure interoperability, data sharing, replicability, and scale of PE innovations.

While the COVID-19 pandemic amplified the need for accurate and actionable health information, uncertainty and the proliferation of misinformation have contributed to significant mistrust in public health messages, especially among marginalized communities. Community health organizations can play an important role in creating trust and providing targeted health information to vulnerable groups. This qualitative study, which is focused on community health organizations supporting vulnerable populations in South Africa and Zambia, finds that during the pandemic, community health organizations expanded their roles and leveraged their established access and trust to support the communities they serve with health education and services. However, the reliance on external support limits the organizations' ability to respond in an effective and efficient manner during health crises.

IntroductionCOVID-19 created a global need for healthcare worker (HCW) training. Initially, mass trainings focused on public health workers and physicians working in intensive care units. However, in resource-constrained settings, nurses and general practitioners provide most patient care, typically lacking the training and equipment to manage critically ill patients. We developed a massive open online course (MOOC) for HCWs in resource-constrained settings aimed at training bedside providers caring for COVID-19 patients. We describe the development, implementation and analysis of this MOOC.MethodsFrom May through June 2020, the course was developed by a multi-disciplinary team and launched on two online platforms in July. The 4-hour course comprises 6 video-based modules. Student knowledge was assessed using pre- and post-module quizzes and final exam, while demographics and user experience were evaluated by pre- and post-course surveys and learning platform data.ResultsFrom July 17th to September 24th, 30,859 students enrolled, 18,818 started, and 7,101 completed the course. Most participants worked in healthcare (78%) and resided in lower middle- (38%) or upper middle- (20%) income countries. Learners from upper middle-income and lower middle-income countries had higher completion rates. Knowledge gains were observed from pre-module to post-module quizzes and a final exam. Afterward, participants reported increased self-efficacy regarding course objectives, a 0.63 mean increase on a 4-point scale (95% CI [0.60,0.66]). Most participants (93%) would recommend the course to others.ConclusionThis article demonstrates the potential of MOOCs to rapidly provide access to emerging medical knowledge during a public health crisis, particularly for HCWs in high- and middle-income countries.

This Viewpoint describes the role of school boards in both education delivery and health outcomes and the importance of clinician involvement in effecting health-promoting policies for all students.

The aging population, burnout, and earlier retirement of physicians along with the static number of training positions are likely to worsen the current physician shortage. There is an urgent need to transform the process for selecting medical students. In this Invited Commentary, the authors suggest that to build the physician workforce that the United States needs for the future, academic medicine should focus on building capacity in 3 overarching areas. First, medical schools need to develop a more diverse pool of capable applicants that better matches the demographic characteristics of health care trainees with those of the population, and they need to nurture applicants with diverse career aspirations. Second, medical schools should recalibrate their student selection process, aligning criteria for admission with competencies expected of medical school graduates, whether they choose to become practicing clinicians, physician-scientists, members of the public health workforce, or policy makers. Selection criteria that overweight the results of standardized test scores should be replaced by assessments that value and predict academic capacity, adaptive learning skills, curiosity, compassion, empathy, emotional maturity, and superior communication skills. Finally, to improve the equity and effectiveness of the selection processes, medical schools should leverage innovations in data science and generative artificial intelligence platforms. The ability of ChatGPT to pass the United States Medical Licensing Examination (USMLE) demonstrates the decreasing importance of memorization in medicine in favor of critical thinking and problem-solving skills. The 2022 change in the USMLE Step 1 to pass/fail plus the exodus of several prominent medical schools from the U.S. News and World Report rankings have exposed limitations of the current selection processes. Newer approaches that use precision education systems to leverage data and technology can help address these limitations.

Abstract Background Side-effect concerns are a major barrier to vaccination against COVID-19 and other diseases. Identifying cost- and time-efficient interventions to improve vaccine experience and reduce vaccine hesitancy—without withholding information about side effects—is critical. Purpose Determine whether a brief symptom as positive signals mindset intervention can improve vaccine experience and reduce vaccine hesitancy after the COVID-19 vaccination. Methods English-speaking adults (18+) were recruited during the 15-min wait period after receiving their second dose of the Pfizer COVID-19 vaccination and were randomly allocated to the symptom as positive signals mindset condition or the treatment as usual control. Participants in the mindset intervention viewed a 3:43-min video explaining how the body responds to vaccinations and how common side effects such as fatigue, sore arm, and fever are signs that the vaccination is helping the body boost immunity. The control group received standard vaccination center information. Results Mindset participants (N = 260) versus controls (N = 268) reported significantly less worry about symptoms at day 3 [t(506)=2.60, p=.01, d=0.23], fewer symptoms immediately following the vaccine [t(484)=2.75, p=.006, d=0.24], and increased intentions to vaccinate against viruses like COVID-19 in the future [t(514)=−2.57, p=.01, d=0.22]. No significant differences for side-effect frequency at day 3, coping, or impact. Conclusions This study supports the use of a brief video aimed at reframing symptoms as positive signals to reduce worry and increase future vaccine intentions. Clinical Trial information Australian New Zealand Clinical Trials Registry: ACTRN12621000722897p.

Managing difficult conversations is an important skill to develop and refine for all professionals and future leaders, particularly for those in health care where difficult situations with high stakes are prevalent. The intensity and frequency of these types of conversations will predictably increase as one’s professional responsibility grows. In this article, the authors discuss their interprofessional course, Managing Difficult Conversations, developed 15 years ago for medical and graduate students at Stanford University. The course facilitates the practice of managing difficult conversations through role play in a low-risk, safe classroom setting among peers. The role-played difficult conversations are based upon a series of case studies and are facilitated by faculty and guest experts. There is no single communication style that suits everyone, but the authors offer resources from the course that can be applied for effective difficult conversations, including 12 guiding principles and a 3-stage framework for planning, beginning, and conducting the conversation. Preparing and practicing for difficult conversations will enhance the likelihood of conveying the necessary information with professionalism, directness, clarity, empathy, and warmth. Although unsettling news will always be difficult to receive, the method of delivery should be a source of comfort and hope, not one of discomfort and pain.

Mobile health (mHealth) interventions are increasingly used to support community health workers (CHWs) in low-and middle-income countries. As near-peers within their communities, the credibility of CHWs is sometimes questioned—a recognized barrier to their efficacy. Nested within a large, randomized-controlled trial, this qualitative study captured the experiences of South African CHWs, called “Mentor-Mothers,” using tablets and animated videos to promote exclusive breastfeeding. We conducted in-depth telephone interviews with 26 tablet-carrying Mentor-Mothers. We analyzed interview transcripts using a Grounded Theory approach, then developed a theoretical framework, based on an emerging theme, for understanding how tablet technology boosts the perceived credibility of CHWs. Tablet-carrying Mentor-Mothers described an increase in their perceived credibility, which they attributed to overt and signaling effects related to enhanced credibility of (1) their messages, (2) themselves as messengers, and (3) the program employing them. Mobile technology investments in CHWs could enhance their credibility, translating into meaningful investments in the health of under-served communities.

Background Health professions education has undergone major changes with the advent and adoption of digital technologies worldwide. Objective This study aims to map the existing evidence and identify gaps and research priorities to enable robust and relevant research in digital health professions education. Methods We searched for systematic reviews on the digital education of practicing and student health care professionals. We searched MEDLINE, Embase, Cochrane Library, Educational Research Information Center, CINAHL, and gray literature sources from January 2014 to July 2020. A total of 2 authors independently screened the studies, extracted the data, and synthesized the findings. We outlined the key characteristics of the included reviews, the quality of the evidence they synthesized, and recommendations for future research. We mapped the empirical findings and research recommendations against the newly developed conceptual framework. Results We identified 77 eligible systematic reviews. All of them included experimental studies and evaluated the effectiveness of digital education interventions in different health care disciplines or different digital education modalities. Most reviews included studies on various digital education modalities (22/77, 29%), virtual reality (19/77, 25%), and online education (10/77, 13%). Most reviews focused on health professions education in general (36/77, 47%), surgery (13/77, 17%), and nursing (11/77, 14%). The reviews mainly assessed participants’ skills (51/77, 66%) and knowledge (49/77, 64%) and included data from high-income countries (53/77, 69%). Our novel conceptual framework of digital health professions education comprises 6 key domains (context, infrastructure, education, learners, research, and quality improvement) and 16 subdomains. Finally, we identified 61 unique questions for future research in these reviews; these mapped to framework domains of education (29/61, 47% recommendations), context (17/61, 28% recommendations), infrastructure (9/61, 15% recommendations), learners (3/61, 5% recommendations), and research (3/61, 5% recommendations). Conclusions We identified a large number of research questions regarding digital education, which collectively reflect a diverse and comprehensive research agenda. Our conceptual framework will help educators and researchers plan, develop, and study digital education. More evidence from low- and middle-income countries is needed.

Background In South Africa, breastfeeding promotion is a national health priority. Regular perinatal home visits by community health workers (CHWs) have helped promote exclusive breastfeeding (EBF) in underresourced settings. Innovative, digital approaches including mobile video content have also shown promise, especially as access to mobile technology increases among CHWs. We measured the effects of an animated, mobile video series, the Philani MObile Video Intervention for Exclusive breastfeeding (MOVIE), delivered by a cadre of CHWs (“mentor mothers”). Methods and findings We conducted a stratified, cluster-randomized controlled trial from November 2018 to March 2020 in Khayelitsha, South Africa. The trial was conducted in collaboration with the Philani Maternal Child Health and Nutrition Trust, a nongovernmental community health organization. We quantified the effect of the MOVIE intervention on EBF at 1 and 5 months (primary outcomes), and on other infant feeding practices and maternal knowledge (secondary outcomes). We randomized 1,502 pregnant women in 84 clusters 1:1 to 2 study arms. Participants’ median age was 26 years, 36.9% had completed secondary school, and 18.3% were employed. Mentor mothers in the video intervention arm provided standard-of-care counseling plus the MOVIE intervention; mentor mothers in the control arm provided standard of care only. Within the causal impact evaluation, we nested a mixed-methods performance evaluation measuring mentor mothers’ time use and eliciting their subjective experiences through in-depth interviews. At both points of follow-up, we observed no statistically significant differences between the video intervention and the control arm with regard to EBF rates and other infant feeding practices [EBF in the last 24 hours at 1 month: RR 0.93 (95% CI 0.86 to 1.01, P = 0.091); EBF in the last 24 hours at 5 months: RR 0.90 (95% CI 0.77 to 1.04, P = 0.152)]. We observed a small, but significant improvement in maternal knowledge at the 1-month follow-up, but not at the 5-month follow-up. The interpretation of the results from this causal impact evaluation changes when we consider the results of the nested mixed-methods performance evaluation. The mean time spent per home visit was similar across study arms, but the intervention group spent approximately 40% of their visit time viewing videos. The absence of difference in effects on primary and secondary endpoints implies that, for the same time investment, the video intervention was as effective as face-to-face counseling with a mentor mother. The videos were also highly valued by mentor mothers and participants. Study limitations include a high loss to follow-up at 5 months after premature termination of the trial due to the COVID-19 pandemic and changes in mentor mother service demarcations. Conclusions This trial measured the effect of a video-based, mobile health (mHealth) intervention, delivered by CHWs during home visits in an underresourced setting. The videos replaced about two-fifths of CHWs’ direct engagement time with participants in the intervention arm. The similar outcomes in the 2 study arms thus suggest that the videos were as effective as face-to-face counselling, when CHWs used them to replace a portion of that counselling. Where CHWs are scarce, mHealth video interventions could be a feasible and practical solution, supporting the delivery and scaling of community health promotion services. Trial registration The study and its outcomes were registered at clinicaltrials.gov (#NCT03688217) on September 27, 2018.

We appreciate Roman and colleagues’ letter in response to our commentary. We congratulate them on the successful implementation of their school’s new curriculum that minimizes lectures and classroom time; emphasizes peer-to-peer engagement, facilitated by faculty; and incorporates frequent assessments and feedback. We note their preference for assigned readings rather than videos as preparatory work for interactive sessions. In addition, we believe that the learners might benefit from choosing their own favored ways for foundational knowledge acquisition, approaches that support their individual learning styles. We believe that teaching sessions that do not support interaction with faculty and peers should not require attendance. However, if sessions are organized to foster discussion with experts, encourage debate among peers, and incorporate a diversity of opinions, students should have an obligation to participate. Otherwise, the richness of the experience is compromised and open exchange of different points of view and team development are not fostered. The development of critical thinking, problem solving, and communications skills depend upon struggling with the content through thoughtful discussions and debates, respectful consideration of multiple perspectives, and clear communication. These are not skills that can be developed by reading, watching videos, listening to lectures, and working in isolation. We also agree with Roman and colleagues that the pathway to curricular reform is not easy. There are many stakeholders, some of whom have long-standing and deeply engrained biases about what we should be teaching and how we should be teaching it. In general, faculty priorities around particular topics usually determine what receives the most attention in a specific medical school’s curriculum—thus, each school’s priorities are different. In contrast, the highest priorities for most students are to excel in their studies, perform well on national assessments, and graduate with a medical degree and the opportunity to pursue their postgraduate training of choice. We have seen that many students convert this tension between priorities into stress, contributing to the unacceptable rates of burnout and depression experienced by medical students across the country. Medical school reform must prioritize the mental health of the learners and focus on engaging every student. Bringing students back to the classroom should emphasize fostering critical thinking, communication, and interpersonal dynamics while building a more tight-knit and supportive community that will benefit learners throughout their entire careers.

Without the USMLE Step 1 exam exerting undue influence on our curricula, we have the opportunity to work as a community to redefine what it takes to train scientifically grounded and exemplary caregivers in today's world. Such collaborative action is overdue.

Medical schools across the United States and Canada constantly consider how to improve their curricula and their pedagogical strategies. The authors found it informative to compare how students in 2 professional schools, medicine and business, are taught. The authors believe that creating the best future physicians requires students and faculty to be physically together to learn essential skills. Increasing student interactions with peers and faculty enhances learning, and the classroom is a natural place for these interactions to take place. Requiring medical students to attend teaching sessions in the preclinical curriculum should help foster their development of core competencies, including critical decision making, clinical reasoning, and patient-centered care.

The COVID-19 pandemic created an urgent global need for healthcare worker (HCW) training. Initial COVID-19-related online courses focused primarily on training public health workers and physicians caring for patients in intensive care units (ICUs). However, in resource-constrained settings, nurses and general practitioners are responsible for providing most COVID-19 patient medical care, typically lacking the training and equipment necessary to manage complex, critically ill patients. In these environments, early recognition and interventions to prevent patient deterioration are essential to optimizing outcomes. We developed a massive open online course (MOOC) for HCWs in resource-constrained settings aimed at training bedside providers caring for patients with COVID-19. This study evaluates the impact of this MOOC by assessing HCW course engagement, knowledge, confidence in caring for COVID-19 patients, and user experience. From May thru June of 2020, the course was rapidly developed by a team of physicians, educators, medical illustrators, and education technology staff, and was subsequently launched on two online platforms in July 2020. The approximately 4-hour course comprises 6 video-based modules with accompanying handouts. Student knowledge was assessed using pre- and post-module quizzes and a final exam, while demographics and user experience were evaluated by pre- and post-course surveys and data collected through the platforms. From July 17th to September 24th, 30,859 students enrolled, 18,818 started, and 7,101 completed the course. Most participants worked in healthcare (86%) and resided in lower middle- (36%) or upper middle- (21%) income countries. Higher course completion rates were observed among learners who were from upper middle-income (aOR 1.152 [95% CI 1.019-1.303]) and lower middle-income countries (aOR 1.229 [95% CI 1.104-1.368]). Significant knowledge gains were observed from pre-module (mean 56% [SD 17%]) to post-module quizzes (80% [SD 15%], P<.001), and from pre-module quizzes to the final exam (78% [SD 17%], P<.001). After course completion, participants reported increased self-efficacy regarding the course objectives, with a 0.63 mean increase on a 4-point scale (95% CI [0.60,0.66]). Overall, there was high satisfaction with the course experience, with 93% of participants reporting they would recommend the course to others. This study demonstrates the potential of MOOCs to rapidly provide access to emerging medical knowledge during a public health crisis, particularly for HCWs in high- and middle-income countries. Further research is required to understand the impact of such online courses on patient care and how to better reach learners in low-income countries.

Background Ensuring access to accurate and actionable health information is crucial during the COVID-19 pandemic, especially in low-resource settings. Among marginalized groups, there are disparities in access to information, along with significant mistrust of government sources. Non-governmental organizations (NGOs) involved in community-level health education can play an important role in bridging mistrust and targeting information to reach vulnerable populations. There is a lack of research on the experiences and needs of organizations involved in disseminating health information during the pandemic. Methods This study uses a qualitative approach to investigate the current strategies, challenges, and needs of community-based organizations involved in COVID-19 public education. From May to June 2020, we conducted 19 semi-structured interviews with leaders of organizations in South Africa and Zambia. Participants were asked a series of open-ended questions in three domains: 1) the impact of the pandemic on the communities served by the organization, 2) their COVID-19 response, and 3) organization needs and challenges during the pandemic. Interviews were recorded, transcribed, and coded using thematic analysis. Coding and analysis were conducted by four study authors and every interview was independently coded by 2 separate authors to maximize internal validity and consistency. Results 5 themes relevant to the roles and challenges of locally active NGO’s were identified: (1) they intimately understand community needs during the pandemic; (2) they adapt to pandemic constraints to continue supporting vulnerable populations; (3) they play a unique role in educating the public about COVID-19 due to established access and trust within communities; (4) they are able to customize health education and information to address nuanced needs of local communities served; and (5) they need external support to effectively respond to the pandemic. Conclusions Overall, our study contributes a deeper understanding of the role of NGOs in providing needed support and customized health education for vulnerable communities during a global public health crisis. To maximize their ability to support their communities, NGO’s would benefit from access to educational resources designed to be easily modified, support in navigating technological and safety challenges during the pandemic, and sustainable funding.

Drawing on 5 years of experience designing, producing, and disseminating video health education programs globally, we outline the process of creating accessible, engaging, and relevant video health education content using a community-based, human-centered design approach. We show that this approach can yield a new generation of interventions, which are better aligned with the needs and contexts of target communities. The participation of target communities and local stakeholders in the content production and design process fosters ownership of the content and increases the likelihood that the resulting intervention will resonate within its intended primary audience and be disseminated broadly. Ease of future adaptation for additional global audiences and modification of the content for multiple dissemination pathways are important early considerations to ensure scalability and long-term impact of the intervention. Recent advances in mobile technology can facilitate the dissemination of accessible, engaging health education at scale, thereby enhancing the potential impact of video-based educational tools. Accessible and engaging health education is a cornerstone of health behavior change. Especially in low- and middle-income countries, increasing access to effective health education can contribute to improved health outcomes. Prior research has identified several characteristics of effective health education interventions. These include the integration of pictures, narratives, and entertainment-education, in which the health messages that make up the educational content are embedded. However, the effectiveness and long-term impact of health messages ultimately depend on how well the end users can identify with the content that is presented. This identification, in turn, is a function of how well the messages correspond to user needs and wants and how this correspondence is communicated through the design characteristics of the health education intervention.