Several strategies have been developed to detect diagnostic errors for organizational learning and improvement. However, few health care organizations (HCOs) have integrated these strategies into routine operations. To address this gap, the Agency for Healthcare Research and Quality released “Measure Dx: A Resource To Identify, Analyze, and Learn From Diagnostic Safety Events” in 2022. We conducted an evaluation of Measure Dx to measure feasibility of implementation and effects on short-term and intermediate outcomes related to diagnostic safety. Prospective observational study. Teams from 11 HCOs, primarily academic medical centers. Participants were asked to use Measure Dx over approximately 6 months and attend monthly virtual learning collaborative sessions to share and discuss approaches to measuring diagnostic safety. Descriptive outcomes were gathered at the HCO level and included uptake of different case-finding strategies and the number of cases reviewed and confirmed to have diagnostic safety improvement opportunities. We collected information on organizational practices related to diagnostic safety at each HCO at baseline and at the conclusion of the project. The 11 HCOs completed all requirements for the evaluation. Each of the four diagnostic safety case finding strategies outlined in Measure Dx were used by at least three HCOs. Across the cohort, participants reviewed 703 cases using a standardized data collection instrument. Of those cases, 224 (31.8
Introduction: One in three patients is affected by diagnosis-related communication failures. Only a few valid and reliable instruments that measure teamwork and communication exist, and none of those focus on improving diagnosis. The authors ( TAT ), which assesses diagnostic teamwork and communication in five critical teamwork domains and can be used to identify strengths and opportunities for improvement and monitor performance. Methods: The TAT was administered as a cross-sectional survey to 360 health professionals across nine diverse US health systems. Content and construct validity were evaluated through pilot implementation and subject matter expert review. Reliability and internal consistency were assessed with Cronbach's alpha. To understand sources of variation in TAT scores and assess the tool's consistency across diverse health care organizations, generalizability theory (G-theory) was used. Best practices in screening for careless responding identified participants with random or nonvarying responses. Results: Analyses indicated strong support for the tool. Content validity findings indicated that the TAT encompassed relevant diagnostic improvement teamwork and communication content. Construct validity, evaluated through pilot implementations, demonstrated the tool's effectiveness in assessing teamwork categories. Reliability analyses confirmed the TAT's internal consistency, with an overall Cronbach's alpha of 0.97. Each dimension of the TAT exhibited good reliability coefficients, ranging from 0.83 to 0.95. G-theory analysis showed that variations in TAT scores were primarily attributed to respondents (28.0%) and scale dimensions (59.6%); both are desirable facets of variation. Further, examination of careless respondents ensured the accuracy and quality of the results, enhancing the TAT's credibility as a valuable diagnostic improvement tool. Conclusion: Psychometric evaluation demonstrated that the TAT is a reliable and valid instrument for assessing teamwork and communication among and across diagnostic teams. The TAT adds a novel, evidence-based, psychometrically sound measurement tool to help advance diagnostic teamwork and communication to improve patient care and outcomes.
Objectives: No framework currently exists to guide how payers and providers can collaboratively develop and implement incentives to improve diagnostic safety. We conducted a literature review and interviews with subject matter experts to develop a multi-component 'Payer Relationships for Improving Diagnoses (PRIDx)' framework, that could be used to engage payers in diagnostic safety efforts.Content: The PRIDx framework, 1) conceptualizes diagnostic safety links to care provision, 2) illustrates ways to promote payer and provider engagement in the design and adoption of accountability mechanisms, and 3) explicates the use of data analytics. Certain approaches suggested by PRIDx were refined by subject matter expert interviewee perspectives.Summary: The PRIDx framework can catalyze public and private payers to take specific actions to improve diagnostic safety.Outlook: Implementation of the PRIDx framework requires new types of partnerships, including external support from public and private payer organizations, and requires creation of strong provider incentives without undermining providers' sense of professionalism and autonomy. PRIDx could help facilitate collaborative payer-provider approaches to improve diagnostic safety and generate research concepts, policy ideas, and potential innovations for engaging payers in diagnostic safety improvement activities.
Reducing the incidence of diagnostic errors is increasingly a priority for government, professional, and philanthropic organizations. Several obstacles to measurement of diagnostic safety have hampered progress toward this goal. Although a coordinated national strategy to measure diagnostic safety remains an aspirational goal, recent research has yielded practical guidance for healthcare organizations to start using measurement to enhance diagnostic safety. This paper, concurrently published as an Issue Brief by the Agency for Healthcare Research and Quality, issues a "call to action" for healthcare organizations to begin measurement efforts using data sources currently available to them. Our aims are to outline the state of the science and provide practical recommendations for organizations to start identifying and learning from diagnostic errors. Whether by strategically leveraging current resources or building additional capacity for data gathering, nearly all organizations can begin their journeys to measure and reduce preventable diagnostic harm.
BACKGROUND:The design and execution of measurement in quality improvement (QI) initiatives is often poor. Better guidance on "what good looks like" might help to mitigate some of the problems. We report a consensus-building process that sought to identify which features are important to include in QI measurement plans.METHODS:We conducted a three-stage consensus-building approach: (1) identifying the list of features of measurement plans that were potential candidates for inclusion based on literature review and the study team's experience; (2) a two-round modified Delphi exercise with a panel of experts to establish consensus on the importance of these features; and (3) a small in-person consensus group meeting to finalise the list of features.RESULTS:A list of 104 candidate questions was generated. A panel of 19 experts in the Delphi reviewed these questions and produced consensus on retaining 46 questions in the first round and on a further 22 in the second round. Thematic analysis of open text responses from the panellists suggested a number of areas of debate that were explicitly considered by the consensus group. The exercise yielded 74 questions (71% of 104) on which there was consensus in five categories of measurement relating to: design, data collection and management, analysis, action, and embedding.CONCLUSIONS:This study offers a consensus-based view on the features of a good measurement plan for a QI project in healthcare. The results may be of use to QI teams, funders and evaluators, but are likely to require further development and testing to ensure feasibility and usefulness.
Assess perceived barriers to speaking up and to provide recommendations for reducing barriers to reporting adverse events and near misses. A six-item survey was administered to critical care providers in 19 Intensive Care Units in Abu Dhabi as part of an organizational safety and quality improvement effort. Questions elicited perspectives about influences on reporting, perceived barriers and recommendations for conveying patient safety as an organizational priority. Qualitative thematic analyses were conducted for open-ended questions. A total of 1171 participants were invited to complete the survey and 639 responded (response rate = 54.6%). Compared to other stakeholders (e.g. the media, public), a larger proportion of respondents 'agreed/strongly agreed' that corporate health system leadership and the health regulatory authority encouraged and supported error reporting (83%; 75%), and had the most influence on their decisions to report (81%; 74%). 29.5% of respondents cited fear of repercussion as a barrier, and 21.3% of respondents indicated no barriers to reporting. Barriers included perceptions of a culture of blame and issues with reporting procedures. Recommendations to establish patient safety as an organizational priority included creating supportive environments to discuss errors, hiring staff to advocate for patient safety, and implementing policies to standardize clinical practices and streamline reporting procedures. Influences on reporting perceived by providers in the UAE were similar to those in the US and other countries. These findings highlight the roles of corporate leadership and regulators in developing non-punitive environments where reporting is a valuable and safe activity.
A national collaborative helped many hospitals dramatically reduce central line–associated bloodstream infections (CLABSIs), but some hospitals struggled to reduce infection rates. This article describes the development of a peer-to-peer assessment process (CLABSI Conversations) and the practical, actionable practices we discovered that helped intensive care unit teams achieve a CLABSI rate of less than 1 infection per 1000 catheter-days for at least 1 year. CLABSI Conversations was designed as a learning-oriented process, in which a team of peers visited hospitals to surface barriers to infection prevention and to share best practices and insights from successful intensive care units. Common practices led to 10 recommendations: executive and board leaders communicate the goal of zero CLABSI throughout the hospital; senior and unit-level leaders hold themselves accountable for CLABSI rates; unit physicians and nurse leaders own the problem; clinical leaders and infection preventionists build infection prevention training and simulation programs; infection preventionists participate in unit-based CLABSI reduction efforts; hospital managers make compliance with best practices easy; clinical leaders standardize the hospital's catheter insertion and maintenance practices and empower nurses to stop any potentially harmful acts; unit leaders and infection preventionists investigate CLABSIs to identify root causes; and unit nurses and staff audit catheter maintenance policies and practices.
A national collaborative helped many hospitals dramatically reduce central line-associated bloodstream infections (CLABSIs), but some hospitals struggled to reduce infection rates. This article describes the development of a peer-to-peer assessment process (CLABSI Conversations) and the practical, actionable practices we discovered that helped intensive care unit teams achieve a CLABSI rate of less than 1 infection per 1000 catheter-days for at least 1 year. CLABSI Conversations was designed as a learning-oriented process, in which a team of peers visited hospitals to surface barriers to infection prevention and to share best practices and insights from successful intensive care units. Common practices led to 10 recommendations: executive and board leaders communicate the goal of zero CLABSI throughout the hospital; senior and unit-level leaders hold themselves accountable for CLABSI rates; unit physicians and nurse leaders own the problem; clinical leaders and infection preventionists build infection prevention training and simulation programs; infection preventionists participate in unit-based CLABSI reduction efforts; hospital managers make compliance with best practices easy; clinical leaders standardize the hospital's catheter insertion and maintenance practices and empower nurses to stop any potentially harmful acts; unit leaders and infection preventionists investigate CLABSIs to identify root causes; and unit nurses and staff audit catheter maintenance policies and practices.
This article describes the interventions that sustained low central line-associated bloodstream infection (CLABSI) rates in the Michigan Keystone ICU Project. This analysis included data from March 2004 to December 2013 for 121 intensive care units (ICUs) in 73 hospitals. The Keystone Project was a cohort collaborative with an improvement team in each ICU. During the sustainability period, teams integrated the intervention into staff orientation, collected and submitted monthly data, and reported infection rates to leaders. The annual mean rate of BSIs dropped from 2.5 infections/1000 catheter-days in 2004 to 0.76 in 2013. A subset analysis found nearly double the percentage of ICUs with a mean rate of <1 infection/1000 catheter-days in 2013 compared with baseline. Active involvement of hospital leaders and the Keystone Center as well as ongoing monitoring and feedback of performance were important in sustaining results. These findings suggest that large-scale improvement projects can be sustained, establishing a new normal for care.
OBJECTIVES:The objectives were to develop a scientifically sound and feasible peer-to-peer assessment model that allows health-care organizations to evaluate patient safety in cardiovascular operating rooms and to establish safety priorities for improvement.METHODS:The locating errors through networked surveillance study was conducted to identify hazards in cardiac surgical care. A multidisciplinary team, composed of organizational sociology, organizational psychology, applied social psychology, clinical medicine, human factors engineering, and health services researchers, conducted the study. We used a transdisciplinary approach, which integrated the theories, concepts, and methods from each discipline, to develop comprehensive research methods. Multiple data collection was involved: focused literature review of cardiac surgery-related adverse events, retrospective analysis of cardiovascular events from a national database in the United Kingdom, and prospective peer assessment at 5 sites, involving survey assessments, structured interviews, direct observations, and contextual inquiries. A nominal group methodology, where one single group acts to problem solve and make decisions was used to review the data and develop a list of the top priority hazards.RESULTS:The top 6 priority hazard themes were as follows: safety culture, teamwork and communication, infection prevention, transitions of care, failure to adhere to practices or policies, and operating room layout and equipment.CONCLUSIONS:We integrated the theories and methods of a diverse group of researchers to identify a broad range of hazards and good clinical practices within the cardiovascular surgical operating room. Our findings were the basis for a plan to prioritize improvements in cardiac surgical care. These study methods allowed for the comprehensive assessment of a high-risk clinical setting that may translate to other clinical settings.
Objectives The objectives were to develop a scientifically sound and feasible peer-to-peer assessment model that allows health-care organizations to evaluate patient safety in cardiovascular operating rooms and to establish safety priorities for improvement. Methods The locating errors through networked surveillance study was conducted to identify hazards in cardiac surgical care. A multidisciplinary team, composed of organizational sociology, organizational psychology, applied social psychology, clinical medicine, human factors engineering, and health services researchers, conducted the study. We used a transdisciplinary approach, which integrated the theories, concepts, and methods from each discipline, to develop comprehensive research methods. Multiple data collection was involved: focused literature review of cardiac surgery-related adverse events, retrospective analysis of cardiovascular events from a national database in the United Kingdom, and prospective peer assessment at 5 sites, involving survey assessments, structured interviews, direct observations, and contextual inquiries. A nominal group methodology, where one single group acts to problem solve and make decisions was used to review the data and develop a list of the top priority hazards. Results The top 6 priority hazard themes were as follows: safety culture, teamwork and communication, infection prevention, transitions of care, failure to adhere to practices or policies, and operating room layout and equipment. Conclusions We integrated the theories and methods of a diverse group of researchers to identify a broad range of hazards and good clinical practices within the cardiovascular surgical operating room. Our findings were the basis for a plan to prioritize improvements in cardiac surgical care. These study methods allowed for the comprehensive assessment of a high-risk clinical setting that may translate to other clinical settings.