PURPOSE:We aimed to describe the development of a tailored, theory-informed training session for an outcome measure (the Mayo-Portland Adaptability Inventory), and evaluate the session's impact on clinician reactions, learning, and behavioural intent. MATERIALS AND METHODS:We developed the training session using an integrated knowledge translation approach with stroke outpatient rehabilitation clinicians in Québec, Canada. We conducted a mixed-method explanatory sequential evaluation informed by the New World Kirkpatrick Model (reaction, learning, behavioural intent) composed of three surveys followed by interviews. We analyzed survey data using cumulative link mixed models, and interviews using directed content analysis. RESULTS:Eighty clinicians attended the training session, of which 51 responded to the surveys and 6 participated in interviews. Odds ratios indicate that individuals were more likely to rate themselves higher post-training on most outcomes. During the interviews, participants indicated that: they experienced positive reactions, learning and behavioural impacts from the session, negative attitudes and commitment were due to perceived limitations in the outcome measure, and training impacts were affected by contextual factors including a provincial mandate for the measure. CONCLUSION:Implementation teams could adapt this training design process to their context. Further research to understand how educational strategies work would produce more robust guidance.
PURPOSE:Traumatic brain injury and spinal cord injury impact all areas of individuals' quality of life. A synthesis of available evidence for the Traumatic Brain Injury Quality of Life (TBI-QoL) and Spinal Cord Injury Quality of Life (SCI-QoL) measurement systems could inform evidence-based clinical practice and research. Thus, we aimed to systematically review the literature of existing evidence on the measurement properties of SCI-QoL and TBI-QoL among rehabilitation populations. METHODS:We used the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) framework for evaluating measures to guide this systematic review. We searched nine electronic databases and registries, and hand-searched reference lists of included articles. Two independent reviewers screened selected articles and extracted the data. We used COSMIN's thresholds to synthesize measurement properties evidence (insufficient, sufficient), and the modified GRADE approach to synthesize evidence quality (very-low, low, moderate, high). RESULTS:We included 16 studies for SCI-QoL and 14 studies for TBI-QoL. Both measurement systems have sufficient content validity, structural validity, internal consistency and construct validity across nearly all domains (GRADE: high). Most SCI-QoL domains and some TBI-QoL domains have sufficient evidence of cross-cultural validity and test-retest reliability (GRADE: moderate-high). Besides the cognition domains of TBI-QoL, which have indeterminate evidence for measurement error and sufficient evidence for responsiveness (GRADE: high), there is no additional evidence available for these measurement properties. CONCLUSION:Rehabilitation researchers and clinicians can use SCI-QoL and TBI-QoL to describe and evaluate patients. Further evidence of measurement error, responsiveness, and predictive validity would advance the use and interpretation of SCI-QoL and TBI-QoL in rehabilitation.
RATIONALE:Only half of newly implemented evidence-based practices are sustained. Though poor sustainment can lead to negative consequences for clinical teams, organizations and patients, the causal explanations of sustainment are largely unknown. AIMS AND OBJECTIVES:We aimed to ascertain how (mechanisms) and in what circumstances (context) a newly implemented outcome measure in rehabilitation was sustained or not (outcome). METHODOLOGY:Informed by an integrated knowledge translation approach, we conducted a realist evaluation using a mixed method, embedded single case study design with data collection up to 18 months following the implementation of the Mayo-Portland Adaptability Inventory - version 4 (MPAI-4), a rehabilitation outcome measure. Quantitative data (survey and patient charts) was analysed using descriptive statistics, then integrated with qualitative data (interviews with 10 key informants) and analysed using inductive and deductive retroduction. We integrated the data to develop a case description and ultimately, to refine the programme theory to better understand the sustainability of the MPAI-4. RESULTS:We linked context, mechanisms and outcomes, and also emphasized sustainability strategies in 18 explanations of how sustainability works. These explanations provide evidence for four overarching patterns: (1) implementation and sustainability phases are interconnected, (2) outcomes build on each other recursively, with patient benefits as the keystone outcome, (3) sustainment is achieved to varying levels across different sustainability outcomes [e.g., high level (e.g., rate of MPAI-4 scoring: 77.7%) to low level (e.g., rate of MPAI-4 application to clinical decision-making: 3.7%)] and (4) the work of sustaining the MPAI-4 is shared amongst different stakeholders. CONCLUSION:Implementation teams can draw from this programme theory to improve the sustainment of outcomes measures while researchers could continue to refine the theory. Continued investigation of sustainability, including diverse and continuous sustainability outcomes, is needed to understand how to maintain improvements in quality of care and patient outcomes.
Rationale: Evidence suggests that sustainability planning and the use of a collaborative approach to planning result in better sustainability outcomes and more relevant knowledge. Yet, both approaches appear to be underutilized. A detailed description of collaborative sustainability planning may encourage the use of these two impactful strategies. Aims and Objectives: To explore the collaborative sustainability planning process for a single outcome measure in three rehabilitation sites. Methodology: Within the Mayo-Portland Adaptability Inventory-version 4 (MPAI-4) implementation project, we conducted a qualitative description study. We used data from 12 core sustainability planning meetings and 108 follow-up meetings that included a total of 31 clinical and research team participants. Sustainability planning was informed by an MPAI-4-specific implementation guide, and by the results from a realist review of the sustainability of rehabilitation practices and the Clinical Sustainability Assessment Tool. We analyzed qualitative data using thematic content analysis. Results: Three themes describe the collaborative sustainability planning process: (1) "collaboration as a driver for sustainability" which captures the active collaboration underpinning sustainability planning; (2) "co-creation of a sustainability plan to achieve shared objectives" which captures the identified barriers and facilitators, and selected sustainability strategies linked to one of six collaboratively identified shared objectives; and (3) "the iterative nature of sustainability planning" which captures the necessity of an agile and responsive sustainability planning process. Conclusion: Identified strategies may be useful to support (collaborative) sustainment. Future research could investigate the effect of collaborative sustainability planning on sustainability objectives, and the relationship between these objectives.
We contend that the notion of critical friend is a legitimate consideration with respect to considering how to most effectively encourage professional relationships that support and enhance professional learning and development (PLD). This paper will firstly consider an overarching framework of professional relationships and define characteristics, roles and expected tasks of a critical friend, noting that the development of trust is central to both. The authors thread (where relevant) elements of PLD throughout the framework, before introducing the reader to a proposed dual-continuum model of critical friend roles and tasks in PLD. A scenario is then mapped for each of the four quadrants, displaying elements of a specific type of critical friend activity related to the defining characteristics of critical friend shared in the paper. The intention is to capture the nuances between multiple enactments of critical friend as well as informing a possible continuum of what constitutes operating as a critical friend supporting and enhancing PLD. The paper concludes with observations from the scenarios and future considerations for further exploration of critical friend roles, tasks, skills and behaviour.
Abstract Objective To systematically review the literature of existing evidence on the measurement properties of the Quality of Life in Neurological Disorders (Neuro-QoL) measurement system among neurorehabilitation populations. Data sources The Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) guided this systematic review in which we searched nine electronic databases and registries, and hand-searched reference lists of included articles. Study selection Two independent reviewers screened selected articles and extracted data from 28 included studies. Data extraction COSMIN’s approach guided extraction and synthesizing measurement properties evidence (insufficient, sufficient), and the modified GRADE approach guided synthesizing evidence quality (very-low, low, moderate, high) by diagnosis. Data synthesis Neuro-QoL has sufficient measurement properties when used by individuals with Huntington’s disease, Multiple Sclerosis, Parkinson’s disease, stroke, lupus, cognitive decline, and amyotrophic lateral sclerosis. The strongest evidence is for the first four conditions, where test-retest reliability, construct validity, and responsiveness are nearly always sufficient (GRADE: moderate-high). Structural validity is assessed only in multiple sclerosis and stroke but is often insufficient (GRADE: moderate-high). Criterion validity is sufficient in some stroke and Huntington’s disease domains (GRADE: high). Item response theory analyses were reported for some stroke domains only. There is limited, mixed evidence for responsiveness and measurement error (GRADE: moderate-high), and no cross-cultural validity evidence Conclusions Neuro-QoL domains can describe and evaluate patients with Huntington’s disease, multiple sclerosis, Parkinson’s disease, and stroke, but predictive validity evidence would be beneficial. In the other conditions captured in this review, a limited number of Neuro-QoL domains have evidence for descriptive use only. For these conditions, further evidence of structural validity, measurement error, cross-cultural validity and predictive validity would enhance the use and interpretation of Neuro-QoL.
IntroductionStroke is a leading cause of morbidity and mortality worldwide, placing an immense burden on patients and the health system. Timely access to rehabilitation services can improve stroke survivors' quality of life. The use of standardised outcome measures is endorsed for optimising patient rehabilitation outcomes and improving clinical decision-making. This project results from a provincially mandated recommendation to use the fourth version of the Mayo-Portland Adaptability Inventory (MPAI-4) to measure changes in social participation of stroke survivors and to maintain commitment to evidence-informed practices in stroke care. This protocol outlines the implementation process of the MPAI-4 for three rehabilitation centres. The objectives are to: (a) describe the context of MPAI-4 implementation; (b) determine clinical teams' readiness for change; (c) identify barriers and enablers to implementing the MPAI-4 and match the implementation strategies; (d) evaluate the MPAI-4 implementation outcomes including the degree of integration of the MPAI-4 into clinical practice and (e) explore participants' experiences using the MPAI-4.Methods and analysisWe will use a multiple case study design within an integrated knowledge translation (iKT) approach with active engagement from key informants. Each case is a rehabilitation centre implementing MPAI-4. We will collect data from clinicians and programme managers using mixed methods guided by several theoretical frameworks. Data sources include surveys, focus groups and patient charts. We will conduct descriptive, correlational and content analyses. Ultimately, we will analyse, integrate data from qualitative and quantitative components and report them within and across participating sites. Results will provide insights about iKT within stroke rehabilitation settings that could be applied to future research projects.Ethics and disseminationThe project received Institutional Review Board approval from the Centre for Interdisciplinary Research in Rehabilitation of Greater Montreal. We will disseminate results in peer-reviewed publications and at local, national and international scientific conferences.
INTRODUCTION:Health care professionals work in different contexts, which can influence professional competencies. Despite existing literature on the impact of context on practice, the nature and influence of contextual characteristics, and how context is defined and measured, remain poorly understood. The aim of this study was to map the breadth and depth of the literature on how context is defined and measured and the contextual characteristics that may influence professional competencies.METHODS:A scoping review using Arksey and O'Malley's framework. We searched MEDLINE (Ovid) and CINAHL (EBSCO). Our inclusion criteria were studies that reported on context or relationships between contextual characteristics and professional competencies or that measured context. We extracted data on context definitions, context measures and their psychometric properties, and contextual characteristics influencing professional competencies. We performed numerical and qualitative analyses.RESULTS:After duplicate removal, 9106 citations were screened and 283 were retained. We compiled a list of 67 context definitions and 112 available measures, with or without psychometric properties. We identified 60 contextual factors and organized them into five themes: Leadership and Agency, Values, Policies, Supports, and Demands.DISCUSSION:Context is a complex construct that covers a wide array of dimensions. Measures are available, but none include the five dimensions in one single measure or focus on items targeting the likelihood of context influencing several competencies. Given that the practice context plays a critical role in health care professionals' competencies, stakeholders from all sectors (education, practice, and policy) should work together to address those contextual characteristics that can adversely influence practice.
Abstract Introduction Adolescents and young adults require age-appropriate healthcare services delivered by clinicians with expertise in adolescent medicine. However, resident family physicians report a low perceived self-efficacy and under-preparedness to deliver adolescent medical care. We conducted a scoping review to map the breadth and depth of the current evidence about adolescent medicine training for family medicine residents. Content We followed Arksey and O’Malley’s framework and searched seven electronic databases and key organizations’ webpages from inception to September 2020. Informed by the CanMEDS-FM, we analyzed the extracted data concerning basic document characteristics, competencies and medical topics using numerical and qualitative content analysis. Summary We included 41 peer-reviewed articles and six adolescent health competency frameworks (n=47). Most competencies taught in family medicine programs were organized under the roles of family medicine expert (75%), communicator (11.8%), and professional roles (7.9%). Health advocate and leader were rarely included (1.3%), and never scholar. Outlook The omission of multiple competency roles in family medicine resident education on adolescents is insufficient for family physicians to deliver optimal care to adolescents. The combined efforts of family medicine stakeholders to address adolescent medicine competency gaps may positively impact the perceived competence reported by family medicine residents.
Objective To assess the Mayo-Portland Adaptability Inventory—version 4 (MPAI-4) and related measures' measurement properties and the quality of evidence supporting these results; and identify the interpretability and feasibility of the MPAI-4 and related measures. Data Sources We conducted a systematic review according to COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) guidelines. We searched 9 electronic databases and registries, and hand searched reference lists of included articles. Study Selection Two independent reviewers screened and selected all articles. From 605 retrieved articles, 48 were included. Data Extraction Two independent reviewers appraised the evidence quality and rated the extracted classical test theory and Rasch results from each study. Data Synthesis We used meta-analysis and COSMIN's approach to synthesize measurement properties evidence (insufficient, sufficient), and the modified Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to synthesize evidence quality (very low, low, moderate, high) by diagnosis (traumatic brain injury [TBI], stroke), and setting (inpatient, outpatient). The MPAI-4 and its subscales are sufficiently comprehensible (GRADE: very low), but there is currently no other content validity evidence (relevance, comprehensiveness). The MPAI-4 and its participation index (M2PI) have sufficient interrater reliability for stroke and TBI outpatients (GRADE: moderate), whereas interrater reliability between TBI inpatients and clinicians is currently insufficient (GRADE: moderate). There is no evidence for measurement error. For stroke and TBI outpatients, the MPAI-4 and M2PI have sufficient construct validity (GRADE: high) and responsiveness (GRADE: moderate-high). For TBI inpatients, the MPAI-4 and M2PI have mixed indeterminant/sufficient construct validity and responsiveness evidence (GRADE: moderate-high). There is 1 study with mixed insufficient/sufficient evidence for each MPAI-4 adaptation (21- and 22-item MPAI, 9-item M2PI) (GRADE: low-high). Conclusion Users can be most confident in using the MPAI-4 and M2PI in TBI and stroke outpatient settings. Future research is needed on reliability, measurement error, predictive validity, and content validity of the MPAI-4 and its related measures across populations and settings.
OBJECTIVE:We conducted a realist review to understand how (mechanism) and in what circumstances (context) evidence-based practices are sustained in rehabilitation (outcome). DATA SOURCES:MEDLINE, Embase, reference lists, and targeted websites. STUDY SELECTION:Two independent reviewers calibrated study selection; then 1 reviewer screened all titles and abstracts, while the second reviewer screened a random 20%. We repeated this process for full texts. We included 115 documents representing 61 implementation projects (8.9% of identified documents). Included documents described implementation projects in which physical therapists, occupational therapists, and/or speech-language pathologists were the target users of an evidence-based practice. DATA EXTRACTION:Two reviewers repeated the independent process described in study selection to extract basic study and sustainability characteristics as well as context, mechanism, outcome, and strategy text. DATA SYNTHESIS:Using basic numerical analyses, we found that only 54% of evidence-based practices in rehabilitation are sustained. Furthermore, while authors who reported sustainability planning sustained the practice 94% of the time, sustainability planning in rehabilitation is rare (only reported 26% of the time). Extracted text was synthesized using the realist technique of inductive and deductive retroduction in which context, mechanism, outcome, and strategy text are combined into narrative explanations of how sustainability works. To inform these explanations, we applied normalization process theory and the theory of planned behavior. Collectively, the 52 identified narratives provide evidence for 3 patterns: (1) implementation and sustainability phases are interconnected, (2) continued use of the evidence-based practice can be interpreted as the ultimate sustainability outcome, and (3) intermediate sustainability outcomes (ie, fit/alignment, financial support, benefits, expertise) can become contextual features influencing other sustainability outcomes. CONCLUSIONS:Implementation teams can use the narrative explanations generated in this review to optimize sustainability planning. This can sustain practice changes and improve quality of care and patient outcomes. Future research should seek to iteratively refine the proposed narrative explanations.
RATIONALE, AIMS AND OBJECTIVES:The Withdrawal Assessment Tool (WAT-1) is one of the most widely used clinician-reported outcome measures to evaluate iatrogenic withdrawal symptoms (IWS) in critically ill children. However, the WAT-1's measurement properties have not been aggregated. Aggregating psychometric research on the WAT-1 will enhance appropriate use, and outline gaps for future empirical research. The aim of this systematic review is to critically appraise, compare, and summarize the measurement properties and evidence quality, and describe the interpretability and feasibility of the WAT-1 for identifying IWS symptoms in critically ill children. METHODS:A systematic search of Medline, Embase and CINAHL was conducted from inception to 15 April 2020. Study inclusion/exclusion, data extraction, and measurement property evidence and the modified GRADE quality scoring were applied according to the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) guidelines. RESULTS:Six studies were included in the review. There was sufficient, high-quality evidence for reliability, structural validity, criterion validity, measurement error, construct validity, and feasibility. More information is required to support the WAT-1's content validity, responsiveness, internal consistency, cross-cultural validity, and interpretability according to COSMIN guidelines. CONCLUSION:The results of this review indicate that the WAT-1 is a precise, easy to use measure of IWS in critically ill children despite some measurement property inconsistencies and gaps in the publication record. More information is required to support its content validity, responsiveness, internal consistency, cross-cultural validity, and interpretability.
Medical EducationVolume 55, Issue 5 p. 647-647 REALLY GOOD STUFF: Lessons learned through innovation in medical education Introducing scientific paradigms: A primer for graduate students Rebecca Ataman, orcid.org/0000-0001-5419-5817 Search for more papers by this authorMarco Zaccagnini, orcid.org/0000-0002-9627-430X Search for more papers by this authorCatherine George, orcid.org/0000-0003-3167-1715 Search for more papers by this authorJacqueline Roberge-Dao, orcid.org/0000-0003-2691-7696 Search for more papers by this authorAliki Thomas, Corresponding Author aliki.thomas@mcgill.ca orcid.org/0000-0001-9807-6609 Correspondence Aliki Thomas, School of Physical and Occupational Therapy and Institute of Health Sciences Education, McGill University, Lady Meredith House 1110 Pine Avenue West, Montréal, QC H3A 1A3, Canada. Email: aliki.thomas@mcgill.caSearch for more papers by this author Rebecca Ataman, orcid.org/0000-0001-5419-5817 Search for more papers by this authorMarco Zaccagnini, orcid.org/0000-0002-9627-430X Search for more papers by this authorCatherine George, orcid.org/0000-0003-3167-1715 Search for more papers by this authorJacqueline Roberge-Dao, orcid.org/0000-0003-2691-7696 Search for more papers by this authorAliki Thomas, Corresponding Author aliki.thomas@mcgill.ca orcid.org/0000-0001-9807-6609 Correspondence Aliki Thomas, School of Physical and Occupational Therapy and Institute of Health Sciences Education, McGill University, Lady Meredith House 1110 Pine Avenue West, Montréal, QC H3A 1A3, Canada. Email: aliki.thomas@mcgill.caSearch for more papers by this author First published: 10 March 2021 https://doi.org/10.1111/medu.14497Read the full textAboutPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL Share a linkShare onEmailFacebookTwitterLinked InRedditWechat No abstract is available for this article. Volume55, Issue5May 2021Pages 647-647 RelatedInformation
In Canada, kinesiology academic units are undergoing change. The growth of kinesiology as a health profession is reflected in increased clinical course offerings to train student clinicians. These courses require clinical educators, however, not all programs have clinical staff and faculty with the required knowledge or experience. In particular, prospective clinical educators may lack fundamental knowledge of clinical reasoning theory. Clinical reasoning is defined as problem solving and judgment in relation to patient or client assessment, diagnosis, treatment and management, and is considered to be essential for the development of autonomous health professionals. Clinical reasoning theory is applied in an educational context to streamline and enhance student clinician development. Unlike in the education of other health professionals, there has been no literature detailing the application of clinical reasoning theory to the kinesiology educational context. Thus, the objectives of this paper are to: (1) introduce the theories in clinical reasoning relevant to kinesiology, (2) link these theories to practical educational strategies and, (3) connect these strategies directly to the teaching of clinical kinesiology subjects.
ABSTRACT Optimal delivery of health care service requires evidence-based practice by the professionals within their respective fields. Kinesiology recently became a regulated health profession in the Province of Ontario, drawing on principles of movement science in related areas of human clinical and performance disciplines to appropriately guide practice. However, with the addition of kinesiology to the class of regulated health professions, research that specifically guides service delivery and best practice policy is needed. A clear research agenda with identified priorities within the profession of kinesiology that is informed by current practitioners and stakeholders will enhance the discipline by ensuring clinical excellence and scientific relevance. A mixed methods Delphi study for consensus building was used, consisting of four rounds of participant engagement including baseline focus groups, online Delphi survey (two rounds), and final ranking of top research questions. In the final round, Kendall's W was used to determine agreement among participants on final questions. n = 67 participated in the focus groups, and n = 104, 102, 102 kinesiologists participated in rounds 2, 3, and 4, respectively. Two hundred and eighteen baseline research questions were identified from the focus groups, spanning three thematic areas: clinical skills, education/professional development, and contemporary issues/advocacy for professionals. Following the conclusion of the third round, 32 research questions achieved consensus of “significant importance.” The list of 32 questions was prioritized by respondents to identify the top 10 research questions for professional kinesiology, which reached statistical concordance ( W = 0.44, P < 0.001). This is the inaugural research agenda for registered kinesiologists. Consensus-based research priorities identified in this agenda should be considered when designing and allocating resources to professional kinesiology research.