What does competently delivered neuropsychological assessment feedback look like? Development and validation of a competency evaluation tool

Objective: Neuropsychological assessment (NP) feedback helps patients and caregivers understand assessment results to maximise their utility and impact in everyday life. Yet feedback practices are inconsistent and there are no evidence-based guidelines for how feedback should be most effectively delivered. The aim of our study was to develop a psychometrically sound feedback competency checklist, the Psychology Competency Assessment Tool - Feedback (PsyCET-F), for use in research, training, and clinical settings. Method: The Delphi method of expert consensus was used to establish checklist items that clearly described competencies important for NP feedback. To examine the inter-rater reliability of the checklist, two experienced neuropsychologists rated the competencies demonstrated by trainee neuropsychologists across four feedback sessions. Results: After two Delphi rounds, consensus was reached on the 20-item checklist. Consensus was defined as at least 80% agreement amongst the panel of 20 experts. Four item categories resulted from the Delphi: (a) Opening the Session; (b) Applying Specific Feedback Techniques; (c) Engagement, Collaboration, and Alliance; and (d) Structuring and Ending the Session. Inter-rater reliability was moderate (kappa(W) = 0.79, p <.001, 80.52% agreement) when using a simple coding system, coded as Beginner, Intermediate, Competent, and Skilful; and strong (kappa(W) = 0.82, p <.001) when competency level was coded using an 8-point, detailed coding method. Conclusions: The PsyCET-F is psychometrically sound and fit-for-purpose for measuring competencies in giving NP feedback. It can be used in the training of clinicians to develop effective feedback skills. International benchmarking and usability testing will be conducted in a future study.