Validating the Virtual: a Deep Dive into Ultrasound Simulator Metrics in Otorhinolaryngology

This study aimed to assess the validity of simulation-based assessment of ultrasound skills for thyroid ultrasound. The study collected validity evidence for simulation-based ultrasound assessment of thyroid ultrasound skills. Experts (n = 8) and novices (n = 21) completed a test containing two tasks and four cases on a virtual reality ultrasound simulator (U/S Mentor's Neck Ultrasound Module). Validity evidence was collected and structured according to Messick’s validity framework. The assessments being evaluated included built-in simulator metrics and expert-based evaluations using the Objective Structured Assessment of Ultrasound Skills (OSAUS) scale. Out of 64 built-in simulator metrics, 9 (14.1