Digital vs Conventional OSCE in Orthopedic Surgery: A Feasibility Cross-Sectional Study

OBJECTIVE Remote OSCEs (Objective Structured Clinical Examination) are an alternative evaluation method during pandemic periods but they have never been evaluated in orthopedic surgery. We aimed to evaluate whether remote OSCEs would be feasible, and efficient for assessment of undergraduate medical students. METHODS A cross-sectional study was performed. Thirty-four students were randomly assigned into 2 equal groups, either the conventional OSCE group or the digital OSCE group. Three types of skills were assessed: technical procedure, clinical examination, and radiographic analysis. Students were graded and they filled in a satisfaction questionnaire for both types of OSCEs. RESULTS The mean score, out of 20, was 14.3 ± 2.5 (range 9.3-19) for the digital sessions, versus 14.4 ± 2.3 (range 10-18.6) for conventional sessions (p = 0.81). Bland Altman Plot showed that 88% of students scored within agreement. The average global feedback was different for item repeatability, relevance, and OSCEs preference (p < 0.0001, p = 0.0001, and p < 0.0001 respectively). However, they did not report differences for the item concerning the organization (p = 0.2). CONCLUSION The results of this comparative study between digital and conventional OSCEs showed comparable distance learning scores between the 2 groups, whatever the skill assessed. However, the student's evaluation showed some reticence to conduct again OSCEs remotely.