Rethinking assessment in response to generative artificial intelligence

Medical EducationEarly View COMMENTARY Rethinking assessment in response to generative artificial intelligence Jacob Pearce, Corresponding Author Jacob Pearce [email protected] orcid.org/0000-0003-3081-9132 Tertiary Education, Australian Council for Educational Research, Camberwell, Victoria, Australia Correspondence Jacob Pearce, Tertiary Education, Australian Council for Educational Research, 19 Prospect Hill Road, Camberwell, Victoria 3124, Australia. Email: [email protected]Search for more papers by this authorNeville Chiavaroli, Neville Chiavaroli orcid.org/0000-0003-1488-9747 Tertiary Education, Australian Council for Educational Research, Camberwell, Victoria, AustraliaSearch for more papers by this author Jacob Pearce, Corresponding Author Jacob Pearce [email protected] orcid.org/0000-0003-3081-9132 Tertiary Education, Australian Council for Educational Research, Camberwell, Victoria, Australia Correspondence Jacob Pearce, Tertiary Education, Australian Council for Educational Research, 19 Prospect Hill Road, Camberwell, Victoria 3124, Australia. Email: [email protected]Search for more papers by this authorNeville Chiavaroli, Neville Chiavaroli orcid.org/0000-0003-1488-9747 Tertiary Education, Australian Council for Educational Research, Camberwell, Victoria, AustraliaSearch for more papers by this author First published: 12 April 2023 https://doi.org/10.1111/medu.15092Read the full textAboutPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL Share a linkShare onEmailFacebookTwitterLinkedInRedditWechat No abstract is available for this article. REFERENCES 1Sibbald M, Pugh D, Sherbino J, Morin M, Norman G, Monteiro S. Does allowing access to electronic differential diagnosis support threaten the reliability of a licensing exam? Med Ed. Forthcoming 2023. doi:10.1111/medu.15057 2Tseng V. Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLOS Digit Health. 2023; 2(2):e0000198. 3Singhal K, Azizi S, Tu T, et al. Large language models encode clinical knowledge [Internet]. arXiv; 2022 [cited 2023 Mar 9]. Available from: http://arxiv.org/abs/2212.13138 4Shelmerdine SC, Martin H, Shirodkar K, Shamshuddin S, Weir-McCall JR. Can artificial intelligence pass the fellowship of the Royal College of Radiologists examination multi-reader diagnostic accuracy study? BMJ. 2022; 379:e072826. 5Miller GE. The assessment of clinical skills/competence/performance. Acad Med. 1990; 65(suppl 9): S63-S67. doi:10.1097/00001888-199009000-00045 6Wiggins G, McTighe J. Understanding by Design. 2nd ed. Pearson Education; 2006. 7Davis MH, Karunathilake I. The place of the oral examination in today's assessment systems. Med Teach. 2005; 27(4): 294-297. doi:10.1080/01421590500126437 8Van der Vleuten C. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ. 1996; 1(1): 41-67. doi:10.1007/BF00596229 9Tekian A, Yudkowsky R. Oral examinations. In: SM Downing, R Yudkowsky, eds. Assessment in Health Professions Education. Routledge; 2009. 10Memon MA, Joughin GR, Memon B. Oral assessment and postgraduate medical examinations: establishing conditions for validity, reliability and fairness. Adv Health Sci Educ. 2010; 15(2): 277-289. doi:10.1007/s10459-008-9111-9 11Pearce J, Chiavaroli N. Prompting candidates in oral assessment contexts: a taxonomy and guiding principles. J Med Educ Curric Dev. 2020; 7:2382120520948881. doi:10.1177/2382120520948881 12Pylman S, Ward A. 12 tips for effective questioning in medical education. Med Teach. 2020; 42(12): 1330-1336. doi:10.1080/0142159X.2020.1749583 13Bearman M, Luckin R. Preparing university assessment for a world with AI: tasks for human intelligence. In: Re-imagining University Assessment in a Digital World. Springer; 2020: 49-63. Early ViewOnline Version of Record before inclusion in an issue ReferencesRelatedInformation