
ABSTRACT Background Social determinants of health (SDH) significantly influence emergency department (ED) care and patient outcomes, yet experiential learning opportunities in SDH remain inconsistently integrated into clinical education. Prior work has been effective but resource intensive. We sought to explore an adapted SDH‐focused clinical experience that built on prior curricula and pre‐clerkship SDH instruction while minimizing additional non‐clinical resources. Methods We implemented a semi‐structured SDH‐focused experience within a required emergency medicine (EM) clerkship which sought to integrate prior knowledge from a pre‐clerkship SDH curriculum. In the ED, students partnered with care managers or social workers to identify patients affected by SDH, conducted patient interviews, and completed written reflections. De‐identified reflections from one academic year (2023–2024) were analyzed using an inductive thematic analysis approach. Two investigators independently coded an initial subset, developed a shared codebook, and applied iterative constant comparison to generate themes with investigator triangulation to enhance trustworthiness. Results Students described intersecting barriers to care, including language discordance, financial insecurity, and immigration‐related challenges. Reflections also linked these barriers to direct clinical consequences such as delays in care, limited follow‐up access, and patients leaving against medical advice. Students described how communication barriers and limited interpreter availability impacted care delivery and safety. Reflections also described structural inequities and the role of interdisciplinary teams in mitigating these challenges. Two additional themes, chronic illness and aging and health systems science, were interpreted as cross‐cutting factors that modified how SDH were experienced rather than as determinants themselves. Conclusions A semi‐structured, experiential SDH curriculum embedded within the ED clerkship elicited reflections in which students identified and interpreted real‐world barriers to care. These findings describe how students applied SDH concepts in the ED rather than demonstrating change attributable to the activity. This approach offers a feasible model for embedding SDH learning within existing clinical workflows.
ABSTRACT Medical training relies heavily on assessment. Although gathering validity evidence for assessments is critical, validity is often treated as a fixed property that a test either possesses or lacks. Building on earlier work by Cronbach and Meehl, Messick reshaped this model by proposing that validity belongs to the interpretation and uses of scores rather than to the instrument itself. He also challenged the traditional division of validity into separate types, proposing instead that content, criterion, and construct evidence represent complementary sources of evidence that together support a single, unified view of construct validity, in which theory connects a score to the construct it is meant to represent and the evidence supports a judgment about whether a score means what it is intended to mean. This Pedagogical Primer traces the origins of that view, the developments that followed, and how it now guides assessment in medical education and research. The framework was developed out of decades of debate in educational measurement and was later codified in the Standards for Educational and Psychological Testing, which describe five sources of validity evidence: content, response processes, internal structure, relationship to other variables, and the consequences of testing. Kane offered a complementary approach that lays out the chain of inferences within a validity argument, so that the evidence gathered matches the specific claims a score is being asked to support. The unified validity framework provides educators with a way to plan the evidence needed before using an assessment to make consequential decisions and gives researchers a standard for reporting validation work without overreaching conclusions. This framework requires significant and sustained effort. The amount of evidence needed should be proportional to the stakes of the decision, although there is no fixed rule for when sufficient evidence has been gathered. Despite this, Messick's unified validity framework remains a practical guide for building and defending the assessments on which training decisions rest.
ABSTRACT Background The current American College of Emergency Physicians (ACEP) guidelines recommend that trainees perform 25 ocular ultrasound scans before being considered competent. This threshold has not been substantiated for ocular ultrasound. The purpose of this study was to determine the number of ocular scans required to reach competency in ocular ultrasound using the learning curve cumulative sum (LC‐CUSUM) analysis. A secondary objective was to evaluate whether individualized learning curve feedback influences competency attainment. Methods Using the LC‐CUSUM method with an 85% success threshold, we assessed the number of scans needed to achieve competency in both image acquisition and interpretation among first‐year emergency medicine residents. For a secondary analysis, residents were then randomized into two groups: one receiving bimonthly personalized learning curve updates alongside standard feedback, and another receiving standard feedback alone. Competency attainment was compared between groups. Results Twenty‐six residents were included. LC‐CUSUM analysis determined that 21 studies were needed to reach competency. The median number of scans per resident was 26.5 (IQR: 22–30). At the end of the academic year, 17 residents (65%) reached technical competency, 10 residents (35%) reached interpretation competency, and 10 residents (35%) reached competency in both domains. Fifteen residents (58%) remained in the learning phase. There was no significant difference between competency attainment or perceived feedback in the randomized feedback groups. Conclusion LC‐CUSUM analysis suggests that competency in ocular ultrasound may be achieved after approximately 21 individual‐eye scans, or approximately 10.5 bilateral ocular exams, fewer than half the 25 bilateral examinations recommended by ACEP. Individualized learning curve feedback did not improve competency attainment or perceptions of feedback compared with standard feedback.