Linguistic Analysis of Letters of Recommendation for Vascular Surgery and Obstetrics and Gynecology Applicants Detects Differences in Attributable Strengths Based on Gender

OBJECTIVE: We asked whether letters of recommendation (LOR) written for applicants to vascular surgery (VS), a field where men have traditionally predominated, differentially highlight attributes based on applicant gender. For comparison, LOR for applicants to Obstetrics and Gynecology (Ob/Gyn), a surgical field where women are highly represented were evaluated. DESIGN: We performed a cross-sectional review of LORs for students applying to VS or Ob/Gyn at our institution from 2017 to2018. Blinded to the gender of both the applicant and the letter author, investigators assessed word count per letter and used published rubrics to quantify how many words in the following categories: communal ("friendly"), able ("competent"), standout ("exceptional"), and grindstone ("hardworking"). Frequencies were reported as a function of specialty and gender. SETTING: The study was performed at the University of Pittsburgh Medical Center and included letters written for applicants only to the stated residency programs at University of Pittsburgh Medical Center. PARTICIPANTS: LOR written for self-identified women and men applying to both residencies from US-based allopathic medical schools were de-identified and evaluated by blinded reviewers. RESULTS: One hundred and ninety-eight letters were reviewed for vascular surgery applicants. Two hundred letters were randomly selected from applications to Ob/ Gyn as a comparison. Fifty-four vascular (27.8% women) and 63 Ob/Gyn (77.8% women) applicants were reviewed (p < 0.001 for gender). Licensing exam scores were higher for women than men applying to Ob/Gyn. Honor status was similar across fields and gender. Letters were shorter for VS applicants (p = 0.04). Gender-specific words (i.e., "lady" or "gentleman") were used more in VS letters (0.24 +/- 0.50 vs 0.14 +/- 0.42, p = 0.048). Ability words were more common (4.7 +/- 2.6 vs 3.8 +/- 2.1, p = 0.028) and grindstone adjectives were less common (3.4 +/- 2.3 vs 4.5 +/- 3.1, p = 0.024) in letters written for women compared to men VS applicants. Twentynine letters written for students applying to VS had honors status. While none written for women mentioned this achievement, 43% of those written for men did (p < 0.05). Letters for women applicants to Ob/Gyn contained more standout adjectives than those written for men (2.12 +/- 2.2 vs 1.39 +/- 1.25, p = 0.021). CONCLUSIONS: Reference letters for both specialties highlighted attributes differently depending on the gender of the applicant. Although this likely represents an unconscious process, care should be taken to limit potential biases in LOR which are "gatekeepers" to access and advancement. (C) 2021 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.