OBJECTIVE:To estimate and adjust for rater effects in operating room surgical skills assessment performed using a structured rating scale for nasal septoplasty. METHODS:We analyzed survey responses from attending surgeons (raters) who supervised residents and fellows (trainees) performing nasal septoplasty in a prospective cohort study. We fit a structural equation model with the rubric item scores regressed on a latent component of skill and then fit a second model including the rating surgeon as a random effect to model a rater-effects-adjusted latent surgical skill. We validated this model against conventional measures including the level of expertise and post-graduation year (PGY) commensurate with the trainee's performance, the actual PGY of the trainee, and whether the surgical goals were achieved. RESULTS:Our dataset included 188 assessments by 7 raters and 41 trainees. The model with one latent construct for surgical skill and the rater as a random effect was the best. Rubric scores depended on how severe or lenient the rater was, sometimes almost as much as they depended on trainee skill. Rater-adjusted latent skill scores increased with attending-estimated skill levels and PGY of trainees, increased with the actual PGY, and appeared constant over different levels of achievement of surgical goals. CONCLUSION:Our work provides a method to obtain rater effect adjusted surgical skill assessments in the operating room using structured rating scales. Our method allows for the creation of standardized (i.e., rater-effects-adjusted) quantitative surgical skill benchmarks using national-level databases on trainee assessments. LEVEL OF EVIDENCE:N/A Laryngoscope, 134:3548-3554, 2024.
Background: Surgeons must select cases whose complexity aligns with their skill set. Objectives: To determine how accurately trainees report involvement in procedures, judge case complexity, and assess their own skills. Methods: We recruited attendings and trainees from two otolaryngology departments. After performing septoplasty, they completed identical surveys regarding case complexity, achievement of goals, who performed which steps, and trainee skill using the septoplasty global assessment tool (SGAT) and visual analog scale (VAS). Agreement regarding which steps were performed by the trainee was assessed with Cohen's kappa coefficients (κ). Correlations between trainee and attending responses were measured with Spearman's correlation coefficients (rho). Results: Seven attendings and 42 trainees completed 181 paired surveys. Trainees and attendings sometimes disagreed about which steps were performed by trainees (range of κ = 0.743-0.846). Correlation between attending and trainee responses was low for VAS skill ratings (range of rho = 0.12-0.34), SGAT questions (range of rho = 0.03-0.53), and evaluation of case complexity (range of rho = 0.24-0.48). Conclusion: Trainees sometimes disagree with attendings about which septoplasty steps they perform and are limited in their ability to judge complexity, goals, and their skill.
IMPORTANCE:Daytime sleepiness in surgical trainees can impair intraoperative technical skill and thus affect their learning and pose a risk to patient safety. OBJECTIVE:To determine the association between daytime sleepiness of surgeons in residency and fellowship training and their intraoperative technical skill during septoplasty. DESIGN, SETTING, AND PARTICIPANTS:This prospective cohort study included 19 surgical trainees in otolaryngology-head and neck surgery programs at 2 academic institutions (Johns Hopkins University School of Medicine and MedStar Georgetown University Hospital). The physicians were recruited from June 13, 2016, to April 20, 2018. The analysis includes data that were captured between June 27, 2016, and April 20, 2018. MAIN OUTCOMES AND MEASURES:Attending physician and surgical trainee self-rated intraoperative technical skill using the Septoplasty Global Assessment Tool (SGAT) and visual analog scales. Daytime sleepiness reported by surgical trainees was measured using the Epworth Sleepiness Scale (ESS). RESULTS:Of 19 surgical trainees, 17 resident physicians (9 female [53%]) and 2 facial plastic surgery fellowship physicians (1 female and 1 male) performed a median of 3.00 septoplasty procedures (range, 1-9 procedures) under supervision by an attending physician. Of the 19 surgical trainees, 10 (53%) were aged 25 to 30 years and 9 (47%) were 31 years or older. The mean ESS score overall was 6.74 (95% CI, 5.96-7.52), and this score did not differ between female and male trainees. The mean ESS score was 7.57 (95% CI, 6.58-8.56) in trainees aged 25 to 30 years and 5.44 (95% CI, 4.32-6.57) in trainees aged 31 years or older. In regression models adjusted for sex, age, postgraduate year, and technical complexity of the procedure, there was a statistically significant inverse association between ESS scores and attending physician-rated technical skill for both SGAT (-0.41; 95% CI, -0.55 to -0.27; P < .001) and the visual analog scale (-0.75; 95% CI, -1.40 to -0.07; P = .03). The association between ESS scores and technical skill was not statistically significant for trainee self-rated SGAT (0.04; 95% CI, -0.17 to 0.24; P = .73) and the self-rated visual analog scale (0.19; 95% CI, -0.79 to 1.2; P = .70). CONCLUSIONS AND RELEVANCE:The findings suggest that daytime sleepiness of surgical trainees is inversely associated with attending physician-rated intraoperative technical skill when performing septoplasty. Thus, surgical trainees' ability to learn technical skill in the operating room may be influenced by their daytime sleepiness. LEVEL OF EVIDENCE:NA.
BACKGROUND The current study presents mature results from a Phase III randomized trial comparing radiation therapy and concurrent chemoradiotherapy in patients with resectable American Joint Committee on Cancer Stage III and IV disease. METHODS One hundred patients were randomized to receive either radiation therapy alone (Arm A) (at a dose of between 66–72 grays [Gy] at 1.8–2 Gy per day) and the identical radiation therapy with concurrent chemotherapy (Arm B) (5-fluorouracil, 1000 mg/m2/day, and cisplatin, 20 mg/m2/day, both given as continuous intravenous infusions over 4 days beginning on Days 1 and 22 of the radiation therapy). Primary site resection was planned for patients with residual or recurrent local disease. Cervical lymph node dissection was performed for regional persistent disease or recurrence, or if N2-3 disease was present at the time of presentation. RESULTS After completing all therapy including surgery, 82% of the patients in Arm A and 98% of the patients in Arm B had been rendered disease free (P = 0.02). At a median follow-up of 5 years (range, 3–8 years), the 5-year Kaplan–Meier projections for overall survival for Arm A versus Arm B were 48% versus 50% (P = 0.55). Kaplan–Meier projections for the recurrence free interval were 51% versus 62% (P = 0.04), projections for a distant metastasis free interval were 75% versus 84% (P = 0.09), projections for overall survival with primary site preservation were 34% versus 42% (P = 0.004), and projections for local control without surgical resection were 45% versus 77% (P < 0.001). Salvage surgery proved to be successful in 63% and 73%, respectively, of the Arm A and Arm B patients with primary site failure. Unrelated death while free of disease occurred in 22% and 32%, respectively, of Arm A and Arm B patients (P = 0.26). CONCLUSIONS The addition of concurrent chemotherapy to definitive radiation in patients with resectable Stage III and IV squamous cell carcinoma of the head and neck improves the likelihood of disease clearance, a recurrence free interval, and primary site preservation. However, overall survival does not appear to be improved, reflecting both effective surgical salvage after local recurrence and competing causes of death. Cancer 2000;88:876–83. © 2000 American Cancer Society.
BACKGROUNDVagal paragangliomas (VPs) arise from paraganglia associated with the vagus nerve. Approximately 200 cases have been reported in the medical literature. Because of their rarity, most information regarding these tumors has arisen from case reports and small clinical series.OBJECTIVETo detail the clinicopathologic features of 46 patients with VP with an emphasis on the role of a multidisciplinary skull base team in both the successful extirpation and rehabilitation.DESIGNRetrospective review of 46 patients with VP managed by a single skull base team.SETTINGAn academic tertiary medical center.RESULTSForty-six patients were treated over a 20-year period (1978-1998). Ten (22%) demonstrated intracranial extension. There was a history of familial paragangliomas in 9 (20%) of the patients. The incidence of multicentric paragangliomas was 78% in patients with familial paragangliomas vs 23% in patients with nonfamilial paragangliomas. Management of this group of 46 patients consisted of surgery (n = 40), radiation therapy (n = 4), and observation (n = 2). The operative approach consisted of a transcervical excision often combined with a transtemporal or lateral skull base approach as dictated by the tumor extent. Postoperative cranial nerve deficits were common, and, as such, aggressive rehabilitation was a vital component in the management of these tumors.CONCLUSIONSThe management of VP and its associated cranial nerve deficits remains a difficult clinical problem. Options for treatment include surgical resection, radiation therapy, and, in selected cases, observation. Surgical extirpation requires a multidisciplinary skull base team to achieve complete tumor resection. Radiation therapy is reserved for elderly patients and patients at risk for bilateral cranial nerve deficits. Rehabilitation of cranial nerve deficits is an integral part of the management of VP.
Vagal paragangliomas (VPs) arise from paraganglia associated with the vagus nerve. Approximately 200 cases have been reported in the medical literature. Because of their rarity, most information regarding these tumors has arisen from case reports and small clinical series.To detail the clinicopathologic features of 46 patients with VP with an emphasis on the role of a multidisciplinary skull base team in both the successful extirpation and rehabilitation.Retrospective review of 46 patients with VP managed by a single skull base team.An academic tertiary medical center.Forty-six patients were treated over a 20-year period (1978-1998). Ten (22%) demonstrated intracranial extension. There was a history of familial paragangliomas in 9 (20%) of the patients. The incidence of multicentric paragangliomas was 78% in patients with familial paragangliomas vs 23% in patients with nonfamilial paragangliomas. Management of this group of 46 patients consisted of surgery (n = 40), radiation therapy (n = 4), and observation (n = 2). The operative approach consisted of a transcervical excision often combined with a transtemporal or lateral skull base approach as dictated by the tumor extent. Postoperative cranial nerve deficits were common, and, as such, aggressive rehabilitation was a vital component in the management of these tumors.The management of VP and its associated cranial nerve deficits remains a difficult clinical problem. Options for treatment include surgical resection, radiation therapy, and, in selected cases, observation. Surgical extirpation requires a multidisciplinary skull base team to achieve complete tumor resection. Radiation therapy is reserved for elderly patients and patients at risk for bilateral cranial nerve deficits. Rehabilitation of cranial nerve deficits is an integral part of the management of VP.
Plasmacytomas are rare tumors that often appear in the head and neck region and are characterized by a monoclonal proliferation of plasma cells. On both clinical presentation and pathologic examination these tumors may be confused with more common tumors of the head and neck. The purpose of this article is to review our experience with these rare neoplasms, with emphasis on clinical, pathologic, and therapeutic features. On retrospective chart review, we identified 20 patients with the diagnosis of plasmacytoma of the head and neck region at the Cleveland Clinic Foundation between 1976 and 1993. Records were reviewed with regard to initial symptoms, location of the neoplasm, diagnostic evaluation, treatment modalities, and survival. Of the 20 cases we identified, the tumor arose in the sinonasal/nasopharyngeal region in 11 (55%). Two cases (10%) represented medullary plasmacytomas, arising in the clavicle and presenting as supraclavicular masses. The mean follow-up was 60.2 months (range 6 to 131 months). In 15 of the 20 cases, immunohistochemistry staining for immunoglobulin light chain production was conducted. One of the two cases (50%) classified as medullary plasmacytoma demonstrated conversion to multiple myeloma, whereas only 2 of 18 cases of extramedullary plasmacytoma (11%) converted to multiple myeloma. The primary modality of treatment was radiation therapy with typical doses of 4500 to 6000 cGy. Kaplan-Meier survival estimates demonstrated 95% survival at 1 year, 82% survival at 5 years, and 10-year estimated survival of 72%. Plasmacytomas of the head and neck region are rare and on initial evaluation must be distinguished from multiple myeloma. The diagnostic evaluation includes appropriate radiologic and pathologic studies including immunohistochemistry. Despite the typical presentation as a locally destructive tumor, plasmacytomas are highly radiosensitive, and 70% to 80% survival may be obtained with the use of radiotherapy. Patients with plasmacytomas require long-term follow-up to detect conversion to multiple myeloma.
OBJECTIVE:To determine the incidence of minor and major complications in patients with squamous cell carcinoma of the upper aerodigestive tract who require surgical salvage or planned neck dissection after an initial treatment regimen with radiotherapy or concurrent chemoradiotherapy for organ preservation.DESIGN:The medical records of 100 patients treated in a phase 3 trial comparing radiotherapy alone with concurrent chemoradiotherapy for stage III and IV head and neck squamous cell carcinoma were reviewed. Fifty-four patients underwent 59 surgical procedures. Twenty-nine planned neck dissections were performed for persistent neck disease or initial stage N2 or greater. For persistent or recurrent disease at the primary site, 30 salvage operations were performed.SETTING:Academic tertiary care referral center.RESULTS:Complications occurred in 15 (46%) of the 33 procedures in the radiation-only group and 12 (46%) of the 26 procedures in the chemoradiotherapy group. Major complications occurred in 4 (12%) of the procedures in the radiation-only group and 3 (12%) of the procedures in the chemoradiotherapy group. The incidence of minor complications was 33% and 35% in the radiation-only and chemoradiotherapy groups, respectively. The major complication rate for salvage operations did not differ between the radiation-only and chemoradiotherapy groups (16% and 27%, respectively; P=.79 by chi2 test). The incidence of major complications in planned neck dissections was 7% of the radiation-only group and 0% of the chemoradiotherapy group.CONCLUSIONS:After radiation or concurrent chemoradiotherapy, surgery can be performed with an acceptable rate of major complications. Adding chemotherapy did not increase the incidence of surgical complications. These results differ from other reports in the literature.
Background Treating the neck after organ-preservation treatment with radiotherapy or chemoradiotherapy can be problematic. Methods To develop management guidelines, we reviewed the results of a 100-patient phase-3 trial that had compared outcome after radiotherapy alone with outcome after chemoradiotherapy for head and neck cancer. Patients were randomly assigned to receive radiotherapy alone or concurrent chemoradiotherapy. After completing therapy, patients were reassessed, and surgery was recommended for persistent disease at the primary site or neck and for all patients with stage N2–3 neck nodes regardless of clinical response. Results Of the 47 patients with stage N0–1, 43 had a complete response (CR); of the 18 N1 patients, all but 4 had a CR. One of these 4, as well as 5 others among the N0–1 patients, underwent neck dissection (n = 6). No disease was found on pathologic examination, and no patient had neck recurrence. Of the remaining 41 N0–1 patients, 3 had disease progression and received no further therapy. Of the 38 others, 4 had neck recurrence, with 3 recurring at the primary site. Of the 53 with stage N2–3, 23 had less than a complete response (
OBJECTIVE:To identify factors predicting prosthesis use and final speech quality in patients undergoing secondary tracheoesophageal puncture (TEP) for voice restoration alter laryngectomy. METHODS:We undertook a retrospective study of 168 patients who underwent secondary TEP at the Cleveland Clinic between June 1980 and October 1993. Factors examined were: patient demographics, extent of initial surgery, method of pharyngeal preparation, history of irradiation, insufflation test results, pharyngeal stricture, and concurrent medical conditions. Univariate and multivariate statistical analyses were performed to identify predictive factors. RESULTS:At last evaluation, 73.8% (124) of the patients were still using the prosthesis. Quality of speech was the only predictor of prosthesis use (p < .001). Phonation on the first day was achieved in 90% (151) of patients. Speech result improved significantly over the first 6 months (p < .001). Univariate analysis found that the need for reconstruction at laryngectomy (p = .04), the presence of pharyngeal stricture (p = .001), and continued prosthetic use (p < .001) were associated with the speech result. There was no significant advantage to the lack of approximation of the pharyngeal constrictors (p = .31). Stepwise logistic regression showed that only the absence of pharyngeal stricture was associated with a better-quality voice (p = .001). CONCLUSION:Tracheoesophageal puncture is a reliable method for restoring voice after laryngectomy. Prosthesis use decreases with time, and good voice quality is the only predictor of continued prosthesis use. In this series the absence of pharyngeal stricture was the only significant predictor of good to excellent speech.
Arteriovenous malformations are uncommon vascular lesions of developmental origin characterized by abnormal communications between arteries and veins. Although present at birth, they usually become apparent during late infancy or childhood, grow proportionately with the child, and fail to regress. Imaging studies accurately define the location and extent and show the serpentine signal voids characteristic of these high-flow lesions. Arteriography reveals the nidus and the nature of collateral vascular structures and provides access for endovascular therapy. Because of the potential for severe intraoperative hemorrhage and cosmetic and functional deficits, treatment is problematic. Superselective embolization is important in obliterating the vascularity and is an important adjunct to complete surgical resection. Reconstructing the defects is challenging, and the use of tissue expansion and free tissue transfer promises to improve cosmetic and functional outcomes.
PURPOSE:To determine whether the use of fibrin glue has an impact on wound drainage created in an animal model.MATERIALS AND METHODS:Fibrin glue was prepared from single-donation autologous phlebotomy before surgery. Bilateral skin flaps were raised over the parotid gland in 10 rabbits. After exposure of the parotid, fibrin glue was applied on one side using an atomizer. The opposite side was treated with normal saline. Self-suction drains were placed under each flap and the wounds closed. Drainage was recorded daily for 7 days.RESULTS:Drainage differed significantly (P = .001) between the two sides on the first postoperative day and subsequent days. The average drainage on the fibrin-glue-treated side was 2.1 mL on the first day and 0.5 mL on subsequent days. On the nontreated side, the average output was 13.4 mL on the first day and 4.6 mL on subsequent days.CONCLUSIONS:This preliminary animal investigation showed that fibrin glue treatment decreased wound drainage. It is hoped that this concept may be applied to commonly performed head and neck procedures in which large flaps are elevated and large potential spaces are created. By decreasing the amount of drainage, fibrin glue has the potential to improve coaptation of flaps and minimize potential for seroma and hematoma formation. In some cases, the use of closed suction drains may be shortened and possibly eliminated, with shorter length of hospitalization.