AUGMENTED INTELLIGENCE IS SUPERIOR TO ARTIFICIAL INTELLIGENCE! HUMAN-COMPUTER SYNERGY FOR GENERATING HIGH QUALITY GLIOBLASTOMA SUB-REGION SEGMENTATIONS

Abstract PURPOSE Artificial intelligence (AI) is poised to improve diagnostic methods in neuro-oncologic imaging and contribute to patient management by analyzing pre-operative MRI scans. AI results are better interpreted by compartmentalizing glioblastoma into distinct sub-regions, i.e., necrotic core, enhancing tumor, peritumoral T2/FLAIR signal abnormality (ED). Manual delineation of these sub-regions by expert neuroradiologists is impractical, requiring hours for intricate cases. Computer-aided segmentation (CAS) can mitigate this issue but is limited in the quality of the produced segmentations. We hypothesize that CAS followed by expert refinements is more practical/time-efficient. METHODS CAS was used on a total of 359 glioblastoma patients with four MRI sequences (T1, T1Gd, T2, T2-FLAIR) from each patient. All segmentations were sent to expert neuroradiologist annotators for manual refinements. Once refined, our team including two senior attending neuroradiologists with ≥13 years of experience each, reviewed and either approved or returned the segmentations to individual annotators for further refinements. Total time required to refine and review the finalized segmentations was measured. RESULTS Following one round of refinements by expert annotators, 244/359 (68%) segmentations were approved by our team while 115/359 (32%) segmentations contained a variety of errors that required a second round of refinements. The most common observed errors were 1) missed ED in the anterior/inferior temporal lobes and corpus callosum (37/115 cases, 32%) and 2) erroneous segmentation of normal choroid plexus and blood vessels (14/115 cases, 12%). The expert annotators required 120 hours to refine all 359 segmentations, and our team required 26 additional hours to review them, resulting in 24 minutes/segmentation following CAS. CONCLUSION Our findings support the value of a well-communicated annotation protocol to coordinate CAS and expert annotators. With CAS, our team and expert annotators rapidly finalized segmentations for 359 glioblastoma patients, demonstrating the value of a synergistic approach to creating high quality tumor sub-region segmentations.