Objectives: The presence of a catheter required for contrast infusion during sialography obscures imaging of the distal duct. Static imaging via cone beam computed tomography and magnetic resonance sialography fails to address changes that occur dynamically to the anatomy of the flexible salivary ductal system. We aim to identify dynamic changes to the parotid gland by introducing a novel approach to analyze the full extent of Stensen’s duct based on dynamic infusion digital sialography. Methods: Retrospective chart review of a single-center consecutive series of 409 parotid sialograms performed between April 2008 and June 2023 permitted selection of a contemporary series including seven normal sialograms and seven sialograms with stricture(s). Dynamic (fluoroscopic) infusion (iopamidol/gadolinium) sialograms were assessed through blinded review by two radiologists employing the institution’s picture archiving and communication (PACS) system (©2023 Koninklijke Philips N.V., Amsterdam, Netherlands). Measurements determined changes, in two dimensions, to the angle of the masseteric bend and duct length while the catheter was in place (repose), during catheter withdrawal (stretch), and during recoil after withdrawal. Differences in median lengths and angles of Stensen’s duct between the three time points were compared using Wilcoxon matched-pairs signed rank and Mann–Whitney tests. Results: Fourteen patients [median age (IQR), 55 years (24.7); 10 women] were evaluated. The median angle of the masseteric bend was 117.7° in repose versus 155.4° during catheter withdrawal ( P < .001, n = 14). The median distance measured from the Stensen’s duct orifice to the first major ductal bifurcation was 81.5 mm (IQR = 12.3) in repose. The median percent increase in length from repose to stretch was 6.3% ( P < .001, n = 14). Conclusions: Dynamic infusion digital sialography with fluoroscopic recording during catheter removal permits assessment of the distal duct unobstructed by the presence of a catheter. The technique also identifies the dynamic nature and varying length and angulation of Stensen’s duct.
Radiation treatment of cancers like prostate or cervix cancer requires considering nearby bone structures like vertebrae. In this work, we present and validate a novel automated method for the 3D segmentation of individual lumbar and thoracic vertebra in computed tomography (CT) scans. It is based on a single, low-complexity convolutional neural network (CNN) architecture which works well even if little application-specific training data are available. It is based on volume patch-based processing, enabling the handling of arbitrary scan sizes. For each patch, it performs segmentation and an estimation of up to three vertebrae center locations in one step, which enables utilizing an advanced post-processing scheme to achieve high segmentation accuracy, as required for clinical use. Overall, 1763 vertebrae were used for the performance assessment. On 26 CT scans acquired for standard radiation treatment planning, a Dice coefficient of 0.921 ± 0.047 (mean ± standard deviation) and a signed distance error of 0.271 ± 0.748 mm was achieved. On the large-sized publicly available VerSe2020 data set with 129 CT scans depicting lumbar and thoracic vertebrae, the overall Dice coefficient was 0.940 ± 0.065 and the signed distance error was 0.109 ± 0.301 mm. A comparison to other methods that have been validated on VerSe data showed that our approach achieved a better overall segmentation performance.
Convolutional neural networks (CNNs) have a proven track record in medical image segmentation. Recently, Vision Transformers were introduced and are gaining popularity for many computer vision applications, including object detection, classification, and segmentation. Machine learning algorithms such as CNNs or Transformers are subject to an inductive bias, which can have a significant impact on the performance of machine learning models. This is especially relevant for medical image segmentation applications where limited training data are available, and a model’s inductive bias should help it to generalize well. In this work, we quantitatively assess the performance of two CNN-based networks (U-Net and U-Net-CBAM) and three popular Transformer-based segmentation network architectures (UNETR, TransBTS, and VT-UNet) in the context of HNC lesion segmentation in volumetric [F-18] fluorodeoxyglucose (FDG) PET scans. For performance assessment, 272 FDG PET-CT scans of a clinical trial (ACRIN 6685) were utilized, which includes a total of 650 lesions (primary: 272 and secondary: 378). The image data used are highly diverse and representative for clinical use. For performance analysis, several error metrics were utilized. The achieved Dice coefficient ranged from 0.833 to 0.809 with the best performance being achieved by CNN-based approaches. U-Net-CBAM, which utilizes spatial and channel attention, showed several advantages for smaller lesions compared to the standard U-Net. Furthermore, our results provide some insight regarding the image features relevant for this specific segmentation application. In addition, results highlight the need to utilize primary as well as secondary lesions to derive clinically relevant segmentation performance estimates avoiding biases.
For multicenter clinical studies, characterizing the robustness of image-derived radiomics features is essential. Features calculated on PET images have been shown to be very sensitive to image noise. The purpose of this work was to investigate the efficacy of a relatively simple harmonization strategy on feature robustness and agreement. A purpose-built texture pattern phantom was scanned on 10 different PET scanners in 7 institutions with various different image acquisition and reconstruction protocols. An image harmonization technique based on equalizing a contrast-to-noise ratio was employed to generate a "harmonized" alongside a "standard" dataset for a reproducibility study. In addition, a repeatability study was performed with images from a single PET scanner of variable image noise, varying the binning time of the reconstruction. Feature agreement was measured using the intraclass correlation coefficient (ICC). In the repeatability study, 81/93 features had a lower ICC on the images with the highest image noise as compared to the images with the lowest image noise. Using the harmonized dataset significantly improved the feature agreement for five of the six investigated feature classes over the standard dataset. For three feature classes, high feature agreement corresponded with higher sensitivity to the different patterns, suggesting a way to select suitable features for predictive models.
PURPOSE:The purpose of this work was to develop and validate a deep convolutional neural network (CNN) approach for the automated pelvis segmentation in computed tomography (CT) scans to enable the quantification of active pelvic bone marrow by means of Fluorothymidine F-18 (FLT) tracer uptake measurement in positron emission tomography (PET) scans. This quantification is a critical step in calculating bone marrow dose for radiopharmaceutical therapy clinical applications as well as external beam radiation doses. METHODS:An approach for the combined localization and segmentation of the pelvis in CT volumes of varying sizes, ranging from full-body to pelvis CT scans, was developed that utilizes a novel CNN architecture in combination with a random sampling strategy. The method was validated on 34 planning CT scans and 106 full-body FLT PET-CT scans using a cross-validation strategy. Specifically, two different training and CNN application options were studied, quantitatively assessed, and statistically compared. RESULTS:The proposed method was able to successfully locate and segment the pelvis in all test cases. On all data sets, an average Dice coefficient of 0.9396 ± $\pm$ 0.0182 or better was achieved. The relative tracer uptake measurement error ranged between 0.065% and 0.204%. The proposed approach is time-efficient and shows a reduction in runtime of up to 95% compared to a standard U-Net-based approach without a localization component. CONCLUSIONS:The proposed method enables the efficient calculation of FLT uptake in the pelvis. Thus, it represents a valuable tool to facilitate bone marrow preserving adaptive radiation therapy and radiopharmaceutical dose calculation. Furthermore, the method can be adapted to process other bone structures as well as organs.
: Rupture risk assessment is a key to devise patient-specific treatment plans of cerebral aneurysms. To understand and predict the development of aneurysms and other vascular diseases over time, both hemodynamic flow patterns and their effect on the vessel surface need to be analyzed. Flow structures close to the vessel wall often correlate directly with local changes in surface parameters, such as pressure or wall shear stress. However, especially for the identification of specific blood flow characteristics that cause local startling parameters on the vessel surface, like elevated pressure values, an interactive analysis tool is missing. In order to find meaningful structures in the entirety of the flow, the data has to be filtered based on the respective explorative aim. Thus, we present a combination of visualization, filtering and interaction techniques for explorative analysis of blood flow with a focus on the relation of local surface parameters and underlying flow structures. In combination with a filtering-based approach, we propose the usage of evolutionary algorithms to reduce the overhead of computing pathlines that do not contribute to the analysis, while simultaneously reducing the undersampling artifacts. We present clinical cases to demonstrate the benefits of both our filter-based and evolutionary approach and showcase its potential for patient-specific treatment plans.
Radiation therapy (RT), along with surgery and medical therapies, are the fundamental methods used to treat cancers, as well as a wide range of other diseases. RT is delivered in multiple forms, including external beam therapy, brachytherapy, and radiopharmaceutical therapy. RT is a completely image-guided treatment paradigm, and benefits from advances made in quantitative imaging (QI). The therapeutic effects of radiation are proven, and have improved with each advance, enabling more precisely delivered radiation dose to a tumor target and avoidance of normal tissues. Advances in QI enable improved target and normal tissue definitions, and advances in computer-based algorithmic tools enable enhanced consistency, efficiency, and depth in utilization of the rich information within QI. RT benefits from application of these enhanced tools to imaging to ultimately improve therapy.
Fractal biological structures are pervasive throughout the plant and animal kingdoms, with the mammalian lung being a quintessential example. The lung airway and vascular trees are generated during embryogenesis from a small set of building codes similar to Turing mechanisms that create robust trees ideally suited to their functions. Whereas the blood flow pattern generated by these fractal trees has been shown to be genetically determined, the geometry of the trees has not. We explored a newly established repository providing high-resolution bronchial trees from the four most commonly studied laboratory mice (B6C3F1, BALB/c, C57BL/6 and CD-1). The data fit a fractal model well for all animals with the fractal dimensions ranging from 1.54 to 1.67, indicating that the conducting airway of mice can be considered a self-similar and space-filling structure. We determined that the fractal dimensions of these airway trees differed by strain but not sex, reinforcing the concept that airway branching patterns are encoded within the DNA. The observations also highlight that future study design and interpretations may need to consider differences in airway geometry between mouse strains.NEW & NOTEWORTHY Similar to larger mammals such as humans, the geometries of the bronchial tree in mice are fractal structures that have repeating patterns from the trachea to the terminal branches. The airway geometries of the four most commonly studied mice are different and need to be considered when comparing results that employ different mouse strains. This variability in mouse airway geometries should be incorporated into computer models exploring toxicology and aerosol deposition in mouse models.
Medical imaging is utilized in a wide range of clinical applications. To enable a detailed quantitative analysis, medical images must often be segmented to label (delineate) structures of interest; for example, a tumor. Frequently, manual segmentation is utilized in clinical practice (e.g., in radiation oncology) to define such structures of interest. However, it can be quite time consuming and subject to substantial between-, and within-reader variability. A more reproducible, less variable, and more time efficient segmentation approach is likely to improve medical treatment. This potential has spurred the development of segmentation algorithms which harness computational power. Segmentation algorithms’ widespread use is limited due to difficulty in quantifying their performance relative to manual segmentation, which itself is subject to variation. This paper presents a statistical model which simultaneously estimates segmentation method accuracy, and between- and within-reader variability. The model is simultaneously fit for multiple segmentation methods within a unified Bayesian framework. The Bayesian model is compared to other methods used in literature via a simulation study, and application to head and neck cancer PET/CT data. The modeling framework is flexible and can be employed in numerous comparison applications. Several alternate applications are discussed in the paper.
Quantitative imaging biomarkers (QIBs) provide medical image–derived intensity, texture, shape, and size features that may help characterize cancerous tumors and predict clinical outcomes. Successful clinical translation of QIBs depends on the robustness of their measurements. Biomarkers derived from positron emission tomography images are prone to measurement errors owing to differences in image processing factors such as the tumor segmentation method used to define volumes of interest over which to calculate QIBs. We illustrate a new Bayesian statistical approach to characterize the robustness of QIBs to different processing factors. Study data consist of 22 QIBs measured on 47 head and neck tumors in 10 positron emission tomography/computed tomography scans segmented manually and with semiautomated methods used by 7 institutional members of the NCI Quantitative Imaging Network. QIB performance is estimated and compared across institutions with respect to measurement errors and power to recover statistical associations with clinical outcomes. Analysis findings summarize the performance impact of different segmentation methods used by Quantitative Imaging Network members. Robustness of some advanced biomarkers was found to be similar to conventional markers, such as maximum standardized uptake value. Such similarities support current pursuits to better characterize disease and predict outcomes by developing QIBs that use more imaging information and are robust to different processing factors. Nevertheless, to ensure reproducibility of QIB measurements and measures of association with clinical outcomes, errors owing to segmentation methods need to be reduced.
PURPOSE We summarize Quantitative Imaging Informatics for Cancer Research (QIICR; U24 CA180918), one of the first projects funded by the National Cancer Institute (NCI) Informatics Technology for Cancer Research program. METHODS QIICR was motivated by the 3 use cases from the NCI Quantitative Imaging Network. 3D Slicer was selected as the platform for implementation of open-source quantitative imaging (QI) tools. Digital Imaging and Communications in Medicine (DICOM) was chosen for standardization of QI analysis outputs. Support of improved integration with community repositories focused on The Cancer Imaging Archive (TCIA). Priorities included improved capabilities of the standard, toolkits and tools, reference datasets, collaborations, and training and outreach. RESULTS Fourteen new tools to support head and neck cancer, glioblastoma, and prostate cancer QI research were introduced and downloaded over 100,000 times. DICOM was amended, with over 40 correction proposals addressing QI needs. Reference implementations of the standard in a popular toolkit and standalone tools were introduced. Eight datasets exemplifying the application of the standard and tools were contributed. An open demonstration/connectathon was organized, attracting the participation of academic groups and commercial vendors. Integration of tools with TCIA was improved by implementing programmatic communication interface and by refining best practices for QI analysis results curation. CONCLUSION Tools, capabilities of the DICOM standard, and datasets we introduced found adoption and utility within the cancer imaging community. A collaborative approach is critical to addressing challenges in imaging informatics at the national and international levels. Numerous challenges remain in establishing and maintaining the infrastructure of analysis tools and standardized datasets for the imaging community. Ideas and technology developed by the QIICR project are contributing to the NCI Imaging Data Commons currently being developed.
To facilitate computational toxicology, we developed an approach for generating high-resolution lung-anatomy and particle-deposition mouse models. Major processing steps of our method include mouse preparation, serial block-face cryomicrotome imaging, and highly automated image analysis for generating three-dimensional (3D) mesh-based models and volume-based models of lung anatomy (airways, lobes, sublobes, and near-acini structures) that are linked to local particle-deposition measurements. Analysis resulted in 34 mouse models covering 4 different mouse strains (B6C3F1: 8, BALB/C: 11, C57Bl/6: 8, and CD-1: 7) as well as both sexes (16 male and 18 female) and different particle sizes [2 μm ( n = 15), 1 μm ( n = 16), and 0.5 μm ( n = 3)]. On average, resulting mouse airway models had 1,616.9 ± 298.1 segments, a centerline length of 597.6 ± 59.8 mm, and 1,968.9 ± 296.3 outlet regions. In addition to 3D geometric lung models, matching detailed relative particle-deposition measurements are provided. All data sets are available online in the lapdMouse archive for download. The presented approach enables linking relative particle deposition to anatomical structures like airways. This will in turn improve the understanding of site-specific airflows and how they affect drug, environmental, or biological aerosol deposition. NEW & NOTEWORTHY Computer simulations of particle deposition in mouse lungs play an important role in computational toxicology. Until now, a limiting factor was the lack of high-resolution mouse lung models and measured local particle-deposition information, which are required for developing accurate modeling approaches (e.g., computational fluid dynamics). With the developed imaging and analysis approach, we address this issue and provide all of the raw and processed data in a publicly accessible repository.
Introduction 18 F-fluorodeoxyglucose (FDG) positron emission tomography (PET) is now a standard diagnostic imaging test performed in patients with head and neck cancer for staging, re-staging, radiotherapy planning, and outcome assessment. Currently, quantitative analysis of FDG PET scans is limited to simple metrics like maximum standardized uptake value, metabolic tumor volume, or total lesion glycolysis, which have limited predictive value. The goal of this work was to assess the predictive potential of new (i.e., nonstandard) quantitative imaging features on head and neck cancer outcome. Methods This retrospective study analyzed fifty-eight pre- and post-treatment FDG PET scans of patients with head and neck squamous cell cancer to calculate five standard and seventeen new features at baseline and post-treatment. Cox survival regression was used to assess the predictive potential of each quantitative imaging feature on disease-free survival. Results Analysis showed that the post-treatment change of the average tracer uptake in the rim background region immediately adjacent to the tumor normalized by uptake in the liver represents a novel PET feature that is associated with disease-free survival (HR 1.95; 95% CI 1.27, 2.99) and has good discriminative performance (c index 0.791). Conclusion The reported findings define a promising new direction for quantitative imaging biomarker research in head and neck squamous cell cancer and highlight the potential role of new radiomics features in oncology decision making as part of precision medicine.
PurposeThe purpose of this work was to assess the potential of deep convolutional neural networks in automated measurement of cerebellum tracer uptake in F‐18 fluorodeoxyglucose (FDG) positron emission tomography (PET) scans.MethodsThree different three‐dimensional (3D) convolutional neural network architectures (U‐Net, V‐Net, and modified U‐Net) were implemented and compared regarding their performance in 3D cerebellum segmentation in FDG PET scans. For network training and testing, 134 PET scans with corresponding manual volumetric segmentations were utilized. For segmentation performance assessment, a fivefold cross‐validation was used, and the Dice coefficient as well as signed and unsigned distance errors were calculated. In addition, standardized uptake value (SUV) uptake measurement performance was assessed by means of a statistical comparison to an independent reference standard. Furthermore, a comparison to a previously reported active‐shape‐model‐based approach was performed.ResultsOut of the three convolutional neural networks investigated, the modified U‐Net showed significantly better segmentation performance. It achieved a Dice coefficient of 0.911 ± 0.026, a signed distance error of 0.220 ± 0.103 mm, and an unsigned distance error of 1.048 ± 0.340 mm. When compared to the independent reference standard, SUV uptake measurements produced with the modified U‐Net showed no significant error in slope and intercept. The estimated reduction in total SUV measurement error was 95.1%.ConclusionsThe presented work demonstrates the potential of deep convolutional neural networks in automated SUV measurement of reference regions. While it focuses on the cerebellum, utilized methods can be generalized to other reference regions like the liver or aortic arch. Future work will focus on combining lesion and reference region analysis into one approach.
BACKGROUND:In the era of precision oncology and publicly available datasets, the amount of information available for each patient case has dramatically increased. From clinical variables and PET-CT radiomics measures to DNA-variant and RNA expression profiles, such a wide variety of data presents a multitude of challenges. Large clinical datasets are subject to sparsely and/or inconsistently populated fields. Corresponding sequencing profiles can suffer from the problem of high-dimensionality, where making useful inferences can be difficult without correspondingly large numbers of instances. In this paper we report a novel deployment of machine learning techniques to handle data sparsity and high dimensionality, while evaluating potential biomarkers in the form of unsupervised transformations of RNA data. We apply preprocessing, MICE imputation, and sparse principal component analysis (SPCA) to improve the usability of more than 500 patient cases from the TCGA-HNSC dataset for enhancing future oncological decision support for Head and Neck Squamous Cell Carcinoma (HNSCC).RESULTS:Imputation was shown to improve prognostic ability of sparse clinical treatment variables. SPCA transformation of RNA expression variables reduced runtime for RNA-based models, though changes to classifier performance were not significant. Gene ontology enrichment analysis of gene sets associated with individual sparse principal components (SPCs) are also reported, showing that both high- and low-importance SPCs were associated with cell death pathways, though the high-importance gene sets were found to be associated with a wider variety of cancer-related biological processes.CONCLUSIONS:MICE imputation allowed us to impute missing values for clinically informative features, improving their overall importance for predicting two-year recurrence-free survival by incorporating variance from other clinical variables. Dimensionality reduction of RNA expression profiles via SPCA reduced both computation cost and model training/evaluation time without affecting classifier performance, allowing researchers to obtain experimental results much more quickly. SPCA simultaneously provided a convenient avenue for consideration of biological context via gene ontology enrichment analysis.
Radiomics is an image analysis approach for extracting large amounts of quantitative information from medical images using a variety of computational methods. Our goal was to evaluate the utility of radiomic feature analysis from 18F-fluorothymidine positron emission tomography (FLT PET) obtained at baseline in prediction of treatment response in patients with head and neck cancer. Thirty patients with advanced-stage oropharyngeal or laryngeal cancer, treated with definitive chemoradiation therapy, underwent FLT PET imaging before treatment. In total, 377 radiomic features of FLT uptake and feature variants were extracted from volumes of interest; these features variants were defined by either the primary tumor or the total lesion burden, which consisted of the primary tumor and all FLT-avid nodes. Feature variants included normalized measurements of uptake, which were calculated by dividing lesion uptake values by the mean uptake value in the bone marrow. Feature reduction was performed using clustering to remove redundancy, leaving 172 representative features. Effects of these features on progression-free survival were modeled with Cox regression and P-values corrected for multiple comparisons. In total, 9 features were considered significant. Our results suggest that smaller, more homogenous lesions at baseline were associated with better prognosis. In addition, features extracted from total lesion burden had a higher concordance index than primary tumor features for 8 of the 9 significant features. Furthermore, total lesion burden features showed lower interobserver variability.