Accurate assessment of left atrial fibrosis in patients with atrial fibrillation relies on high-quality 3D late gadolinium enhancement (LGE) MRI images. However, obtaining such images is challenging due to patient motion, changing breathing patterns, or sub-optimal choice of pulse sequence parameters. Automated assessment of LGE-MRI image diagnostic quality is clinically significant as it would enhance diagnostic accuracy, improve efficiency, ensure standardization, and contributes to better patient outcomes by providing reliable and high-quality LGE-MRI scans for fibrosis quantification and treatment planning. To address this, we propose a two-stage deep-learning approach for automated LGE-MRI image diagnostic quality assessment. The method includes a left atrium detector to focus on relevant regions and a deep network to evaluate diagnostic quality. We explore two training strategies, multi-task learning, and pretraining using contrastive learning, to overcome limited annotated data in medical imaging. Contrastive Learning result shows about 4%, and 9% improvement in F1-Score and Specificity compared to Multi-Task learning when there’s limited data.
Late gadolinium-enhanced (LGE) MRI has become a widely used technique to non-invasively image the left atrium prior to catheter ablation. However, LGE-MRI images are prone to variable image quality, with quality metrics that do not necessarily correlate to the image’s diagnostic quality. In this study, we aimed to define consistent clinically relevant metrics for image and diagnostic quality in 3D LGE-MRI images of the left atrium, have multiple observers assess LGE-MRI image quality to identify key features that measure quality and intra/inter-observer variabilities, and train and test a CNN to assess image quality automatically. We identified four image quality categories that impact fibrosis assessment in LGE-MRI images and trained individuals to score 50 consecutive pre-ablation atrial fibrillation LGE-MRI scans from the University of Utah hospital image database. The trained individuals then scored 146 additional scans, which were used to train a convolutional neural network (CNN) to assess diagnostic quality. There was excellent agreement among trained observers when scoring LGE-MRI scans, with inter-rater reliability scores ranging from 0.65 to 0.76 for each category. When the quality scores were converted to a binary diagnostic/non-diagnostic, the CNN achieved a sensitivity of 0.80 ± 0.06 and a specificity of 0.56 ± 0.10 . The use of a training document with reference examples helped raters achieve excellent agreement in their quality scores. The CNN gave a reasonably accurate classification of diagnostic or non-diagnostic 3D LGE-MRI images of the left atrium, despite the use of a relatively small training set.
The accurate evaluation of left atrial fibrosis via high-quality 3D Late Gadolinium Enhancement (LGE) MRI is crucial for atrial fibrillation management but is hindered by factors like patient movement and imaging variability. The pursuit of automated LGE MRI quality assessment is critical for enhancing diagnostic accuracy, standardizing evaluations, and improving patient outcomes. The deep learning models aimed at automating this process face significant challenges due to the scarcity of expert annotations, high computational costs, and the need to capture subtle diagnostic details in highly variable images. This study introduces HAMIL-QA, a multiple instance learning (MIL) framework, designed to overcome these obstacles. HAMIL-QA employs a hierarchical bag and sub-bag structure that allows for targeted analysis within sub-bags and aggregates insights at the volume level. This hierarchical MIL approach reduces reliance on extensive annotations, lessens computational load, and ensures clinically relevant quality predictions by focusing on diagnostically critical image features. Our experiments show that HAMIL-QA surpasses existing MIL methods and traditional supervised approaches in accuracy, AUROC, and F1-Score on an LGE MRI scan dataset, demonstrating its potential as a scalable solution for LGE MRI quality assessment automation. The code is available at: https://github.com/arf111/HAMIL-QA
Introduction: Shape of the left atrial appendage (LAA) has been proposed a predictor of stroke in patients with atrial fibrillation (AF). Prior literature employ qualitative assessments of LAA shape, which limits reproducibility. Statistical shape modeling is a quantitative method for assessment of shape. CT is increasingly utilized for identifying LAA thrombus prior to cardioversion in patients with AF. In this study we use particle based statistical shape modeling to quantify shape of the LAA, both independently and with the left atrium (LA), and evaluate if shape correlates with presence of LAA thrombus. Methods: We collected 132 cardiac CTs from consecutive studies of patients over 14 months obtained for evaluation of LAA thrombus prior to cardioversion. Of these, 16 patients were excluded. The LA and LAA were manually segmented independently from the systolic phase of the remaining 116 patients. Shape analysis was then performed using Shapeworks software (SCI, University of Utah) to compute shape parameters of the LAA in isolation as well as the LA and LAA in combination without controlling for scale or orientation. The shape parameters explaining the greatest shape variance were considered for the model until at least 80% of shape variance was included. A logistic regression model for prediction of LAA thrombus was created using these shape parameters with forward and backward stepwise model selection. Results: Of the 116 studies analyzed, 6 patients had thrombus in the LAA. Average shapes of the patients with and without thrombus differed in overall size as well as prominence of the LAA. Four shape parameters accounted for 81.2% of the LAA shape variance while six shape parameters accounted for 80.5% of the combined LA and LAA variance. The first shape parameter was predictive of LAA thrombus using both shape of the LAA only (p = 0.0258, AUC = 0.762), and when LAA shape was combined with LA shape in a joint model (p = 0.00511, AUC = 0.877). Conclusion: Statistical shape modeling of the LAA, with or without the LA, can be performed on CT image data, and demonstrates differences in shape of these structures between patients with and without LAA thrombus. Patients with LAA thrombus had a larger overall LAA size, LA size, and a more prominent LAA with distinctive morphology. Findings suggest that statistical shape modeling may offer a quantitative and reproducible approach for using LAA shape to assess stroke risk in patients with AF.
The pathomorphology of Legg–Calvé–Perthes disease (LCPD) is a key contributor to poor long-term outcomes such as hip pain, femoroacetabular impingement, and early-onset osteoarthritis. Plain radiographs, commonly used for research and in the clinic, cannot accurately represent the full extent of LCPD deformity. The purpose of this study was to develop and evaluate a methodological framework for three-dimensional (3D) statistical shape modeling (SSM) of the proximal femur in LCPD. We developed a framework consisting of three core steps: segmentation, surface mesh preparation, and particle-based correspondence. The framework aims to address challenges in modeling this rare condition, characterized by highly heterogeneous deformities across a wide age range and small sample sizes. We evaluated this framework by producing a SSM from clinical magnetic resonance images of 13 proximal femurs with LCPD deformity from 11 patients between the ages of six and 12 years. After removing differences in scale and pose, the dominant shape modes described morphological features characteristic of LCPD, including a broad and flat femoral head, high-riding greater trochanter, and reduced neck-shaft angle. The first four shape modes were chosen for the evaluation of the model’s performance, together describing 87.5
Patient-specific 3D vertebra models are essential for accurately assessing the spinal deformities quantitatively in 3D and for surgical planning, including determining the optimal implant size and 3D positioning. Calibrated biplanar X-rays serve as an alternative to CT scans to generate the 3D models in a weight-bearing standing position. This paper presents an intensity-based 3D/2D registration method for vertebra statistical shape model (VSSM), incorporating two key elements: the particle-based shape modeling and an image domain transfer for efficient image matching. In the 3D/3D setting, the VSSMs reach a surface reconstruction error of less than 0.5 mm. For 3D reconstruction from biplanar X-rays, the root mean square point-to-surface are 1.05mm for L1 to L4 vertebrae and 1.6mm for the L5 vertebra. The particle-based VSSMs offer a significant balance between the model compactness and the reconstruction error, which is advantageous for deformable 3D/2D registration.
Methods for statistically analyzing patient-specific data that vary both spatially and over time are currently either limited to summary statistics or require elaborate surface registration. We propose a new method, called correspondence-based network analysis, which leverages particle-based shape modeling to establish correspondence across a population and preserve patient-specific measurements and predictions through statistical analysis. Herein, we evaluated this method using three published datasets of the hip describing cortical bone thickness of the proximal femur, cartilage contact stress, and dynamic joint space between control and patient cohorts to evaluate activity- and group-based differences, as applicable, using traditional statistical parametric mapping (SPM) and our proposed spatially considerate correspondence-based network analysis approach. The network approach was insensitive to correspondence density, while the traditional application of SPM showed decreasing area of the region of significance with increasing correspondence density. In comparison to SPM, the network approach identified broader and more connected regions of significance for all three datasets. The correspondence-based network analysis approach identified differences between groups and activities without loss of subject and spatial specificity which could improve clinical interpretation of results.
Introduction: Statistical shape modeling (SSM) is a valuable and powerful tool to generate a detailed representation of complex anatomy that enables quantitative analysis of shapes and their variations. SSM applies mathematics, statistics, and computing to parse the shape into some quantitative representation (such as correspondence points or landmarks) which can be used to study the covariance patterns of the shapes and answer various questions about the anatomical variations across the population. Complex anatomical structures have many diverse parts with varying interactions or intricate architecture. For example, the heart is a four-chambered organ with several shared boundaries between chambers. Subtle shape changes within the shared boundaries of the heart can indicate potential pathologic changes such as right ventricular overload. Early detection and robust quantification could provide insight into ideal treatment techniques and intervention timing. However, existing SSM methods do not explicitly handle shared boundaries which aid in a better understanding of the anatomy of interest. If shared boundaries are not explicitly modeled, it restricts the capability of the shape model to identify the pathological shape changes occurring at the shared boundary. Hence, this paper presents a general and flexible data-driven approach for building statistical shape models of multi-organ anatomies with shared boundaries that explicitly model contact surfaces. Methods: This work focuses on particle-based shape modeling (PSM), a state-of-art SSM approach for building shape models by optimizing the position of correspondence particles. The proposed PSM strategy for handling shared boundaries entails (a) detecting and extracting the shared boundary surface and contour (outline of the surface mesh/isoline) of the meshes of the two organs, (b) followed by a formulation for a correspondence-based optimization algorithm to build a multi-organ anatomy statistical shape model that captures morphological and alignment changes of individual organs and their shared boundary surfaces throughout the population. Results: We demonstrate the shared boundary pipeline using a toy dataset of parameterized shapes and a clinical dataset of the biventricular heart models. The shared boundary model for the cardiac biventricular data achieves consistent parameterization of the shared surface (interventricular septum) and identifies the curvature of the interventricular septum as pathological shape differences.
Statistical Shape Modeling (SSM) is a quantitative method for analyzing morphological variations in anatomical structures. These analyses often necessitate building models on targeted anatomical regions of interest to focus on specific morphological features. We propose an extension to particle-based shape modeling (PSM), a widely used SSM framework, to allow shape modeling to arbitrary regions of interest. Existing methods to define regions of interest are computationally expensive and have topological limitations. To address these shortcomings, we use mesh fields to define free-form constraints, which allow for delimiting arbitrary regions of interest on shape surfaces. Furthermore, we add a quadratic penalty method to the model optimization to enable computationally efficient enforcement of any combination of cutting-plane and free-form constraints. We demonstrate the effectiveness of this method on a challenging synthetic dataset and two medical datasets.
Clinical investigations of anatomy's structural changes over time could greatly benefit from population-level quantification of shape, or spatiotemporal statistic shape modeling (SSM). Such a tool enables characterizing patient organ cycles or disease progression in relation to a cohort of interest. Constructing shape models requires establishing a quantitative shape representation (e.g., corresponding landmarks). Particle-based shape modeling (PSM) is a data-driven SSM approach that captures population-level shape variations by optimizing landmark placement. However, it assumes cross-sectional study designs and hence has limited statistical power in representing shape changes over time. Existing methods for modeling spatiotemporal or longitudinal shape changes require predefined shape atlases and pre-built shape models that are typically constructed cross-sectionally. This paper proposes a data-driven approach inspired by the PSM method to learn population-level spatiotemporal shape changes directly from shape data. We introduce a novel SSM optimization scheme that produces landmarks that are in correspondence both across the population (inter-subject) and across time-series (intra-subject). We apply the proposed method to 4D cardiac data from atrial-fibrillation patients and demonstrate its efficacy in representing the dynamic change of the left atrium. Furthermore, we show that our method outperforms an image-based approach for spatiotemporal SSM with respect to a generative time-series model, the Linear Dynamical System (LDS). LDS fit using a spatiotemporal shape model optimized via our approach provides better generalization and specificity, indicating it accurately captures the underlying time-dependency.
Statistical shape modeling is an indispensable tool in the quantitative analysis of anatomies. Particle-based shape modeling (PSM) is a state-of-the-art approach that enables the learning of population-level shape representation from medical imaging data (e.g., CT, MRI) and the associated 3D models of anatomy generated from them. PSM optimizes the placement of a dense set of landmarks (i.e., correspondence points) on a given shape cohort. PSM supports multi-organ modeling as a particular case of the conventional single-organ framework via a global statistical model, where multi-structure anatomy is considered as a single structure. However, global multi-organ models are not scalable for many organs, induce anatomical inconsistencies, and result in entangled shape statistics where modes of shape variation reflect both within- and between-organ variations. Hence, there is a need for an efficient modeling approach that can capture the inter-organ relations (i.e., pose variations) of the complex anatomy while simultaneously optimizing the morphological changes of each organ and capturing the population-level statistics. This paper leverages the PSM approach and proposes a new approach for correspondence-point optimization of multiple organs that overcomes these limitations. The central idea of multilevel component analysis, is that the shape statistics consists of two mutually orthogonal subspaces: the within-organ subspace and the between-organ subspace. We formulate the correspondence optimization objective using this generative model. We evaluate the proposed method using synthetic shape data and clinical data for articulated joint structures of the spine, foot and ankle, and hip joint.
Statistical shape modeling (SSM) is a valuable and powerful tool to generate a detailed representation of complex anatomy that enables quantitative analysis and the comparison of shapes and their variations. SSM applies mathematics, statistics, and computing to parse the shape into a quantitative representation (such as correspondence points or landmarks) that will help answer various questions about the anatomical variations across the population. Complex anatomical structures have many diverse parts with varying interactions or intricate architecture. For example, the heart is a four-chambered anatomy with several shared boundaries between chambers. Coordinated and efficient contraction of the chambers of the heart is necessary to adequately perfuse end organs throughout the body. Subtle shape changes within these shared boundaries of the heart can indicate potential pathological changes that lead to uncoordinated contraction and poor end-organ perfusion. Early detection and robust quantification could provide insight into ideal treatment techniques and intervention timing. However, existing SSM approaches fall short of explicitly modeling the statistics of shared boundaries. In this paper, we present a general and flexible data-driven approach for building statistical shape models of multi-organ anatomies with shared boundaries that captures morphological and alignment changes of individual anatomies and their shared boundary surfaces throughout the population. We demonstrate the effectiveness of the proposed methods using a biventricular heart dataset by developing shape models that consistently parameterize the cardiac biventricular structure and the interventricular septum (shared boundary surface) across the population data.
Numerous clinical investigations require understanding changes in anatomical shape over time, such as in dynamic organ cycle characterization or longitudinal analyses (e.g., for disease progression). Spatiotemporal statistical shape modeling (SSM) allows for quantifying and evaluating dynamic shape variation with respect to a cohort or population of interest. Existing data-driven SSM approaches leverage information theory to capture population-level shape variations by learning correspondence-based (landmark) representations of shapes directly from data using entropy-based optimization schemes. These approaches assume sample independence and thus are unsuitable for sequential dynamic shape observations. Previous methods for adapting entropy-based SSM optimization schemes for the spatiotemporal case either utilize a cross-sectional design (ignoring within-subject correlation) or impose other limiting assumptions, such as the linearity of shape dynamics. Here, we present a principled approach to spatiotemporal SSM that relaxes these assumptions to correctly capture population-level shape variation over time. We propose to incorporate modeling the underlying time dependency into correspondence optimization via a regularized principal component polynomial regression. This approach is flexible enough to capture non-linear temporal dynamics while encoding population-specific spatial regularity. We demonstrate our method’s efficacy on synthetic data and left atrium segmented from cardiac MRI scans. Our approach better captures the population modes of variation and a statistically significant time dependency than existing methods.
Introduction: Larger left atrial appendage (LAA) ostium area and greater left atrial (LA) volume have been associated with an increased risk of ischemic stroke. Catheter ablation (CA) of atrial fibrillation (AF) leads to morphological and functional changes within the LA and LAA, some of which are not well studied. Here, we present findings regarding post-ablation changes of the LAA ostia and correlate them with various LA, LAA and left ventricular (LV) functional and morphological metrics. Methods : This retrospective analysis included patients scheduled to undergo first-time radiofrequency CA for AF. Catheter ablation techniques included PVI with or without additional ablations. Cardiac magnetic resonance imaging (CMR) was used to assess LA, LAA and LV morphology and function, including LAA ostium area, LA/LAA volume and volume index, LA ejection fraction, LA strain, and LV ejection fraction. A Kruskal-Wallis test was used for correlating LAA ostial dimensions with other LA morphological and functional metrics. The t-test or two-sample Wilcoxon test were used to compare LA and LAA morphological parameters. Results : A total of 101 patients with AF were included in this study. The mean age was 60.1 ± 11.1 years, 69% were male, the average BMI was 29.22 ± 5.08. The LAA ostial area reduced significantly from 3.84 ± 1.15 cm before ablation to 3.42 ± 0.96 cm after ablation (p=0.0004). This reduction was asymmetrical, as the minor axis length decreased from 1.92 cm to 1.77 cm without significant changes in the major axis. LVEF increased from a pre-ablation average of 48.26% to a post-ablation average of 53.62% (p=0.015). Correlation of pre-ablation LVEF and LAA ostium area showed a near-significant negative trend (r=-0.21, p=0.083). LAEF correlated negatively with LAA ostial area (r=-0.289, p=0.0057), total LA strain (r=-0.248, p=0.0185), and passive LA strain (r=-0.208, p=0.049). Conclusion: There is a significant asymmetrical reduction of the LAA ostial area after AF ablation that is independent of LVEF changes. Larger LAA ostial area was associated with lower LAEF and LA strain. Remodeling of the LAA after AF ablation may help account for reduced risk of stroke and increased cardiac function.