X-ray dark-field radiography provides complementary diagnostic information to conventional attenuation imaging by visualizing microstructural tissue changes through small-angle scattering. However, the limited availability of such data poses challenges for developing robust deep learning models. In this work, we present the first framework for generating dark-field images directly from standard attenuation chest X-rays using an Uncertainty-Guided Progressive Generative Adversarial Network. The model incorporates both aleatoric and epistemic uncertainty to improve interpretability and reliability. Experiments demonstrate high structural fidelity of the generated images, with consistent improvement of quantitative metrics across stages. Furthermore, out-of-distribution evaluation confirms that the proposed model generalizes well. Our results indicate that uncertainty-guided generative modeling enables realistic dark-field image synthesis and provides a reliable foundation for future clinical applications.
Propagation-based X-ray phase-contrast imaging (PBI) enables high-contrast visualization of lung structures and holds strong medical potential. However, safe translation to the clinic will require a substantial radiation dose reduction, which inevitably increases image noise. Supervised convolutional-neural-network-based denoising can restore image quality but depends on paired low- and high-dose datasets, which are rarely available in practice. Self-supervised methods avoid this limitation, yet most are not well adapted to the inverse problem of PBI computed tomography (CT). We introduce Neighbor2Inverse, a self-supervised denoising framework designed for low-dose PBI-CT that generalizes to clinical CT. Building on the Neighbor2Neighbor principle, each noisy projection is subsampled into two variants that preserve structural information but contain independent noise realizations. These are reconstructed separately, and the resulting pairs are used to train a denoising network directly in the image domain. We benchmark the proposed method against established analytical and self-supervised denoising approaches. In region-of-interest PBI CT experiments, Neighbor2Inverse achieves superior noise suppression while preserving fine structural details, as demonstrated by improved contrast-to-noise ratio, spatial resolution, and composite image quality metrics. Competitive performance is also observed on clinical CT data under simulated low-dose conditions. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Code, data, and interactive figures are available at https://github.com/J-3TO/Neighbor2Inverse.
Grating interferometry is a promising diagnostic technique that enables simultaneous acquisition of three complementary, synergistic X-ray images: transmission, differential phase, and dark-field. Its key advantage over other setups is its ability to use large pixels and, hence, large-area detectors, as well as its compatibility with low-coherence, compact X-ray sources, both of which are key factors for human-scale imaging. It has already demonstrated strong potential for chest imaging applications, including the diagnosis of pulmonary emphysema, fibrosis, and cancer. To retrieve transmission, differential phase, and dark-field images from data, an algorithm is required to separate the distinct mechanisms contributing to measured contrast. Since its realization, this image-retrieval step has remained fundamentally unchanged. In this work, we develop a novel transmission- and dark-field retrieval algorithm for grating-interferometry derived from the X-ray Fokker-Planck equation. To demonstrate and validate our Fokker-Planck algorithm, we apply it to experimental measurements of a test sample and to data from a mouse chest acquired with varying exposure times and added Poisson noise. The retrieved images were qualitatively and quantitatively compared with those retrieved using a conventional sinusoidal-fitting approach. Across both samples, the Fokker–Planck method produced images consistent with conventional retrieval, with a comparable signal-to-noise ratio. Notably, our Fokker-Planck method suppresses artefacts arising in the conventional approach under grating perturbations (e.g., structural defects like scratches) and reduced flux or visibility, yielding smoother and more reproducible images. Additionally, we demonstrate that our Fokker-Planck method has an advantage over the conventional dark-field retrieval method for fast sample imaging with short exposure times and high noise.
This retrospective study evaluates U-Net-based artifact reduction for dose-reduced sparse-sampling CT (SpSCT) in terms of image quality and diagnostic performance using a reader study and automated detection. CT pulmonary angiograms from 89 patients were used to generate SpSCT data with 16 to 512 views. Twenty patients were reserved for a reader study and test set, the remaining 69 were used to train (53) and validate (16) a dual-frame U-Net for artifact reduction. U-Net post-processed images were assessed for image quality, diagnostic performance, and automated pulmonary embolism (PE) detection using the top-performing network from the 2020 RSNA PE detection challenge. Statistical comparisons were made using two-sided Wilcoxon signed-rank and DeLong two-sided tests. Post-processing with the dual-frame U-Net significantly improved image quality in the internal test set, with a structural similarity index of 0.634/0.378/0.234/0.152 for FBP and 0.894/0.892/0.866/0.778 for U-Net at 128/64/32/16 views, respectively. The reader study showed significantly enhanced image quality (3.15 vs. 3.53 for 256 views, 0.00 vs. 2.52 for 32 views), increased diagnostic confidence (0.00 vs. 2.38 for 32 views), and fewer artifacts across all subsets (P < 0.05). Diagnostic performance, measured by the Sørensen–Dice coefficient, was significantly better for 64- and 32-view images (0.23 vs. 0.44 and 0.00 vs. 0.09, P < 0.05). Automated PE detection was better at fewer views (64 views: 0.77 vs. 0.80, 16 views: 0.59 vs. 0.80), although the differences were not statistically significant. U-Net-based post-processing of SpSCT data significantly enhances image quality and diagnostic performance, supporting substantial dose reduction in CT pulmonary angiography.
This study aims to investigate the effect of various beam geometries and dimensions of input data on the sparse-sampling streak artifact correction task with U-Nets for clinical CT scans as a means of incorporating the volumetric context into artifact reduction tasks to improve model performance. A total of 22 subjects were retrospectively selected (01.2016-12.2018) from the Technical University of Munich's research hospital, TUM Klinikum rechts der Isar. Sparsely-sampled CT volumes were simulated with the Astra toolbox for parallel, fan, and cone beam geometries. 2048 views were taken as full-view scans. 2D and 3D U-Nets were trained and validated on 14, and tested on 8 subjects, respectively. For the dimensionality study, in addition to the 512x512 2D CT images, the CT scans were further pre-processed to generate a so-called '2.5D', and 3D data: Each CT volume was divided into 64x64x64 voxel blocks. The 3D data refers to individual 64-voxel blocks. An axial, coronal, and sagittal cut through the center of each block resulted in three 64x64 2D patches that were rearranged as a single 64x64x3 image, proposed as 2.5D data. Model performance was assessed with the mean squared error (MSE) and structural similarity index measure (SSIM). For all geometries, the 2D U-Net trained on axial 2D slices results in the best MSE and SSIM values, outperforming the 2.5D and 3D input data dimensions.
Purpose To estimate the total lung volume (TLV) from real and synthetic frontal chest radiographs on a pixel level using lung thickness maps generated by a U-Net deep learning model. Materials and Methods This retrospective study included 5959 chest CT scans from two public datasets, the Lung Nodule Analysis 2016 (Luna16) (n = 656) and the Radiological Society of North America Pulmonary Embolism Detection Challenge 2020 (n = 5303). Additionally, 72 participants were selected from the Klinikum Rechts der Isar dataset (October 2018 through December 2019), each with a corresponding chest radiograph obtained within 7 days. Synthetic radiographs and lung thickness maps were generated using forward projection of CT scans and their lung segmentations. A U-Net model was trained on synthetic radiographs to predict lung thickness maps and estimate TLV. Model performance was assessed using mean squared error (MSE), Pearson correlation coefficient, and two-sided Student t distribution. Results The study included 72 participants (45 male and 27 female participants; 33 healthy participants: mean age, 62 years [range, 34-80 years]; 39 with chronic obstructive pulmonary disease: mean age, 69 years [range, 47-91 years]). TLV predictions showed low error rates (MSEPublic-Synthetic, 0.16 L2; MSEKRI-Synthetic, 0.20 L2; MSEKRI-Real, 0.35 L2) and strong correlations with CT-derived reference standard TLV (nPublic-Synthetic, 1191; r = 0.99; P < .001) (nKRI-Synthetic, 72; r = 0.97; P < .001) (nKRI-Real, 72; r = 0.91; P < .001). When evaluated on different datasets, the U-Net model achieved the highest performance for TLV estimation on the Luna16 test dataset, with the lowest MSE (0.09 L2) and strongest correlation (r = 0.99; P < .001) compared with CT-derived TLV. Conclusion The U-Net-generated pixel-level lung thickness maps successfully estimated TLV for both synthetic and real radiographs. Keywords: Frontal Chest Radiographs, Lung Thickness Map, Pixel-Level, Total Lung Volume, U-Net Supplemental material is available for this article. © RSNA, 2025.
X-ray phase-contrast imaging utilizes wave-optical effects to generate image contrast, complementing traditional X-ray attenuation. This has proven particularly interesting for investigating biological samples with tissues that would otherwise produce weak attenuation contrast. Amongst the available techniques, grating-based imaging and propagation-based imaging stand out as two of the most promising methods to advance medical imaging and microscopy, respectively. In propagation-based imaging, approximating the object as a single material enables single-shot imaging with substantially reduced noise levels and enhanced image quality. Building on the success of the single-material approximation in propagation-based imaging, this study explores its potential application in grating-based imaging. We derive a physics-based model that directly integrates the single-material approximation into signal processing. Applying this approach to experimental data demonstrates its ability to reduce noise in the resulting composite image. Comparing our results with those from a single-material-based post-processing method reveals comparable outcomes, further validating the applicability of the single-material approximation in grating-based imaging.
Undersampled CT volumes minimize acquisition time and radiation exposure but introduce artifacts degrading image quality and diagnostic utility. Reducing these artifacts is critical for high-quality imaging. We propose a computationally efficient hybrid deep-learning framework that combines the strengths of 2D and 3D models. First, a 2D U-Net operates on individual slices of undersampled CT volumes to extract feature maps. These slice-wise feature maps are then stacked across the volume and used as input to a 3D decoder, which utilizes contextual information across slices to predict an artifact-free 3D CT volume. The proposed two-stage approach balances the computational efficiency of 2D processing with the volumetric consistency provided by 3D modeling. The results show substantial improvements in inter-slice consistency in coronal and sagittal direction with low computational overhead. This hybrid framework presents a robust and efficient solution for high-quality 3D CT image post-processing. The code of this project can be found on github: https://github.com/J-3TO/2D-3DCNN_sparseview/.
We aim to optimize the binary detection of Chronic Obstructive Pulmonary Disease (COPD) based on emphysema presence in the lung with convolutional neural networks (CNN) by exploring manually adjusted versus automated window-setting optimization (WSO) on computed tomography (CT) images. 7194 contrast-enhanced CT images (3597 with COPD; 3597 healthy controls) from 78 subjects were selected retrospectively (01.2018–12.2021) and preprocessed. For each image, intensity values were manually clipped to the emphysema window setting and a baseline ‘full-range’ window setting. Class-balanced train, validation, and test sets contained 3392, 1114, and 2688 images. The network backbone was optimized by comparing various CNN architectures. Furthermore, automated WSO was implemented by adding a customized layer to the model. The image-level area under the Receiver Operating Characteristics curve (AUC) [lower, upper limit 95% confidence] was utilized to compare model variations. Repeated inference (n = 7) on the test set showed that the DenseNet was the most efficient backbone and achieved a mean AUC of 0.80 [0.76, 0.85] without WSO. Comparably, with input images manually adjusted to the emphysema window, the DenseNet model predicted COPD with a mean AUC of 0.86 [0.82, 0.89]. By adding a customized WSO layer to the DenseNet, an optimal window in the proximity of the emphysema window setting was learned automatically, and a mean AUC of 0.82 [0.78, 0.86] was achieved. Detection of COPD with DenseNet models was improved by WSO of CT data to the emphysema window setting range.
BACKGROUND:Computed tomography (CT) relies on the attenuation of x-rays, and is, hence, of limited use for weakly attenuating organs of the body, such as the lung. X-ray dark-field (DF) imaging is a recently developed technology that utilizes x-ray optical gratings to enable small-angle scattering as an alternative contrast mechanism. The DF signal provides structural information about the micromorphology of an object, complementary to the conventional attenuation signal. A first human-scale x-ray DF CT has been developed by our group. Despite specialized processing algorithms, reconstructed images remain affected by streaking artifacts, which often hinder image interpretation. In recent years, convolutional neural networks have gained popularity in the field of CT reconstruction, amongst others for streak artefact removal. PURPOSE:Reducing streak artifacts is essential for the optimization of image quality in DF CT, and artefact free images are a prerequisite for potential future clinical application. The purpose of this paper is to demonstrate the feasibility of CNN post-processing for artefact reduction in x-ray DF CT and how multi-rotation scans can serve as a pathway for training data. METHODS:We employed a supervised deep-learning approach using a three-dimensional dual-frame UNet in order to remove streak artifacts. Required training data were obtained from the experimental x-ray DF CT prototype at our institute. Two different operating modes were used to generate input and corresponding ground truth data sets. Clinically relevant scans at dose-compatible radiation levels were used as input data, and extended scans with substantially fewer artifacts were used as ground truth data. The latter is neither dose-, nor time-compatible and, therefore, unfeasible for clinical imaging of patients. RESULTS:The trained CNN was able to greatly reduce streak artifacts in DF CT images. The network was tested against images with entirely different, previously unseen image characteristics. In all cases, CNN processing substantially increased the image quality, which was quantitatively confirmed by increased image quality metrics. Fine details are preserved during processing, despite the output images appearing smoother than the ground truth images. CONCLUSIONS:Our results showcase the potential of a neural network to reduce streak artifacts in x-ray DF CT. The image quality is successfully enhanced in dose-compatible x-ray DF CT, which plays an essential role for the adoption of x-ray DF CT into modern clinical radiology.
Abstract Background We aimed to improve the image quality (IQ) of sparse-view computed tomography (CT) images using a U-Net for lung metastasis detection and determine the best tradeoff between number of views, IQ, and diagnostic confidence. Methods CT images from 41 subjects aged 62.8 ± 10.6 years (mean ± standard deviation, 23 men), 34 with lung metastasis, 7 healthy, were retrospectively selected (2016–2018) and forward projected onto 2,048-view sinograms. Six corresponding sparse-view CT data subsets at varying levels of undersampling were reconstructed from sinograms using filtered backprojection with 16, 32, 64, 128, 256, and 512 views. A dual-frame U-Net was trained and evaluated for each subsampling level on 8,658 images from 22 diseased subjects. A representative image per scan was selected from 19 subjects (12 diseased, 7 healthy) for a single-blinded multireader study. These slices, for all levels of subsampling, with and without U-Net postprocessing, were presented to three readers. IQ and diagnostic confidence were ranked using predefined scales. Subjective nodule segmentation was evaluated using sensitivity and Dice similarity coefficient (DSC); clustered Wilcoxon signed-rank test was used. Results The 64-projection sparse-view images resulted in 0.89 sensitivity and 0.81 DSC, while their counterparts, postprocessed with the U-Net, had improved metrics (0.94 sensitivity and 0.85 DSC) (p = 0.400). Fewer views led to insufficient IQ for diagnosis. For increased views, no substantial discrepancies were noted between sparse-view and postprocessed images. Conclusions Projection views can be reduced from 2,048 to 64 while maintaining IQ and the confidence of the radiologists on a satisfactory level. Relevance statement Our reader study demonstrates the benefit of U-Net postprocessing for regular CT screenings of patients with lung metastasis to increase the IQ and diagnostic confidence while reducing the dose. Key points • Sparse-projection-view streak artifacts reduce the quality and usability of sparse-view CT images. • U-Net-based postprocessing removes sparse-view artifacts while maintaining diagnostically accurate IQ. • Postprocessed sparse-view CTs drastically increase radiologists’ confidence in diagnosing lung metastasis. Graphical Abstract
Purpose To explore the potential benefits of deep learning-based artifact reduction in sparse-view cranial CT scans and its impact on automated hemorrhage detection. Materials and Methods In this retrospective study, a U-Net was trained for artifact reduction on simulated sparse-view cranial CT scans in 3000 patients, obtained from a public dataset and reconstructed with varying sparse-view levels. Additionally, EfficientNet-B2 was trained on full-view CT data from 17 545 patients for automated hemorrhage detection. Detection performance was evaluated using the area under the receiver operating characteristic curve (AUC), with differences assessed using the DeLong test, along with confusion matrices. A total variation (TV) postprocessing approach, commonly applied to sparse-view CT, served as the basis for comparison. A Bonferroni-corrected significance level of .001/6 = .00017 was used to accommodate for multiple hypotheses testing. Results Images with U-Net postprocessing were better than unprocessed and TV-processed images with respect to image quality and automated hemorrhage detection. With U-Net postprocessing, the number of views could be reduced from 4096 (AUC: 0.97 [95% CI: 0.97, 0.98]) to 512 (0.97 [95% CI: 0.97, 0.98], P < .00017) and to 256 views (0.97 [95% CI: 0.96, 0.97], P < .00017) with a minimal decrease in hemorrhage detection performance. This was accompanied by mean structural similarity index measure increases of 0.0210 (95% CI: 0.0210, 0.0211) and 0.0560 (95% CI: 0.0559, 0.0560) relative to unprocessed images. Conclusion U-Net-based artifact reduction substantially enhanced automated hemorrhage detection in sparse-view cranial CT scans. Keywords: CT, Head/Neck, Hemorrhage, Diagnosis, Supervised Learning Supplemental material is available for this article. © RSNA, 2024.
Background Many clinically relevant fractures are occult on conventional radiographs and therefore challenging to diagnose reliably. X-ray dark-field radiography is a developing method that uses x-ray scattering as an additional signal source. Purpose To investigate whether x-ray dark-field radiography enhances the depiction of radiographically occult fractures in an experimental model compared with attenuation-based radiography alone and whether the directional dependence of dark-field signal impacts observer ratings. Materials and Methods Four porcine loin ribs had nondisplaced fractures experimentally introduced. Microstructural changes were visually verified using high-spatial-resolution three-dimensional micro-CT. X-ray dark-field radiographs were obtained before and after fracture, with the before-fracture scans serving as control images. The presence of a fracture was scored by three observers using a six-point scale (6, surely; 5, very likely; 4, likely; 3, unlikely; 2, very unlikely; and 1, certainly not). Differences between scores based on attenuation radiographs alone (n = 96) and based on combined attenuation and dark-field radiographs (n = 96) were evaluated by using the DeLong method to compare areas under the receiver operating characteristic curve. The impact of the dark-field signal directional sensitivity on observer ratings was evaluated using the Wilcoxon test. The dark-field data were split into four groups (24 images per group) according to their sensitivity orientation and tested against each other. Musculoskeletal dark-field radiography was further demonstrated on human finger and foot specimens. Results The addition of dark-field radiographs was found to increase the area under the receiver operating characteristic curve to 1 compared with an area under the receiver operating characteristic curve of 0.87 (95% CI: 0.80, 0.94) using attenuation-based radiographs alone (P < .001). There were similar observer ratings for the four different dark-field sensitivity orientations (P = .16-.65 between the groups). Conclusion These results suggested that the inclusion of dark-field radiography has the potential to help enhance the detection of nondisplaced fractures compared with attenuation-based radiography alone. © RSNA, 2024 See also the editorial by Rubin in this issue.
Purpose: Sparse-view computed tomography (CT) is an effective way to reduce dose by lowering the total number of views acquired, albeit at the expense of image quality, which, in turn, can impact the ability to detect diseases. We explore deep learning-based artifact reduction in sparse-view cranial CT scans and its impact on automated hemorrhage detection. Methods: We trained a U-Net for artefact reduction on simulated sparse-view cranial CT scans from 3000 patients obtained from a public dataset and reconstructed with varying levels of sub-sampling. Additionally, we trained a convolutional neural network on fully sampled CT data from 17,545 patients for automated hemorrhage detection. We evaluated the classification performance using the area under the receiver operator characteristic curves (AUC-ROCs) with corresponding 95% confidence intervals (CIs) and the DeLong test, along with confusion matrices. The performance of the U-Net was compared to an analytical approach based on total variation (TV). Results: The U-Net performed superior compared to unprocessed and TV-processed images with respect to image quality and automated hemorrhage diagnosis. With U-Net post-processing, the number of views can be reduced from 4096 (AUC-ROC: 0.974; 95% CI: 0.972-0.976) views to 512 views (0.973; 0.971-0.975) with minimal decrease in hemorrhage detection (P<.001) and to 256 views (0.967; 0.964-0.969) with a slight performance decrease (P<.001). Conclusion: The results suggest that U-Net based artifact reduction substantially enhances automated hemorrhage detection in sparse-view cranial CTs. Our findings highlight that appropriate post-processing is crucial for optimal image quality and diagnostic accuracy while minimizing radiation dose.
This is a preprint. The latest version has been published here: https://pubs.rsna.org/doi/10.1148/ryai.230275 Purpose: Sparse-view computed tomography (CT) is an effective way to reduce dose by lowering the total number of views acquired, albeit at the expense of image quality, which, in turn, can impact the ability to detect diseases. We explore deep learning-based artifact reduction in sparse-view cranial CT scans and its impact on automated hemorrhage detection. Methods: We trained a U-Net for artefact reduction on simulated sparse-view cranial CT scans from 3000 patients obtained from a public dataset and reconstructed with varying levels of sub-sampling. Additionally, we trained a convolutional neural network on fully sampled CT data from 17,545 patients for automated hemorrhage detection. We evaluated the classification performance using the area under the receiver operator characteristic curves (AUC-ROCs) with corresponding 95 intervals (CIs) and the DeLong test, along with confusion matrices. The performance of the U-Net was compared to an analytical approach based on total variation (TV). Results: The U-Net performed superior compared to unprocessed and TV-processed images with respect to image quality and automated hemorrhage diagnosis. With U-Net post-processing, the number of views can be reduced from 4096 (AUC-ROC: 0.974; 95 0.971-0.975) with minimal decrease in hemorrhage detection (P<.001) and to 256 views (0.967; 0.964-0.969) with a slight performance decrease (P<.001). Conclusion: The results suggest that U-Net based artifact reduction substantially enhances automated hemorrhage detection in sparse-view cranial CTs. Our findings highlight that appropriate post-processing is crucial for optimal image quality and diagnostic accuracy while minimizing radiation dose.
In X-ray imaging, photons are transmitted through and absorbed by the target object, but are also scattered in significant quantities. Previous attempts to use scattered X-ray photons for imaging applications used pencil or fan beam illumination. Here we present 3D X-ray Scatter Tomography using full-field illumination for small-animal imaging. Synchrotron imaging experiments were performed on a phantom and the chest of a juvenile rat. Transmitted and scattered photons were simultaneously imaged with separate cameras; a scientific camera directly downstream of the sample stage, and a pixelated detector with a pinhole imaging system placed at $45{}^\circ $ to the beam axis. We obtained scatter tomogram feature fidelity sufficient for segmentation of the lungs and major airways in the rat. The image contrast in the scatter tomogram slices approached that of transmission imaging, indicating robustness to the amount of multiple scattering present in our case. This opens the possibility of augmenting full-field 2D imaging systems with additional scatter detectors to obtain complementary modes or to improve the fidelity of existing images without additional dose, potentially leading to single-shot or reduced-angle tomography or overall dose reduction for live animal studies.