Repeatability of measurements from image analytics is difficult, due to the heterogeneity and complexity of cell samples, exact microscope stage positioning, and slide thickness. We present a method to define and use a reference focal plane that provides repeatable measurements with very high accuracy, by relying on control beads as reference material and a convolutional neural network focused on the control bead images. Previously we defined a reference effective focal plane (REFP) based on the image gradient of bead edges and three specific bead image features. This paper both generalizes and improves on this previous work. First, we refine the definition of the REFP by fitting a cubic spline to describe the relationship between the distance from a bead's center and pixel intensity and by sharing information across experiments, exposures, and fields of view. Second, we remove our reliance on image features that behave differently from one instrument to another. Instead, we apply a convolutional regression neural network (ResNet 18) trained on cropped bead images that is generalizable to multiple microscopes. Our ResNet 18 network predicts the location of the REFP with only a single inferenced image acquisition that can be taken across a wide range of focal planes and exposure times. We illustrate the different strategies and hyperparameter optimization of the ResNet 18 to achieve a high prediction accuracy with an uncertainty for every image tested coming within the microscope repeatability measure of 7.5 mu m from the desired focal plane. We demonstrate the generalizability of this methodology by applying it to two different optical systems and show that this level of accuracy can be achieved using only 6 beads per image.
In pursuing sustainable lunar exploration and habitation, understanding the electrostatic and electromagnetic behavior of lunar dust and regolith particles is receiving significant interest. However, the limited number of lunar regolith samples collected during the Apollo missions is insufficient to sustain the large number of current lunar experimental studies. Therefore, many lunar simulants have been fabricated using terrestrial materials to emulate the properties of lunar dust and regolith particles. Different lunar regolith simulants are used to represent different moon regions and for different applications. In this work, we study the electrostatic properties of the particles of two lunar simulants: JSC-l A and NU - LHT-4 M. JSC-lA is a simulant for the lunar mare regions, the dark areas of the moon, whereas NU-LHT-4M is a highland simulant, the lighter or brighter parts of the moon. Both simulants have particles with stable 3D shapes and have been used in a wide range of experiments. Utilizing advanced 3D X-ray tomography, we imaged the 3D particle shapes of thousands of particles from each simulant with sub-micron resolution. Using the open-source SCUFF-EM package, a Method of Moments (MOM)-based tool, we calculated the electrostatic polarizability tensors of the particles in each simulant. The particles were assigned a relative dielectric permittivity of 9.8 following: Grant Heiken, David Vaniman, and Bevan M. French, Lunar sourcebook: A user's guide to the Moon, No. 1259, Cup Archive, 1991. The electrostatic polarizability describes the electric dipole moment acquired by the particle when exposed to electric fields of different directions. After calculating the polarizability tensor, its eigenvalues are calculated and arranged in decreasing order $P_{1}\geq P_{2}$ 2: P3. Our quantitative analysis shows significant differences between the polarizability values of the NU-LHT-4M and JSC-IA simulants. Averaging 5000 particles from each simulant, NU-LHT-4M yielded average polarizability values $(P_{1}=240,527,\ P_{2}=169,075,\ P_{3}=111,707)$ whereas the average JSC I-A values were $(P_{1}=127,243,\ P_{2}=93,879,\ P_{3}=69,671)$ . Comparisons with previously published polarizability results from actual lunar regolith particles collected in the Apollo missions will be presented.
To facilitate the characterization of unlabeled induced pluripotent stem cells (iPSCs) during culture and expansion, we developed an AI pipeline for nuclear segmentation and mitosis detection from phase contrast images of individual cells within iPSC colonies. The analysis uses a 2D convolutional neural network (U-Net) plus a 3D U-Net applied on time lapse images to detect and segment nuclei, mitotic events, and daughter nuclei to enable tracking of large numbers of individual cells over long times in culture. The analysis uses fluorescence data to train models for segmenting nuclei in phase contrast images. The use of classical image processing routines to segment fluorescent nuclei precludes the need for manual annotation. We optimize and evaluate the accuracy of automated annotation to assure the reliability of the training. The model is generalizable in that it performs well on different datasets with an average F1 score of 0.94, on cells at different densities, and on cells from different pluripotent cell lines. The method allows us to assess, in a non-invasive manner, rates of mitosis and cell division which serve as indicators of cell state and cell health. We assess these parameters in up to hundreds of thousands of cells in culture for more than 36 hours, at different locations in the colonies, and as a function of excitation light exposure.
In order to predict cell population behavior, it is important to understand the dynamic characteristics of individual cells. Individual induced pluripotent stem (iPS) cells in colonies have been difficult to track over long times, both because segmentation is challenging due to close proximity of cells and because cell morphology at the time of cell division does not change dramatically in phase contrast images; image features do not provide sufficient discrimination for 2D neural network models of label-free images. However, these cells do not move significantly during division, and they display a distinct temporal pattern of morphologies. As a result, we can detect cell division with images overlaid in time. Using a combination of a 3D neural network applied over time-lapse data to find regions of cell division activity, followed by a 2D neural network for images in these selected regions to find individual dividing cells, we developed a robust detector of iPS cell division. We created an initial 3D neural network to find 3D image regions in (x,y,t) in which identified cell divisions occurred, then used semi-supervised training with additional stacks of images to create a more refined 3D model. These regions were then inferenced with our 2D neural network to find the location and time immediately before cells divide when they contain two sets of chromatin, information needed to track the cells after division. False positives from the 3D inferenced results were identified and removed with the addition of the 2D model. We successfully identified 37 of the 38 cell division events in our manually annotated test image stack, and specified the time and (x,y) location of each cell just before division within an accuracy of 10 pixels.
Trypan blue dye exclusion-based cell viability measurements are highly dependent upon image quality and consistency. In order to make measurements repeatable, one must be able to reliably capture images at a consistent focal plane, and with signal-to-noise ratio within appropriate limits to support proper execution of image analysis routines. Imaging chambers and imaging systems used for trypan blue analysis can be inconsistent or can drift over time, leading to a need to assure the acquisition of images prior to automated image analysis. Although cell-based autofocus techniques can be applied, the heterogeneity and complexity of the cell samples can make it difficult to assure the effectiveness, repeatability and accuracy of the routine for each measurement. Instead of auto-focusing on cells in our images, we add control beads to the images, and use them to repeatedly return to a reference focal plane. We use bead image features that have stable profiles across a wide range of focal values and exposure levels. We created a predictive model based on image quality features computed over reference datasets. Because the beads have little variation, we can determine the reference plane from bead image features computed over a single-shot image and can reproducibly return to that reference plane with each sample. The achieved accuracy (over 95%) is within the limits of the actuator repeatability. We demonstrate that a small number of beads (less than 3 beads per image) is needed to achieve this accuracy. We have also developed an open-source Graphical User Interface called Bead Benchmarking-Focus And Intensity Tool (BB-FAIT) to implement these methods for a semi-automated cell viability analyser.
A reconstruction algorithm for partially coherent x-ray computed tomography (XCT) including Fresnel diffraction is developed and applied to an optical fiber. The algorithm is applicable to a high-resolution tube-based laboratory-scale x-ray tomography instrument. The computing time is only a few times longer than the projective counterpart. The algorithm is used to reconstruct, with projections and diffraction, a tilt series acquired at the micrometer scale of a graded-index optical fiber using maximum likelihood and a Bayesian method based on the work of Bouman and Sauer. The inclusion of Fresnel diffraction removes some reconstruction artifacts and use of a Bayesian prior probability distribution removes others, resulting in a substantially more accurate reconstruction.
Using a unique data collection, we are able to study the detection of dense geometric objects in image data where object density, clarity, and size vary.The data is a large set of black and white images of scatterplots, taken from journals reporting thermophysical property data of metal systems, whose plot points are represented primarily by circles, triangles, and squares.We built a highly accurate single class U-Net convolutional neural network model to identify 97 % of image objects in a defined set of test images, locating the centers of the objects to within a few pixels of the correct locations.We found an optimal way in which to mark our training data masks to achieve this level of accuracy.The optimal markings for object classification, however, required more information in the masks to identify particular types of geometries.We show a range of different patterns used to mark the training data masks, and how they help or hurt our dual goals of location and classification.Altering the annotations in the segmentation masks can increase both the accuracy of object classification and localization on the plots, more than other factors such as adding loss terms to the network calculations.However, localization of the plot points and classification of the geometric objects require different optimal training data.
LEVEL OF EVIDENCE:5 Technical Efficacy: Stage 5 J. Magn. Reson. Imaging 2019.
Fundamental limits for the calculation of scattering corrections within X-ray computed tomography (CT) are found within the independent atom approximation from an analysis of the cross sections, CT geometry, and the Nyquist sampling theorem, suggesting large reductions in computational time compared to existing methods. By modifying the scatter by less than 1 %, it is possible to treat some of the elastic scattering in the forward direction as inelastic to achieve a smoother elastic scattering distribution. We present an analysis showing that the number of samples required for the smoother distribution can be greatly reduced. We show that fixed forced detection can be used with many fewer points for inelastic scattering, but that for pure elastic scattering, a standard Monte Carlo calculation is preferred. We use smoothing for both elastic and inelastic scattering because the intrinsic angular resolution is much poorer than can be achieved for projective tomography. Representative numerical examples are given.
Using a commercial X-ray tomography instrument, we have obtained reconstructions of a graded-index optical fiber with voxels of edge length 1.05 µm at 12 tube voltages. The fiber manufacturer created a graded index in the central region by varying the germanium concentration from a peak value in the center of the core to a very small value at the core-cladding boundary. Operating on 12 tube voltages, we show by a singular value decomposition that there are only two singular vectors with significant weight. Physically, this means scans beyond two tube voltages contain largely redundant information. We concentrate on an analysis of the images associated with these two singular vectors. The first singular vector is dominant and images of the coefficients of the first singular vector at each voxel look are similar to any of the single-energy reconstructions. Images of the coefficients of the second singular vector by itself appear to be noise. However, by averaging the reconstructed voxels in each of several narrow bands of radii, we can obtain values of the second singular vector at each radius. In the core region, where we expect the germanium doping to go from a peak value at the fiber center to zero at the core-cladding boundary, we find that a plot of the two coefficients of the singular vectors forms a line in the two-dimensional space consistent with the dopant decreasing linearly with radial distance from the core center. The coating, made of a polymer rather than silica, is not on this line indicating that the two-dimensional results are sensitive not only to the density but also to the elemental composition.
The visual inspection of pluripotent stem cell colonies by microscopy is widely used as a primary method to assess the quality of the preparations and degree of pluripotency. The lack of ground truth and the possible inconsistency of evaluations from multiple experts within and between stem cell laboratories are sources of uncertainty about the state of the cells, the reproducibility of preparations, and the efficiency of expansion protocols. To examine how to evaluate the level of confidence one has in disparate rating from experts, we explored a statistical method for assessing the differences in ratings of pluripotent stem cells by two different experts. Two experts rated phase contrast microscope images of human embryonic stem cell (hESC) colonies on a scale of 1 (poor) to 5 (maximum pluripotency character) but agreed with one another only 48% of the time. To assess whether experts used similar criteria to rate colonies, we developed custom image feature algorithms based on the stated visual criteria provided by the experts for selection of colonies. These features, plus others, were then used to develop pluripotency scoring algorithms trained to reflect ratings of both experts. We treated expert ratings as inexact indicators of a continuous pluripotency score and considered the inconsistency between expert ratings in developing our models. The model suggests that the two experts use somewhat different scales for discriminating between colony quality. Covariance analysis indicated that both experts use features that are not included in the model. Two image features, colony perimeter and a feature based on texture, were the most important for both experts for predicting the ratings. Interestingly, colony perimeter was not one of the expert-provided criteria for rating colonies, showing that this modeling approach allowed identification of features that the experts were not aware they were using. A linear model based on both experts identified each expert’s top-rated colonies as well as, or better than, the ratings of the other expert, as indicated by receiver operator characteristic curve analysis. By providing an understanding of the differences and similarities in disparate sets of expert ratings, this analysis helps to establish confidence in the ratings and the criteria for ratings, even when the experts disagree.
PurposeThis paper lays the groundwork for linking Hounsfield unit measurements to the International System of Units (SI), ultimately enabling traceable measurements across X-ray CT (XCT) machines. We do this by characterizing a material basis that may be used in XCT reconstruction giving linear combinations of concentrations of chemical elements (in the SI units of mol/m(3)) which may be observed at each voxel. By implication, linear combinations not in the set are not observable.Methods and materialsWe formulated a model for our material basis with a set of measurements of elemental powders at four tube voltages, 80 kV, 100 kV, 120 kV, and 140 kV, on a medical XCT. The samples included 30 small plastic bottles of powders containing various compounds spanning the atomic numbers up to 20, and a bottle of water and one of air. Using the chemical formulas and measured masses, we formed a matrix giving the number of Hounsfield units per (mole per cubic meter) at each tube voltage for each of 13 chemical elements. We defined a corresponding matrix in units we call molar Hounsfield unit (HU) potency, the difference in HU values that an added mole per cubic meter in a given voxel would add to the measured HU value. We built a matrix of molar potencies for each chemical element and tube voltage and performed a singular value decomposition (SVD) on these to formulate our material basis. We determined that the dimension of this basis is two. We then compared measurements in this material space with theoretical measurements, combining XCOM cross section data with the tungsten anode spectral model using interpolating cubic splines (TASMICS), a one-parameter filter, and a simple detector model, creating a matrix similar to our experimental matrix for the first 20 chemical elements. Finally, we compared the model predictions to Hounsfield unit measurements on three XCT calibration phantoms taken from the literature.ResultsWe predict the experimental HU potency values derived from our scans of chemical elements with our theoretical model built from XCOM data. The singular values and singular vectors of the model and powder measurements are in substantial agreement. Application of the Bayesian Information Criterion (BIC) shows that exactly two singular values and singular vectors describe the results over four tube voltages. We give a good account of the HU values from the literature, measured for the calibration phantoms at several tube voltages for several commercial instruments, compared with our theoretical model without introducing additional parameters.ConclusionsWe have developed a two-dimensional material basis that specifies the degree to which individual elements in compounds effect the HU values in XCT images of samples with elements up to atomic number Z = 20. We show that two dimensions is sufficient given the contrast and noise in our experiment. The linear combination of concentrations of elements that can be observed using a medical XCT have been characterized, providing a material basis for use in dual-energy reconstruction. This approach provides groundwork for improved reconstruction and for the link of Hounsfield units to the SI.
Purpose: The immediate purpose is to determine the maximum number of tube voltages which are useful for acquiring information in medical computed tomography (CT) along with specific linear combinations of quantities of chemical elements which are observable with the current generation of medical CT machines. The larger purpose is to encourage the development of CT reconstruction algorithms based on the material basis described herein and, ultimately, to tie the measurand of CT to the International System of Units (SI).Methods and Materials: Experimentally, we scanned samples at four tube voltages, namely 80 kV, 100 kV, 120 kV, and 140 kV on a medical CT. The samples included 30 small plastic bottles of powders containing various compounds spanning the atomic numbers from 1 to 20, along with a similar bottle of water and one of air. Using the known chemical formulas and measured masses, we formed a matrix giving the number of Hounsfield units per (mole per cubic meter) at each tube voltage for each of 13 chemical elements. Theoretically, we took the XCOM cross sections, combined them with the tungsten anode spectral model using interpolating cubic splines (TASMICS), with a one-parameter filter, and a simple detector model, and created a similar matrix for the first 20 chemical elements. In the training phase, we found a best-fit parameter. We define the molar Hounsfield unit (HU) potency as the difference in HU values that anadded mole per cubic meter in a given voxel would add to the measured HU value. We built a matrix of molar potencies for each chemical element and tube voltage and performed a singular value decomposition (SVD) on these. In a validation phase, we compared the model predictions to Hounsfield unit measurements on three CT calibration phantoms taken from the literature.Results: We found that we could predict the measured HU potency for the chemical elements within our model. The singular values and singular vectors of the model and powder measurements are in substantial agreement. Application of the Bayesian Information Criterion (BIC) shows that exactly two singular values and singular vectors describes the results over four tube voltages. We were able to give a good account of the HU values measured for the calibration phantoms at several tube voltages for several vendors within our model withoutintroducing additional parameters.Conclusions: Measurements at two tube voltages are necessary and sufficient to extract the available material dependent information in medical CT. The linear combination of elements that can be observed using a medical CT have been characterized, providing a material basis for use in dual-energy reconstruction. This approach provides groundwork for improved reconstruction and for the link of Hounsfield units to the SI.
The goal of this study was to compare volumetric analysis in computed tomography (CT) with the length measurement prescribed by the Response Evaluation Criteria in Solid Tumors (RECIST) for a system with known mass and unknown shape. We injected 2 mL to 4 mL of water into vials of sodium polyacrylate and into disposable diapers. Volume measurements of the sodium polyacrylate powder were able to predict both mass and proportional changes in mass within a 95 % prediction interval of width 12 % and 16 %, respectively. The corresponding figures for RECIST were 102 % and 82 %.
We present a case study in which we use natural language processing and machine learning techniques to automatically select candidate scientific articles that may contain new experimental thermophysical property data from thousands of articles available in five different relevant journals. The National Institute of Standards and Technology (NIST) Thermodynamic Research Center (TRC) maintains a large database of available thermophysical property data extracted from articles that are manually selected for content. Over time, the number of articles requiring manual inspection has grown and assistance from machine-based methods is needed. Previous work used topic modeling along with classification techniques to classify these journal articles into those with data for the TRC database and those without. These techniques have produced classifications with accuracy between 85 and 90%. However, the TRC does not want to lose data from the misclassified articles that contain relevant information. In this study, we start with these topic modeling and classification techniques, and then enhance the model using information relevant to the TRC’s selection process. Our goal is to minimize the number of articles that require manual selection without missing articles of importance. Through a series of selection methods, we eliminate those articles for which we can determine a rejection criterion. We can reduce the number of articles that are not of interest by 70.8% while retaining 98.7% of the articles of interest. We have also found that topic model classification improves when the corpus of words is derived from specific sections of the articles rather than the entire articles, and we improve on our classification by using a combination of topic models from different sections of the article. Our best classification used only the Experimental and Literature Cited sections.
PurposeTo assess the ability of a recent, anatomically designed breast phantom incorporating T-1 and diffusion elements to serve as a quality control device for quantitative comparison of apparent diffusion coefficient (ADC) measurements calculated from diffusion-weighted MRI (DWI) within and across MRI systems.Materials and MethodsA bilateral breast phantom incorporating multiple T-1 and diffusion tissue mimics and a geometric distortion array was imaged with DWI on 1.5 Tesla (T) and 3.0T scanners from two different manufacturers, using three different breast coils (three configurations total). Multiple measurements were acquired to assess the bias and variability of different diffusion weighted single-shot echo-planar imaging sequences on the scanner-coil systems.ResultsThe repeatability of ADC measurements was mixed: the standard deviation relative to baseline across scanner-coil-sequences ranged from low variability (0.47, 95% confidence interval [CI]: 0.22-1.00) to high variability (1.69, 95% CI: 0.17-17.26), depending on material, with the lowest and highest variability from the same scanner-coil-sequence. Assessment of image distortion showed that right/left measurements of the geometric distortion array were 1 to 16% larger on the left coil side compared with the right coil side independent of scanner-coil systems, diffusion weighting, and phase-encoding direction.ConclusionThis breast phantom can be used to measure scanner-coil-sequence bias and variability for DWI. When establishing a multisystem study, this breast phantom may be used to minimize protocol differences (e.g., due to available sequences or shimming technique), to correct for bias that cannot be minimized, and to weigh results from each system depending on respective variability. J. Magn. Reson. Imaging 2016. J. MAGN. RESON. IMAGING 2016;44:846-855.
A materials data infrastructure that enables the sharing and transformation of a wide range of materials data is an essential part of achieving the goals of the Materials Genome Initiative. We describe two high-level requirements of such an infrastructure as well as an emerging open-source implementation consisting of the Materials Data Curation System and the National Institute of Standards and Technology Materials Resource Registry.
Rationale and Objectives: Quantifying changes in lung tumor volume is important for diagnosis, therapy planning, and evaluation of response to therapy. The aim of this study was to assess the performance of multiple algorithms on a reference data set. The study was organized by the Quantitative Imaging Biomarker Alliance (QIBA).Materials and Methods: The study was organized as a public challenge. Computed tomography scans of synthetic lung tumors in an anthropomorphic phantom were acquired by the Food and Drug Administration. Tumors varied in size, shape, and radiodensity. Participants applied their own semi-automated volume estimation algorithms that either did not allow or allowed post-segmentation correction (type 1 or 2, respectively). Statistical analysis of accuracy (percent bias) and precision (repeatability and reproducibility) was conducted across algorithms, as well as across nodule characteristics, slice thickness, and algorithm type.Results: Eighty-four percent of volume measurements of QIBA-compliant tumors were within 15% of the true volume, ranging from 66% to 93% across algorithms, compared to 61% of volume measurements for all tumors (ranging from 37% to 84%). Algorithm type did not affect bias substantially; however, it was an important factor in measurement precision. Algorithm precision was notably better as tumor size increased, worse for irregularly shaped tumors, and on the average better for type 1 algorithms. Over all nodules meeting the QIBA Profile, precision, as measured by the repeatability coefficient, was 9.0% compared to 18.4% overall.Conclusion: The results achieved in this study, using a heterogeneous set of measurement algorithms, support QIBA quantitative performance claims in terms of volume measurement repeatability for nodules meeting the QIBA Profile criteria.