We propose new methods for automatic segmentation of images based on an atlas of manually labeled scans and contours in the image. First, we introduce a Bayesian framework for creating initial label maps from manually annotated training images. Within this framework, we model various registration- and patch-based segmentation techniques by changing the deformation field prior. Second, we perform contour-driven regression on the created label maps to refine the segmentation. Image contours and image parcellations give rise to non-stationary kernel functions that model the relationship between image locations. Setting the kernel to the covariance function in a Gaussian process establishes a distribution over label maps supported by image structures. Maximum a posteriori estimation of the distribution over label maps conditioned on the outcome of the atlas-based segmentation yields the refined segmentation. We evaluate the segmentation in two clinical applications: the segmentation of parotid glands in head and neck CT scans and the segmentation of the left atrium in cardiac MR angiography images.
Registration performance can significantly deteriorate when image regions do not comply with model assumptions. Robust estimation improves registration accuracy by reducing or ignoring the contribution of voxels with large intensity differences, but existing approaches are limited to monomodal registration. In this work, we propose a robust and inverse-consistent technique for cross-modal, affine image registration. The algorithm is derived from a contextual framework of image registration. The key idea is to use a modality invariant representation of images based on local entropy estimation, and to incorporate a heteroskedastic noise model. This noise model allows us to draw the analogy to iteratively reweighted least squares estimation and to leverage existing weighting functions to account for differences in local information content in multimodal registration. Furthermore, we use the nonparametric windows density estimator to reliably calculate entropy of small image patches. Finally, we derive the Gauss-Newton update and show that it is equivalent to the efficient second-order minimization for the fully symmetric registration approach. We illustrate excellent performance of the proposed methods on datasets containing outliers for alignment of brain tumor, full head, and histology images.
We introduce BrainPrint, a compact and discriminative representation of brain morphology. BrainPrint captures shape information of an ensemble of cortical and subcortical structures by solving the eigenvalue problem of the 2D and 3D Laplace-Beltrami operator on triangular (boundary) and tetrahedral (volumetric) meshes. This discriminative characterization enables new ways to study the similarity between brains; the focus can either be on a specific brain structure of interest or on the overall brain similarity. We highlight four applications for BrainPrint in this article: (i) subject identification, (ii) age and sex prediction, (iii) brain asymmetry analysis, and (iv) potential genetic influences on brain morphology. The properties of BrainPrint require the derivation of new algorithms to account for the heterogeneous mix of brain structures with varying discriminative power. We conduct experiments on three datasets, including over 3000 MRI scans from the ADNI database, 436 MRI scans from the OASIS dataset, and 236 MRI scans from the VETSA twin study. All processing steps for obtaining the compact representation are fully automated, making this processing framework particularly attractive for handling large datasets.
The anisotropy of water diffusion in brain tissue is affected by both disease and development. This change can be detected using diffusion MRI and is often quantified by the fractional anisotropy (FA) derived from diffusion tensor imaging (DTI). Although FA is sensitive to anisotropic cell structures, such as axons, it is also sensitive to their orientation dispersion. This is a major limitation to the use of FA as a biomarker for "tissue integrity", especially in regions of complex microarchitecture. In this work, we seek to circumvent this limitation by disentangling the effects of microscopic diffusion anisotropy from the orientation dispersion. The microscopic fractional anisotropy (μFA) and the order parameter (OP) were calculated from the contrast between signal prepared with directional and isotropic diffusion encoding, where the latter was achieved by magic angle spinning of the q-vector (qMAS). These parameters were quantified in healthy volunteers and in two patients; one patient with meningioma and one with glioblastoma. Finally, we used simulations to elucidate the relation between FA and μFA in various micro-architectures. Generally, μFA was high in the white matter and low in the gray matter. In the white matter, the largest differences between μFA and FA were found in crossing white matter and in interfaces between large white matter tracts, where μFA was high while FA was low. Both tumor types exhibited a low FA, in contrast to the μFA which was high in the meningioma and low in the glioblastoma, indicating that the meningioma contained disordered anisotropic structures, while the glioblastoma did not. This interpretation was confirmed by histological examination. We conclude that FA from DTI reflects both the amount of diffusion anisotropy and orientation dispersion. We suggest that the μFA and OP may complement FA by independently quantifying the microscopic anisotropy and the level of orientation coherence.
In a previous study we have demonstrated, using a novel diffusion MRI analysis called free-water imaging, that the early stages of schizophrenia are more likely associated with a neuroinflammatory response and less so with a white matter deterioration or a demyelination process. What is not known is how neuroinflammation and white matter deterioration change along the progression of the disorder. In this study we apply the free-water measures on a population of 29 chronic schizophrenia subjects and compare them with 25 matching controls. Our aim was to compare the extent of free-water imaging abnormalities in chronic subjects with the ones previously obtained for subjects at their first psychotic episode. We find that chronic subjects showed a limited extent of abnormal increase in the volume of the extracellular space, suggesting a less extensive neuroinflammatory response relative to patients at the onset of schizophrenia. At the same time, the chronic schizophrenia subjects had greater extent of reduced fractional anisotropy compared to the previous study, suggesting increased white matter deterioration along the progression of the disease. Our findings substantiate the role of neuroinflammation in the earlier stages of the disorder, and the effect of neurodegeneration that is worsening in the chronic phase.
Ultrasound is becoming an ever increasingly important modality in medical care. However, underlying physical acquisition principles are prone to image artifacts and result in overall quality variation. Therefore processing medical ultrasound data remains a challenging task. We propose a novel distribution-based measure of assessing the confidence in the signal, which emphasizes uncertainty in attenuated as well as shadow regions. In contrast to the similar recently proposed method that relies on image intensities, the new approach makes use of the enveloped-detected radio-frequency data, facilitating the use of Nakagami speckle statistics. Employing J-divergence as distance measure for the random-walk based algorithm, provides a natural measure of similarity, yielding a more reliable estimate of confidence. For evaluation of the model’s performance, tests are conducted on the application of shadow detection. Additionally, computed maps are presented for different organs such as neck, liver and prostate, showcasing the properties of the model. The probabilistic approach is shown to have beneficial features for image processing tasks.
We present an interactive algorithm to segment the heart chambers and epicardial surfaces, including the great vessel walls, in pediatric cardiac MRI of congenital heart disease. Accurate whole-heart segmentation is necessary to create patient-specific 3D heart models for surgical planning in the presence of complex heart defects. Anatomical variability due to congenital defects precludes fully automatic atlas-based segmentation. Our interactive segmentation method exploits expert segmentations of a small set of short-axis slice regions to automatically delineate the remaining volume using patch-based segmentation. We also investigate the potential of active learning to automatically solicit user input in areas where segmentation error is likely to be high. Validation is performed on four subjects with double outlet right ventricle, a severe congenital heart defect. We show that strategies asking the user to manually segment regions of interest within short-axis slices yield higher accuracy with less user input than those querying entire short-axis slices.