Image Features for Brain Phenotypes Core Publications

Sedghi A, O'Donnell LJ, Kapur T, Learned-Miller E, Mousavi P, Wells WM. Image Registration: Maximum Likelihood, Minimum Entropy and Deep Learning. Med Image Anal. 2021;69 :101939.Abstract
In this work, we propose a theoretical framework based on maximum profile likelihood for pairwise and groupwise registration. By an asymptotic analysis, we demonstrate that maximum profile likelihood registration minimizes an upper bound on the joint entropy of the distribution that generates the joint image data. Further, we derive the congealing method for groupwise registration by optimizing the profile likelihood in closed form, and using coordinate ascent, or iterative model refinement. We also describe a method for feature based registration in the same framework and demonstrate it on groupwise tractographic registration. In the second part of the article, we propose an approach to deep metric registration that implements maximum likelihood registration using deep discriminative classifiers. We show further that this approach can be used for maximum profile likelihood registration to discharge the need for well-registered training data, using iterative model refinement. We demonstrate that the method succeeds on a challenging registration problem where the standard mutual information approach does not perform well.
Dalamagkas K, Tsintou M, Rathi Y, O'Donnell LJ, Pasternak O, Gong X, Zhu A, Savadjiev P, Papadimitriou GM, Kubicki M, et al. Individual Variations of the Human Corticospinal Tract and Its Hand-Related Motor Fibers Using Diffusion MRI Tractography. Brain Imaging Behav. 2020;14 (3) :696-714.Abstract
The corticospinal tract (CST) is one of the most well studied tracts in human neuroanatomy. Its clinical significance can be demonstrated in many notable traumatic conditions and diseases such as stroke, spinal cord injury (SCI) or amyotrophic lateral sclerosis (ALS). With the advent of diffusion MRI and tractography the computational representation of the human CST in a 3D model became available. However, the representation of the entire CST and, specifically, the hand motor area has remained elusive. In this paper we propose a novel method, using manually drawn ROIs based on robustly identifiable neuroanatomic structures to delineate the entire CST and isolate its hand motor representation as well as to estimate their variability and generate a database of their volume, length and biophysical parameters. Using 37 healthy human subjects we performed a qualitative and quantitative analysis of the CST and the hand-related motor fiber tracts (HMFTs). Finally, we have created variability heat maps from 37 subjects for both the aforementioned tracts, which could be utilized as a reference for future studies with clinical focus to explore neuropathology in both trauma and disease states.
Haehn D, Franke L, Zhang F, Cetin-Karayumak S, Pieper S, O'Donnell LJ, Rathi Y. TRAKO: Efficient Transmission of Tractography Data for Visualization. Med Image Comput Comput Assist Interv. 2020;12267 :322-32.Abstract
Fiber tracking produces large tractography datasets that are tens of gigabytes in size consisting of millions of streamlines. Such vast amounts of data require formats that allow for efficient storage, transfer, and visualization. We present TRAKO, a new data format based on the Graphics Layer Transmission Format (glTF) that enables immediate graphical and hardware-accelerated processing. We integrate a state-of-the-art compression technique for vertices, streamlines, and attached scalar and property data. We then compare TRAKO to existing tractography storage methods and provide a detailed evaluation on eight datasets. TRAKO can achieve data reductions of over 28x without loss of statistical significance when used to replicate analysis from previously published studies.
Rushmore RJ, Wilson-Braun P, Papadimitriou G, Ng I, Rathi Y, Zhang F, O'Donnell LJ, Kubicki M, Bouix S, Yeterian E, et al. 3D Exploration of the Brainstem in 50-Micron Resolution MRI. Front Neuroanat. 2020;14 :40.Abstract
The brainstem, a structure of vital importance in mammals, is currently becoming a principal focus in cognitive, affective, and clinical neuroscience. Midbrain, pontine and medullary structures serve as the conduit for signals between the forebrain and spinal cord, are the epicenter of cranial nerve-circuits and systems, and subserve such integrative functions as consciousness, emotional processing, pain, and motivation. In this study, we parcellated the nuclear masses and the principal fiber pathways that were visible in a high-resolution T2-weighted MRI dataset of 50-micron isotropic voxels of a postmortem human brainstem. Based on this analysis, we generated a detailed map of the human brainstem. To assess the validity of our maps, we compared our observations with histological maps of traditional human brainstem atlases. Given the unique capability of MRI-based morphometric analysis in generating and preserving the morphology of 3D objects from individual 2D sections, we reconstructed the motor, sensory and integrative neural systems of the brainstem and rendered them in 3D representations. We anticipate the utilization of these maps by the neuroimaging community for applications in basic neuroscience as well as in neurology, psychiatry, and neurosurgery, due to their versatile computational nature in 2D and 3D representations in a publicly available capacity.
Canalini L, Klein J, Miller D, Kikinis R. Enhanced Registration of Ultrasound Volumes by Segmentation of Resection Cavity in Neurosurgical Procedures. Int J Comput Assist Radiol Surg. 2020;15 (13) :1963-74.Abstract
PURPOSE: Neurosurgeons can have a better understanding of surgical procedures by comparing ultrasound images obtained at different phases of the tumor resection. However, establishing a direct mapping between subsequent acquisitions is challenging due to the anatomical changes happening during surgery. We propose here a method to improve the registration of ultrasound volumes, by excluding the resection cavity from the registration process. METHODS: The first step of our approach includes the automatic segmentation of the resection cavities in ultrasound volumes, acquired during and after resection. We used a convolution neural network inspired by the 3D U-Net. Then, subsequent ultrasound volumes are registered by excluding the contribution of resection cavity. RESULTS: Regarding the segmentation of the resection cavity, the proposed method achieved a mean DICE index of 0.84 on 27 volumes. Concerning the registration of the subsequent ultrasound acquisitions, we reduced the mTRE of the volumes acquired before and during resection from 3.49 to 1.22 mm. For the set of volumes acquired before and after removal, the mTRE improved from 3.55 to 1.21 mm. CONCLUSIONS: We proposed an innovative registration algorithm to compensate the brain shift affecting ultrasound volumes obtained at subsequent phases of neurosurgical procedures. To the best of our knowledge, our method is the first to exclude automatically segmented resection cavities in the registration of ultrasound volumes in neurosurgery.
Zhang F, Cetin Karayumak S, Hoffmann N, Rathi Y, Golby AJ, O'Donnell LJ. Deep White Matter Analysis (DeepWMA): Fast and Consistent Tractography Segmentation. Med Image Anal. 2020;65 :101761.Abstract
White matter tract segmentation, i.e. identifying tractography fibers (streamline trajectories) belonging to anatomically meaningful fiber tracts, is an essential step to enable tract quantification and visualization. In this study, we present a deep learning tractography segmentation method (DeepWMA) that allows fast and consistent identification of 54 major deep white matter fiber tracts from the whole brain. We create a large-scale training tractography dataset of 1 million labeled fiber samples, and we propose a novel 2D multi-channel feature descriptor (FiberMap) that encodes spatial coordinates of points along each fiber. We learn a convolutional neural network (CNN) fiber classification model based on FiberMap and obtain a high fiber classification accuracy of 90.99% on the training tractography data with ground truth fiber labels. Then, the method is evaluated on a test dataset of 597 diffusion MRI scans from six independently acquired populations across genders, the lifespan (1 day - 82 years), and different health conditions (healthy control, neuropsychiatric disorders, and brain tumor patients). We perform comparisons with two state-of-the-art tract segmentation methods. Experimental results show that our method obtains a highly consistent tract segmentation result, where on average over 99% of the fiber tracts are successfully identified across all subjects under study, most importantly, including neonates and patients with space-occupying brain tumors. We also demonstrate good generalization of the method to tractography data from multiple different fiber tracking methods. The proposed method leverages deep learning techniques and provides a fast and efficient tool for brain white matter segmentation in large diffusion MRI tractography datasets.
Levitt JJ, Nestor PG, Kubicki M, Lyall AE, Zhang F, Riklin-Raviv T, O Donnell LJ, McCarley RW, Shenton ME, Rathi Y. Miswiring of Frontostriatal Projections in Schizophrenia. Schizophr Bull. 2020;46 (4) :990-8.Abstract
We investigated brain wiring in chronic schizophrenia and healthy controls in frontostriatal circuits using diffusion magnetic resonance imaging tractography in a novel way. We extracted diffusion streamlines in 27 chronic schizophrenia and 26 healthy controls connecting 4 frontal subregions to the striatum. We labeled the projection zone striatal surface voxels into 2 subtypes: dominant-input from a single cortical subregion, and, functionally integrative, with mixed-input from diverse cortical subregions. We showed: 1) a group difference for total striatal surface voxel number (P = .045) driven by fewer mixed-input voxels in the left (P  = .007), but not right, hemisphere; 2) a group by hemisphere interaction for the ratio quotient between voxel subtypes (P  = .04) with a left (P  = .006), but not right, hemisphere increase in schizophrenia, also reflecting fewer mixed-input voxels; and 3) fewer mixed-input voxel counts in schizophrenia (P  = .045) driven by differences in left hemisphere limbic (P  = .007) and associative (P  = .01), but not sensorimotor, striatum. These results demonstrate a less integrative pattern of frontostriatal structural connectivity in chronic schizophrenia. A diminished integrative pattern yields a less complex input pattern to the striatum from the cortex with less circuit integration at the level of the striatum. Further, as brain wiring occurs during early development, aberrant brain wiring could serve as a developmental biomarker for schizophrenia.
Zhang F, Noh T, Juvekar P, Frisken SF, Rigolo L, Norton I, Kapur T, Pujol S, Wells W, Yarmarkovich A, et al. SlicerDMRI: Diffusion MRI and Tractography Research Software for Brain Cancer Surgery Planning and Visualization. JCO Clin Cancer Inform. 2020;4 :299-309.Abstract
PURPOSE: We present SlicerDMRI, an open-source software suite that enables research using diffusion magnetic resonance imaging (dMRI), the only modality that can map the white matter connections of the living human brain. SlicerDMRI enables analysis and visualization of dMRI data and is aimed at the needs of clinical research users. SlicerDMRI is built upon and deeply integrated with 3D Slicer, a National Institutes of Health-supported open-source platform for medical image informatics, image processing, and three-dimensional visualization. Integration with 3D Slicer provides many features of interest to cancer researchers, such as real-time integration with neuronavigation equipment, intraoperative imaging modalities, and multimodal data fusion. One key application of SlicerDMRI is in neurosurgery research, where brain mapping using dMRI can provide patient-specific maps of critical brain connections as well as insight into the tissue microstructure that surrounds brain tumors. PATIENTS AND METHODS: In this article, we focus on a demonstration of SlicerDMRI as an informatics tool to enable end-to-end dMRI analyses in two retrospective imaging data sets from patients with high-grade glioma. Analyses demonstrated here include conventional diffusion tensor analysis, advanced multifiber tractography, automated identification of critical fiber tracts, and integration of multimodal imagery with dMRI. RESULTS: We illustrate the ability of SlicerDMRI to perform both conventional and advanced dMRI analyses as well as to enable multimodal image analysis and visualization. We provide an overview of the clinical rationale for each analysis along with pointers to the SlicerDMRI tools used in each. CONCLUSION: SlicerDMRI provides open-source and clinician-accessible research software tools for dMRI analysis. SlicerDMRI is available for easy automated installation through the 3D Slicer Extension Manager.
Xie G, Zhang F, Leung L, Mooney MA, Epprecht L, Norton I, Rathi Y, Kikinis R, Al-Mefty O, Makris N, et al. Anatomical Assessment of Trigeminal Nerve Tractography Using Diffusion MRI: A Comparison of Acquisition B-Values and Single- and Multi-Fiber Tracking Strategies. Neuroimage Clin. 2020;25 :102160.Abstract
BACKGROUND: The trigeminal nerve (TGN) is the largest cranial nerve and can be involved in multiple inflammatory, compressive, ischemic or other pathologies. Currently, imaging-based approaches to identify the TGN mostly rely on T2-weighted magnetic resonance imaging (MRI), which provides localization of the cisternal portion of the TGN where the contrast between nerve and cerebrospinal fluid (CSF) is high enough to allow differentiation. The course of the TGN within the brainstem as well as anterior to the cisternal portion, however, is more difficult to display on traditional imaging sequences. An advanced imaging technique, diffusion MRI (dMRI), enables tracking of the trajectory of TGN fibers and has the potential to visualize anatomical regions of the TGN not seen on T2-weighted imaging. This may allow a more comprehensive assessment of the nerve in the context of pathology. To date, most work in TGN tracking has used clinical dMRI acquisitions with a b-value of 1000 s/mm and conventional diffusion tensor MRI (DTI) tractography methods. Though higher b-value acquisitions and multi-tensor tractography methods are known to be beneficial for tracking brain white matter fiber tracts, there have been no studies conducted to evaluate the performance of these advanced approaches on nerve tracking of the TGN, in particular on tracking different anatomical regions of the TGN. OBJECTIVE: We compare TGN tracking performance using dMRI data with different b-values, in combination with both single- and multi-tensor tractography methods. Our goal is to assess the advantages and limitations of these different strategies for identifying the anatomical regions of the TGN. METHODS: We proposed seven anatomical rating criteria including true and false positive structures, and we performed an expert rating study of over 1000 TGN visualizations, as follows. We tracked the TGN using high-quality dMRI data from 100 healthy adult subjects from the Human Connectome Project (HCP). TGN tracking performance was compared across dMRI acquisitions with b = 1000 s/mm, b = 2000 s/mm and b = 3000 s/mm, using single-tensor (1T) and two-tensor (2T) unscented Kalman filter (UKF) tractography. This resulted in a total of six tracking strategies. The TGN was identified using an anatomical region-of-interest (ROI) selection approach. First, in a subset of the dataset we identified ROIs that provided good TGN tracking performance across all tracking strategies. Using these ROIs, the TGN was then tracked in all subjects using the six tracking strategies. An expert rater (GX) visually assessed and scored each TGN based on seven anatomical judgment criteria. These criteria included the presence of multiple expected anatomical segments of the TGN (true positive structures), specifically branch-like structures, cisternal portion, mesencephalic trigeminal tract, and spinal cord tract of the TGN. False positive criteria included the presence of any fibers entering the temporal lobe, the inferior cerebellar peduncle, or the middle cerebellar peduncle. Expert rating scores were analyzed to compare TGN tracking performance across the six tracking strategies. Intra- and inter-rater validation was performed to assess the reliability of the expert TGN rating result. RESULTS: The TGN was selected using two anatomical ROIs (Meckel's Cave and cisternal portion of the TGN). The two-tensor tractography method had significantly better performance on identifying true positive structures, while generating more false positive streamlines in comparison to the single-tensor tractography method. TGN tracking performance was significantly different across the three b-values for almost all structures studied. Tracking performance was reported in terms of the percentage of subjects achieving each anatomical rating criterion. Tracking of the cisternal portion and branching structure of the TGN was generally successful, with the highest performance of over 98% using two-tensor tractography and b = 1000 or b = 2000. However, tracking the smaller mesencephalic and spinal cord tracts of the TGN was quite challenging (highest performance of 37.5% and 57.07%, using two-tensor tractography with b = 1000 and b = 2000, respectively). False positive connections to the temporal lobe (over 38% of subjects for all strategies) and cerebellar peduncles (100% of subjects for all strategies) were prevalent. High joint probability of agreement was obtained in the inter-rater (on average 83%) and intra-rater validation (on average 90%), showing a highly reliable expert rating result. CONCLUSIONS: Overall, the results of the study suggest that researchers and clinicians may benefit from tailoring their acquisition and tracking methodology to the specific anatomical portion of the TGN that is of the greatest interest. For example, tracking of branching structures and TGN-T2 overlap can be best achieved with a two-tensor model and an acquisition using b = 1000 or b = 2000. In general, b = 1000 and b = 2000 acquisitions provided the best-rated tracking results. Further research is needed to improve both sensitivity and specificity of the depiction of the TGN anatomy using dMRI.
Chauvin L, Kumar K, Wachinger C, Vangel M, de Guise J, Desrosiers C, Wells W, Toews M. Neuroimage Signature from Salient Keypoints is Highly Specific to Individuals and Shared by Close Relatives. Neuroimage. 2020;204 :116208.Abstract
Neuroimaging studies typically adopt a common feature space for all data, which may obscure aspects of neuroanatomy only observable in subsets of a population, e.g. cortical folding patterns unique to individuals or shared by close relatives. Here, we propose to model individual variability using a distinctive keypoint signature: a set of unique, localized patterns, detected automatically in each image by a generic saliency operator. The similarity of an image pair is then quantified by the proportion of keypoints they share using a novel Jaccard-like measure of set overlap. Experiments demonstrate the keypoint method to be highly efficient and accurate, using a set of 7536 T1-weighted MRIs pooled from four public neuroimaging repositories, including twins, non-twin siblings, and 3334 unique subjects. All same-subject image pairs are identified by a similarity threshold despite confounds including aging and neurodegenerative disease progression. Outliers reveal previously unknown data labeling inconsistencies, demonstrating the usefulness of the keypoint signature as a computational tool for curating large neuroimage datasets.
Wachinger C, Toews M, Langs G, Wells W, Golland P. Keypoint Transfer for Fast Whole-Body Segmentation. IEEE Trans Med Imaging. 2020;39 (2) :273-82.Abstract
We introduce an approach for image segmentation based on sparse correspondences between keypoints in testing and training images. Keypoints represent automatically identified distinctive image locations, where each keypoint correspondence suggests a transformation between images. We use these correspondences to transfer label maps of entire organs from the training images to the test image. The keypoint transfer algorithm includes three steps: (i) keypoint matching, (ii) voting-based keypoint labeling, and (iii) keypoint-based probabilistic transfer of organ segmentations. We report segmentation results for abdominal organs in whole-body CT and MRI, as well as in contrast-enhanced CT and MRI. Our method offers a speed-up of about three orders of magnitude in comparison to common multi-atlas segmentation, while achieving an accuracy that compares favorably. Moreover, keypoint transfer does not require the registration to an atlas or a training phase. Finally, the method allows for the segmentation of scans with highly variable field-of-view.
Zhang F, Hoffmann N, Cetin Karayumak S, Rathi Y, Golby AJ, O'Donnell LJ. Deep White Matter Analysis: Fast, Consistent Tractography Segmentation Across Populations and dMRI Acquisitions. Med Image Comput Comput Assist Interv. 2019;11766 :599-608.Abstract
We present a deep learning tractography segmentation method that allows fast and consistent white matter fiber tract identification across healthy and disease populations and across multiple diffusion MRI (dMRI) acquisitions. We create a large-scale training tractography dataset of 1 million labeled fiber samples (54 anatomical tracts are included). To discriminate between fibers from different tracts, we propose a novel 2D multi-channel feature descriptor (FiberMap) that encodes spatial coordinates of points along each fiber. We learn a CNN tract classification model based on FiberMap and obtain a high tract classification accuracy of 90.99%. The method is evaluated on a test dataset of 374 dMRI scans from three independently acquired populations across health conditions (healthy control, neuropsychiatric disorders, and brain tumor patients). We perform comparisons with two state-of-the-art white matter tract segmentation methods. Experimental results show that our method obtains a highly consistent segmentation result, where over 99% of the fiber tracts are successfully detected across all subjects under study, most importantly, including patients with space occupying brain tumors. The proposed method leverages deep learning techniques and provides a much faster and more efficient tool for large data analysis than methods using traditional machine learning techniques.
Fan D, Chaudhari NN, Rostowsky KA, Calvillo M, Lee SK, Chowdhury NF, Zhang F, O'Donnell LJ, Irimia A. Post-Traumatic Cerebral Microhemorrhages and their Effects Upon White Matter Connectivity in the Aging Human Brain. Conf Proc IEEE Eng Med Biol Soc. 2019;2019 :198-203.Abstract
Cerebral microbleeds (CMBs), a common manifestation of mild traumatic brain injury (mTBI), have been sporadically implicated in the neurocognitive deficits of mTBI victims but their clinical significance has not been established adequately. Here we investigate the longitudinal effects of post-mTBI CMBs upon the fractional anisotropy (FA) of white matter (WM) in 21 older mTBI patients across the first ~6 months post-injury. CMBs were segmented automatically from susceptibility-weighted imaging (SWI) by leveraging the intensity gradient properties of SWI to identify CMB-related hypointensities using gradient-based edge detection. A detailed diffusion magnetic resonance imaging (dMRI) atlas of WM was used to segment and cluster tractography streamlines whose prototypes were then identified. The correlation coefficient was calculated between (A) FA values at vertices along streamline prototypes and (B) topological (along-streamline) distances between these vertices and the nearest CMB. Across subjects, the CMB identification approach achieved a sensitivity of 97.1% ± 4.7% and a precision of 72.4% ± 11.0% across subjects. The correlation coefficient was found to be negative and, additionally, statistically significant for 12.3% ± 3.5% of WM clusters (p <; 0.05, corrected), whose FA was found to decrease, on average, by 11.8% ± 5.3% across the first 6 months post-injury. These results suggest that CMBs can be associated with deleterious effects upon peri-lesional WM and highlight the vulnerability of older mTBI patients to neurovascular injury.
Kocev B, Hahn HK, Linsen L, Wells WM, Kikinis R. Uncertainty-aware asynchronous scattered motion interpolation using Gaussian process regression. Comput Med Imaging Graph. 2019;72 :1-12.Abstract
We address the problem of interpolating randomly non-uniformly spatiotemporally scattered uncertain motion measurements, which arises in the context of soft tissue motion estimation. Soft tissue motion estimation is of great interest in the field of image-guided soft-tissue intervention and surgery navigation, because it enables the registration of pre-interventional/pre-operative navigation information on deformable soft-tissue organs. To formally define the measurements as spatiotemporally scattered motion signal samples, we propose a novel motion field representation. To perform the interpolation of the motion measurements in an uncertainty-aware optimal unbiased fashion, we devise a novel Gaussian process (GP) regression model with a non-constant-mean prior and an anisotropic covariance function and show through an extensive evaluation that it outperforms the state-of-the-art GP models that have been deployed previously for similar tasks. The employment of GP regression enables the quantification of uncertainty in the interpolation result, which would allow the amount of uncertainty present in the registered navigation information governing the decisions of the surgeon or intervention specialist to be conveyed.
Lyall AE, Savadjiev P, Del Re EC, Seitz J, O'Donnell LJ, Westin C-F, Mesholam-Gately RI, Petryshen T, Wojcik JD, Nestor P, et al. Utilizing Mutual Information Analysis to Explore the Relationship Between Gray and White Matter Structural Pathologies in Schizophrenia. Schizophr Bull. 2019;45 (2) :386-95.Abstract
Schizophrenia has been characterized as a neurodevelopmental disorder, with structural brain abnormalities reported at all stages. However, at present, it remains unclear whether gray and white matter abnormalities represent related or independent pathologies in schizophrenia. In this study, we present findings from an integrative analysis exploring the morphological relationship between gray and white matter in 45 schizophrenia participants and 49 healthy controls. We utilized mutual information (MI), a measure of how much information two variables share, to assess the morphological dependence between gray and white matter in three segments of the corpus callsoum, and the gray matter regions these segments connect: (1) the genu and the left and right rostral middle frontal gyrus (rMFG), (2) the isthmus and the left and right superior temporal gyrus (STG), (3) the splenium and the left and right lateral occipital gyrus (LOG). We report significantly reduced MI between white matter tract dispersion of the right hemispheric callosal connections to the STG and both cortical thickness and area in the right STG in schizophrenia patients, despite a lack of group differences in cortical thickness, surface area, or dispersion. We believe that this reduction in morphological dependence between gray and white matter may reflect a possible decoupling of the developmental processes that shape morphological features of white and gray matter early in life. The present study also demonstrates the importance of studying the relationship between gray and white matter measures, as opposed to restricting analyses to gray and white matter measures independently.