Image Features for Brain Phenotypes Core Publications

2022
Chauvin L, Kumar K, Desrosiers C, Wells W, Toews M. Efficient Pairwise Neuroimage Analysis Using the Soft Jaccard Index and 3D Keypoint Sets. IEEE Trans Med Imaging. 2022;41 (4) :836-45.Abstract
We propose a novel pairwise distance measure between image keypoint sets, for the purpose of large-scale medical image indexing. Our measure generalizes the Jaccard index to account for soft set equivalence (SSE) between keypoint elements, via an adaptive kernel framework modeling uncertainty in keypoint appearance and geometry. A new kernel is proposed to quantify the variability of keypoint geometry in location and scale. Our distance measure may be estimated between O (N 2) image pairs in [Formula: see text] operations via keypoint indexing. Experiments report the first results for the task of predicting family relationships from medical images, using 1010 T1-weighted MRI brain volumes of 434 families including monozygotic and dizygotic twins, siblings and half-siblings sharing 100%-25% of their polymorphic genes. Soft set equivalence and the keypoint geometry kernel improve upon standard hard set equivalence (HSE) and appearance kernels alone in predicting family relationships. Monozygotic twin identification is near 100%, and three subjects with uncertain genotyping are automatically paired with their self-reported families, the first reported practical application of image-based family identification. Our distance measure can also be used to predict group categories, sex is predicted with an AUC = 0.97. Software is provided for efficient fine-grained curation of large, generic image datasets.
Robles DJ, Dharani A, Rostowsky KA, Chaudhari NN, Ngo V, Zhang F, O'Donnell LJ, Green L, Sheikh-Bahaei N, Chui HC, et al. Older Age, Male Sex, and Cerebral Microbleeds Predict White Matter Loss After Traumatic Brain Injury. Geroscience. 2022;44 (1) :83-102.Abstract
Little is known on how mild traumatic brain injury affects white matter based on age at injury, sex, cerebral microbleeds, and time since injury. Here, we study the fractional anisotropy of white matter to study these effects in 109 participants aged 18-77 (46 females, age μ ± σ = 40 ± 17 years) imaged within [Formula: see text] 1 week and [Formula: see text] 6 months post-injury. Age is found to be linearly associated with white matter degradation, likely due not only to injury but also to cumulative effects of other pathologies and to their interactions with injury. Age is associated with mean anisotropy decreases in the corpus callosum, middle longitudinal fasciculi, inferior longitudinal and occipitofrontal fasciculi, and superficial frontal and temporal fasciculi. Over [Formula: see text] 6 months, the mean anisotropies of the corpus callosum, left superficial frontal fasciculi, and left corticospinal tract decrease significantly. Independently of other predictors, age and cerebral microbleeds contribute to anisotropy decrease in the callosal genu. Chronically, the white matter of commissural tracts, left superficial frontal fasciculi, and left corticospinal tract degrade appreciably, independently of other predictors. Our findings suggest that large commissural and intra-hemispheric structures are at high risk for post-traumatic degradation. This study identifies detailed neuroanatomic substrates consistent with brain injury patients' age-dependent deficits in information processing speed, interhemispheric communication, motor coordination, visual acuity, sensory integration, reading speed/comprehension, executive function, personality, and memory. We also identify neuroanatomic features underlying white matter degradation whose severity is associated with the male sex. Future studies should compare our findings to functional measures and other neurodegenerative processes.
2021
Sedghi A, O'Donnell LJ, Kapur T, Learned-Miller E, Mousavi P, Wells WM. Image Registration: Maximum Likelihood, Minimum Entropy and Deep Learning. Med Image Anal. 2021;69 :101939.Abstract
In this work, we propose a theoretical framework based on maximum profile likelihood for pairwise and groupwise registration. By an asymptotic analysis, we demonstrate that maximum profile likelihood registration minimizes an upper bound on the joint entropy of the distribution that generates the joint image data. Further, we derive the congealing method for groupwise registration by optimizing the profile likelihood in closed form, and using coordinate ascent, or iterative model refinement. We also describe a method for feature based registration in the same framework and demonstrate it on groupwise tractographic registration. In the second part of the article, we propose an approach to deep metric registration that implements maximum likelihood registration using deep discriminative classifiers. We show further that this approach can be used for maximum profile likelihood registration to discharge the need for well-registered training data, using iterative model refinement. We demonstrate that the method succeeds on a challenging registration problem where the standard mutual information approach does not perform well.
Bastos DCDA, Juvekar P, Tie Y, Jowkar N, Pieper S, Wells WM, Bi WL, Golby A, Frisken S, Kapur T. Challenges and Opportunities of Intraoperative 3D Ultrasound With Neuronavigation in Relation to Intraoperative MRI. Front Oncol. 2021;11 :656519.Abstract
Introduction: Neuronavigation greatly improves the surgeons ability to approach, assess and operate on brain tumors, but tends to lose its accuracy as the surgery progresses and substantial brain shift and deformation occurs. Intraoperative MRI (iMRI) can partially address this problem but is resource intensive and workflow disruptive. Intraoperative ultrasound (iUS) provides real-time information that can be used to update neuronavigation and provide real-time information regarding the resection progress. We describe the intraoperative use of 3D iUS in relation to iMRI, and discuss the challenges and opportunities in its use in neurosurgical practice. Methods: We performed a retrospective evaluation of patients who underwent image-guided brain tumor resection in which both 3D iUS and iMRI were used. The study was conducted between June 2020 and December 2020 when an extension of a commercially available navigation software was introduced in our practice enabling 3D iUS volumes to be reconstructed from tracked 2D iUS images. For each patient, three or more 3D iUS images were acquired during the procedure, and one iMRI was acquired towards the end. The iUS images included an extradural ultrasound sweep acquired before dural incision (iUS-1), a post-dural opening iUS (iUS-2), and a third iUS acquired immediately before the iMRI acquisition (iUS-3). iUS-1 and preoperative MRI were compared to evaluate the ability of iUS to visualize tumor boundaries and critical anatomic landmarks; iUS-3 and iMRI were compared to evaluate the ability of iUS for predicting residual tumor. Results: Twenty-three patients were included in this study. Fifteen patients had tumors located in eloquent or near eloquent brain regions, the majority of patients had low grade gliomas (11), gross total resection was achieved in 12 patients, postoperative temporary deficits were observed in five patients. In twenty-two iUS was able to define tumor location, tumor margins, and was able to indicate relevant landmarks for orientation and guidance. In sixteen cases, white matter fiber tracts computed from preoperative dMRI were overlaid on the iUS images. In nineteen patients, the EOR (GTR or STR) was predicted by iUS and confirmed by iMRI. The remaining four patients where iUS was not able to evaluate the presence or absence of residual tumor were recurrent cases with a previous surgical cavity that hindered good contact between the US probe and the brainsurface. Conclusion: This recent experience at our institution illustrates the practical benefits, challenges, and opportunities of 3D iUS in relation to iMRI.
Zhang F, Breger A, Cho KIK, Ning L, Westin C-F, O'Donnell LJ, Pasternak O. Deep Learning Based Segmentation of Brain Tissue from Diffusion MRI. Neuroimage. 2021;233 :117934.Abstract
Segmentation of brain tissue types from diffusion MRI (dMRI) is an important task, required for quantification of brain microstructure and for improving tractography. Current dMRI segmentation is mostly based on anatomical MRI (e.g., T1- and T2-weighted) segmentation that is registered to the dMRI space. However, such inter-modality registration is challenging due to more image distortions and lower image resolution in dMRI as compared with anatomical MRI. In this study, we present a deep learning method for diffusion MRI segmentation, which we refer to as DDSeg. Our proposed method learns tissue segmentation from high-quality imaging data from the Human Connectome Project (HCP), where registration of anatomical MRI to dMRI is more precise. The method is then able to predict a tissue segmentation directly from new dMRI data, including data collected with different acquisition protocols, without requiring anatomical data and inter-modality registration. We train a convolutional neural network (CNN) to learn a tissue segmentation model using a novel augmented target loss function designed to improve accuracy in regions of tissue boundary. To further improve accuracy, our method adds diffusion kurtosis imaging (DKI) parameters that characterize non-Gaussian water molecule diffusion to the conventional diffusion tensor imaging parameters. The DKI parameters are calculated from the recently proposed mean-kurtosis-curve method that corrects implausible DKI parameter values and provides additional features that discriminate between tissue types. We demonstrate high tissue segmentation accuracy on HCP data, and also when applying the HCP-trained model on dMRI data from other acquisitions with lower resolution and fewer gradient directions.
2020
Dalamagkas K, Tsintou M, Rathi Y, O'Donnell LJ, Pasternak O, Gong X, Zhu A, Savadjiev P, Papadimitriou GM, Kubicki M, et al. Individual Variations of the Human Corticospinal Tract and Its Hand-Related Motor Fibers Using Diffusion MRI Tractography. Brain Imaging Behav. 2020;14 (3) :696-714.Abstract
The corticospinal tract (CST) is one of the most well studied tracts in human neuroanatomy. Its clinical significance can be demonstrated in many notable traumatic conditions and diseases such as stroke, spinal cord injury (SCI) or amyotrophic lateral sclerosis (ALS). With the advent of diffusion MRI and tractography the computational representation of the human CST in a 3D model became available. However, the representation of the entire CST and, specifically, the hand motor area has remained elusive. In this paper we propose a novel method, using manually drawn ROIs based on robustly identifiable neuroanatomic structures to delineate the entire CST and isolate its hand motor representation as well as to estimate their variability and generate a database of their volume, length and biophysical parameters. Using 37 healthy human subjects we performed a qualitative and quantitative analysis of the CST and the hand-related motor fiber tracts (HMFTs). Finally, we have created variability heat maps from 37 subjects for both the aforementioned tracts, which could be utilized as a reference for future studies with clinical focus to explore neuropathology in both trauma and disease states.
Chauhan G, Liao R, Wells W, Andreas J, Wang X, Berkowitz S, Horng S, Szolovits P, Golland P. Joint Modeling of Chest Radiographs and Radiology Reports for Pulmonary Edema Assessment. Med Image Comput Comput Assist Interv. 2020;12262 :529-39.Abstract
We propose and demonstrate a novel machine learning algorithm that assesses pulmonary edema severity from chest radiographs. While large publicly available datasets of chest radiographs and free-text radiology reports exist, only limited numerical edema severity labels can be extracted from radiology reports. This is a significant challenge in learning such models for image classification. To take advantage of the rich information present in the radiology reports, we develop a neural network model that is trained on both images and free-text to assess pulmonary edema severity from chest radiographs at inference time. Our experimental results suggest that the joint image-text representation learning improves the performance of pulmonary edema assessment compared to a supervised model trained on images only. We also show the use of the text for explaining the image classification by the joint model. To the best of our knowledge, our approach is the first to leverage free-text radiology reports for improving the image model performance in this application. Our code is available at: https://github.com/RayRuizhiLiao/joint_chestxray.
Haehn D, Franke L, Zhang F, Cetin-Karayumak S, Pieper S, O'Donnell LJ, Rathi Y. TRAKO: Efficient Transmission of Tractography Data for Visualization. Med Image Comput Comput Assist Interv. 2020;12267 :322-32.Abstract
Fiber tracking produces large tractography datasets that are tens of gigabytes in size consisting of millions of streamlines. Such vast amounts of data require formats that allow for efficient storage, transfer, and visualization. We present TRAKO, a new data format based on the Graphics Layer Transmission Format (glTF) that enables immediate graphical and hardware-accelerated processing. We integrate a state-of-the-art compression technique for vertices, streamlines, and attached scalar and property data. We then compare TRAKO to existing tractography storage methods and provide a detailed evaluation on eight datasets. TRAKO can achieve data reductions of over 28x without loss of statistical significance when used to replicate analysis from previously published studies.
Rushmore RJ, Wilson-Braun P, Papadimitriou G, Ng I, Rathi Y, Zhang F, O'Donnell LJ, Kubicki M, Bouix S, Yeterian E, et al. 3D Exploration of the Brainstem in 50-Micron Resolution MRI. Front Neuroanat. 2020;14 :40.Abstract
The brainstem, a structure of vital importance in mammals, is currently becoming a principal focus in cognitive, affective, and clinical neuroscience. Midbrain, pontine and medullary structures serve as the conduit for signals between the forebrain and spinal cord, are the epicenter of cranial nerve-circuits and systems, and subserve such integrative functions as consciousness, emotional processing, pain, and motivation. In this study, we parcellated the nuclear masses and the principal fiber pathways that were visible in a high-resolution T2-weighted MRI dataset of 50-micron isotropic voxels of a postmortem human brainstem. Based on this analysis, we generated a detailed map of the human brainstem. To assess the validity of our maps, we compared our observations with histological maps of traditional human brainstem atlases. Given the unique capability of MRI-based morphometric analysis in generating and preserving the morphology of 3D objects from individual 2D sections, we reconstructed the motor, sensory and integrative neural systems of the brainstem and rendered them in 3D representations. We anticipate the utilization of these maps by the neuroimaging community for applications in basic neuroscience as well as in neurology, psychiatry, and neurosurgery, due to their versatile computational nature in 2D and 3D representations in a publicly available capacity.
Canalini L, Klein J, Miller D, Kikinis R. Enhanced Registration of Ultrasound Volumes by Segmentation of Resection Cavity in Neurosurgical Procedures. Int J Comput Assist Radiol Surg. 2020;15 (13) :1963-74.Abstract
PURPOSE: Neurosurgeons can have a better understanding of surgical procedures by comparing ultrasound images obtained at different phases of the tumor resection. However, establishing a direct mapping between subsequent acquisitions is challenging due to the anatomical changes happening during surgery. We propose here a method to improve the registration of ultrasound volumes, by excluding the resection cavity from the registration process. METHODS: The first step of our approach includes the automatic segmentation of the resection cavities in ultrasound volumes, acquired during and after resection. We used a convolution neural network inspired by the 3D U-Net. Then, subsequent ultrasound volumes are registered by excluding the contribution of resection cavity. RESULTS: Regarding the segmentation of the resection cavity, the proposed method achieved a mean DICE index of 0.84 on 27 volumes. Concerning the registration of the subsequent ultrasound acquisitions, we reduced the mTRE of the volumes acquired before and during resection from 3.49 to 1.22 mm. For the set of volumes acquired before and after removal, the mTRE improved from 3.55 to 1.21 mm. CONCLUSIONS: We proposed an innovative registration algorithm to compensate the brain shift affecting ultrasound volumes obtained at subsequent phases of neurosurgical procedures. To the best of our knowledge, our method is the first to exclude automatically segmented resection cavities in the registration of ultrasound volumes in neurosurgery.
Zhang F, Cetin Karayumak S, Hoffmann N, Rathi Y, Golby AJ, O'Donnell LJ. Deep White Matter Analysis (DeepWMA): Fast and Consistent Tractography Segmentation. Med Image Anal. 2020;65 :101761.Abstract
White matter tract segmentation, i.e. identifying tractography fibers (streamline trajectories) belonging to anatomically meaningful fiber tracts, is an essential step to enable tract quantification and visualization. In this study, we present a deep learning tractography segmentation method (DeepWMA) that allows fast and consistent identification of 54 major deep white matter fiber tracts from the whole brain. We create a large-scale training tractography dataset of 1 million labeled fiber samples, and we propose a novel 2D multi-channel feature descriptor (FiberMap) that encodes spatial coordinates of points along each fiber. We learn a convolutional neural network (CNN) fiber classification model based on FiberMap and obtain a high fiber classification accuracy of 90.99% on the training tractography data with ground truth fiber labels. Then, the method is evaluated on a test dataset of 597 diffusion MRI scans from six independently acquired populations across genders, the lifespan (1 day - 82 years), and different health conditions (healthy control, neuropsychiatric disorders, and brain tumor patients). We perform comparisons with two state-of-the-art tract segmentation methods. Experimental results show that our method obtains a highly consistent tract segmentation result, where on average over 99% of the fiber tracts are successfully identified across all subjects under study, most importantly, including neonates and patients with space-occupying brain tumors. We also demonstrate good generalization of the method to tractography data from multiple different fiber tracking methods. The proposed method leverages deep learning techniques and provides a fast and efficient tool for brain white matter segmentation in large diffusion MRI tractography datasets.
Levitt JJ, Nestor PG, Kubicki M, Lyall AE, Zhang F, Riklin-Raviv T, O Donnell LJ, McCarley RW, Shenton ME, Rathi Y. Miswiring of Frontostriatal Projections in Schizophrenia. Schizophr Bull. 2020;46 (4) :990-8.Abstract
We investigated brain wiring in chronic schizophrenia and healthy controls in frontostriatal circuits using diffusion magnetic resonance imaging tractography in a novel way. We extracted diffusion streamlines in 27 chronic schizophrenia and 26 healthy controls connecting 4 frontal subregions to the striatum. We labeled the projection zone striatal surface voxels into 2 subtypes: dominant-input from a single cortical subregion, and, functionally integrative, with mixed-input from diverse cortical subregions. We showed: 1) a group difference for total striatal surface voxel number (P = .045) driven by fewer mixed-input voxels in the left (P  = .007), but not right, hemisphere; 2) a group by hemisphere interaction for the ratio quotient between voxel subtypes (P  = .04) with a left (P  = .006), but not right, hemisphere increase in schizophrenia, also reflecting fewer mixed-input voxels; and 3) fewer mixed-input voxel counts in schizophrenia (P  = .045) driven by differences in left hemisphere limbic (P  = .007) and associative (P  = .01), but not sensorimotor, striatum. These results demonstrate a less integrative pattern of frontostriatal structural connectivity in chronic schizophrenia. A diminished integrative pattern yields a less complex input pattern to the striatum from the cortex with less circuit integration at the level of the striatum. Further, as brain wiring occurs during early development, aberrant brain wiring could serve as a developmental biomarker for schizophrenia.
Zhang F, Noh T, Juvekar P, Frisken SF, Rigolo L, Norton I, Kapur T, Pujol S, Wells W, Yarmarkovich A, et al. SlicerDMRI: Diffusion MRI and Tractography Research Software for Brain Cancer Surgery Planning and Visualization. JCO Clin Cancer Inform. 2020;4 :299-309.Abstract
PURPOSE: We present SlicerDMRI, an open-source software suite that enables research using diffusion magnetic resonance imaging (dMRI), the only modality that can map the white matter connections of the living human brain. SlicerDMRI enables analysis and visualization of dMRI data and is aimed at the needs of clinical research users. SlicerDMRI is built upon and deeply integrated with 3D Slicer, a National Institutes of Health-supported open-source platform for medical image informatics, image processing, and three-dimensional visualization. Integration with 3D Slicer provides many features of interest to cancer researchers, such as real-time integration with neuronavigation equipment, intraoperative imaging modalities, and multimodal data fusion. One key application of SlicerDMRI is in neurosurgery research, where brain mapping using dMRI can provide patient-specific maps of critical brain connections as well as insight into the tissue microstructure that surrounds brain tumors. PATIENTS AND METHODS: In this article, we focus on a demonstration of SlicerDMRI as an informatics tool to enable end-to-end dMRI analyses in two retrospective imaging data sets from patients with high-grade glioma. Analyses demonstrated here include conventional diffusion tensor analysis, advanced multifiber tractography, automated identification of critical fiber tracts, and integration of multimodal imagery with dMRI. RESULTS: We illustrate the ability of SlicerDMRI to perform both conventional and advanced dMRI analyses as well as to enable multimodal image analysis and visualization. We provide an overview of the clinical rationale for each analysis along with pointers to the SlicerDMRI tools used in each. CONCLUSION: SlicerDMRI provides open-source and clinician-accessible research software tools for dMRI analysis. SlicerDMRI is available for easy automated installation through the 3D Slicer Extension Manager.
Xie G, Zhang F, Leung L, Mooney MA, Epprecht L, Norton I, Rathi Y, Kikinis R, Al-Mefty O, Makris N, et al. Anatomical Assessment of Trigeminal Nerve Tractography Using Diffusion MRI: A Comparison of Acquisition b-Values and Single- and Multi-Fiber Tracking Strategies. Neuroimage Clin. 2020;25 :102160.Abstract
BACKGROUND: The trigeminal nerve (TGN) is the largest cranial nerve and can be involved in multiple inflammatory, compressive, ischemic or other pathologies. Currently, imaging-based approaches to identify the TGN mostly rely on T2-weighted magnetic resonance imaging (MRI), which provides localization of the cisternal portion of the TGN where the contrast between nerve and cerebrospinal fluid (CSF) is high enough to allow differentiation. The course of the TGN within the brainstem as well as anterior to the cisternal portion, however, is more difficult to display on traditional imaging sequences. An advanced imaging technique, diffusion MRI (dMRI), enables tracking of the trajectory of TGN fibers and has the potential to visualize anatomical regions of the TGN not seen on T2-weighted imaging. This may allow a more comprehensive assessment of the nerve in the context of pathology. To date, most work in TGN tracking has used clinical dMRI acquisitions with a b-value of 1000 s/mm2 and conventional diffusion tensor MRI (DTI) tractography methods. Though higher b-value acquisitions and multi-tensor tractography methods are known to be beneficial for tracking brain white matter fiber tracts, there have been no studies conducted to evaluate the performance of these advanced approaches on nerve tracking of the TGN, in particular on tracking different anatomical regions of the TGN. OBJECTIVE: We compare TGN tracking performance using dMRI data with different b-values, in combination with both single- and multi-tensor tractography methods. Our goal is to assess the advantages and limitations of these different strategies for identifying the anatomical regions of the TGN. METHODS: We proposed seven anatomical rating criteria including true and false positive structures, and we performed an expert rating study of over 1000 TGN visualizations, as follows. We tracked the TGN using high-quality dMRI data from 100 healthy adult subjects from the Human Connectome Project (HCP). TGN tracking performance was compared across dMRI acquisitions with b = 1000 s/mm2, b = 2000 s/mm2 and b = 3000 s/mm2, using single-tensor (1T) and two-tensor (2T) unscented Kalman filter (UKF) tractography. This resulted in a total of six tracking strategies. The TGN was identified using an anatomical region-of-interest (ROI) selection approach. First, in a subset of the dataset we identified ROIs that provided good TGN tracking performance across all tracking strategies. Using these ROIs, the TGN was then tracked in all subjects using the six tracking strategies. An expert rater (GX) visually assessed and scored each TGN based on seven anatomical judgment criteria. These criteria included the presence of multiple expected anatomical segments of the TGN (true positive structures), specifically branch-like structures, cisternal portion, mesencephalic trigeminal tract, and spinal cord tract of the TGN. False positive criteria included the presence of any fibers entering the temporal lobe, the inferior cerebellar peduncle, or the middle cerebellar peduncle. Expert rating scores were analyzed to compare TGN tracking performance across the six tracking strategies. Intra- and inter-rater validation was performed to assess the reliability of the expert TGN rating result. RESULTS: The TGN was selected using two anatomical ROIs (Meckel's Cave and cisternal portion of the TGN). The two-tensor tractography method had significantly better performance on identifying true positive structures, while generating more false positive streamlines in comparison to the single-tensor tractography method. TGN tracking performance was significantly different across the three b-values for almost all structures studied. Tracking performance was reported in terms of the percentage of subjects achieving each anatomical rating criterion. Tracking of the cisternal portion and branching structure of the TGN was generally successful, with the highest performance of over 98% using two-tensor tractography and b = 1000 or b = 2000. However, tracking the smaller mesencephalic and spinal cord tracts of the TGN was quite challenging (highest performance of 37.5% and 57.07%, using two-tensor tractography with b = 1000 and b = 2000, respectively). False positive connections to the temporal lobe (over 38% of subjects for all strategies) and cerebellar peduncles (100% of subjects for all strategies) were prevalent. High joint probability of agreement was obtained in the inter-rater (on average 83%) and intra-rater validation (on average 90%), showing a highly reliable expert rating result. CONCLUSIONS: Overall, the results of the study suggest that researchers and clinicians may benefit from tailoring their acquisition and tracking methodology to the specific anatomical portion of the TGN that is of the greatest interest. For example, tracking of branching structures and TGN-T2 overlap can be best achieved with a two-tensor model and an acquisition using b = 1000 or b = 2000. In general, b = 1000 and b = 2000 acquisitions provided the best-rated tracking results. Further research is needed to improve both sensitivity and specificity of the depiction of the TGN anatomy using dMRI.
Chauvin L, Kumar K, Wachinger C, Vangel M, de Guise J, Desrosiers C, Wells W, Toews M. Neuroimage Signature from Salient Keypoints is Highly Specific to Individuals and Shared by Close Relatives. Neuroimage. 2020;204 :116208.Abstract
Neuroimaging studies typically adopt a common feature space for all data, which may obscure aspects of neuroanatomy only observable in subsets of a population, e.g. cortical folding patterns unique to individuals or shared by close relatives. Here, we propose to model individual variability using a distinctive keypoint signature: a set of unique, localized patterns, detected automatically in each image by a generic saliency operator. The similarity of an image pair is then quantified by the proportion of keypoints they share using a novel Jaccard-like measure of set overlap. Experiments demonstrate the keypoint method to be highly efficient and accurate, using a set of 7536 T1-weighted MRIs pooled from four public neuroimaging repositories, including twins, non-twin siblings, and 3334 unique subjects. All same-subject image pairs are identified by a similarity threshold despite confounds including aging and neurodegenerative disease progression. Outliers reveal previously unknown data labeling inconsistencies, demonstrating the usefulness of the keypoint signature as a computational tool for curating large neuroimage datasets.
Wachinger C, Toews M, Langs G, Wells W, Golland P. Keypoint Transfer for Fast Whole-Body Segmentation. IEEE Trans Med Imaging. 2020;39 (2) :273-82.Abstract
We introduce an approach for image segmentation based on sparse correspondences between keypoints in testing and training images. Keypoints represent automatically identified distinctive image locations, where each keypoint correspondence suggests a transformation between images. We use these correspondences to transfer label maps of entire organs from the training images to the test image. The keypoint transfer algorithm includes three steps: (i) keypoint matching, (ii) voting-based keypoint labeling, and (iii) keypoint-based probabilistic transfer of organ segmentations. We report segmentation results for abdominal organs in whole-body CT and MRI, as well as in contrast-enhanced CT and MRI. Our method offers a speed-up of about three orders of magnitude in comparison to common multi-atlas segmentation, while achieving an accuracy that compares favorably. Moreover, keypoint transfer does not require the registration to an atlas or a training phase. Finally, the method allows for the segmentation of scans with highly variable field-of-view.
2019
Zhang F, Hoffmann N, Cetin Karayumak S, Rathi Y, Golby AJ, O'Donnell LJ. Deep White Matter Analysis: Fast, Consistent Tractography Segmentation Across Populations and dMRI Acquisitions. Med Image Comput Comput Assist Interv. 2019;11766 :599-608.Abstract
We present a deep learning tractography segmentation method that allows fast and consistent white matter fiber tract identification across healthy and disease populations and across multiple diffusion MRI (dMRI) acquisitions. We create a large-scale training tractography dataset of 1 million labeled fiber samples (54 anatomical tracts are included). To discriminate between fibers from different tracts, we propose a novel 2D multi-channel feature descriptor (FiberMap) that encodes spatial coordinates of points along each fiber. We learn a CNN tract classification model based on FiberMap and obtain a high tract classification accuracy of 90.99%. The method is evaluated on a test dataset of 374 dMRI scans from three independently acquired populations across health conditions (healthy control, neuropsychiatric disorders, and brain tumor patients). We perform comparisons with two state-of-the-art white matter tract segmentation methods. Experimental results show that our method obtains a highly consistent segmentation result, where over 99% of the fiber tracts are successfully detected across all subjects under study, most importantly, including patients with space occupying brain tumors. The proposed method leverages deep learning techniques and provides a much faster and more efficient tool for large data analysis than methods using traditional machine learning techniques.
Fan D, Chaudhari NN, Rostowsky KA, Calvillo M, Lee SK, Chowdhury NF, Zhang F, O'Donnell LJ, Irimia A. Post-Traumatic Cerebral Microhemorrhages and their Effects Upon White Matter Connectivity in the Aging Human Brain. Conf Proc IEEE Eng Med Biol Soc. 2019;2019 :198-203.Abstract
Cerebral microbleeds (CMBs), a common manifestation of mild traumatic brain injury (mTBI), have been sporadically implicated in the neurocognitive deficits of mTBI victims but their clinical significance has not been established adequately. Here we investigate the longitudinal effects of post-mTBI CMBs upon the fractional anisotropy (FA) of white matter (WM) in 21 older mTBI patients across the first ~6 months post-injury. CMBs were segmented automatically from susceptibility-weighted imaging (SWI) by leveraging the intensity gradient properties of SWI to identify CMB-related hypointensities using gradient-based edge detection. A detailed diffusion magnetic resonance imaging (dMRI) atlas of WM was used to segment and cluster tractography streamlines whose prototypes were then identified. The correlation coefficient was calculated between (A) FA values at vertices along streamline prototypes and (B) topological (along-streamline) distances between these vertices and the nearest CMB. Across subjects, the CMB identification approach achieved a sensitivity of 97.1% ± 4.7% and a precision of 72.4% ± 11.0% across subjects. The correlation coefficient was found to be negative and, additionally, statistically significant for 12.3% ± 3.5% of WM clusters (p <; 0.05, corrected), whose FA was found to decrease, on average, by 11.8% ± 5.3% across the first 6 months post-injury. These results suggest that CMBs can be associated with deleterious effects upon peri-lesional WM and highlight the vulnerability of older mTBI patients to neurovascular injury.
Kocev B, Hahn HK, Linsen L, Wells WM, Kikinis R. Uncertainty-aware asynchronous scattered motion interpolation using Gaussian process regression. Comput Med Imaging Graph. 2019;72 :1-12.Abstract
We address the problem of interpolating randomly non-uniformly spatiotemporally scattered uncertain motion measurements, which arises in the context of soft tissue motion estimation. Soft tissue motion estimation is of great interest in the field of image-guided soft-tissue intervention and surgery navigation, because it enables the registration of pre-interventional/pre-operative navigation information on deformable soft-tissue organs. To formally define the measurements as spatiotemporally scattered motion signal samples, we propose a novel motion field representation. To perform the interpolation of the motion measurements in an uncertainty-aware optimal unbiased fashion, we devise a novel Gaussian process (GP) regression model with a non-constant-mean prior and an anisotropic covariance function and show through an extensive evaluation that it outperforms the state-of-the-art GP models that have been deployed previously for similar tasks. The employment of GP regression enables the quantification of uncertainty in the interpolation result, which would allow the amount of uncertainty present in the registered navigation information governing the decisions of the surgeon or intervention specialist to be conveyed.
Lyall AE, Savadjiev P, Del Re EC, Seitz J, O'Donnell LJ, Westin C-F, Mesholam-Gately RI, Petryshen T, Wojcik JD, Nestor P, et al. Utilizing Mutual Information Analysis to Explore the Relationship Between Gray and White Matter Structural Pathologies in Schizophrenia. Schizophr Bull. 2019;45 (2) :386-95.Abstract
Schizophrenia has been characterized as a neurodevelopmental disorder, with structural brain abnormalities reported at all stages. However, at present, it remains unclear whether gray and white matter abnormalities represent related or independent pathologies in schizophrenia. In this study, we present findings from an integrative analysis exploring the morphological relationship between gray and white matter in 45 schizophrenia participants and 49 healthy controls. We utilized mutual information (MI), a measure of how much information two variables share, to assess the morphological dependence between gray and white matter in three segments of the corpus callsoum, and the gray matter regions these segments connect: (1) the genu and the left and right rostral middle frontal gyrus (rMFG), (2) the isthmus and the left and right superior temporal gyrus (STG), (3) the splenium and the left and right lateral occipital gyrus (LOG). We report significantly reduced MI between white matter tract dispersion of the right hemispheric callosal connections to the STG and both cortical thickness and area in the right STG in schizophrenia patients, despite a lack of group differences in cortical thickness, surface area, or dispersion. We believe that this reduction in morphological dependence between gray and white matter may reflect a possible decoupling of the developmental processes that shape morphological features of white and gray matter early in life. The present study also demonstrates the importance of studying the relationship between gray and white matter measures, as opposed to restricting analyses to gray and white matter measures independently.

Pages