OBJECTIVE: To investigate how the presence/side of hippocampal sclerosis (HS) are related to the white matter structure of cingulum bundle (CB), arcuate fasciculus (AF), and inferior longitudinal fasciculus (ILF) in mesial temporal lobe epilepsy (MTLE).

METHODS: We acquired diffusion-weighted magnetic resonance imaging (MRI) from 86 healthy and 71 individuals with MTLE (22 righ-HS; right-HS, 34 left-HS; left-HS, and 15 nonlesional MTLE). We utilized two-tensor tractography and fiber clustering to compare fractional anisotropy (FA) of each side/tract between groups. Additionally, we examined the association between FA and nonverbal (WMS-R) and verbal (WMS-R, RAVLT codification) memory performance for MTLE individuals.

RESULTS: White matter abnormalities depended on the side and presence of HS. The left-HS demonstrated widespread abnormalities for all tracts, the right-HS showed lower FA for ipsilateral tracts and the nonlesional MTLE group did not differ from healthy individuals. Results indicate no differences in verbal/nonverbal memory performance between the groups, but trend-level associations between higher FA of visual memory and the left CB (r = 0.286, P = 0.018), verbal memory (RAVLT) and -left CB (r = 0.335, P = 0.005), -right CB (r = 0.286, P = 0.016), and -left AF (r = 0.287, P = 0.017).

SIGNIFICANCE: Our results highlight that the presence and side of HS are crucial to understand the pathophysiology of MTLE. Specifically, left-sided HS seems to be related to widespread bilateral white matter abnormalities. Future longitudinal studies should focus on developing diagnostic and treatment strategies dependent on HS's presence/side.

White matter fiber clustering is an important strategy for white matter parcellation, which enables quantitative analysis of brain connections in health and disease. In combination with expert neuroanatomical labeling, data-driven white matter fiber clustering is a powerful tool for creating atlases that can model white matter anatomy across individuals. While widely used fiber clustering approaches have shown good performance using classical unsupervised machine learning techniques, recent advances in deep learning reveal a promising direction toward fast and effective fiber clustering. In this work, we propose a novel deep learning framework for white matter fiber clustering, Deep Fiber Clustering (DFC), which solves the unsupervised clustering problem as a self-supervised learning task with a domain-specific pretext task to predict pairwise fiber distances. This process learns a high-dimensional embedding feature representation for each fiber, regardless of the order of fiber points reconstructed during tractography. We design a novel network architecture that represents input fibers as point clouds and allows the incorporation of additional sources of input information from gray matter parcellation. Thus, DFC makes use of combined information about white matter fiber geometry and gray matter anatomy to improve the anatomical coherence of fiber clusters. In addition, DFC conducts outlier removal naturally by rejecting fibers with low cluster assignment probability. We evaluate DFC on three independently acquired cohorts, including data from 220 individuals across genders, ages (young and elderly adults), and different health conditions (healthy control and multiple neuropsychiatric disorders). We compare DFC to several state-of-the-art white matter fiber clustering algorithms. Experimental results demonstrate superior performance of DFC in terms of cluster compactness, generalization ability, anatomical coherence, and computational efficiency.

The human thalamus is a highly connected brain structure, which is key for the control of numerous functions and is involved in several neurological disorders. Recently, neuroimaging studies have increasingly focused on the volume and connectivity of the specific nuclei comprising this structure, rather than looking at the thalamus as a whole. However, accurate identification of cytoarchitectonically designed histological nuclei on standard in vivo structural MRI is hampered by the lack of image contrast that can be used to distinguish nuclei from each other and from surrounding white matter tracts. While diffusion MRI may offer such contrast, it has lower resolution and lacks some boundaries visible in structural imaging. In this work, we present a Bayesian segmentation algorithm for the thalamus. This algorithm combines prior information from a probabilistic atlas with likelihood models for both structural and diffusion MRI, allowing segmentation of 25 thalamic labels per hemisphere informed by both modalities. We present an improved probabilistic atlas, incorporating thalamic nuclei identified from histology and 45 white matter tracts surrounding the thalamus identified in ultra-high gradient strength diffusion imaging. We present a family of likelihood models for diffusion tensor imaging, ensuring compatibility with the vast majority of neuroimaging datasets that include diffusion MRI data. The use of these diffusion likelihood models greatly improves identification of nuclear groups versus segmentation based solely on structural MRI. Dice comparison of 5 manually identifiable groups of nuclei to ground truth segmentations show improvements of up to 10 percentage points. Additionally, our chosen model shows a high degree of reliability, with median test-retest Dice scores above 0.85 for four out of five nuclei groups, whilst also offering improved detection of differential thalamic involvement in Alzheimer's disease (AUROC 81.98%). The probabilistic atlas and segmentation tool will be made publicly available as part of the neuroimaging package FreeSurfer.

Sleep disturbances are strongly associated with mild traumatic brain injury (mTBI) and post-traumatic stress disorder (PTSD). PTSD and mTBI have been linked to alterations in white matter (WM) microstructure, but whether poor sleep quality has a compounding effect on WM remains largely unknown. We evaluated sleep and diffusion magnetic resonance imaging (dMRI) data from 180 male post-9/11 veterans diagnosed with (1) PTSD (n = 38), (2) mTBI (n = 25), (3) comorbid PTSD+mTBI (n = 94), and (4) a control group with neither PTSD nor mTBI (n = 23). We compared sleep quality (Pittsburgh Sleep Quality Index, PSQI) between groups using ANCOVAs and calculated regression and mediation models to assess associations between PTSD, mTBI, sleep quality, and WM. Veterans with PTSD and comorbid PTSD+mTBI reported poorer sleep quality than those with mTBI or no history of PTSD or mTBI (p = 0.012 to <0.001). Poor sleep quality was associated with abnormal WM microstructure in veterans with comorbid PTSD+mTBI (p < 0.001). Most importantly, poor sleep quality fully mediated the association between greater PTSD symptom severity and impaired WM microstructure (p < 0.001). Our findings highlight the significant impact of sleep disturbances on brain health in veterans with PTSD+mTBI, calling for sleep-targeted interventions.

Diffusion MRI tractography is an advanced imaging technique that enables in vivo mapping of the brain's white matter connections. White matter parcellation classifies tractography streamlines into clusters or anatomically meaningful tracts. It enables quantification and visualization of whole-brain tractography. Currently, most parcellation methods focus on the deep white matter (DWM), whereas fewer methods address the superficial white matter (SWM) due to its complexity. We propose a novel two-stage deep-learning-based framework, Superficial White Matter Analysis (SupWMA), that performs an efficient and consistent parcellation of 198 SWM clusters from whole-brain tractography. A point-cloud-based network is adapted to our SWM parcellation task, and supervised contrastive learning enables more discriminative representations between plausible streamlines and outliers for SWM. We train our model on a large-scale tractography dataset including streamline samples from labeled long- and medium-range (over 40 mm) SWM clusters and anatomically implausible streamline samples, and we perform testing on six independently acquired datasets of different ages and health conditions (including neonates and patients with space-occupying brain tumors). Compared to several state-of-the-art methods, SupWMA obtains highly consistent and accurate SWM parcellation results on all datasets, showing good generalization across the lifespan in health and disease. In addition, the computational speed of SupWMA is much faster than other methods.

Identifying patterns from the neuroimaging recordings of brain activity related to the unobservable psychological or mental state of an individual can be treated as a unsupervised pattern recognition problem. The main challenges, however, for such an analysis of fMRI data are: a) defining a physiologically meaningful feature-space for representing the spatial patterns across time; b) dealing with the high-dimensionality of the data; and c) robustness to the various artifacts and confounds in the fMRI time-series. In this paper, we present a network-aware feature-space to represent the states of a general network, that enables comparing and clustering such states in a manner that is a) meaningful in terms of the network connectivity structure; b)computationally efficient; c) low-dimensional; and d) relatively robust to structured and random noise artifacts. This feature-space is obtained from a spherical relaxation of the transportation distance metric which measures the cost of trans- porting “mass over the network to transform one function into another. Through theoretical and empirical assessments, we demonstrate the accuracy and efficiency of the approximation, especially for large problems.

This paper presents feature-based alignment (FBA), a general method for efficient and robust model-to-image alignment. Volumetric images, e.g. CT scans of the human body, are modeled probabilistically as a collage of 3D scale-invariant image features within a normalized reference space. Features are incorporated as a latent random variable and marginalized out in computing a maximum a-posteriori alignment solution. The model is learned from features extracted in pre-aligned training images, then fit to features extracted from a new image to identify a globally optimal locally linear alignment solution. Novel techniques are presented for determining local feature orientation and efficiently encoding feature intensity in 3D. Experiments involving difficult magnetic resonance (MR) images of the human brain demonstrate FBA achieves alignment accuracy similar to widely-used registration methods, while requiring a fraction of the memory and computation resources and offering a more robust, globally optimal solution. Experiments on CT human body scans demonstrate FBA as an effective system for automatic human body alignment where other alignment methods break down.

The neural correlates of working memory (WM) in schizophrenia (SZ) have been extensively studied using the multisite fMRI data acquired by the Functional Biomedical Informatics Research Network (fBIRN) consortium. Although univariate and multivariate analysis methods have been variously employed to localize brain responses under differing task conditions, important hypotheses regarding the representation of mental processes in the spatio-temporal patterns of neural recruitment and the differential organization of these mental processes in patients versus controls have not been addressed in this context. This paper uses a multivariate state-space model (SSM) to analyze the differential representation and organization of mental processes of controls and patients performing the Sternberg Item Recognition Paradigm (SIRP) WM task. The SSM is able to not only predict the mental state of the subject from the data, but also yield estimates of the spatial distribution and temporal ordering of neural activity, along with estimates of the hemodynamic response. The dynamical Bayesian modeling approach used in this study was able to find significant differences between the predictability and organization of the working memory processes of SZ patients versus healthy subjects. Prediction of some stimulus types from imaging data in the SZ group was significantly lower than controls, reflecting a greater level of disorganization/heterogeneity of their mental processes. Moreover, the changes in accuracy of predicting the mental state of the subject with respect to parametric modulations, such as memory load and task duration, may have important implications on the neurocognitive models for WM processes in both SZ and healthy adults. Additionally, the SSM was used to compare the spatio-temporal patterns of mental activity across subjects, in a holistic fashion and to derive a low-dimensional representation space for the SIRP task, in which subjects were found to cluster according to their diagnosis.

Traditional models of the human language circuitry encompass three cortical areas, Broca s, Geschwind s and Wernicke s, and their connectivity through white matter fascicles. The neural connectivity deep to these cortical areas remains poorly understood, as does the macroscopic functional organization of the cortico-subcortical language circuitry. In an effort to expand current knowledge, we combined functional MRI (fMRI) and diffusion tensor imaging to explore subject-specific structural and functional macroscopic connectivity, focusing on Broca s area. Fascicles were studied using diffusion tensor imaging fiber tracking seeded from volumes placed manually within the white matter. White matter fascicles and fMRI-derived clusters (antonym-generation task) of positive and negative blood-oxygen-level-dependent (BOLD) signal were co-registered with 3-D renderings of the brain in 12 healthy subjects. Fascicles connecting BOLD-derived clusters were analyzed within specific cortical areas: Broca s, with the pars triangularis, the pars opercularis, and the pars orbitaris; Geschwind s and Wernicke s; the premotor cortex, the dorsal supplementary motor area, the middle temporal gyrus, the dorsal prefrontal cortex and the frontopolar region. We found a functional connectome divisible into three systems-anterior, superior and inferior-around the insula, more complex than previously thought, particularly with respect to a new extended Broca s area. The extended Broca s area involves two new fascicles: the operculo-premotor fascicle comprised of well-organized U-shaped fibers that connect the pars opercularis with the premotor region; and (2) the triangulo-orbitaris system comprised of intermingled U-shaped fibers that connect the pars triangularis with the pars orbitaris. The findings enhance our understanding of language function.

This paper presents feature-based alignment (FBA), a general method for efficient and robust model-to-image alignment. Volumetric images, e.g. CT scans of the human body, are modeled probabilistically as a collage of 3D scale-invariant image features within a normalized reference space. Features are incorporated as a latent random variable and marginalized out in computing a maximum a posteriori alignment solution. The model is learned from features extracted in pre-aligned training images, then fit to features extracted from a new image to identify a globally optimal locally linear alignment solution. Novel techniques are presented for determining local feature orientation and efficiently encoding feature intensity in 3D. Experiments involving difficult magnetic resonance (MR) images of the human brain demonstrate FBA achieves alignment accuracy similar to widely-used registration methods, while requiring a fraction of the memory and computation resources and offering a more robust, globally optimal solution. Experiments on CT human body scans demonstrate FBA as an effective system for automatic human body alignment where other alignment methods break down.

We propose a hierarchical Bayesian model for analyzing multi-site experimental fMRI studies. Our method takes the hierarchical structure of the data (subjects are nested within sites, and there are multiple observations per subject) into account and allows for modeling between-site variation. Using posterior predictive model checking and model selection based on the deviance information criterion (DIC), we show that our model provides a good fit to the observed data by sharing information across the sites. We also propose a simple approach for evaluating the efficacy of the multi-site experiment by comparing the results to those that would be expected in hypothetical single-site experiments with the same sample size.

In settings where high-level inferences are made based on registered image data, the registration uncertainty can contain important information. In this article, we propose a Bayesian non-rigid registration framework where conventional dissimilarity and regularization energies can be included in the likelihood and the prior distribution on deformations respectively through the use of Boltzmann’s distribution. The posterior distribution is characterized using Markov Chain Monte Carlo (MCMC) methods with the effect of the Boltzmann temperature hyper-parameters marginalized under broad uninformative hyper-prior distributions. The MCMC chain permits estimation of the most likely deformation as well as the associated uncertainty. On synthetic examples, we demonstrate the ability of the method to identify the maximum a posteriori estimate and the associated posterior uncertainty, and demonstrate that the posterior distribution can be non-Gaussian. Additionally, results from registering clinical data acquired during neurosurgery for resection of brain tumor are provided; we compare the method to single transformation results from a deterministic optimizer and introduce methods that summarize the high-dimensional uncertainty. At the site of resection, the registration uncertainty increases and the marginal distribution on deformations is shown to be multi-modal.

The clustering of fibers into bundles is an important task in studying the structure and function of white matter. Existing technology mostly relies on geometrical features, such as the shape of fibers, and thus only provides very limited information about the neuroanatomical function of the brain. We advance this issue by proposing a multinomial representation of fibers decoding their connectivity to gray matter regions. We then simplify the clustering task by first deriving a compact encoding of our representation via the logit transformation. Furthermore, we define a distance between fibers that is in theory invariant to parcellation biases and is equivalent to a family of Riemannian metrics on the simplex of multinomial probabilities. We apply our method to longitudinal scans of two healthy subjects showing high reproducibility of the resulting fiber bundles without needing to register the corresponding scans to a common coordinate system. We confirm these qualitative findings via a simple statistical analyse of the fiber bundles.

This paper proposes a method for aligning image volumes acquired from different imaging modalities (e.g. MR, CT) based on 3D scale-invariant image features. A novel method for encoding invariant feature geometry and appearance is developed, based on the assumption of locally linear intensity relationships, providing a solution to poor repeatability of feature detection in different image modalities. The encoding method is incorporated into a probabilistic feature-based model for multi-modal image alignment. The model parameters are estimated via a group-wise alignment algorithm, that iteratively alternates between estimating a feature-based model from feature data, then realigning feature data to the model, converging to a stable alignment solution with few pre-processing or pre-alignment requirements. The resulting model can be used to align multi-modal image data with the benefits of invariant feature correspondence: globally optimal solutions, high efficiency and low memory usage. The method is tested on the difficult RIRE data set of CT, T1, T2, PD and MP-RAGE brain images of subjects exhibiting significant inter-subject variability due to pathology.

Intensity-based image registration requires resampling images on a common grid to evaluate the similarity function. The uncertainty of interpolation varies across the image, depending on the location of resampled points relative to the base grid. We propose to perform Bayesian inference with Gaussian processes, where the covariance matrix of the Gaussian process posterior distribution estimates the uncertainty in interpolation. The Gaussian process replaces a single image with a distribution over images that we integrate into a generative model for registration. Marginalization over resampled images leads to a new similarity measure that includes the uncertainty of the interpolation. We demonstrate that our approach increases the registration accuracy and propose an efficient approximation scheme that enables seamless integration with existing registration methods.

This paper reports on a new computational methodology, inter-slice correspondence (ISC), for robustly aligning sets of 2D ultrasound (US) slices during image-guided medical procedures. Correspondences are derived from distinctive, local scale-invariant features, which are used in one-to-many matching of US slices in near real-time despite out-of-plane rotation, in addition to global in-plane similarity transforms, occlusion, missing tissue, US plane mirroring, changes in US probe depth settings. Experiments demonstrate that ISC can align manually-acquired US slices without probe tracking information in the context of image-guided neurosurgery, with an accuracy of 1.3mm. A novel reconstruction-without-calibration application based on ISC is proposed, where 3D US reconstruction results are very similar to those obtained via traditional phantom-based calibration.

Deformable image registration is used increasingly in image-guided interventions and other applications. However, validation and characterization of registration performance remain areas that require further study. We propose an analysis methodology for deriving tolerance limits on the initial conditions for deformable registration that reliably lead to a successful registration. This approach results in a concise summary of the probability of registration failure, while accounting for the variability in the test data. The (β, γ) tolerance limit can be interpreted as a value of the input parameter that leads to successful registration outcome in at least 100β% of cases with the 100γ% confidence. The utility of the methodology is illustrated by summarizing the performance of a deformable registration algorithm evaluated in three different experimental setups of increasing complexity. Our examples are based on clinical data collected during MRI-guided prostate biopsy registered using publicly available deformable registration tool. The results indicate that the proposed methodology can be used to generate concise graphical summaries of the experiments, as well as a probabilistic estimate of the registration outcome for a future sample. Its use may facilitate improved objective assessment, comparison and retrospective stress-testing of deformable.

We present an image segmentation method that transfers label maps of entire organs from the training images to the novel image to be segmented. The transfer is based on sparse correspondences between keypoints that represent automatically identified distinctive image locations. Our segmentation algorithm consists of three steps: (i) keypoint matching, (ii) voting-based keypoint labeling, and (iii) keypoint-based probabilistic transfer of organ label maps. We introduce generative models for the inference of keypoint labels and for image segmentation, where keypoint matches are treated as a latent random variable and are marginalized out as part of the algorithm. We report segmentation results for abdominal organs in whole-body CT and in contrast-enhanced CT images. The accuracy of our method compares favorably to common multi-atlas segmentation while offering a speed-up of about three orders of magnitude. Furthermore, keypoint transfer requires no training phase or registration to an atlas. The algorithm’s robustness enables the segmentation of scans with highly variable field-of-view.

The analysis of the connectome of the human brain provides key insight into the brain’s organisation and function, and its evolution in disease or ageing. Parcellation of the cortical surface into distinct regions in terms of structural connectivity is an essential step that can enable such analysis. The estimation of a stable connectome across a population of healthy subjects requires the estimation of a groupwise parcellation that can capture the variability of the connectome across the population. This problem has solely been addressed in the literature via averaging of connectivity profiles or finding correspondences between individual parcellations a posteriori. In this paper, we propose a groupwise parcellation method of the cortex based on diffusion MR images (dMRI). We borrow ideas from the area of cosegmentation in computer vision and directly estimate a consistent parcellation across different subjects and scales through a spectral clustering approach. The parcellation is driven by the tractography connectivity profiles, and information between subjects and across scales. Promising qualitative and quantitative results on a sizeable data-set demonstrate the strong potential of the method.

This paper proposes an inference method well-suited to large sets of medical images. The method is based upon a framework where distinctive 3D scale-invariant features are indexed efficiently to identify approximate nearest-neighbor (NN) feature matches-in O (log N) computational complexity in the number of images N. It thus scales well to large data sets, in contrast to methods based on pair-wise image registration or feature matching requiring O(N) complexity. Our theoretical contribution is a density estimator based on a generative model that generalizes kernel density estimation and K-nearest neighbor (KNN) methods.. The estimator can be used for on-the-fly queries, without requiring explicit parametric models or an off-line training phase. The method is validated on a large multi-site data set of 95,000,000 features extracted from 19,000 lung CT scans. Subject-level classification identifies all images of the same subjects across the entire data set despite deformation due to breathing state, including unintentional duplicate scans. State-of-the-art performance is achieved in predicting chronic pulmonary obstructive disorder (COPD) severity across the 5-category GOLD clinical rating, with an accuracy of 89% if both exact and one-off predictions are considered correct.

BACKGROUND AND PURPOSE: Diffusion tensor imaging (DTI) tractography reconstruction of white matter pathways can help guide brain tumor resection. However, DTI tracts are complex mathematical objects and the validity of tractography-derived information in clinical settings has yet to be fully established. To address this issue, we initiated the DTI Challenge, an international working group of clinicians and scientists whose goal was to provide standardized evaluation of tractography methods for neurosurgery. The purpose of this empirical study was to evaluate different tractography techniques in the first DTI Challenge workshop. METHODS: Eight international teams from leading institutions reconstructed the pyramidal tract in four neurosurgical cases presenting with a glioma near the motor cortex. Tractography methods included deterministic, probabilistic, filtered, and global approaches. Standardized evaluation of the tracts consisted in the qualitative review of the pyramidal pathways by a panel of neurosurgeons and DTI experts and the quantitative evaluation of the degree of agreement among methods. RESULTS: The evaluation of tractography reconstructions showed a great interalgorithm variability. Although most methods found projections of the pyramidal tract from the medial portion of the motor strip, only a few algorithms could trace the lateral projections from the hand, face, and tongue area. In addition, the structure of disagreement among methods was similar across hemispheres despite the anatomical distortions caused by pathological tissues. CONCLUSIONS: The DTI Challenge provides a benchmark for the standardized evaluation of tractography methods on neurosurgical data. This study suggests that there are still limitations to the clinical use of tractography for neurosurgical decision making.

Ultrasound is becoming an ever increasingly important modality in medical care. However, underlying physical acquisition principles are prone to image artifacts and result in overall quality variation. Therefore processing medical ultrasound data remains a challenging task. We propose a novel distribution-based measure of assessing the confidence in the signal, which emphasizes uncertainty in attenuated as well as shadow regions. In contrast to the similar recently proposed method that relies on image intensities, the new approach makes use of the enveloped-detected radio-frequency data, facilitating the use of Nakagami speckle statistics. Employing J-divergence as distance measure for the random-walk based algorithm, provides a natural measure of similarity, yielding a more reliable estimate of confidence. For evaluation of the model’s performance, tests are conducted on the application of shadow detection. Additionally, computed maps are presented for different organs such as neck, liver and prostate, showcasing the properties of the model. The probabilistic approach is shown to have beneficial features for image processing tasks. 

The National Alliance for Medical Image Computing (NA-MIC) was launched in 2004 with the goal of investigating and developing an open source software infrastructure for the extraction of information and knowledge from medical images using computational methods. Several leading research and engineering groups participated in this effort that was funded by the US National Institutes of Health through a variety of infrastructure grants. This effort transformed 3D Slicer from an internal, Boston-based, academic research software application into a professionally maintained, robust, open source platform with an international leadership and developer and user communities. Critical improvements to the widely used underlying open source libraries and tools-VTK, ITK, CMake, CDash, DCMTK-were an additional consequence of this effort. This project has contributed to close to a thousand peer-reviewed publications and a growing portfolio of US and international funded efforts expanding the use of these tools in new medical computing applications every year. In this editorial, we discuss what we believe are gaps in the way medical image computing is pursued today; how a well-executed research platform can enable discovery, innovation and reproducible science ("Open Science"); and how our quest to build such a software platform has evolved into a productive and rewarding social engineering exercise in building an open-access community with a shared vision.