Multimodal neuroimaging is increasingly used in neuroscience research, as it overcomes the limitations of individual modalities. One of the most important applications of multimodal neuroimaging is the provision of vital diagnostic data for neuropsychiatric disorders. Multimodal neuroimaging computing enables the visualization and quantitative analysis of the alterations in brain structure and function, and has reshaped how neuroscience research is carried out. Research in this area is growing exponentially, and so it is an appropriate time to review the current and future development of this emerging area. Hence, in this paper, we review the recent advances in multimodal neuroimaging (MRI, PET) and electrophysiological (EEG, MEG) technologies, and their applications to the neuropsychiatric disorders. We also outline some future directions for multimodal neuroimaging where researchers will design more advanced methods and models for neuropsychiatric research.
The last two decades have witnessed the explosive growth in the development and use of noninvasive neuroimaging technologies that advance the research on human brain under normal and pathological conditions. Multimodal neuroimaging has become a major driver of current neuroimaging research due to the recognition of the clinical benefits of multimodal data, and the better access to hybrid devices. Multimodal neuroimaging computing is very challenging, and requires sophisticated computing to address the variations in spatiotemporal resolution and merge the biophysical/biochemical information. We review the current workflows and methods for multimodal neuroimaging computing, and also demonstrate how to conduct research using the established neuroimaging computing packages and platforms.
Ning L, Laun F, Gur Y, DiBella ER V, Deslauriers-Gauthier S, Megherbi T, Ghosh A, Zucchelli M, Menegaz G, Fick R, St-Jean S, Paquette M, Aranda R, Descoteaux M, Deriche R, Donnell LO, Rathi Y. Sparse Reconstruction Challenge for diffusion MRI: Validation on a physical phantom to determine which acquisition scheme and analysis method to use?. Med Image Anal. 2015;26(1):316–31.
Diffusion magnetic resonance imaging (dMRI) is the modality of choice for investigating in-vivo white matter connectivity and neural tissue architecture of the brain. The diffusion-weighted signal in dMRI reflects the diffusivity of water molecules in brain tissue and can be utilized to produce image-based biomarkers for clinical research. Due to the constraints on scanning time, a limited number of measurements can be acquired within a clinically feasible scan time. In order to reconstruct the dMRI signal from a discrete set of measurements, a large number of algorithms have been proposed in recent years in conjunction with varying sampling schemes, i.e., with varying b-values and gradient directions. Thus, it is imperative to compare the performance of these reconstruction methods on a single data set to provide appropriate guidelines to neuroscientists on making an informed decision while designing their acquisition protocols. For this purpose, the SPArse Reconstruction Challenge (SPARC) was held along with the workshop on Computational Diffusion MRI (at MICCAI 2014) to validate the performance of multiple reconstruction methods using data acquired from a physical phantom. A total of 16 reconstruction algorithms (9 teams) participated in this community challenge. The goal was to reconstruct single b-value and/or multiple b-value data from a sparse set of measurements. In particular, the aim was to determine an appropriate acquisition protocol (in terms of the number of measurements, b-values) and the analysis method to use for a neuroimaging study. The challenge did not delve on the accuracy of these methods in estimating model specific measures such as fractional anisotropy (FA) or mean diffusivity, but on the accuracy of these methods to fit the data. This paper presents several quantitative results pertaining to each reconstruction algorithm. The conclusions in this paper provide a valuable guideline for choosing a suitable algorithm and the corresponding data-sampling scheme for clinical neuroscience applications.
Segmentation of anatomical structures in medical imagery is a key step in a variety of clinical applications. Designing a generic, automated method that works for various structures and imaging modalities is a daunting task. Instead of proposing a new specific segmentation algorithm, in this paper, we present a general design principle on how to integrate user interactions from the perspective of control theory. In this formulation, Lyapunov stability analysis is employed to design and analyze an interactive segmentation system. The effectiveness and robustness of the proposed method are demonstrated.
In multiatlas segmentation, one typically registers several atlases to the novel image, and their respective segmented label images are transformed and fused to form the final segmentation. In this work, we provide a new dynamical system perspective for multiatlas segmentation, inspired by the following fact: The transformation that aligns the current atlas to the novel image can be not only computed by direct registration but also inferred from the transformation that aligns the previous atlas to the image together with the transformation between the two atlases. This process is similar to the global positioning system on a vehicle, which gets position by inquiring from the satellite and by employing the previous location and velocity-neither answer in isolation being perfect. To solve this problem, a dynamical system scheme is crucial to combine the two pieces of information; for example, a Kalman filtering scheme is used. Accordingly, in this work, a Kalman multiatlas segmentation is proposed to stabilize the global/affine registration step. The contributions of this work are twofold. First, it provides a new dynamical systematic perspective for standard independent multiatlas registrations, and it is solved by Kalman filtering. Second, with very little extra computation, it can be combined with most existing multiatlas segmentation schemes for better registration/segmentation accuracy.
Wang D, Buckner RL, Fox MD, Holt DJ, Holmes AJ, Stoecklein S, Langs G, Pan R, Qian T, Li K, Baker JT, Stufflebeam SM, Wang K, Wang X, Hong B, Liu H. Parcellating Cortical Functional Networks in Individuals. Nat Neurosci. 2015;18(12):1853–60.
The capacity to identify the unique functional architecture of an individual’s brain is a crucial step toward personalized medicine and understanding the neural basis of variation in human cognition and behavior. Here we developed a cortical parcellation approach to accurately map functional organization at the individual level using resting-state functional magnetic resonance imaging (fMRI). A population-based functional atlas and a map of inter-individual variability were employed to guide the iterative search for functional networks in individual subjects. Functional networks mapped by this approach were highly reproducible within subjects and effectively captured the variability across subjects, including individual differences in brain lateralization. The algorithm performed well across different subject populations and data types, including task fMRI data. The approach was then validated by invasive cortical stimulation mapping in surgical patients, suggesting potential for use in clinical applications.
Volumes reconstructed from tracked planar ultrasound images often contain regions where no information was recorded. Existing interpolation methods introduce image artifacts and tend to be slow in filling large missing regions. Our goal was to develop a computationally efficient method that fills missing regions while adequately preserving image features. We use directional sticks to interpolate between pairs of known opposing voxels in nearby images. We tested our method on 30 volumetric ultrasound scans acquired from human subjects, and compared its performance to that of other published hole-filling methods. Reconstruction accuracy, fidelity, and time were improved compared with other methods.
To enhance neuro-navigation, high quality pre-operative images must be registered onto intra-operative configuration of the brain. Therefore evaluation of the degree to which structures may remain misaligned after registration is critically important. We consider two Hausdorff Distance (HD)-based evaluation approaches: the edge-based HD (EBHD) metric and the Robust HD (RHD) metric as well as various commonly used intensity-based similarity metrics such as Mutual Information (MI), Normalised Mutual Information (NMI), Entropy Correlation Coefficient (ECC), Kullback-Leibler Distance (KLD) and Correlation Ratio (CR). We conducted the evaluation by applying known deformations to simple sample images and real cases of brain shift. We conclude that the intensity-based similarity metrics such as MI, NMI, ECC, KLD and CR do not correlate well with actual alignment errors, and hence are not useful for assessing misalignment. On the contrary, the EBHD and the RHD metrics correlated well with actual alignment errors; however, they have been found to underestimate the actual misalignment. We also note that it is beneficial to present HD results as a percentile-HD curve rather than a single number such as the 95-percentile HD. Percentile-HD curves present the full range of alignment errors and also facilitate the comparison of results obtained using different approaches. Furthermore, the qualities that should be possessed by an ideal evaluation metric were highlighted. Future studies could focus on developing such an evaluation metric.
Chen Z, Tie Y, Olubiyi O, Rigolo L, Mehrtash A, Norton I, Pasternak O, Rathi Y, Golby AJ, Donnell LJO. Reconstruction of the arcuate fasciculus for surgical planning in the setting of peritumoral edema using two-tensor unscented Kalman filter tractography. Neuroimage Clin. 2015;7:815–22.
BACKGROUND: Diffusion imaging tractography is increasingly used to trace critical fiber tracts in brain tumor patients to reduce the risk of post-operative neurological deficit. However, the effects of peritumoral edema pose a challenge to conventional tractography using the standard diffusion tensor model. The aim of this study was to present a novel technique using a two-tensor unscented Kalman filter (UKF) algorithm to track the arcuate fasciculus (AF) in brain tumor patients with peritumoral edema. METHODS: Ten right-handed patients with left-sided brain tumors in the vicinity of language-related cortex and evidence of significant peritumoral edema were retrospectively selected for the study. All patients underwent 3-Tesla magnetic resonance imaging (MRI) including a diffusion-weighted dataset with 31 directions. Fiber tractography was performed using both single-tensor streamline and two-tensor UKF tractography. A two-regions-of-interest approach was applied to perform the delineation of the AF. Results from the two different tractography algorithms were compared visually and quantitatively. RESULTS: Using single-tensor streamline tractography, the AF appeared disrupted in four patients and contained few fibers in the remaining six patients. Two-tensor UKF tractography delineated an AF that traversed edematous brain areas in all patients. The volume of the AF was significantly larger on two-tensor UKF than on single-tensor streamline tractography (p
Whole-body computed tomography (CT) image registration is important for cancer diagnosis, therapy planning and treatment. Such registration requires accounting for large differences between source and target images caused by deformations of soft organs/tissues and articulated motion of skeletal structures. The registration algorithms relying solely on image processing methods exhibit deficiencies in accounting for such deformations and motion. We propose to predict the deformations and movements of body organs/tissues and skeletal structures for whole-body CT image registration using patient-specific non-linear biomechanical modelling. Unlike the conventional biomechanical modelling, our approach for building the biomechanical models does not require time-consuming segmentation of CT scans to divide the whole body into non-overlapping constituents with different material properties. Instead, a Fuzzy C-Means (FCM) algorithm is used for tissue classification to assign the constitutive properties automatically at integration points of the computation grid. We use only very simple segmentation of the spine when determining vertebrae displacements to define loading for biomechanical models. We demonstrate the feasibility and accuracy of our approach on CT images of seven patients suffering from cancer and aortic disease. The results confirm that accurate whole-body CT image registration can be achieved using a patient-specific non-linear biomechanical model constructed without time-consuming segmentation of the whole-body images.