Segmentation of anatomical structures in medical imagery is a key step in a variety of clinical applications. Designing a generic, automated method that works for various structures and imaging modalities is a daunting task. In this paper, we present an effective interactive segmentation method that reformulates the GrowCut algorithm as a clustering problem and computes a fast, approximate solution. The method is further improved by using an efficient updating scheme requiring only local computations when new user input becomes available, making it applicable to high resolution images. The algorithm may easily be included as a user-oriented software module in any number of available medical imaging/image processing platforms such as 3D Slicer. The efficiency and effectiveness of the algorithm are demonstrated through tests on several challenging data sets where it is also compared to standard GrowCut.
Introducing BrainPrint, a compact and discriminative representation of anatomical structures in the brain. BrainPrint captures shape information of an ensemble of cortical and subcortical structures by solving the 2D and 3D Laplace-Beltrami operator on triangular (boundary) and tetrahedral (volumetric) meshes. We derive a robust classifier for this representation that identifies the subject in a new scan, based on a database of brain scans. In an example dataset containing over 3000 MRI scans, we show that BrainPrint captures unique information about the subject's anatomy and permits to correctly classify a scan with an accuracy of over 99.8%. All processing steps for obtaining the compact representation are fully automated making this processing framework particularly attractive for handling large datasets.
Intensity-based image registration requires resampling images on a common grid to evaluate the similarity function. The uncertainty of interpolation varies across the image, depending on the location of resampled points relative to the base grid. We propose to perform Bayesian inference with Gaussian processes, where the covariance matrix of the Gaussian process posterior distribution estimates the uncertainty in interpolation. The Gaussian process replaces a single image with a distribution over images that we integrate into a generative model for registration. Marginalization over resampled images leads to a new similarity measure that includes the uncertainty of the interpolation. We demonstrate that our approach increases the registration accuracy and propose an efficient approximation scheme that enables seamless integration with existing registration methods.
Many studies have observed altered neurofunctional and structural organization in the aging brain. These observations from functional neuroimaging studies show a shift in brain activity from the posterior to the anterior regions with aging (PASA model), as well as a decrease in cortical thickness, which is more pronounced in the frontal lobe followed by the parietal, occipital, and temporal lobes (retrogenesis model). However, very little work has been done using diffusion MRI (dMRI) with respect to examining the structural tissue alterations underlying these neurofunctional changes in the gray matter. Thus, for the first time, we propose to examine gray matter changes using diffusion MRI in the context of aging. In this work, we propose a novel dMRI based measure of gray matter "heterogeneity" that elucidates these functional and structural models (PASA and retrogenesis) of aging from the viewpoint of diffusion MRI. In a cohort of 85 subjects (all males, ages 15-55 years), we show very high correlation between age and "heterogeneity" (a measure of structural layout of tissue in a region-of-interest) in specific brain regions. We examine gray matter alterations by grouping brain regions into anatomical lobes as well as functional zones. Our findings from dMRI data connects the functional and structural domains and confirms the "retrogenesis" hypothesis of gray matter alterations while lending support to the neurofunctional PASA model of aging in addition to showing the preservation of paralimbic areas during healthy aging.
Deformable image registration is used increasingly in image-guided interventions and other applications. However, validation and characterization of registration performance remain areas that require further study. We propose an analysis methodology for deriving tolerance limits on the initial conditions for deformable registration that reliably lead to a successful registration. This approach results in a concise summary of the probability of registration failure, while accounting for the variability in the test data. The (β, γ) tolerance limit can be interpreted as a value of the input parameter that leads to successful registration outcome in at least 100β% of cases with the 100γ% confidence. The utility of the methodology is illustrated by summarizing the performance of a deformable registration algorithm evaluated in three different experimental setups of increasing complexity. Our examples are based on clinical data collected during MRI-guided prostate biopsy registered using publicly available deformable registration tool. The results indicate that the proposed methodology can be used to generate concise graphical summaries of the experiments, as well as a probabilistic estimate of the registration outcome for a future sample. Its use may facilitate improved objective assessment, comparison and retrospective stress-testing of deformable.
Tumor associated seizures (TAS) are common and cause significant morbidity. Both imaging and gene expression features play significant roles in determining TAS, with strong interactions between them. We describe gene expression imaging tools which allow mapping of brain regions where gene expression has significant influence on TAS, and apply these methods to study 77 patients who underwent surgical evaluation for supratentorial glioblastomas. Tumor size and location were measured from MRI scans. A 9-set gene expression profile predicting long-term survivors was obtained from RNA derived from formalin-fixed paraffin embedded tissue. A total of 32 patients (42%) experienced preoperative TAS. Tumor volume was smaller (31.1 vs. 58.8 cubic cm, p<0.001) and there was a trend toward median survival being higher (48.4 vs. 32.7 months, p=0.055) in patients with TAS. Although the expression of only OLIG2 was significantly lower in patients with TAS in a groupwise analysis, gene expression imaging analysis revealed regions with significantly lower expression of OLIG2 and RTN1 in patients with TAS. Gene expression imaging is a powerful technique that demonstrates that the influence of gene expression on TAS is highly region specific. Regional variability should be evaluated with any genomic or molecular markers of solid brain lesions.
The normal human brain is characterized by a pattern of gross anatomical asymmetry. This pattern, known as the "torque", is associated with a sexual dimorphism: The male brain tends to be more asymmetric than that of the female. This fact, along with well-known sex differences in brain development (faster in females) and onset of psychosis (earlier with worse outcome in males), has led to the theory that schizophrenia is a disorder in which sex-dependent abnormalities in the development of brain torque, the correlate of the capacity for language, cause alterations in interhemispheric connectivity, which are causally related to psychosis (Crow TJ, Paez P, Chance SE. 2007. Callosal misconnectivity and the sex difference in psychosis. Int Rev Psychiatry. 19(4):449-457.). To provide evidence toward this theory, we analyze the geometry of interhemispheric white matter connections in adolescent-onset schizophrenia, with a particular focus on sex, using a recently introduced framework for white matter geometry computation in diffusion tensor imaging data (Savadjiev P, Kindlmann GL, Bouix S, Shenton ME, Westin CF. 2010. Local white geometry from diffusion tensor gradients. Neuroimage. 49(4):3175-3186.). Our results reveal a pattern of sex-dependent white matter geometry abnormalities that conform to the predictions of Crow's torque theory and correlate with the severity of patients' symptoms. To the best of our knowledge, this is the first study to associate geometrical differences in white matter connectivity with torque in schizophrenia.
This tutorial demonstrates how to prepare data for 3D printing using the open source software 3D Slicer. The following topics are highlighted in the tutorial: introduction to the 3D Slicer interface, loading data into 3D Slicer, volume rendering, cropping image volumes, creating label maps, creating surface models, and saving data in file formats appropriate for 3D printing.
When multiple persons speak simultaneously, it may be difficult for the listener to direct attention to correct sound objects among conflicting ones. This could occur, for example, in an emergency situation in which one hears conflicting instructions and the loudest, instead of the wisest, voice prevails. Here, we used cortically-constrained oscillatory MEG/EEG estimates to examine how different brain regions, including caudal anterior cingulate (cACC) and dorsolateral prefrontal cortices (DLPFC), work together to resolve these kinds of auditory conflicts. During an auditory flanker interference task, subjects were presented with sound patterns consisting of three different voices, from three different directions (45° left, straight ahead, 45° right), sounding out either the letters "A" or "O". They were asked to discriminate which sound was presented centrally and ignore the flanking distracters that were phonetically either congruent (50%) or incongruent (50%) with the target. Our cortical MEG/EEG oscillatory estimates demonstrated a direct relationship between performance and brain activity, showing that efficient conflict resolution, as measured with reduced conflict-induced RT lags, is predicted by theta/alpha phase coupling between cACC and right lateral frontal cortex regions intersecting the right frontal eye fields (FEF) and DLPFC, as well as by increased pre-stimulus gamma (60-110 Hz) power in the left inferior fontal cortex. Notably, cACC connectivity patterns that correlated with behavioral conflict-resolution measures were found during both the pre-stimulus and the pre-response periods. Our data provide evidence that, instead of being only transiently activated upon conflict detection, cACC is involved in sustained engagement of attentional resources required for effective sound object selection performance.
Although diffusion tensor imaging (DTI) studies have reported fractional anisotropy (FA) abnormalities in multiple white matter (WM) regions in schizophrenia, relationship between abnormal FA and negative symptoms has not been fully explored. DTI data were acquired from twenty-four patients with chronic schizophrenia and twenty-five healthy controls. Regional brain abnormalities were evaluated by conducting FA comparisons in the cerebral and each lobar WMs between groups. Focal abnormalities were also evaluated with a voxel-wise tract specific method. Associations between structural WM changes and negative symptoms were assessed using the Scale for the Assessment of Negative Symptoms (SANS). The patient group showed decreased FA in the cerebrum, especially in the frontal lobe, compared with controls. A voxel-wise analysis showed FA decreases in almost all WM tracts in schizophrenia. Correlation analyses demonstrated negative relationships between FA in the cerebrum, particularly in the left hemisphere, and SANS global and global rating scores (Anhedonia-Asociality, Attention, and Affective-Flattening), and also associations between FA of left frontal lobe and SANS global score, Anhedonia-Asociality, and Attention. This study demonstrates that patients with chronic schizophrenia evince widespread cerebral FA abnormalities and that these abnormalities, especially in the left hemisphere, are associated with negative symptoms.
The left ventricular myocardium plays a key role in the entire circulation system and an automatic delineation of the myocardium is a prerequisite for most of the subsequent functional analysis. In this paper, we present a complete system for an automatic segmentation of the left ventricular myocardium from cardiac computed tomography (CT) images using the shape information from images to be segmented. The system follows a coarse-to-fine strategy by first localizing the left ventricle and then deforming the myocardial surfaces of the left ventricle to refine the segmentation. In particular, the blood pool of a CT image is extracted and represented as a triangulated surface. Then, the left ventricle is localized as a salient component on this surface using geometric and anatomical characteristics. After that, the myocardial surfaces are initialized from the localization result and evolved by applying forces from the image intensities with a constraint based on the initial myocardial surface locations. The proposed framework has been validated on 34-human and 12-pig CT images, and the robustness and accuracy are demonstrated.
A study was conducted to test the hypothesis that instruction with graphically integrated representations of whole and sectional neuroanatomy is especially effective for learning to recognize neural structures in sectional imagery (such as MRI images). Neuroanatomy was taught to two groups of participants using computer graphical models of the human brain. Both groups learned whole anatomy first with a three-dimensional model of the brain. One group then learned sectional anatomy using two-dimensional sectional representations, with the expectation that there would be transfer of learning from whole to sectional anatomy. The second group learned sectional anatomy by moving a virtual cutting plane through the three-dimensional model. In tests of long-term retention of sectional neuroanatomy, the group with graphically integrated representation recognized more neural structures that were known to be challenging to learn. This study demonstrates the use of graphical representation to facilitate a more elaborated (deeper) understanding of complex spatial relations.
BACKGROUND: The fornix is a compact bundle of white matter fibers that project from the hippocampus to the mamillary bodies and septal nuclei. Its association with memory, as well as with symptoms in schizophrenia, has been reported in chronic schizophrenia. The purpose of this study is to determine whether or not fornix abnormalities are evident at the onset of schizophrenia.
METHODS: Diffusion tensor imaging (DTI) and DT tractography were used to evaluate the fornix in 21 patients with first episode schizophrenia (16 males/5 females) and 22 healthy controls (13 males/9 females). Groups were matched on age, gender, parental socioeconomic status, education and handedness. Fractional anisotropy (FA), a measure of white matter integrity, radial diffusivity (RD), thought to reflect myelin integrity, trace, a possible marker of atrophy or cell loss, and axial diffusivity (AD), thought to reflect axonal integrity, were averaged over the entire tract extracted by means of DT tractography, and used to investigate fornix abnormalities in first episode schizophrenia compared with healthy controls.
RESULTS: Significant group differences were found between first episode patients and controls for FA (p=0.0001), RD (p=0.001) and trace (p=0.006).
CONCLUSION: These findings suggest abnormalities in the fornix in the early stages of schizophrenia, and further suggest that white matter abnormalities, which are apparent in the early course of the disease, may reflect myelin disturbances.
Thomas L Chenevert, Dariya I Malyarenko, David Newitt, Xin Li, Mohan Jayatilake, Alina Tudorica, Andriy Fedorov, Ron Kikinis, Tiffany Ting Liu, Mark Muzi, Matthew J Oborski, Charles M Laymon, Xia Li, Yankeelov Thomas, Kalpathy-Cramer Jayashree, James M Mountz, Paul E Kinahan, Daniel L Rubin, Fiona Fennessy, Wei Huang, Nola Hylton, and Brian D Ross. 2014. “Errors in Quantitative Image Analysis due to Platform-Dependent Image Scaling.” Transl Oncol, 7, 1, Pp. 65-71.Abstract
PURPOSE: To evaluate the ability of various software (SW) tools used for quantitative image analysis to properly account for source-specific image scaling employed by magnetic resonance imaging manufacturers.
METHODS: A series of gadoteridol-doped distilled water solutions (0%, 0.5%, 1%, and 2% volume concentrations) was prepared for manual substitution into one (of three) phantom compartments to create "variable signal," whereas the other two compartments (containing mineral oil and 0.25% gadoteriol) were held unchanged. Pseudodynamic images were acquired over multiple series using four scanners such that the histogram of pixel intensities varied enough to provoke variable image scaling from series to series. Additional diffusion-weighted images were acquired of an ice-water phantom to generate scanner-specific apparent diffusion coefficient (ADC) maps. The resulting pseudodynamic images and ADC maps were analyzed by eight centers of the Quantitative Imaging Network using 16 different SW tools to measure compartment-specific region-of-interest intensity.
RESULTS: Images generated by one of the scanners appeared to have additional intensity scaling that was not accounted for by the majority of tested quantitative image analysis SW tools. Incorrect image scaling leads to intensity measurement bias near 100%, compared to nonscaled images.
CONCLUSION: Corrective actions for image scaling are suggested for manufacturers and quantitative imaging community.
In this work, we present a faceted-search based approach for visualization of anatomy by combining a three dimensional digital atlas with an anatomy ontology. Specifically, our approach provides a drill-down search interface that exposes the relevant pieces of information (obtained by searching the ontology) for a user query. Hence, the user can produce visualizations starting with minimally specified queries. Furthermore, by automatically translating the user queries into the controlled terminology our approach eliminates the need for the user to use controlled terminology. We demonstrate the scalability of our approach using an abdominal atlas and the same ontology. We implemented our visualization tool on the opensource 3D Slicer software. We present results of our visualization approach by combining a modified Foundational Model of Anatomy (FMA) ontology with the Surgical Planning Laboratory (SPL) Brain 3D digital atlas, and geometric models specific to patients computed using the SPL brain tumor dataset.
PURPOSE: Diffusion encoding with asymmetric gradient waveforms is appealing because the asymmetry provides superior efficiency. However, concomitant gradients may cause a residual gradient moment at the end of the waveform, which can cause significant signal error and image artifacts. The purpose of this study was to develop an asymmetric waveform designs for tensor-valued diffusion encoding that is not sensitive to concomitant gradients. METHODS: The "Maxwell index" was proposed as a scalar invariant to capture the effect of concomitant gradients. Optimization of "Maxwell-compensated" waveforms was performed in which this index was constrained. Resulting waveforms were compared to waveforms from literature, in terms of the measured and predicted impact of concomitant gradients, by numerical analysis as well as experiments in a phantom and in a healthy human brain. RESULTS: Maxwell-compensated waveforms with Maxwell indices below 100 (mT/m) ms showed negligible signal bias in both numerical analysis and experiments. By contrast, several waveforms from literature showed gross signal bias under the same conditions, leading to a signal bias that was large enough to markedly affect parameter maps. Experimental results were accurately predicted by theory. CONCLUSION: Constraining the Maxwell index in the optimization of asymmetric gradient waveforms yields efficient diffusion encoding that negates the effects of concomitant fields while enabling arbitrary shapes of the b-tensor. This waveform design is especially useful in combination with strong gradients, long encoding times, thick slices, simultaneous multi-slice acquisition, and large FOVs.
Although brain functionality is often remarkably robust to lesions and other insults, it may be fragile when these take place in specific locations. Previous attempts to quantify robustness and fragility sought to understand how the functional connectivity of brain networks is affected by structural changes, using either model-based predictions or empirical studies of the effects of lesions. We advance a geometric viewpoint relying on a notion of network curvature, the so-called Ollivier-Ricci curvature. This approach has been proposed to assess financial market robustness and to differentiate biological networks of cancer cells from healthy ones. Here, we apply curvature-based measures to brain structural networks to identify robust and fragile brain regions in healthy subjects. We show that curvature can also be used to track changes in brain connectivity related to age and autism spectrum disorder (ASD), and we obtain results that are in agreement with previous MRI studies.
The Human Placenta Project has focused attention on the need for noninvasive magnetic resonance imaging (MRI)-based techniques to diagnose and monitor placental function throughout pregnancy. The hope is that the management of placenta-related pathologies would be improved if physicians had more direct, real-time measures of placental health to guide clinical decision making. As oxygen alters signal intensity on MRI and oxygen transport is a key function of the placenta, many of the MRI methods under development are focused on quantifying oxygen transport or oxygen content of the placenta. For example, measurements from blood oxygen level-dependent imaging of the placenta during maternal hyperoxia correspond to outcomes in twin pregnancies, suggesting that some aspects of placental oxygen transport can be monitored by MRI. Additional methods are being developed to accurately quantify baseline placental oxygenation by MRI relaxometry. However, direct validation of placental MRI methods is challenging and therefore animal studies and ex vivo studies of human placentas are needed. Here we provide an overview of the current state of the art of oxygen transport and quantification with MRI. We suggest that as these techniques are being developed, increased focus be placed on ensuring they are robust and reliable across individuals and standardized to enable predictive diagnostic models to be generated from the data. The field is still several years away from establishing the clinical benefit of monitoring placental function in real time with MRI, but the promise of individual personalized diagnosis and monitoring of placental disease in real time continues to motivate this effort.
Jie Luo, Alireza Sedghi, Karteek Popuri, Dana Cobzas, Miaomiao Zhang, Frank Preiswerk, Matthew Toews, Alexandra Golby, Masashi Sugiyama, William III M Wells, and Sarah Frisken. 10/2019. “On the Applicability of Registration Uncertainty.” In MICCAI 2019, LNCS 11765: Pp. 410-9. Shenzhen, China: Springer.Abstract
Estimating the uncertainty in (probabilistic) image registration enables, e.g., surgeons to assess the operative risk based on the trustworthiness of the registered image data. If surgeons receive inaccurately calculated registration uncertainty and misplace unwarranted confidence in the alignment solutions, severe consequences may result. For probabilistic image registration (PIR), the predominant way to quantify the registration uncertainty is using summary statistics of the distribution of transformation parameters. The majority of existing research focuses on trying out different summary statistics as well as means to exploit them. Distinctively, in this paper, we study two rarely examined topics: (1) whether those summary statistics of the transformation distribution most informatively represent the registration uncertainty; (2) Does utilizing the registration uncertainty always be beneficial. We show that there are two types of uncertainties: the transformation uncertainty, Ut, and label uncertainty Ul. The conventional way of using Ut to quantify Ul is inappropriate and can be misleading. By a real data experiment, we also share a potentially critical finding that making use of the registration uncertainty may not always be an improvement.
External-beam radiotherapy followed by high dose rate (HDR) brachytherapy is the standard-of-care for treating gynecologic cancers. The enhanced soft-tissue contrast provided by magnetic resonance imaging (MRI) makes it a valuable imaging modality for diagnosing and treating these cancers. However, in contrast to computed tomography (CT) imaging, the appearance of the brachytherapy catheters, through which radiation sources are inserted to reach the cancerous tissue later on, is often variable across images. This paper reports, for the first time, a new deep-learning-based method for fully automatic segmentation of multiple closely spaced brachytherapy catheters in intraoperative MRI. Represented in the data are 50 gynecologic cancer patients treated by MRI-guided HDR brachytherapy. For each patient, a single intraoperative MRI was used. 826 catheters in the images were manually segmented by an expert radiation physicist who is also a trained radiation oncologist. The number of catheters in a patient ranged between 10 and 35. A deep 3D convolutional neural network (CNN) model was developed and trained. In order to make the learning process more robust, the network was trained 5 times, each time using a different combination of shown patients. Finally, each test case was processed by the five networks and the final segmentation was generated by voting on the obtained five candidate segmentations. 4-fold validation was executed and all the patients were segmented. An average distance error of 2.0 ± 3.4 mm was achieved. False positive and false negative catheters were 6.7% and 1.5% respectively. Average Dice score was equal to 0.60 ± 0.17. The algorithm is available for use in the open source software platform 3D Slicer allowing for wide scale testing and research discussion. In conclusion, to the best of our knowledge, fully automatic segmentation of multiple closely spaced catheters from intraoperative MR images was achieved for the first time in gynecological brachytherapy.