Identifying patterns from the neuroimaging recordings of brain activity related to the unobservable psychological or mental state of an individual can be treated as a unsupervised pattern recognition problem. The main challenges, however, for such an analysis of fMRI data are: a) defining a physiologically meaningful feature-space for representing the spatial patterns across time; b) dealing with the high-dimensionality of the data; and c) robustness to the various artifacts and confounds in the fMRI time-series. In this paper, we present a network-aware feature-space to represent the states of a general network, that enables comparing and clustering such states in a manner that is a) meaningful in terms of the network connectivity structure; b)computationally efficient; c) low-dimensional; and d) relatively robust to structured and random noise artifacts. This feature-space is obtained from a spherical relaxation of the transportation distance metric which measures the cost of trans- porting “mass” over the network to transform one function into another. Through theoretical and empirical assessments, we demonstrate the accuracy and efficiency of the approximation, especially for large problems.
This paper presents feature-based alignment (FBA), a general method for efficient and robust model-to-image alignment. Volumetric images, e.g. CT scans of the human body, are modeled probabilistically as a collage of 3D scale-invariant image features within a normalized reference space. Features are incorporated as a latent random variable and marginalized out in computing a maximum a-posteriori alignment solution. The model is learned from features extracted in pre-aligned training images, then fit to features extracted from a new image to identify a globally optimal locally linear alignment solution. Novel techniques are presented for determining local feature orientation and efficiently encoding feature intensity in 3D. Experiments involving difficult magnetic resonance (MR) images of the human brain demonstrate FBA achieves alignment accuracy similar to widely-used registration methods, while requiring a fraction of the memory and computation resources and offering a more robust, globally optimal solution. Experiments on CT human body scans demonstrate FBA as an effective system for automatic human body alignment where other alignment methods break down.
In this paper, anatomical development is modeled as a collection of distinctive image patterns localized in space and time. A Bayesian posterior probability is defined over a random variable of subject age, conditioned on data in the form of scale-invariant image features. The model is automatically learned from a large set of images exhibiting significant variation, used to discover anatomical structure related to age and development, and fit to new images to predict age. The model is applied to a set of 230 infant structural MRIs of 92 subjects acquired at multiple sites over an age range of 8-590 days. Experiments demonstrate that the model can be used to identify age-related anatomical structure, and to predict the age of new subjects with an average error of 72 days.
PURPOSE: To develop and evaluate image registration methodology for automated re-identification of tumor-suspicious foci from preprocedural MR exams during MR-guided transperineal prostate core biopsy. MATERIALS AND METHODS: A hierarchical approach for automated registration between planning and intra-procedural T2-weighted prostate MRI was developed and evaluated on the images acquired during 10 consecutive MR-guided biopsies. Registration accuracy was quantified at image-based landmarks and by evaluating spatial overlap for the manually segmented prostate and sub-structures. Registration reliability was evaluated by simulating initial mis-registration and analyzing the convergence behavior. Registration precision was characterized at the planned biopsy targets. RESULTS: The total computation time was compatible with a clinical setting, being at most 2 min. Deformable registration led to a significant improvement in spatial overlap of the prostate and peripheral zone contours compared with both rigid and affine registration. Average in-slice landmark registration error was 1.3 ± 0.5 mm. Experiments simulating initial mis-registration resulted in an estimated average capture range of 6 mm and an average in-slice registration precision of ±0.3 mm. CONCLUSION: Our registration approach requires minimum user interaction and is compatible with the time constraints of our interventional clinical workflow. The initial evaluation shows acceptable accuracy, reliability and consistency of the method.
James A Shackleford, Nadya Shusharina, Joost Verberg, Guy Warmerdam, Brian Winey, Markus Neuner, Philipp Steininger, Amelia Arbisser, and Polina Golland. 10/2012. “Plastimatch 1.6 - Current Capabilities and Future Directions.” Int Conf Med Image Comput Comput Assist Interv. Workshop on Image-Guidance and Multimodal Dose Planning in Radiation Therapy. 15 (WS).Abstract
Open-source software provides an economic benefit by reducing duplicated development effort, and advances science knowledge by fostering a culture of reproducible experimentation. This paper describes recent advances in the Plastimatch open software suite, which implements a broad set of useful tools for research and practice in radiotherapy and medical imaging. The focus of this paper is to highlight recent advancements, including 2D-3D registration, GPU-accelerated mutual information, analytic regularization of B-spline registration, automatic 3D feature detection and feature matching, and radiotherapy plan evaluation tools.
Transrectal ultrasound (TRUS) facilitates intra-treatment delineation of the prostate gland (PG) to guide insertion of brachytherapy seeds, but the prostate substructure and apex are not always visible which may make the seed placement sub-optimal. Based on an elastic model of the prostate created from MRI, where the prostate substructure and apex are clearly visible, we use a Bayesian approach to estimate the posterior distribution on deformations that aligns the pre-treatment MRI with intra-treatment TRUS. Without apex information in TRUS, the posterior prediction of the location of the prostate boundary, and the prostate apex boundary in particular, is mainly determined by the pseudo stiffness hyper-parameter of the prior distribution. We estimate the optimal value of the stiffness through likelihood maximization that is sensitive to the accuracy as well as the precision of the posterior prediction at the apex boundary. From a data-set of 10 pre- and intra-treatment prostate images with ground truth delineation of the total PG, 4 cases were used to establish an optimal stiffness hyper-parameter when 15% of the prostate delineation was removed to simulate lack of apex information in TRUS, while the remaining 6 cases were used to cross-validate the registration accuracy and uncertainty over the PG and in the apex.
This software framework brings a set of input volumes from pediatric brains into alignment. Therefore, the notion of pair-wise image registration is extended to group-wise alignment, which allows to find correspondence among a whole group of data sets instead of just two of them. Moreover, it simultaneously brings the set of input volumes into alignment, with every member of the population approaching the group's central tendency at the same time.
A method for automated location of shape differences in diseased anatomical structures via high resolution biomedical atlases annotated with labels from formal ontologies is described. In particular, a high resolution magnetic resonance image of the myocardium of the human left ventricle was segmented and annotated with structural terms from an extracted subset of the Foundational Model of Anatomy ontology. The atlas was registered to the end systole template of a previous study of left ventricular remodeling in cardiomyopathy using a diffeomorphic registration algorithm. The previous study used thresholding and visual inspection to locate a region of statistical significance which distinguished patients with ischemic cardiomyopathy from those with nonischemic cardiomyopathy. Using semantic technologies and the deformed annotated atlas, this location was more precisely found. Although this study used only a cardiac atlas, it provides a proof-of-concept that ontologically labeled biomedical atlases of any anatomical structure can be used to automate location-based inferences.
Mild traumatic brain injury (mTBI), also referred to as concussion, remains a controversial diagnosis because the brain often appears quite normal on conventional computed tomography (CT) and magnetic resonance imaging (MRI) scans. Such conventional tools, however, do not adequately depict brain injury in mTBI because they are not sensitive to detecting diffuse axonal injuries (DAI), also described as traumatic axonal injuries (TAI), the major brain injuries in mTBI. Furthermore, for the 15 to 30 % of those diagnosed with mTBI on the basis of cognitive and clinical symptoms, i.e., the "miserable minority," the cognitive and physical symptoms do not resolve following the first 3 months post-injury. Instead, they persist, and in some cases lead to long-term disability. The explanation given for these chronic symptoms, i.e., postconcussive syndrome, particularly in cases where there is no discernible radiological evidence for brain injury, has led some to posit a psychogenic origin. Such attributions are made all the easier since both posttraumatic stress disorder (PTSD) and depression are frequently co-morbid with mTBI. The challenge is thus to use neuroimaging tools that are sensitive to DAI/TAI, such as diffusion tensor imaging (DTI), in order to detect brain injuries in mTBI. Of note here, recent advances in neuroimaging techniques, such as DTI, make it possible to characterize better extant brain abnormalities in mTBI. These advances may lead to the development of biomarkers of injury, as well as to staging of reorganization and reversal of white matter changes following injury, and to the ability to track and to characterize changes in brain injury over time. Such tools will likely be used in future research to evaluate treatment efficacy, given their enhanced sensitivity to alterations in the brain. In this article we review the incidence of mTBI and the importance of characterizing this patient population using objective radiological measures. Evidence is presented for detecting brain abnormalities in mTBI based on studies that use advanced neuroimaging techniques. Taken together, these findings suggest that more sensitive neuroimaging tools improve the detection of brain abnormalities (i.e., diagnosis) in mTBI. These tools will likely also provide important information relevant to outcome (prognosis), as well as play an important role in longitudinal studies that are needed to understand the dynamic nature of brain injury in mTBI. Additionally, summary tables of MRI and DTI findings are included. We believe that the enhanced sensitivity of newer and more advanced neuroimaging techniques for identifying areas of brain damage in mTBI will be important for documenting the biological basis of postconcussive symptoms, which are likely associated with subtle brain alterations, alterations that have heretofore gone undetected due to the lack of sensitivity of earlier neuroimaging techniques. Nonetheless, it is noteworthy to point out that detecting brain abnormalities in mTBI does not mean that other disorders of a more psychogenic origin are not co-morbid with mTBI and equally important to treat. They arguably are. The controversy of psychogenic versus physiogenic, however, is not productive because the psychogenic view does not carefully consider the limitations of conventional neuroimaging techniques in detecting subtle brain injuries in mTBI, and the physiogenic view does not carefully consider the fact that PTSD and depression, and other co-morbid conditions, may be present in those suffering from mTBI. Finally, we end with a discussion of future directions in research that will lead to the improved care of patients diagnosed with mTBI.
Extracting anatomical and functional significant structures renders one of the important tasks for both the theoretical study of the medical image analysis, and the clinical and practical community. In the past, much work has been dedicated only to the algorithmic development. Nevertheless, for clinical end users, a well designed algorithm with an interactive software is necessary for an algorithm to be utilized in their daily work. Furthermore, the software would better be open sourced in order to be used and validated by not only the authors but also the entire community. Therefore, the contribution of the present work is twofolds: first, we propose a new robust statistics based conformal metric and the conformal area driven multiple active contour framework, to simultaneously extract multiple targets from MR and CT medical imagery in 3D. Second, an open source graphically interactive 3D segmentation tool based on the aforementioned contour evolution is implemented and is publicly available for end users on multiple platforms. In using this software for the segmentation task, the process is initiated by the user drawn strokes (seeds) in the target region in the image. Then, the local robust statistics are used to describe the object features, and such features are learned adaptively from the seeds under a non-parametric estimation scheme. Subsequently, several active contours evolve simultaneously with their interactions being motivated by the principles of action and reaction-this not only guarantees mutual exclusiveness among the contours, but also no longer relies upon the assumption that the multiple objects fill the entire image domain, which was tacitly or explicitly assumed in many previous works. In doing so, the contours interact and converge to equilibrium at the desired positions of the desired multiple objects. Furthermore, with the aim of not only validating the algorithm and the software, but also demonstrating how the tool is to be used, we provide the reader reproducible experiments that demonstrate the capability of the proposed segmentation tool on several public available data sets.
Quantitative analysis has tremendous but mostly unrealized potential in healthcare to support objective and accurate interpretation of the clinical imaging. In 2008, the National Cancer Institute began building the Quantitative Imaging Network (QIN) initiative with the goal of advancing quantitative imaging in the context of personalized therapy and evaluation of treatment response. Computerized analysis is an important component contributing to reproducibility and efficiency of the quantitative imaging techniques. The success of quantitative imaging is contingent on robust analysis methods and software tools to bring these methods from bench to bedside. 3D Slicer is a free open-source software application for medical image computing. As a clinical research tool, 3D Slicer is similar to a radiology workstation that supports versatile visualizations but also provides advanced functionality such as automated segmentation and registration for a variety of application domains. Unlike a typical radiology workstation, 3D Slicer is free and is not tied to specific hardware. As a programming platform, 3D Slicer facilitates translation and evaluation of the new quantitative methods by allowing the biomedical researcher to focus on the implementation of the algorithm and providing abstractions for the common tasks of data communication, visualization and user interface development. Compared to other tools that provide aspects of this functionality, 3D Slicer is fully open source and can be readily extended and redistributed. In addition, 3D Slicer is designed to facilitate the development of new functionality in the form of 3D Slicer extensions. In this paper, we present an overview of 3D Slicer as a platform for prototyping, development and evaluation of image analysis tools for clinical research applications. To illustrate the utility of the platform in the scope of QIN, we discuss several use cases of 3D Slicer by the existing QIN teams, and we elaborate on the future directions that can further facilitate development and validation of imaging biomarkers using 3D Slicer.
Thalamo-cortical feedback loops play a key role in the processing and coordination of processing and integration of perceptual inputs and outputs, and disruption in this connection has long been hypothesized to contribute significantly to neuropsychological disturbances in schizophrenia. To test this hypothesis, we applied diffusion tensor tractography to 18 patients suffering schizophrenia and 20 control subjects. Fractional anisotropy (FA) was evaluated in the bilateral anterior and posterior limbs of the internal capsule, and correlated with clinical and neurocognitive measures. Patients diagnosed with schizophrenia showed significantly reduced FA bilaterally in the anterior but not the posterior limb of the internal capsule, compared with healthy control subjects. Lower FA correlated with lower scores on tests of declarative episodic memory in the patient group only. These findings suggest that disruptions, bilaterally, in thalamo-cortical connections in schizophrenia may contribute to disease-related impairment in the coordination of mnemonic processes of encoding and retrieval that are vital for efficient learning of new information.
The properties of carbon nanotube (CNT)/polymer composites are strongly dependent on the dispersion and orientation of CNTs in the host matrix. Quantification of the dispersion and orientation of CNTs by means of microstructure observation and image analysis has been demonstrated as a useful way to understand the structure-property relationship of CNT/polymer composites. However, due to the various morphologies and large amount of CNTs in one image, automatic and accurate identification of CNTs has become the bottleneck for dispersion/orientation analysis. To solve this problem, shape identification is performed for each pixel in the filler identification step, so that individual CNTs can be extracted from images automatically. The improved filler identification enables more accurate analysis of CNT dispersion and orientation. The dispersion index and orientation index obtained for both synthetic and real images from model compounds correspond well with the observations. Moreover, these indices help to explain the electrical properties of CNT/silicone composite, which is used as a model compound. This method can also be extended to other polymer composites with high-aspect-ratio fillers.
We propose an automatic approach for segmenting the left atrium from MRI images. In particular, the thoracic aorta is detected and used as a salient feature to find a seed region that lies inside the left atrium. A hybrid energy that combines robust statistics and localized region intensity information is employed to evolve active contours from the seed region to capture the whole left atrium. The experimental results demonstrate the accuracy and robustness of our approach.
The purpose of this study is to evaluate perfusion indices and pharmacokinetic parameters in solitary pulmonary nodules (SPNs). Thirty patients of 34 enrolled with SPNs (15-30 mm) were evaluated in this study. T1 and T2-weighted structural images and 2D turbo FLASH perfusion images were acquired with shallow free breathing. B-spline nonrigid image registration and optimization by χ² test against pharmacokinetic model curve were performed on dynamic contrast-enhanced MRI. This allowed voxel-by-voxel calculation of k(ep) , the rate constant for tracer transport to and from plasma and the extravascular extracellular space. Mean transit time, time-to-peak, initial slope, and maximum enhancement (E(max) ) were calculated from time-intensity curves fitted to a gamma variate function. After blinded data analysis, correlation with tissue histology from surgical resection or biopsy samples was performed. Histologic evaluation revealed 25 malignant and five benign SPNs. All benign SPNs had k(ep) < 1.0 min⁻¹. Nineteen of 25 (76%) malignant SPNs showed k(ep) > 1.0 min⁻¹. Sensitivity to diagnose malignant SPNs at a cutoff of k(ep) = 1.0 min⁻¹ was 76%, specificity was 100%, positive predictive value was 100%, negative predictive value was 45%, and accuracy was 80%. Of all indices studied, k(ep) was the most significant in differentiating malignant from benign SPNs.
Patients in the intensive care unit (ICU) who require mechanical ventilation due to acute respiratory failure also frequently require the administration of sedative agents. The need for sedation arises both from patient anxiety due to the loss of personal control and the unfamiliar and intrusive environment of the ICU, and also due to pain or other variants of noxious stimuli. While physicians select the agent(s) used for sedation and cardiovascular function, the actual administration of these agents is the responsibility of the nursing staff. If clinical decision support systems and closed-loop control systems could be developed for critical care monitoring and lifesaving interventions as well as the administration of sedation and cardiopulmonary management, the ICU nurse could be released from the intense monitoring of sedation, allowing her/him to focus on other critical tasks. One particularly attractive strategy is to utilize the knowledge and experience of skilled clinicians, capturing explicitly the rules expert clinicians use to decide on how to titrate drug doses depending on the level of sedation. In this paper, we extend the deterministic rule-based expert system for cardiopulmonary management and ICU sedation framework presented in  to a stochastic setting by using probability theory to quantify uncertainty and hence deal with more realistic clinical situations.
For a given cognitive task such as language processing, the location of corresponding functional regions in the brain may vary across subjects relative to anatomy. We present a probabilistic generative model that accounts for such variability as observed in fMRI data. We relate our approach to sparse coding that estimates a basis consisting of functional regions in the brain. Individual fMRI data is represented as a weighted sum of these functional regions that undergo deformations. We demonstrate the proposed method on a language fMRI study. Our method identified activation regions that agree with known literature on language processing and established correspondences among activation regions across subjects, producing more robust group-level effects than anatomical alignment alone.
The nonlocal means (NLM) filter has become a popular approach for denoising medical images due to its excellent performance. However, its heavy computational load has been an important shortcoming preventing its use. NLM works by averaging pixels in nonlocal vicinities, weighting them depending on their similarity with the pixel of interest. This similarity is assessed based on the squared difference between corresponding pixels inside local patches centered at the locations compared. Our proposal is to reduce the computational load of this comparison by checking only a subset of salient features associated to the pixels, which suffice to estimate the actual difference as computed in the original NLM approach. The speedup achieved with respect to the original implementation is over one order of magnitude, and, when compared to more recent NLM improvements for MRI denoising, our method is nearly twice as fast. At the same time, we evidence from both synthetic and in vivo experiments that computing of appropriate salient features make the estimation of NLM weights more robust to noise. Consequently, we are able to improve the outcomes achieved with recent state of the art techniques for a wide range of realistic Signal-to-Noise ratio scenarios like diffusion MRI. Finally, the statistical characterization of the features computed allows to get rid of some of the heuristics commonly used for parameter tuning.
Neuroimaging studies typically adopt a common feature space for all data, which may obscure aspects of neuroanatomy only observable in subsets of a population, e.g. cortical folding patterns unique to individuals or shared by close relatives. Here, we propose to model individual variability using a distinctive keypoint signature: a set of unique, localized patterns, detected automatically in each image by a generic saliency operator. The similarity of an image pair is then quantified by the proportion of keypoints they share using a novel Jaccard-like measure of set overlap. Experiments demonstrate the keypoint method to be highly efficient and accurate, using a set of 7536 T1-weighted MRIs pooled from four public neuroimaging repositories, including twins, non-twin siblings, and 3334 unique subjects. All same-subject image pairs are identified by a similarity threshold despite confounds including aging and neurodegenerative disease progression. Outliers reveal previously unknown data labeling inconsistencies, demonstrating the usefulness of the keypoint signature as a computational tool for curating large neuroimage datasets.
OBJECTIVE: Deep brain stimulation (DBS) in zona incerta (Zi) is used for symptom alleviation in essential tremor (ET). Zi is positioned along the dentato-rubro-thalamic tract (DRT). Electric field simulations with the finite element method (FEM) can be used for estimation of a volume where the stimulation affects the tissue by applying a fixed isolevel (V). This work aims to develop a workflow for combined patient-specific electric field simulation and white matter tracing of the DRT, and to investigate the influence on the V from different brain tissue models, lead design and stimulation modes. The novelty of this work lies in the combination of all these components. METHOD: Patients with ET were implanted in Zi (lead 3389, n = 3, voltage mode; directional lead 6172, n = 1, current mode). Probabilistic reconstruction from diffusion MRI (dMRI) of the DRT (n = 8) was computed with FSL Toolbox. Brain tissue models were created for each patient (two homogenous, one heterogenous isotropic, one heterogenous anisotropic) and the respective V (n = 48) calculated from the Comsol Multiphysics FEM simulations. The DRT and V were visualized with 3DSlicer and superimposed on the preoperative T2 MRI, and the common volumes calculated. Dice Coefficient (DC) and level of anisotropy were used to evaluate and compare the brain models. RESULT: Combined patient-specific tractography and electric field simulation was designed and evaluated, and all patients showed benefit from DBS. All V overlapped the reconstructed DRT. Current stimulation showed prominent difference between the tissue models, where the homogenous grey matter deviated most (67 < DC < 69). Result from heterogenous isotropic and anisotropic models were similar (DC > 0.95), however the anisotropic model consistently generated larger volumes related to a greater extension of the electric field along the DBS lead. Independent of tissue model, the steering effect of the directional lead was evident and consistent. CONCLUSION: A workflow for patient-specific electric field simulations in combination with reconstruction of DRT was successfully implemented. Accurate tissue classification is essential for electric field simulations, especially when using the current control stimulation. With an accurate targeting and tractography reconstruction, directional leads have the potential to tailor the electric field into the desired region.
The corticospinal tract (CST) is one of the most well studied tracts in human neuroanatomy. Its clinical significance can be demonstrated in many notable traumatic conditions and diseases such as stroke, spinal cord injury (SCI) or amyotrophic lateral sclerosis (ALS). With the advent of diffusion MRI and tractography the computational representation of the human CST in a 3D model became available. However, the representation of the entire CST and, specifically, the hand motor area has remained elusive. In this paper we propose a novel method, using manually drawn ROIs based on robustly identifiable neuroanatomic structures to delineate the entire CST and isolate its hand motor representation as well as to estimate their variability and generate a database of their volume, length and biophysical parameters. Using 37 healthy human subjects we performed a qualitative and quantitative analysis of the CST and the hand-related motor fiber tracts (HMFTs). Finally, we have created variability heat maps from 37 subjects for both the aforementioned tracts, which could be utilized as a reference for future studies with clinical focus to explore neuropathology in both trauma and disease states.
We address the problem of interpolating randomly non-uniformly spatiotemporally scattered uncertain motion measurements, which arises in the context of soft tissue motion estimation. Soft tissue motion estimation is of great interest in the field of image-guided soft-tissue intervention and surgery navigation, because it enables the registration of pre-interventional/pre-operative navigation information on deformable soft-tissue organs. To formally define the measurements as spatiotemporally scattered motion signal samples, we propose a novel motion field representation. To perform the interpolation of the motion measurements in an uncertainty-aware optimal unbiased fashion, we devise a novel Gaussian process (GP) regression model with a non-constant-mean prior and an anisotropic covariance function and show through an extensive evaluation that it outperforms the state-of-the-art GP models that have been deployed previously for similar tasks. The employment of GP regression enables the quantification of uncertainty in the interpolation result, which would allow the amount of uncertainty present in the registered navigation information governing the decisions of the surgeon or intervention specialist to be conveyed.
Schizophrenia has been characterized as a neurodevelopmental disorder, with structural brain abnormalities reported at all stages. However, at present, it remains unclear whether gray and white matter abnormalities represent related or independent pathologies in schizophrenia. In this study, we present findings from an integrative analysis exploring the morphological relationship between gray and white matter in 45 schizophrenia participants and 49 healthy controls. We utilized mutual information (MI), a measure of how much information two variables share, to assess the morphological dependence between gray and white matter in three segments of the corpus callsoum, and the gray matter regions these segments connect: (1) the genu and the left and right rostral middle frontal gyrus (rMFG), (2) the isthmus and the left and right superior temporal gyrus (STG), (3) the splenium and the left and right lateral occipital gyrus (LOG). We report significantly reduced MI between white matter tract dispersion of the right hemispheric callosal connections to the STG and both cortical thickness and area in the right STG in schizophrenia patients, despite a lack of group differences in cortical thickness, surface area, or dispersion. We believe that this reduction in morphological dependence between gray and white matter may reflect a possible decoupling of the developmental processes that shape morphological features of white and gray matter early in life. The present study also demonstrates the importance of studying the relationship between gray and white matter measures, as opposed to restricting analyses to gray and white matter measures independently.