Radiomics aims to quantify phenotypic characteristics on medical imaging through the use of automated algorithms. Radiomic artificial intelligence (AI) technology, either based on engineered hard-coded algorithms or deep learning methods, can be used to develop noninvasive imaging-based biomarkers. However, lack of standardized algorithm definitions and image processing severely hampers reproducibility and comparability of results. To address this issue, we developed , a flexible open-source platform capable of extracting a large panel of engineered features from medical images. is implemented in Python and can be used standalone or using 3D Slicer. Here, we discuss the workflow and architecture of and demonstrate its application in characterizing lung lesions. Source code, documentation, and examples are publicly available at www.radiomics.io With this platform, we aim to establish a reference standard for radiomic analyses, provide a tested and maintained resource, and to grow the community of radiomic developers addressing critical needs in cancer research. .
Advances in neuroimaging have provided a tremendous amount of in-vivo information on the brain's organisation. Its anatomy and cortical organisation can be investigated from the point of view of several imaging modalities, many of which have been studied for mapping functionally specialised cortical areas. There is strong evidence that a single modality is not sufficient to fully identify the brain's cortical organisation. Combining multiple modalities in the same parcellation task has the potential to provide more accurate and robust subdivisions of the cortex. Nonetheless, existing brain parcellation methods are typically developed and tested on single modalities using a specific type of information. In this paper, we propose Graph-based Multi-modal Parcellation (GraMPa), an iterative framework designed to handle the large variety of available input modalities to tackle the multi-modal parcellation task. At each iteration, we compute a set of parcellations from different modalities and fuse them based on their local reliabilities. The fused parcellation is used to initialise the next iteration, forcing the parcellations to converge towards a set of mutually informed modality specific parcellations, where correspondences are established. We explore two different multi-modal configurations for group-wise parcellation using resting-state fMRI, diffusion MRI tractography, myelin maps and task fMRI. Quantitative and qualitative results on the Human Connectome Project database show that integrating multi-modal information yields a stronger agreement with well established atlases and more robust connectivity networks that provide a better representation of the population.
Using electroencephalography (EEG) to elucidate the spontaneous activation of brain resting-state networks (RSNs) is nontrivial as the signal of interest is of low amplitude and it is difficult to distinguish the underlying neural sources. Using the principles of electric field topographical analysis, it is possible to estimate the meta-stable states of the brain (i.e., the resting-state topographies, so-called microstates). We estimated seven resting-state topographies explaining the EEG data set with k-means clustering (N = 164, 256 electrodes). Using a method specifically designed to localize the sources of broadband EEG scalp topographies by matching sensor and source space temporal patterns, we demonstrated that we can estimate the EEG RSNs reliably by measuring the reproducibility of our findings. After subtracting their mean from the seven EEG RSNs, we identified seven state-specific networks. The mean map includes regions known to be densely anatomically and functionally connected (superior frontal, superior parietal, insula, and anterior cingulate cortices). While the mean map can be interpreted as a "router," crosslinking multiple functional networks, the seven state-specific RSNs partly resemble and extend previous functional magnetic resonance imaging-based networks estimated as the hemodynamic correlates of four canonical EEG microstates.
We combined diffusion tension imaging (DTI) of prefrontal white matter integrity and neuropsychological measures to examine the functional neuroanatomy of human intelligence. Healthy participants completed the Wechsler Adult Intelligence Scale-Third Edition (WAIS-III) along with neuropsychological tests of attention and executive control, as measured by Trail Making Test (TMT) and Wisconsin Card Sorting Test (WCST). Stochastic tractography, considered the most effective DTI method, quantified white matter integrity of the medial orbital frontal cortex (mOFC) and rostral anterior cingulate cortex (rACC) circuitry. Based on prior studies, we hypothesized that posterior mOFC-rACC connections may play a key structural role linking attentional control processes and intelligence. Behavioral results provided strong support for this hypothesis, specifically linking attentional control processes, measured by Trails B and WCST perseverative errors, to intelligent quotient (IQ). Hierarchical regression results indicated left posterior mOFC-rACC fractional anisotropy (FA) and Trails B performance time, but not WCST perseverative errors, each contributed significantly to IQ, accounting for approximately 33.95-51.60% of the variance in IQ scores. These findings suggested that left posterior mOFC-rACC white matter connections may play a key role in supporting the relationship of executive functions of attentional control and general intelligence in healthy cognition.
Experts have previously postulated a linkage between lupus associated vascular pathology and abnormal brain barriers in the immunopathogenesis of neuropsychiatric lupus. Nevertheless, there are some discrepancies between the experimental evidence, or its interpretation, and the working hypotheses prevalent in this field; specifically, that a primary contributor to neuropsychiatric disease in lupus is permeabilization of the blood brain barrier. In this commonly held view, any contribution of the other known brain barriers, including the blood-cerebrospinal fluid and meningeal barriers, is mostly excluded from the discussion. In this review we will shed light on some of the blood brain barrier hypotheses and try to trace their roots. In addition, we will suggest new research directions to allow for confirmation of alternative interpretations of the experimental evidence linking the pathology of intra-cerebral vasculature to the pathogenesis of neuropsychiatric lupus.
Progression markers of Parkinson's disease are crucial for successful therapeutic development. Recently, a diffusion magnetic resonance imaging analysis technique using a bitensor model was introduced allowing the estimation of the fractional volume of free water within a voxel, which is expected to increase in neurodegenerative disorders such as Parkinson's disease. Prior work demonstrated that free water in the posterior substantia nigra was elevated in Parkinson's disease compared to controls across single- and multi-site cohorts, and increased over 1 year in Parkinson's disease but not in controls at a single site. Here, the goal was to validate free water in the posterior substantia nigra as a progression marker in Parkinson's disease, and describe the pattern of progression of free water in patients with a 4-year follow-up tested in a multicentre international longitudinal study of de novo Parkinson's disease (http://www.ppmi-info.org/). The analyses examined: (i) 1-year changes in free water in 103 de novo patients with Parkinson's disease and 49 controls; (ii) 2- and 4-year changes in free water in a subset of 46 patients with Parkinson's disease imaged at baseline, 12, 24, and 48 months; (iii) whether 1- and 2-year changes in free water predict 4-year changes in the Hoehn and Yahr scale; and (iv) the relationship between 4-year changes in free water and striatal binding ratio in a subgroup of Parkinson's disease who had undergone both diffusion and dopamine transporter imaging. Results demonstrated that: (i) free water level in the posterior substantia nigra increased over 1 year in de novo Parkinson's disease but not in controls; (ii) free water kept increasing over 4 years in Parkinson's disease; (iii) sex and baseline free water predicted 4-year changes in free water; (iv) free water increases over 1 and 2 years were related to worsening on the Hoehn and Yahr scale over 4 years; and (v) the 4-year increase in free water was associated with the 4-year decrease in striatal binding ratio in the putamen. Importantly, all longitudinal results were consistent across sites. In summary, this study demonstrates an increase over 1 year in free water in the posterior substantia nigra in a large cohort of de novo patients with Parkinson's disease from a multi-site cohort study and no change in healthy controls, and further demonstrates an increase of free water in Parkinson's disease over the course of 4 years. A key finding was that results are consistent across sites and the 1-year and 2-year increase in free water in the posterior substantia nigra predicts subsequent long-term progression on the Hoehn and Yahr staging system. Collectively, these findings demonstrate that free water in the posterior substantia nigra is a valid, progression imaging marker of Parkinson's disease, which may be used in clinical trials of disease-modifying therapies.
Hypoplastic left heart syndrome (HLHS) is a single-ventricle congenital heart disease that is fatal if left unpalliated. In HLHS patients, the tricuspid valve is the only functioning atrioventricular valve, and its competence is therefore critical. This work demonstrates the first automated strategy for segmentation, modeling, and morphometry of the tricuspid valve in transthoracic 3D echocardiographic (3DE) images of pediatric patients with HLHS. After initial landmark placement, the automated segmentation step uses multi-atlas label fusion and the modeling approach uses deformable modeling with medial axis representation to produce patient-specific models of the tricuspid valve that can be comprehensively and quantitatively assessed. In a group of 16 pediatric patients, valve segmentation and modeling attains an accuracy (mean boundary displacement) of 0.8 ± 0.2 mm relative to manual tracing and shows consistency in annular and leaflet measurements. In the future, such image-based tools have the potential to improve understanding and evaluation of tricuspid valve morphology in HLHS and guide strategies for patient care.
We propose a non-parametric approach for characterizing heterogeneous diseases in large-scale studies. We target diseases where multiple types of pathology present simultaneously in each subject and a more severe disease manifests as a higher level of tissue destruction. For each subject, we model theof local image descriptors as samples generated by an unknown subject-specific probability density. Instead of approximating the probability density via a parametric family, we propose to side step the parametric inference by directly estimating the divergence between subject densities. Our method maps the collection of local image descriptors to a signaturethat is used to predict a clinical measurement. We are able to interpret the prediction of the clinical variable in the population and individual levels by carefully studying the divergences. We illustrate an application this method on simulated data as well as on a large-scale lung CT study of Chronic Obstructive Pulmonary Disease (COPD). Our approach outperforms classical methods on both simulated and COPD data and demonstrates the state-of-the-art prediction on an important physiologic measure of airflow (the forced respiratory volume in one second, FEV1).
In schizophrenia, abnormalities in structural connectivity between brain regions known to contain mirror neurons and their relationship to negative symptoms related to a domain of social cognition are not well understood. Diffusion tensor imaging (DTI) scans were acquired in 16 patients with first episode schizophrenia and 16 matched healthy controls. FA and Trace of the tracts interconnecting regions known to be rich in mirror neurons, i.e., anterior cingulate cortex (ACC), inferior parietal lobe (IPL) and premotor cortex (PMC) were evaluated. A significant group effect for Trace was observed in IPL-PMC white matter fiber tract (F (1, 28) = 7.13, p = .012), as well as in the PMC-ACC white matter fiber tract (F (1, 28) = 4.64, p = .040). There were no group differences in FA. In addition, patients with schizophrenia showed a significant positive correlation between the Trace of the left IPL-PMC white matter fiber tract, and the Ability to Feel Intimacy and Closeness score (rho = .57, p = 0.034), and a negative correlation between the Trace of the left PMC-ACC and the Relationships with Friends and Peers score (rho = remove -.54, p = 0.049). We have demonstrated disrupted white mater microstructure within the white matter tracts subserving brain regions containing mirror neurons. We further showed that such structural disruptions might impact negative symptoms and, more specifically, contribute to the inability to feel intimacy (a measure conceptually related to theory of mind) in first episode schizophrenia. Further studies are needed to understand the potential of our results for diagnosis, prognosis and therapeutic interventions.
This paper presents an efficient algorithm for large deformation diffeomorphic metric mapping (LDDMM) with geodesic shooting for image registration. We introduce a novel finite dimensional Fourier representation of diffeomorphic deformations based on the key fact that the high frequency components of a diffeomorphism remain stationary throughout the integration process when computing the deformation associated with smooth velocity fields. We show that manipulating high dimensional diffeomorphisms can be carried out entirely in the bandlimited space by integrating the nonstationary low frequency components of the displacement field. This insight substantially reduces the computational cost of the registration problem. Experimental results show that our method is significantly faster than the state-of-the-art diffeomorphic image registration methods while producing equally accurate alignment. We demonstrate our algorithm in two different applications of image registration: neuroimaging and in-utero imaging.
We present an algorithm for creating high resolution anatomically plausible images consistent with acquired clinical brain MRI scans with large inter-slice spacing. Although large databases of clinical images contain a wealth of information, medical acquisition constraints result in sparse scans that miss much of the anatomy. These characteristics often render computational analysis impractical as standard processing algorithms tend to fail when applied to such images. Highly specialized or application-specific algorithms that explicitly handle sparse slice spacing do not generalize well across problem domains. In contrast, our goal is to enable application of existing algorithms that were originally developed for high resolution research scans to significantly undersampled scans. We introduce a model that captures fine-scale anatomical similarity across subjects in clinical image collections and use it to fill in the missing data in scans with large slice spacing. Our experimental results demonstrate that the proposed method outperforms current upsampling methods and promises to facilitate subsequent analysis not previously possible with scans of this quality.
Diffusion tensor imaging (DTI) studies in chronic schizophrenia have found widespread but often inconsistent patterns of white matter abnormalities. These studies have typically used the conventional measure of fractional anisotropy, which can be contaminated by extracellular free-water. A recent free-water imaging study reported reduced free-water corrected fractional anisotropy (FAT) in chronic schizophrenia across several brain regions, but limited changes in the extracellular volume. The present study set out to validate these findings in a substantially larger sample. Tract-based spatial statistics (TBSS) was performed in 188 healthy controls and 281 chronic schizophrenia patients. Forty-two regions of interest (ROIs), as well as average whole-brain FAT and FW were extracted from free-water corrected diffusion tensor maps. Compared to healthy controls, reduced FAT was found in the chronic schizophrenia group in the anterior limb of the internal capsule bilaterally, the posterior thalamic radiation bilaterally, as well as the genu and body of the corpus callosum. While a significant main effect of group was observed for FW, none of the follow-up contrasts survived correction for multiple comparisons. The observed FAT reductions in the absence of extracellular FW changes, in a large, multi-site sample of chronic schizophrenia patients, validate the pattern of findings reported by a previous, smaller free-water imaging study of a similar sample. The limited number of regions in which FAT was reduced in the schizophrenia group suggests that actual white matter tissue degeneration in chronic schizophrenia, independent of extracellular FW, might be more localized than suggested previously.
We propose an extension of the Wasserstein 1-metric (W1) for density matrices, matrix-valued density measures, and an unbalanced interpretation of mass transport. We use duality theory and, in particular, a "dual of the dual" formulation of W1. This matrix analogue of the Earth Mover's Distance has several attractive features including ease of computation.
Tractography based on non-invasive diffusion imaging is central to the study of human brain connectivity. To date, the approach has not been systematically validated in ground truth studies. Based on a simulated human brain data set with ground truth tracts, we organized an open international tractography challenge, which resulted in 96 distinct submissions from 20 research groups. Here, we report the encouraging finding that most state-of-the-art algorithms produce tractograms containing 90% of the ground truth bundles (to at least some extent). However, the same tractograms contain many more invalid than valid bundles, and half of these invalid bundles occur systematically across research groups. Taken together, our results demonstrate and confirm fundamental ambiguities inherent in tract reconstruction based on orientation information alone, which need to be considered when interpreting tractography and connectivity results. Our approach provides a novel framework for estimating reliability of tractography and encourages innovation to address its current limitations.