Publications

2021

Zhang F, Breger A, Cho KIK, Ning L, Westin CF, Donnell LJO, Pasternak O. Deep Learning Based Segmentation of Brain Tissue from Diffusion MRI. Neuroimage. 2021;233:117934.

Segmentation of brain tissue types from diffusion MRI (dMRI) is an important task, required for quantification of brain microstructure and for improving tractography. Current dMRI segmentation is mostly based on anatomical MRI (e.g., T1- and T2-weighted) segmentation that is registered to the dMRI space. However, such inter-modality registration is challenging due to more image distortions and lower image resolution in dMRI as compared with anatomical MRI. In this study, we present a deep learning method for diffusion MRI segmentation, which we refer to as DDSeg. Our proposed method learns tissue segmentation from high-quality imaging data from the Human Connectome Project (HCP), where registration of anatomical MRI to dMRI is more precise. The method is then able to predict a tissue segmentation directly from new dMRI data, including data collected with different acquisition protocols, without requiring anatomical data and inter-modality registration. We train a convolutional neural network (CNN) to learn a tissue segmentation model using a novel augmented target loss function designed to improve accuracy in regions of tissue boundary. To further improve accuracy, our method adds diffusion kurtosis imaging (DKI) parameters that characterize non-Gaussian water molecule diffusion to the conventional diffusion tensor imaging parameters. The DKI parameters are calculated from the recently proposed mean-kurtosis-curve method that corrects implausible DKI parameter values and provides additional features that discriminate between tissue types. We demonstrate high tissue segmentation accuracy on HCP data, and also when applying the HCP-trained model on dMRI data from other acquisitions with lower resolution and fewer gradient directions.

Maziero MP, Seitz-Holland J, Cho KIK, Goldenberg JE, Tanamatis TW, Diniz JB, Cappi C, de Mathis MA, Otaduy MCG, Martin M da GM, da Silva R de MF, Shavitt RG, Batistuzzo MC, Lopes AC, Miguel EC, Pasternak O, Hoexter MQ. Cellular and Extracellular White Matter Abnormalities in Obsessive-Compulsive Disorder: A Diffusion MRI Study. Biol Psychiatry Cogn Neurosci Neuroimaging. 2021;6(10):983–91.

BACKGROUND: While previous studies have implicated white matter (WM) as a core pathology of Obsessive-Compulsive Disorder (OCD), the underlying neurobiological processes remain elusive. This study utilizes free-water imaging derived from diffusion MRI to identify cellular and extracellular WM abnormalities in patients with OCD compared to controls (Cs). Next, we investigate the association between diffusion measures, and clinical variables in patients. METHODS: We collected diffusion-weighted MRI and clinical data from eighty-three patients with OCD (56 females/27 males, age=37.7 ± 10.6) and 52 Cs (27 females/25 males, age=32.8 ± 11.5). Fractional anisotropy (FA), fractional anisotropy of cellular tissue (FAT), and extracellular free-water (FW) maps were extracted and compared between patients and Cs using tract-based spatial statistics, and voxel-wise comparison in FSL’s Randomise. Next, we correlated these WM measures with clinical variables (age-of-onset and symptom severity) and compared them between patients with and without comorbidities and patients with and without psychiatric medication. RESULTS: Patients with OCD demonstrated lower FA (43.4% of the WM skeleton), FAт (31% of the WM skeleton), and higher FW (22.5% of the WM skeleton) compared to Cs. We did not observe significant correlations between diffusion measures and clinical variables. Comorbidities and medication status did not influence diffusion measures. CONCLUSIONS: Our findings of widespread FA, FAт, and FW abnormalities suggest that OCD is associated with both microstructural cellular and extracellular abnormalities beyond the cortico-striato-thalamo-cortical circuits. Future multimodal longitudinal studies are needed to understand better the influence of essential clinical variables across the illness trajectory.

He J, Zhang F, Xie G, Yao S, Feng Y, Bastos DCA, Rathi Y, Makris N, Kikinis R, Golby AJ, Donnell LJO. Comparison of Multiple Tractography Methods for Reconstruction of the Retinogeniculate Visual Pathway Using Diffusion MRI. Hum Brain Mapp. 2021;42(12):3887–904.

The retinogeniculate visual pathway (RGVP) conveys visual information from the retina to the lateral geniculate nucleus. The RGVP has four subdivisions, including two decussating and two nondecussating pathways that cannot be identified on conventional structural magnetic resonance imaging (MRI). Diffusion MRI tractography has the potential to trace these subdivisions and is increasingly used to study the RGVP. However, it is not yet known which fiber tracking strategy is most suitable for RGVP reconstruction. In this study, four tractography methods are compared, including constrained spherical deconvolution (CSD) based probabilistic (iFOD1) and deterministic (SD-Stream) methods, and multi-fiber (UKF-2T) and single-fiber (UKF-1T) unscented Kalman filter (UKF) methods. Experiments use diffusion MRI data from 57 subjects in the Human Connectome Project. The RGVP is identified using regions of interest created by two clinical experts. Quantitative anatomical measurements and expert anatomical judgment are used to assess the advantages and limitations of the four tractography methods. Overall, we conclude that UKF-2T and iFOD1 produce the best RGVP reconstruction results. The iFOD1 method can better quantitatively estimate the percentage of decussating fibers, while the UKF-2T method produces reconstructed RGVPs that are judged to better correspond to the known anatomy and have the highest spatial overlap across subjects. Overall, we find that it is challenging for current tractography methods to both accurately track RGVP fibers that correspond to known anatomy and produce an approximately correct percentage of decussating fibers. We suggest that future algorithm development for RGVP tractography should take consideration of both of these two points.

Guder S, Pasternak O, Gerloff C, Schulz R. Strengthened Structure-Function Relationships of the Corticospinal Tract by Free Water Correction After Stroke. Brain Commun. 2021;3(2):fcab034.

The corticospinal tract is the most intensively investigated tract of the human motor system in stroke rehabilitative research. Diffusion-tensor-imaging gives insights into its microstructure, and transcranial magnetic stimulation assesses its excitability. Previous data on the interrelationship between both measures are contradictory. Correlative or predictive models which associate them with motor outcome are incomplete. Free water correction has been developed to enhance diffusion-tensor-imaging by eliminating partial volume with extracellular water, which could improve capturing stroke-related microstructural alterations, thereby also improving structure-function relationships in clinical cohorts. In the present cross-sectional study, data of 18 chronic stroke patients and 17 healthy controls, taken from a previous study on cortico-cerebellar motor tracts, were re-analysed: The data included diffusion-tensor-imaging data quantifying corticospinal tract microstructure with and without free water correction, transcranial magnetic stimulation data assessing recruitment curve properties of motor evoked potentials and detailed clinical data. Linear regression modelling was used to interrelate corticospinal tract microstructure, recruitment curves properties and clinical scores. The main finding of the present study was that free water correction substantially strengthens structure-function associations in stroke patients: Specifically, our data evidenced a significant association between fractional anisotropy of the ipsilesional corticospinal tract and its excitability ( = 0.001, adj. = 0.54), with free water correction explaining additional 20% in recruitment curve variability. For clinical scores, only free water correction leads to the reliable detection of significant correlations between ipsilesional corticospinal tract fractional anisotropy and residual grip ( = 0.001, adj. = 0.70) and pinch force ( < 0.001, adj. = 0.72). Finally, multimodal models can be improved by free water correction as well. This study evidences that corticospinal tract microstructure directly relates to its excitability in stroke patients. It also shows that unexplained variance in motor outcome is considerably reduced by free water correction arguing that it might serve as a powerful tool to improve existing models of structure-function associations and potentially also outcome prediction after stroke.

Horng S, Liao R, Wang X, Dalal S, Golland P, Berkowitz SJ. Deep Learning to Quantify Pulmonary Edema in Chest Radiographs. Radiol Artif Intell. 2021;3(2):e190228.

Purpose: To develop a machine learning model to classify the severity grades of pulmonary edema on chest radiographs. Materials and Methods: In this retrospective study, 369 071 chest radiographs and associated radiology reports from 64 581 patients (mean age, 51.71 years; 54.51% women) from the MIMIC-CXR chest radiograph dataset were included. This dataset was split into patients with and without congestive heart failure (CHF). Pulmonary edema severity labels from the associated radiology reports were extracted from patients with CHF as four different ordinal levels: 0, no edema; 1, vascular congestion; 2, interstitial edema; and 3, alveolar edema. Deep learning models were developed using two approaches: a semisupervised model using a variational autoencoder and a pretrained supervised learning model using a dense neural network. Receiver operating characteristic curve analysis was performed on both models. Results: The area under the receiver operating characteristic curve (AUC) for differentiating alveolar edema from no edema was 0.99 for the semisupervised model and 0.87 for the pretrained models. Performance of the algorithm was inversely related to the difficulty in categorizing milder states of pulmonary edema (shown as AUCs for semisupervised model and pretrained model, respectively): 2 versus 0, 0.88 and 0.81; 1 versus 0, 0.79 and 0.66; 3 versus 1, 0.93 and 0.82; 2 versus 1, 0.69 and 0.73; and 3 versus 2, 0.88 and 0.63. Conclusion: Deep learning models were trained on a large chest radiograph dataset and could grade the severity of pulmonary edema on chest radiographs with high performance.Supplemental material is available for this article.See also the commentary by Auffermann in this issue.© RSNA, 2021.

Bastos DCDA, Juvekar P, Tie Y, Jowkar N, Pieper S, Wells WM, Bi WL, Golby A, Frisken S, Kapur T. Challenges and Opportunities of Intraoperative 3D Ultrasound With Neuronavigation in Relation to Intraoperative MRI. Front Oncol. 2021;11:656519.

Introduction: Neuronavigation greatly improves the surgeons ability to approach, assess and operate on brain tumors, but tends to lose its accuracy as the surgery progresses and substantial brain shift and deformation occurs. Intraoperative MRI (iMRI) can partially address this problem but is resource intensive and workflow disruptive. Intraoperative ultrasound (iUS) provides real-time information that can be used to update neuronavigation and provide real-time information regarding the resection progress. We describe the intraoperative use of 3D iUS in relation to iMRI, and discuss the challenges and opportunities in its use in neurosurgical practice. Methods: We performed a retrospective evaluation of patients who underwent image-guided brain tumor resection in which both 3D iUS and iMRI were used. The study was conducted between June 2020 and December 2020 when an extension of a commercially available navigation software was introduced in our practice enabling 3D iUS volumes to be reconstructed from tracked 2D iUS images. For each patient, three or more 3D iUS images were acquired during the procedure, and one iMRI was acquired towards the end. The iUS images included an extradural ultrasound sweep acquired before dural incision (iUS-1), a post-dural opening iUS (iUS-2), and a third iUS acquired immediately before the iMRI acquisition (iUS-3). iUS-1 and preoperative MRI were compared to evaluate the ability of iUS to visualize tumor boundaries and critical anatomic landmarks; iUS-3 and iMRI were compared to evaluate the ability of iUS for predicting residual tumor. Results: Twenty-three patients were included in this study. Fifteen patients had tumors located in eloquent or near eloquent brain regions, the majority of patients had low grade gliomas (11), gross total resection was achieved in 12 patients, postoperative temporary deficits were observed in five patients. In twenty-two iUS was able to define tumor location, tumor margins, and was able to indicate relevant landmarks for orientation and guidance. In sixteen cases, white matter fiber tracts computed from preoperative dMRI were overlaid on the iUS images. In nineteen patients, the EOR (GTR or STR) was predicted by iUS and confirmed by iMRI. The remaining four patients where iUS was not able to evaluate the presence or absence of residual tumor were recurrent cases with a previous surgical cavity that hindered good contact between the US probe and the brainsurface. Conclusion: This recent experience at our institution illustrates the practical benefits, challenges, and opportunities of 3D iUS in relation to iMRI.

Langbein BJ, Szczepankiewicz F, Westin CF, Bay C, Maier SE, Kibel AS, Tempany CM, Fennessy FM. A Pilot Study of Multidimensional Diffusion MRI for Assessment of Tissue Heterogeneity in Prostate Cancer. Invest Radiol. 2021;56(12):845–53.

OBJECTIVES: The objectives of this exploratory study were to investigate the feasibility of multidimensional diffusion magnetic resonance imaging (MddMRI) in assessing diffusion heterogeneity at both a macroscopic and microscopic level in prostate cancer (PCa). MATERIALS AND METHODS: Informed consent was obtained from 46 subjects who underwent 3.0-T prostate multiparametric MRI, complemented with a prototype spin echo-based MddMRI sequence in this institutional review board-approved study. Prostate cancer tumors and comparative normal tissue from each patient were contoured on both apparent diffusion coefficient and MddMRI-derived mean diffusivity (MD) maps (from which microscopic diffusion heterogeneity [MKi] and microscopic diffusion anisotropy were derived) using 3D Slicer. The discriminative ability of MddMRI-derived parameters to differentiate PCa from normal tissue was determined using the Friedman test. To determine if tumor diffusion heterogeneity is similar on macroscopic and microscopic scales, the linear association between SD of MD and mean MKi was estimated using robust regression (bisquare weighting). Hypothesis testing was 2 tailed; P values less than 0.05 were considered statistically significant. RESULTS: All MddMRI-derived parameters could distinguish tumor from normal tissue in the fixed-effects analysis (P < 0.0001). Tumor MKi was higher (P < 0.05) compared with normal tissue (median, 0.40; interquartile range, 0.29-0.52 vs 0.20-0.18; 0.25), as was tumor microscopic diffusion anisotropy (0.55; 0.36-0.81 vs 0.20-0.15; 0.28). The MKi could not be predicted (no significant association) by SD of MD. There was a significant correlation between tumor volume and SD of MD (R2 = 0.50, slope = 0.008 μm2/ms per millimeter, P < 0.001) but not between tumor volume and MKi. CONCLUSIONS: This explorative study demonstrates that MddMRI provides novel information on MKi and microscopic anisotropy, which differ from measures at the macroscopic level. MddMRI has the potential to characterize tumor tissue heterogeneity at different spatial scales.

Behjat H, Aganj I, Abramian D, Eklund A, Westin CF. Characterization of Spatial Dynamics of Fmri Data in White Matter Using Diffusion-Informed White Matter Harmonics. Proc IEEE Int Symp Biomed Imaging. 2021;2021:1586–90.

In this work, we leverage the Laplacian eigenbasis of voxel-wise white matter (WM) graphs derived from diffusion-weighted MRI data, dubbed WM harmonics, to characterize the spatial structure of WM fMRI data. Our motivation for such a characterization is based on studies that show WM fMRI data exhibit a spatial correlational anisotropy that coincides with underlying fiber patterns. By quantifying the energy content of WM fMRI data associated with subsets of WM harmonics across multiple spectral bands, we show that the data exhibits notable subtle spatial modulations under functional load that are not manifested during rest. WM harmonics provide a novel means to study the spatial dynamics of WM fMRI data, in such way that the analysis is informed by the underlying anatomical structure.

Iglesias JE, Billot B, Balbastre Y, Tabari A, Conklin J, González G, Alexander DC, Golland P, Edlow BL, Fischl B, Initiative A s DN. Joint Super-Resolution and Synthesis of 1 Mm Isotropic MP-RAGE Volumes From Clinical MRI Exams With Scans of Different Orientation, Resolution and Contrast. Neuroimage. 2021;237:118206.

Most existing algorithms for automatic 3D morphometry of human brain MRI scans are designed for data with near-isotropic voxels at approximately 1 mm resolution, and frequently have contrast constraints as well-typically requiring T1-weighted images (e.g., MP-RAGE scans). This limitation prevents the analysis of millions of MRI scans acquired with large inter-slice spacing in clinical settings every year. In turn, the inability to quantitatively analyze these scans hinders the adoption of quantitative neuro imaging in healthcare, and also precludes research studies that could attain huge sample sizes and hence greatly improve our understanding of the human brain. Recent advances in convolutional neural networks (CNNs) are producing outstanding results in super-resolution and contrast synthesis of MRI. However, these approaches are very sensitive to the specific combination of contrast, resolution and orientation of the input images, and thus do not generalize to diverse clinical acquisition protocols - even within sites. In this article, we present SynthSR, a method to train a CNN that receives one or more scans with spaced slices, acquired with different contrast, resolution and orientation, and produces an isotropic scan of canonical contrast (typically a 1 mm MP-RAGE). The presented method does not require any preprocessing, beyond rigid coregistration of the input scans. Crucially, SynthSR trains on synthetic input images generated from 3D segmentations, and can thus be used to train CNNs for any combination of contrasts, resolutions and orientations without high-resolution real images of the input contrasts. We test the images generated with SynthSR in an array of common downstream analyses, and show that they can be reliably used for subcortical segmentation and volumetry, image registration (e.g., for tensor-based morphometry), and, if some image quality requirements are met, even cortical thickness morphometry. The source code is publicly available at https://github.com/BBillot/SynthSR.

Di Biase MA, Cetin-Karayumak S, Lyall AE, Zalesky A, Cho KIK, Zhang F, Kubicki M, Rathi Y, Lyons MG, Bouix S, Billah T, Anticevic A, Schleifer C, Adkinson BD, Ji JL, Tamayo Z, Addington J, Bearden CE, Cornblatt BA, Keshavan MS, Mathalon DH, McGlashan TH, Perkins DO, Cadenhead KS, Tsuang MT, Woods SW, Stone WS, Shenton ME, Cannon TD, Pasternak O. White Matter Changes in Psychosis Risk Relate to Development and Are Not Impacted by the Transition to Psychosis. Mol Psychiatry. 2021;26(11):6833–44.

Subtle alterations in white matter microstructure are observed in youth at clinical high risk (CHR) for psychosis. However, the timing of these changes and their relationships to the emergence of psychosis remain unclear. Here, we track the evolution of white matter abnormalities in a large, longitudinal cohort of CHR individuals comprising the North American Prodrome Longitudinal Study (NAPLS-3). Multi-shell diffusion magnetic resonance imaging data were collected across multiple timepoints (1-5 over 1 year) in 286 subjects (aged 12-32 years): 25 CHR individuals who transitioned to psychosis (CHR-P; 61 scans), 205 CHR subjects with unknown transition outcome after the 1-year follow-up period (CHR-U; 596 scans), and 56 healthy controls (195 scans). Linear mixed effects models were fitted to infer the impact of age and illness-onset on variation in the fractional anisotropy of cellular tissue (FAT) and the volume fraction of extracellular free water (FW). Baseline measures of white matter microstructure did not differentiate between HC, CHR-U and CHR-P individuals. However, age trajectories differed between the three groups in line with a developmental effect: CHR-P and CHR-U groups displayed higher FAT in adolescence, and 4% lower FAT by 30 years of age compared to controls. Furthermore, older CHR-P subjects (20+ years) displayed 4% higher FW in the forceps major (p < 0.05). Prospective analysis in CHR-P did not reveal a significant impact of illness onset on regional FAT or FW, suggesting that transition to psychosis is not marked by dramatic change in white matter microstructure. Instead, clinical high risk for psychosis-regardless of transition outcome-is characterized by subtle age-related white matter changes that occur in tandem with development.