Fiber tracking produces large tractography datasets that are tens of gigabytes in size consisting of millions of streamlines. Such vast amounts of data require formats that allow for efficient storage, transfer, and visualization. We present TRAKO, a new data format based on the Graphics Layer Transmission Format (glTF) that enables immediate graphical and hardware-accelerated processing. We integrate a state-of-the-art compression technique for vertices, streamlines, and attached scalar and property data. We then compare TRAKO to existing tractography storage methods and provide a detailed evaluation on eight datasets. TRAKO can achieve data reductions of over 28x without loss of statistical significance when used to replicate analysis from previously published studies.

Despite recent progress in image-to-image translation, it remains challenging to apply such techniques to clinical quality medical images. We develop a novel parameterization of conditional generative adversarial networks that achieves high image fidelity when trained to transform MRIs conditioned on a patient’s age and disease severity. The spatial-intensity transform generative adversarial network (SIT-GAN) constrains the generator to a smooth spatial transform composed with sparse intensity changes. This technique improves image quality and robustness to artifacts, and generalizes to different scanners. We demonstrate SIT-GAN on a large clinical image dataset of stroke patients, where it captures associations between ventricle expansion and aging, as well as between white matter hyperintensities and stroke severity. Additionally, SIT-GAN provides a disentangled view of the variation in shape and appearance across subjects.

We propose and demonstrate a novel machine learning algorithm that assesses pulmonary edema severity from chest radiographs. While large publicly available datasets of chest radiographs and free-text radiology reports exist, only limited numerical edema severity labels can be extracted from radiology reports. This is a significant challenge in learning such models for image classification. To take advantage of the rich information present in the radiology reports, we develop a neural network model that is trained on both images and free-text to assess pulmonary edema severity from chest radiographs at inference time. Our experimental results suggest that the joint image-text representation learning improves the performance of pulmonary edema assessment compared to a supervised model trained on images only. We also show the use of the text for explaining the image classification by the joint model. To the best of our knowledge, our approach is the first to leverage free-text radiology reports for improving the image model performance in this application. Our code is available at: https://github.com/RayRuizhiLiao/joint_chestxray.

PURPOSE: To optimize diffusion-relaxation MRI with tensor-valued diffusion encoding for precise estimation of compartment-specific fractions, diffusivities, and T values within a two-compartment model of white matter, and to explore the approach in vivo. METHODS: Sampling protocols featuring different b-values (b), b-tensor shapes (b ), and echo times (TE) were optimized using Cram\ er-Rao lower bounds (CRLB). Whole-brain data were acquired in children, adults, and elderly with white matter lesions. Compartment fractions, diffusivities, and T values were estimated in a model featuring two microstructural compartments represented by a "stick" and a "zeppelin." RESULTS: Precise parameter estimates were enabled by sampling protocols featuring seven or more "shells" with unique b/b /TE-combinations. Acquisition times were approximately 15 minutes. In white matter of adults, the "stick" compartment had a fraction of approximately 0.5 and, compared with the "zeppelin" compartment, featured lower isotropic diffusivities (0.6 vs. 1.3 μm /ms) but higher T values (85 vs. 65 ms). Children featured lower "stick" fractions (0.4). White matter lesions exhibited high "zeppelin" isotropic diffusivities (1.7 μm /ms) and T values (150 ms). CONCLUSIONS: Diffusion-relaxation MRI with tensor-valued diffusion encoding expands the set of microstructure parameters that can be precisely estimated and therefore increases their specificity to biological quantities.

The corticospinal tract (CST) is one of the most well studied tracts in human neuroanatomy. Its clinical significance can be demonstrated in many notable traumatic conditions and diseases such as stroke, spinal cord injury (SCI) or amyotrophic lateral sclerosis (ALS). With the advent of diffusion MRI and tractography the computational representation of the human CST in a 3D model became available. However, the representation of the entire CST and, specifically, the hand motor area has remained elusive. In this paper we propose a novel method, using manually drawn ROIs based on robustly identifiable neuroanatomic structures to delineate the entire CST and isolate its hand motor representation as well as to estimate their variability and generate a database of their volume, length and biophysical parameters. Using 37 healthy human subjects we performed a qualitative and quantitative analysis of the CST and the hand-related motor fiber tracts (HMFTs). Finally, we have created variability heat maps from 37 subjects for both the aforementioned tracts, which could be utilized as a reference for future studies with clinical focus to explore neuropathology in both trauma and disease states.

BACKGROUND: Extracellular free water within cerebral white matter tissue has been shown to increase with age and pathology, yet the cognitive consequences of free water in typical aging prior to the development of neurodegenerative disease remains unclear. Understanding the contribution of free water to cognitive function in older adults may provide important insight into the neural mechanisms of the cognitive aging process. METHODS: A diffusion-weighted MRI measure of extracellular free water as well as a commonly used diffusion MRI metric (fractional anisotropy) along nine bilateral white matter pathways were examined for their relationship with cognitive function assessed by the NIH Toolbox Cognitive Battery in 47 older adults (mean age ​= ​74.4 years, SD ​= ​5.4 years, range ​= ​65-85 years). Probabilistic tractography at the 99th percentile level of probability (Tracts Constrained by Underlying Anatomy; TRACULA) was utilized to produce the pathways on which microstructural characteristics were overlaid and examined for their contribution to cognitive function independent of age, education, and gender. RESULTS: When examining the 99th percentile probability core white matter pathway derived from TRACULA, poorer fluid cognitive ability was related to higher mean free water values across the angular and cingulum bundles of the cingulate gyrus, as well as the corticospinal tract and the superior longitudinal fasciculus. There was no relationship between cognition and mean FA or free water-adjusted FA across the 99th percentile core white matter pathway. Crystallized cognitive ability was not associated with any of the diffusion measures. When examining cognitive domains comprising the NIH Toolbox Fluid Cognition index relationships with these white matter pathways, mean free water demonstrated strong hemispheric and functional specificity for cognitive performance, whereas mean FA was not related to age or cognition across the 99th percentile pathway. CONCLUSIONS: Extracellular free water within white matter appears to increase with normal aging, and higher values are associated with significantly lower fluid but not crystallized cognitive functions. When using TRACULA to estimate the core of a white matter pathway, a higher degree of free water appears to be highly specific to the pathways associated with memory, working memory, and speeded decision-making performance, whereas no such relationship existed with FA. These data suggest that free water may play an important role in the cognitive aging process, and may serve as a stronger and more specific indicator of early cognitive decline than traditional diffusion MRI measures, such as FA.

BACKGROUND: Auditory verbal hallucinations (AVH) are a cardinal feature of schizophrenia, but they can also appear in otherwise healthy individuals. Imaging studies implicate language networks in the generation of AVH; however, it remains unclear if alterations reflect biologic substrates of AVH, irrespective of diagnostic status, age, or illness-related factors. We applied multimodal imaging to identify AVH-specific pathology, evidenced by overlapping gray or white matter deficits between schizophrenia patients and healthy voice-hearers. METHODS: Diffusion-weighted and T1-weighted magnetic resonance images were acquired in 35 schizophrenia patients with AVH (SCZ-AVH), 32 healthy voice-hearers (H-AVH), and 40 age- and sex-matched controls without AVH. White matter fractional anisotropy (FA) and gray matter thickness (GMT) were computed for each region comprising ICBM-DTI and Desikan-Killiany atlases, respectively. Regions were tested for significant alterations affecting both SCZ-AVH and H-AVH groups, relative to controls. RESULTS: Compared with controls, the SCZ-AVH showed widespread FA and GMT reductions; but no significant differences emerged between H-AVH and control groups. While no overlapping pathology appeared in the overall study groups, younger (<40 years) H-AVH and SCZ-AVH subjects displayed overlapping FA deficits across four regions (p < 0.05): the genu and splenium of the corpus callosum, as well as the anterior limbs of the internal capsule. Analyzing these regions with free-water imaging ascribed overlapping FA abnormalities to tissue-specific anisotropy changes. CONCLUSIONS: We identified white matter pathology associated with the presence of AVH, independent of diagnostic status. However, commonalities were constrained to younger and more homogenous groups, after reducing pathologic variance associated with advancing age and chronicity effects.

OBJECTIVE: Accurate biopsy sampling of the suspected lesions is critical for the diagnosis and clinical management of prostate cancer. Transperineal in-bore MRI-guided prostate biopsy (tpMRgBx) is a targeted biopsy technique that was shown to be safe, efficient, and accurate. Our goal was to develop an open source software platform to support evaluation, refinement, and translation of this biopsy approach. METHODS: We developed SliceTracker, a 3D Slicer extension to support tpMRgBx. We followed modular design of the implementation to enable customization of the interface and interchange of image segmentation and registration components to assess their effect on the processing time, precision, and accuracy of the biopsy needle placement. The platform and supporting documentation were developed to enable the use of software by an operator with minimal technical training to facilitate translation. Retrospective evaluation studied registration accuracy, effect of the prostate segmentation approach, and re-identification time of biopsy targets. Prospective evaluation focused on the total procedure time and biopsy targeting error (BTE). RESULTS: Evaluation utilized data from 73 retrospective and ten prospective tpMRgBx cases. Mean landmark registration error for retrospective evaluation was 1.88 ± 2.63 mm, and was not sensitive to the approach used for prostate gland segmentation. Prospectively, we observed target re-identification time of 4.60 ± 2.40 min and BTE of 2.40 ± 0.98 mm. CONCLUSION: SliceTracker is modular and extensible open source platform for supporting image processing aspects of the tpMRgBx procedure. It has been successfully utilized to support clinical research procedures at our site.

PURPOSE: Zero-footprint Web architecture enables imaging applications to be deployed on premise or in the cloud without requiring installation of custom software on the user’s computer. Benefits include decreased costs and information technology support requirements, as well as improved accessibility across sites. The Open Health Imaging Foundation (OHIF) Viewer is an extensible platform developed to leverage these benefits and address the demand for open-source Web-based imaging applications. The platform can be modified to support site-specific workflows and accommodate evolving research requirements. MATERIALS AND METHODS: The OHIF Viewer provides basic image review functionality (eg, image manipulation and measurement) as well as advanced visualization (eg, multiplanar reformatting). It is written as a client-only, single-page Web application that can easily be embedded into third-party applications or hosted as a standalone Web site. The platform provides extension points for software developers to include custom tools and adapt the system for their workflows. It is standards compliant and relies on DICOMweb for data exchange and OpenID Connect for authentication, but it can be configured to use any data source or authentication flow. Additionally, the user interface components are provided in a standalone component library so that developers can create custom extensions. RESULTS: The OHIF Viewer and its underlying components have been widely adopted and integrated into multiple clinical research platforms (e,g Precision Imaging Metrics, XNAT, LabCAS, ISB-CGC) and commercial applications (eg, Osirix). It has also been used to build custom imaging applications (eg, ProstateCancer.ai, Crowds Cure Cancer [presented as a case study]). CONCLUSION: The OHIF Viewer provides a flexible framework for building applications to support imaging research. Its adoption could reduce redundancies in software development for National Cancer Institute-funded projects, including Informatics Technology for Cancer Research and the Quantitative Imaging Network.

OBJECTIVE: Delineation of malformations of cortical development (MCD) is central in presurgical evaluation of drug-resistant epilepsy. Delineation using magnetic resonance imaging (MRI) can be ambiguous, however, because the conventional T - and T -weighted contrasts depend strongly on myelin for differentiation of cortical tissue and white matter. Variations in myelin content within both cortex and white matter may cause MCD findings on MRI to change size, become undetectable, or disagree with histopathology. The novel tensor-valued diffusion MRI (dMRI) technique maps microscopic diffusion anisotropy, which is sensitive to axons rather than myelin. This work investigated whether tensor-valued dMRI may improve differentiation of cortex and white matter in the delineation of MCD. METHODS: Tensor-valued dMRI was performed on a 7 T MRI scanner in 13 MCD patients (age = 32 ± 13 years) featuring periventricular heterotopia, subcortical heterotopia, focal cortical dysplasia, and polymicrogyria. Data analysis yielded maps of microscopic anisotropy that were compared with T -weighted and T -fluid-attenuated inversion recovery images and with the fractional anisotropy from diffusion tensor imaging. RESULTS: Maps of microscopic anisotropy revealed large white matter-like regions within MCD that were uniformly cortex-like in the conventional MRI contrasts. These regions were seen particularly in the deep white matter parts of subcortical heterotopias and near the gray-white boundaries of focal cortical dysplasias and polymicrogyrias. SIGNIFICANCE: By being sensitive to axons rather than myelin, mapping of microscopic anisotropy may yield a more robust differentiation of cortex and white matter and improve MCD delineation in presurgical evaluation of epilepsy.