Quantitative analysis of clinical image data is an active area of research that holds promise for precision medicine, early assessment of treatment response, and objective characterization of the disease. Interoperability, data sharing, and the ability to mine the resulting data are of increasing importance, given the explosive growth in the number of quantitative analysis methods being proposed. The Digital Imaging and Communications in Medicine (DICOM) standard is widely adopted for image and metadata in radiology. dcmqi (DICOM for Quantitative Imaging) is a free, open source library that implements conversion of the data stored in commonly used research formats into the standard DICOM representation. dcmqi source code is distributed under BSD-style license. It is freely available as a precompiled binary package for every major operating system, as a Docker image, and as an extension to 3D Slicer. Installation and usage instructions are provided on Harvard DASH.
PRIMARY OBJECTIVE: There is a need to understand pathologic processes of the brain following mild traumatic brain injury (mTBI). Previous studies report axonal injury and oedema in the first week after injury in a rodent model. This study aims to investigate the processes occurring 1 week after injury at the time of regeneration and degeneration using diffusion tensor imaging (DTI) in the impact acceleration rat mTBI model. RESEARCH DESIGN: Eighteen rats were subjected to impact acceleration injury, and three rats served as sham controls. Seven days post injury, DTI was acquired from fixed rat brains using a 7T scanner. Group comparison of Fractional Anisotropy (FA) values between traumatized and sham animals was performed using Tract-Based Spatial Statistics (TBSS), a method that we adapted for rats. MAIN OUTCOMES AND RESULTS: TBSS revealed white matter regions of the brain with increased FA values in the traumatized versus sham rats, localized mainly to the contrecoup region. Regions of increased FA included the pyramidal tract, the cerebral peduncle, the superior cerebellar peduncle and to a lesser extent the fibre tracts of the corpus callosum, the anterior commissure, the fimbria of the hippocampus, the fornix, the medial forebrain bundle and the optic chiasm. CONCLUSION: Seven days post injury, during the period of tissue reparation in the impact acceleration rat model of mTBI, microstructural changes to white matter can be detected using DTI.
PURPOSE: Accurate segmentation of lung nodules is crucial in the development of imaging biomarkers for predicting malignancy of the nodules. Manual segmentation is time consuming and affected by inter-observer variability. We evaluated the robustness and accuracy of a publically available semiautomatic segmentation algorithm that is implemented in the 3D Slicer Chest Imaging Platform (CIP) and compared it with the performance of manual segmentation. METHODS: CT images of 354 manually segmented nodules were downloaded from the LIDC database. Four radiologists performed the manual segmentation and assessed various nodule characteristics. The semiautomatic CIP segmentation was initialized using the centroid of the manual segmentations, thereby generating four contours for each nodule. The robustness of both segmentation methods was assessed using the region of uncertainty (δ) and Dice similarity index (DSI). The robustness of the segmentation methods was compared using the Wilcoxon-signed rank test (pWilcoxon<0.05). The Dice similarity index (DSIAgree) between the manual and CIP segmentations was computed to estimate the accuracy of the semiautomatic contours. RESULTS: The median computational time of the CIP segmentation was 10 s. The median CIP and manually segmented volumes were 477 ml and 309 ml, respectively. CIP segmentations were significantly more robust than manual segmentations (median δCIP = 14ml, median dsiCIP = 99% vs. median δmanual = 222ml, median dsimanual = 82%) with pWilcoxon~10-16. The agreement between CIP and manual segmentations had a median DSIAgree of 60%. While 13% (47/354) of the nodules did not require any manual adjustment, minor to substantial manual adjustments were needed for 87% (305/354) of the nodules. CIP segmentations were observed to perform poorly (median DSIAgree≈50%) for non-/sub-solid nodules with subtle appearances and poorly defined boundaries. CONCLUSION: Semi-automatic CIP segmentation can potentially reduce the physician workload for 13% of nodules owing to its computational efficiency and superior stability compared to manual segmentation. Although manual adjustment is needed for many cases, CIP segmentation provides a preliminary contour for physicians as a starting point.
Diffusion imaging is critical for detecting acute brain injury. However, normal apparent diffusion coefficient (ADC) maps change rapidly in early childhood, making abnormality detection difficult. In this article, we explored clinical PACS and electronic healthcare records (EHR) to create age-specific ADC atlases for clinical radiology reference. Using the EHR and three rounds of multiexpert reviews, we found ADC maps from 201 children 0-6 years of age scanned between 2006 and 2013 who had brain MRIs with no reported abnormalities and normal clinical evaluations 2+ years later. These images were grouped in 10 age bins, densely sampling the first 1 year of life (5 bins, including neonates and 4 quarters) and representing the 1-6 year age range (an age bin per year). Unbiased group-wise registration was used to construct ADC atlases for 10 age bins. We used the atlases to quantify (a) cross-sectional normative ADC variations; (b) spatiotemporal heterogeneous ADC changes; and (c) spatiotemporal heterogeneous volumetric changes. The quantified age-specific whole-brain and region-wise ADC values were compared to those from age-matched individual subjects in our study and in multiple existing independent studies. The significance of this study is that we have shown that clinically acquired images can be used to construct normative age-specific atlases. These first of their kind age-specific normative ADC atlases quantitatively characterize changes of myelination-related water diffusion in the first 6 years of life. The quantified voxel-wise spatiotemporal ADC variations provide standard references to assist radiologists toward more objective interpretation of abnormalities in clinical images. Our atlases are available at https://www.nitrc.org/projects/mgh_adcatlases.
Implant placement has been widely used in various kinds of surgery. However, accurate intraoperative drilling performance is essential to avoid injury to adjacent structures. Although some commercially-available surgical navigation systems have been approved for clinical applications, these systems are expensive and the source code is not available to researchers. 3D Slicer is a free, open source software platform for the research community of computer-aided surgery. In this study, a loadable module based on Slicer has been developed and validated to support surgical navigation. This research module allows reliable calibration of the surgical drill, point-based registration and surface matching registration, so that the position and orientation of the surgical drill can be tracked and displayed on the computer screen in real time, aiming at reducing risks. In accuracy verification experiments, the mean target registration error (TRE) for point-based and surface-based registration were 0.31±0.06mm and 1.01±0.06mm respectively, which should meet clinical requirements. Both phantom and cadaver experiments demonstrated the feasibility of our surgical navigation software module.
Neurosurgery makes use of preoperative imaging to visualize pathology, inform surgical planning, and evaluate the safety of selected approaches. The utility of preoperative imaging for neuronavigation, however, is diminished by the well-characterized phenomenon of brain shift, in which the brain deforms intraoperatively as a result of craniotomy, swelling, gravity, tumor resection, cerebrospinal fluid (CSF) drainage, and many other factors. As such, there is a need for updated intraoperative information that accurately reflects intraoperative conditions. Since 1982, intraoperative ultrasound has allowed neurosurgeons to craft and update operative plans without ionizing radiation exposure or major workflow interruption. Continued evolution of ultrasound technology since its introduction has resulted in superior imaging quality, smaller probes, and more seamless integration with neuronavigation systems. Furthermore, the introduction of related imaging modalities, such as 3-dimensional ultrasound, contrast-enhanced ultrasound, high-frequency ultrasound, and ultrasound elastography, has dramatically expanded the options available to the neurosurgeon intraoperatively. In the context of these advances, we review the current state, potential, and challenges of intraoperative ultrasound for brain tumor resection. We begin by evaluating these ultrasound technologies and their relative advantages and disadvantages. We then review three specific applications of these ultrasound technologies to brain tumor resection: (1) intraoperative navigation, (2) assessment of extent of resection, and (3) brain shift monitoring and compensation. We conclude by identifying opportunities for future directions in the development of ultrasound technologies.
The National Alliance for Medical Image Computing (NA-MIC) was launched in 2004 with the goal of investigating and developing an open source software infrastructure for the extraction of information and knowledge from medical images using computational methods. Several leading research and engineering groups participated in this effort that was funded by the US National Institutes of Health through a variety of infrastructure grants. This effort transformed 3D Slicer from an internal, Boston-based, academic research software application into a professionally maintained, robust, open source platform with an international leadership and developer and user communities. Critical improvements to the widely used underlying open source libraries and tools-VTK, ITK, CMake, CDash, DCMTK-were an additional consequence of this effort. This project has contributed to close to a thousand peer-reviewed publications and a growing portfolio of US and international funded efforts expanding the use of these tools in new medical computing applications every year. In this editorial, we discuss what we believe are gaps in the way medical image computing is pursued today; how a well-executed research platform can enable discovery, innovation and reproducible science ("Open Science"); and how our quest to build such a software platform has evolved into a productive and rewarding social engineering exercise in building an open-access community with a shared vision.
Background. Imaging biomarkers hold tremendous promise for precision medicine clinical applications. Development of such biomarkers relies heavily on image post-processing tools for automated image quantitation. Their deployment in the context of clinical research necessitates interoperability with the clinical systems. Comparison with the established outcomes and evaluation tasks motivate integration of the clinical and imaging data, and the use of standardized approaches to support annotation and sharing of the analysis results and semantics. We developed the methodology and tools to support these tasks in Positron Emission Tomography and Computed Tomography (PET/CT) quantitative imaging (QI) biomarker development applied to head and neck cancer (HNC) treatment response assessment, using the Digital Imaging and Communications in Medicine (DICOM(®)) international standard and free open-source software. Methods. Quantitative analysis of PET/CT imaging data collected on patients undergoing treatment for HNC was conducted. Processing steps included Standardized Uptake Value (SUV) normalization of the images, segmentation of the tumor using manual and semi-automatic approaches, automatic segmentation of the reference regions, and extraction of the volumetric segmentation-based measurements. Suitable components of the DICOM standard were identified to model the various types of data produced by the analysis. A developer toolkit of conversion routines and an Application Programming Interface (API) were contributed and applied to create a standards-based representation of the data. Results. DICOM Real World Value Mapping, Segmentation and Structured Reporting objects were utilized for standards-compliant representation of the PET/CT QI analysis results and relevant clinical data. A number of correction proposals to the standard were developed. The open-source DICOM toolkit (DCMTK) was improved to simplify the task of DICOM encoding by introducing new API abstractions. Conversion and visualization tools utilizing this toolkit were developed. The encoded objects were validated for consistency and interoperability. The resulting dataset was deposited in the QIN-HEADNECK collection of The Cancer Imaging Archive (TCIA). Supporting tools for data analysis and DICOM conversion were made available as free open-source software. Discussion. We presented a detailed investigation of the development and application of the DICOM model, as well as the supporting open-source tools and toolkits, to accommodate representation of the research data in QI biomarker development. We demonstrated that the DICOM standard can be used to represent the types of data relevant in HNC QI biomarker development, and encode their complex relationships. The resulting annotated objects are amenable to data mining applications, and are interoperable with a variety of systems that support the DICOM standard.
This tutorial demonstrates how to prepare data for 3D printing using the open source software 3D Slicer. The following topics are highlighted in the tutorial: introduction to the 3D Slicer interface, loading data into 3D Slicer, volume rendering, cropping image volumes, creating label maps, creating surface models, and saving data in file formats appropriate for 3D printing.
Traditional models of the human language circuitry encompass three cortical areas, Broca's, Geschwind's and Wernicke's, and their connectivity through white matter fascicles. The neural connectivity deep to these cortical areas remains poorly understood, as does the macroscopic functional organization of the cortico-subcortical language circuitry. In an effort to expand current knowledge, we combined functional MRI (fMRI) and diffusion tensor imaging to explore subject-specific structural and functional macroscopic connectivity, focusing on Broca's area. Fascicles were studied using diffusion tensor imaging fiber tracking seeded from volumes placed manually within the white matter. White matter fascicles and fMRI-derived clusters (antonym-generation task) of positive and negative blood-oxygen-level-dependent (BOLD) signal were co-registered with 3-D renderings of the brain in 12 healthy subjects. Fascicles connecting BOLD-derived clusters were analyzed within specific cortical areas: Broca's, with the pars triangularis, the pars opercularis, and the pars orbitaris; Geschwind's and Wernicke's; the premotor cortex, the dorsal supplementary motor area, the middle temporal gyrus, the dorsal prefrontal cortex and the frontopolar region. We found a functional connectome divisible into three systems-anterior, superior and inferior-around the insula, more complex than previously thought, particularly with respect to a new extended Broca's area. The extended Broca's area involves two new fascicles: the operculo-premotor fascicle comprised of well-organized U-shaped fibers that connect the pars opercularis with the premotor region; and (2) the triangulo-orbitaris system comprised of intermingled U-shaped fibers that connect the pars triangularis with the pars orbitaris. The findings enhance our understanding of language function.
Volumetric change in glioblastoma multiforme (GBM) over time is a critical factor in treatment decisions. Typically, the tumor volume is computed on a slice-by-slice basis using MRI scans obtained at regular intervals. (3D)Slicer - a free platform for biomedical research - provides an alternative to this manual slice-by-slice segmentation process, which is significantly faster and requires less user interaction. In this study, 4 physicians segmented GBMs in 10 patients, once using the competitive region-growing based GrowCut segmentation module of Slicer, and once purely by drawing boundaries completely manually on a slice-by-slice basis. Furthermore, we provide a variability analysis for three physicians for 12 GBMs. The time required for GrowCut segmentation was on an average 61% of the time required for a pure manual segmentation. A comparison of Slicer-based segmentation with manual slice-by-slice segmentation resulted in a Dice Similarity Coefficient of 88.43 ± 5.23% and a Hausdorff Distance of 2.32 ± 5.23 mm.
MMVR has provided the leading forum for the multidisciplinary interaction and development of the use of Virtual Reality (VR) techniques in medicine, particularly in surgical practice. Here we look back at the foundations of our field, focusing on the use of VR in Surgery and similar interventional procedures, sum up the current status, and describe the challenges and opportunities going forward.
PURPOSE: Diffusion encoding with asymmetric gradient waveforms is appealing because the asymmetry provides superior efficiency. However, concomitant gradients may cause a residual gradient moment at the end of the waveform, which can cause significant signal error and image artifacts. The purpose of this study was to develop an asymmetric waveform designs for tensor-valued diffusion encoding that is not sensitive to concomitant gradients. METHODS: The "Maxwell index" was proposed as a scalar invariant to capture the effect of concomitant gradients. Optimization of "Maxwell-compensated" waveforms was performed in which this index was constrained. Resulting waveforms were compared to waveforms from literature, in terms of the measured and predicted impact of concomitant gradients, by numerical analysis as well as experiments in a phantom and in a healthy human brain. RESULTS: Maxwell-compensated waveforms with Maxwell indices below 100 (mT/m) ms showed negligible signal bias in both numerical analysis and experiments. By contrast, several waveforms from literature showed gross signal bias under the same conditions, leading to a signal bias that was large enough to markedly affect parameter maps. Experimental results were accurately predicted by theory. CONCLUSION: Constraining the Maxwell index in the optimization of asymmetric gradient waveforms yields efficient diffusion encoding that negates the effects of concomitant fields while enabling arbitrary shapes of the b-tensor. This waveform design is especially useful in combination with strong gradients, long encoding times, thick slices, simultaneous multi-slice acquisition, and large FOVs.
Computational biomechanics of the brain for neurosurgery is an emerging area of research recently gaining in importance and practical applications. This review paper presents the contributions of the Intelligent Systems for Medicine Laboratory and its collaborators to this field, discussing the modeling approaches adopted and the methods developed for obtaining the numerical solutions. We adopt a physics-based modeling approach and describe the brain deformation in mechanical terms (such as displacements, strains, and stresses), which can be computed using a biomechanical model, by solving a continuum mechanics problem. We present our modeling approaches related to geometry creation, boundary conditions, loading, and material properties. From the point of view of solution methods, we advocate the use of fully nonlinear modeling approaches, capable of capturing very large deformations and nonlinear material behavior. We discuss finite element and meshless domain discretization, the use of the total Lagrangian formulation of continuum mechanics, and explicit time integration for solving both time-accurate and steady-state problems. We present the methods developed for handling contacts and for warping 3D medical images using the results of our simulations. We present two examples to showcase these methods: brain shift estimation for image registration and brain deformation computation for neuronavigation in epilepsy treatment.
Jean-Jacques Lemaire, Antonio De Salles, Guillaume Coll, Youssef El Ouadih, Rémi Chaix, Jérôme Coste, Franck Durif, Nikos Makris, and Ron Kikinis. 8/2019. “MRI Atlas of the Human Deep Brain.” Front Neurol, 10, Pp. 851.Abstract
Mastering detailed anatomy of the human deep brain in clinical neurosciences is challenging. Although numerous pioneering works have gathered a large dataset of structural and topographic information, it is still difficult to transfer this knowledge into practice, even with advanced magnetic resonance imaging techniques. Thus, classical histological atlases continue to be used to identify structures for stereotactic targeting in functional neurosurgery. Physicians mainly use these atlases as a template co-registered with the patient's brain. However, it is possible to directly identify stereotactic targets on MRI scans, enabling personalized targeting. In order to help clinicians directly identify deep brain structures relevant to present and future medical applications, we built a volumetric MRI atlas of the deep brain (MDBA) on a large scale (infra millimetric). Twelve hypothalamic, 39 subthalamic, 36 telencephalic, and 32 thalamic structures were identified, contoured, and labeled. Nineteen coronal, 18 axial, and 15 sagittal MRI plates were created. Although primarily designed for direct labeling, the anatomic space was also subdivided in twelfths of AC-PC distance, leading to proportional scaling in the coronal, axial, and sagittal planes. This extensive work is now available to clinicians and neuroscientists, offering another representation of the human deep brain ([https://hal.archives-ouvertes.fr/] [hal-02116633]). The atlas may also be used by computer scientists who are interested in deciphering the topography of this complex region.
Intraoperative tissue deformation, known as brain shift, decreases the benefit of using preoperative images to guide neurosurgery. Non-rigid registration of preoperative magnetic resonance (MR) to intraoperative ultrasound (US) has been proposed as a means to compensate for brain shift. We focus on the initial registration from MR to predurotomy US. We present a method that builds on previous work to address the need for accuracy and generality of MR-iUS registration algorithms in multi-site clinical data. To improve accuracy of registration, we use high-dimensional texture attributes instead of image intensities and propose to replace the standard difference-based attribute matching with correlation-based attribute matching. We also present a strategy that deals explicitly with the large field-of-view mismatch between MR and iUS images. We optimize key parameters across independent MR-iUS brain tumor datasets acquired at three different institutions, with a total of 43 tumor patients and 758 corresponding landmarks to validate the registration algorithm. Despite differences in imaging protocols, patient demographics and landmark distributions, our algorithm was able to reduce landmark errors prior to registration in three data sets (5.37 ± 4.27, 4.18 ± 1.97 and 6.18 ± 3.38 mm, respectively) to a consistently low level (2.28 ± 0.71, 2.08 ± 0.37 and 2.24 ± 0.78 mm, respectively). Our algorithm is compared to 15 other algorithms that have been previously tested on MR-iUS registration and it is competitive with the state-of-the-art on multiple datasets. We show that our algorithm has one of the lowest errors in all datasets (accuracy), and this is achieved while sticking to a fixed set of parameters for multi-site data (generality). In contrast, other algorithms/tools of similar performance need per-dataset parameter tuning (high accuracy but lower generality), and those that stick to fixed parameters have larger errors or inconsistent performance (generality but not the top accuracy). We further characterized landmark errors according to brain regions and tumor types, a topic so far missing in the literature. We found that landmark errors were higher in high-grade than low-grade glioma patients, and higher in tumor regions than in other brain regions.
PURPOSE: In image-guided surgery for glioma removal, neurosurgeons usually plan the resection on images acquired before surgery and use them for guidance during the subsequent intervention. However, after the surgical procedure has begun, the preplanning images become unreliable due to the brain shift phenomenon, caused by modifications of anatomical structures and imprecisions in the neuronavigation system. To obtain an updated view of the resection cavity, a solution is to collect intraoperative data, which can be additionally acquired at different stages of the procedure in order to provide a better understanding of the resection. A spatial mapping between structures identified in subsequent acquisitions would be beneficial. We propose here a fully automated segmentation-based registration method to register ultrasound (US) volumes acquired at multiple stages of neurosurgery. METHODS: We chose to segment sulci and falx cerebri in US volumes, which remain visible during resection. To automatically segment these elements, first we trained a convolutional neural network on manually annotated structures in volumes acquired before the opening of the dura mater and then we applied it to segment corresponding structures in different surgical phases. Finally, the obtained masks are used to register US volumes acquired at multiple resection stages. RESULTS: Our method reduces the mean target registration error (mTRE) between volumes acquired before the opening of the dura mater and during resection from 3.49 mm (± 1.55 mm) to 1.36 mm (± 0.61 mm). Moreover, the mTRE between volumes acquired before opening the dura mater and at the end of the resection is reduced from 3.54 mm (± 1.75 mm) to 2.05 mm (± 1.12 mm). CONCLUSION: The segmented structures demonstrated to be good candidates to register US volumes acquired at different neurosurgical phases. Therefore, our solution can compensate brain shift in neurosurgical procedures involving intraoperative US data.