Spatio-Temporal Modeling Core Publications

Luca Canalini, Jan Klein, Dorothea Miller, and Ron Kikinis. 10/2020. “Enhanced Registration of Ultrasound Volumes by Segmentation of Resection Cavity in Neurosurgical Procedures.” Int J Comput Assist Radiol Surg.Abstract
PURPOSE: Neurosurgeons can have a better understanding of surgical procedures by comparing ultrasound images obtained at different phases of the tumor resection. However, establishing a direct mapping between subsequent acquisitions is challenging due to the anatomical changes happening during surgery. We propose here a method to improve the registration of ultrasound volumes, by excluding the resection cavity from the registration process. METHODS: The first step of our approach includes the automatic segmentation of the resection cavities in ultrasound volumes, acquired during and after resection. We used a convolution neural network inspired by the 3D U-Net. Then, subsequent ultrasound volumes are registered by excluding the contribution of resection cavity. RESULTS: Regarding the segmentation of the resection cavity, the proposed method achieved a mean DICE index of 0.84 on 27 volumes. Concerning the registration of the subsequent ultrasound acquisitions, we reduced the mTRE of the volumes acquired before and during resection from 3.49 to 1.22 mm. For the set of volumes acquired before and after removal, the mTRE improved from 3.55 to 1.21 mm. CONCLUSIONS: We proposed an innovative registration algorithm to compensate the brain shift affecting ultrasound volumes obtained at subsequent phases of neurosurgical procedures. To the best of our knowledge, our method is the first to exclude automatically segmented resection cavities in the registration of ultrasound volumes in neurosurgery.
Christian Wachinger, Matthew Toews, Georg Langs, William Wells, and Polina Golland. 2/2020. “Keypoint Transfer for Fast Whole-Body Segmentation.” IEEE Trans Med Imaging, 39, 2, Pp. 273-82.Abstract
We introduce an approach for image segmentation based on sparse correspondences between keypoints in testing and training images. Keypoints represent automatically identified distinctive image locations, where each keypoint correspondence suggests a transformation between images. We use these correspondences to transfer label maps of entire organs from the training images to the test image. The keypoint transfer algorithm includes three steps: (i) keypoint matching, (ii) voting-based keypoint labeling, and (iii) keypoint-based probabilistic transfer of organ segmentations. We report segmentation results for abdominal organs in whole-body CT and MRI, as well as in contrast-enhanced CT and MRI. Our method offers a speed-up of about three orders of magnitude in comparison to common multi-atlas segmentation, while achieving an accuracy that compares favorably. Moreover, keypoint transfer does not require the registration to an atlas or a training phase. Finally, the method allows for the segmentation of scans with highly variable field-of-view.
Laurent Chauvin, Kuldeep Kumar, Christian Wachinger, Marc Vangel, Jacques de Guise, Christian Desrosiers, William Wells, and Matthew Toews. 1/2020. “Neuroimage Signature from Salient Keypoints is Highly Specific to Individuals and Shared by Close Relatives.” Neuroimage, 204, Pp. 116208.Abstract
Neuroimaging studies typically adopt a common feature space for all data, which may obscure aspects of neuroanatomy only observable in subsets of a population, e.g. cortical folding patterns unique to individuals or shared by close relatives. Here, we propose to model individual variability using a distinctive keypoint signature: a set of unique, localized patterns, detected automatically in each image by a generic saliency operator. The similarity of an image pair is then quantified by the proportion of keypoints they share using a novel Jaccard-like measure of set overlap. Experiments demonstrate the keypoint method to be highly efficient and accurate, using a set of 7536 T1-weighted MRIs pooled from four public neuroimaging repositories, including twins, non-twin siblings, and 3334 unique subjects. All same-subject image pairs are identified by a similarity threshold despite confounds including aging and neurodegenerative disease progression. Outliers reveal previously unknown data labeling inconsistencies, demonstrating the usefulness of the keypoint signature as a computational tool for curating large neuroimage datasets.
Jian Wang, William M Wells, Polina Golland, and Miaomiao Zhang. 12/2019. “Registration Uncertainty Quantification via Low-dimensional Characterization of Geometric Deformations.” Magn Reson Imaging, 64, Pp. 122-31.Abstract
This paper presents an efficient approach to quantifying image registration uncertainty based on a low-dimensional representation of geometric deformations. In contrast to previous methods, we develop a Bayesian diffeomorphic registration framework in a bandlimited space, rather than a high-dimensional image space. We show that a dense posterior distribution on deformation fields can be fully characterized by much fewer parameters, which dramatically reduces the computational complexity of model inferences. To further avoid heavy computation loads introduced by random sampling algorithms, we approximate a marginal posterior by using Laplace's method at the optimal solution of log-posterior distribution. Experimental results on both 2D synthetic data and real 3D brain magnetic resonance imaging (MRI) scans demonstrate that our method is significantly faster than the state-of-the-art diffeomorphic registration uncertainty quantification algorithms, while producing comparable results.
Jie Luo, Alireza Sedghi, Karteek Popuri, Dana Cobzas, Miaomiao Zhang, Frank Preiswerk, Matthew Toews, Alexandra Golby, Masashi Sugiyama, William III M Wells, and Sarah Frisken. 10/2019. “On the Applicability of Registration Uncertainty.” In MICCAI 2019, LNCS 11765: Pp. 410-9. Shenzhen, China: Springer.Abstract
Estimating the uncertainty in (probabilistic) image registration enables, e.g., surgeons to assess the operative risk based on the trustworthiness of the registered image data. If surgeons receive inaccurately calculated registration uncertainty and misplace unwarranted confidence in the alignment solutions, severe consequences may result. For probabilistic image registration (PIR), the predominant way to quantify the registration uncertainty is using summary statistics of the distribution of transformation parameters. The majority of existing research focuses on trying out different summary statistics as well as means to exploit them. Distinctively, in this paper, we study two rarely examined topics: (1) whether those summary statistics of the transformation distribution most informatively represent the registration uncertainty; (2) Does utilizing the registration uncertainty always be beneficial. We show that there are two types of uncertainties: the transformation uncertainty, Ut, and label uncertainty Ul. The conventional way of using Ut to quantify Ul is inappropriate and can be misleading. By a real data experiment, we also share a potentially critical finding that making use of the registration uncertainty may not always be an improvement.
Luo MICCAI 2019
B Kocev, Horst K Hahn, L Linsend, William III M Wells, and Ron Kikinis. 3/2019. “Uncertainty-aware Asynchronous Scattered Motion Interpolation using Gaussian Process Regression.” Computerized Medical Imaging and Graphics, 72, Pp. 1-12.Abstract
We address the problem of interpolating randomly non-uniformly spatiotemporally scattered uncertain motion measurements, which arises in the context of soft tissue motion estimation. Soft tissue motion estimation is of great interest in the field of image-guided soft-tissue intervention and surgery navigation, because it enables the registration of pre-interventional/pre-operative navigation information on deformable soft-tissue organs. To formally define the measurements as spatiotemporally scattered motion signal samples, we propose a novel motion field representation. To perform the interpolation of the motion measurements in an uncertainty-aware optimal unbiased fashion, we devise a novel Gaussian process (GP) regression model with a non-constant-mean prior and an anisotropic covariance function and show through an extensive evaluation that it outperforms the state-of-the-art GP models that have been deployed previously for similar tasks. The employment of GP regression enables the quantification of uncertainty in the interpolation result, which would allow the amount of uncertainty present in the registered navigation information governing the decisions of the surgeon or intervention specialist to be conveyed.
Jie Luo, Sarah Frisken, Ines Machado, Miaomiao Zhang, Steve Pieper, Polina Golland, Matthew Toews, Prashin Unadkat, Alireza Sedghi, Haoyin Zhou, Alireza Mehrtash, Frank Preiswerk, Cheng-Chieh Cheng, Alexandra Golby, Masashi Sugiyama, and William M Wells. 12/2018. “Using the Variogram for Vector Outlier Screening: Application to Feature-based Image Registration.” Int J Comput Assist Radiol Surg, 13, 12, Pp. 1871-80.Abstract
PURPOSE: Matching points that are derived from features or landmarks in image data is a key step in some medical imaging applications. Since most robust point matching algorithms claim to be able to deal with outliers, users may place high confidence in the matching result and use it without further examination. However, for tasks such as feature-based registration in image-guided neurosurgery, even a few mismatches, in the form of invalid displacement vectors, could cause serious consequences. As a result, having an effective tool by which operators can manually screen all matches for outliers could substantially benefit the outcome of those applications. METHODS: We introduce a novel variogram-based outlier screening method for vectors. The variogram is a powerful geostatistical tool for characterizing the spatial dependence of stochastic processes. Since the spatial correlation of invalid displacement vectors, which are considered as vector outliers, tends to behave differently than normal displacement vectors, they can be efficiently identified on the variogram. RESULTS: We validate the proposed method on 9 sets of clinically acquired ultrasound data. In the experiment, potential outliers are flagged on the variogram by one operator and further evaluated by 8 experienced medical imaging researchers. The matching quality of those potential outliers is approximately 1.5 lower, on a scale from 1 (bad) to 5 (good), than valid displacement vectors. CONCLUSION: The variogram is a simple yet informative tool. While being used extensively in geostatistical analysis, it has not received enough attention in the medical imaging field. We believe there is a good deal of potential for clinically applying the proposed outlier screening method. By way of this paper, we also expect researchers to find variogram useful in other medical applications that involve motion vectors analyses.
Inês Machado, Matthew Toews, Jie Luo, Prashin Unadkat, Walid Essayed, Elizabeth George, Pedro Teodoro, Herculano Carvalho, Jorge Martins, Polina Golland, Steve Pieper, Sarah Frisken, Alexandra Golby, and William Wells. 10/2018. “Non-rigid Registration of 3D Ultrasound for Neurosurgery using Automatic Feature Detection and Matching.” Int J Comput Assist Radiol Surg, 13, 10, Pp. 1525-38.Abstract
PURPOSE: The brain undergoes significant structural change over the course of neurosurgery, including highly nonlinear deformation and resection. It can be informative to recover the spatial mapping between structures identified in preoperative surgical planning and the intraoperative state of the brain. We present a novel feature-based method for achieving robust, fully automatic deformable registration of intraoperative neurosurgical ultrasound images. METHODS: A sparse set of local image feature correspondences is first estimated between ultrasound image pairs, after which rigid, affine and thin-plate spline models are used to estimate dense mappings throughout the image. Correspondences are derived from 3D features, distinctive generic image patterns that are automatically extracted from 3D ultrasound images and characterized in terms of their geometry (i.e., location, scale, and orientation) and a descriptor of local image appearance. Feature correspondences between ultrasound images are achieved based on a nearest-neighbor descriptor matching and probabilistic voting model similar to the Hough transform. RESULTS: Experiments demonstrate our method on intraoperative ultrasound images acquired before and after opening of the dura mater, during resection and after resection in nine clinical cases. A total of 1620 automatically extracted 3D feature correspondences were manually validated by eleven experts and used to guide the registration. Then, using manually labeled corresponding landmarks in the pre- and post-resection ultrasound images, we show that our feature-based registration reduces the mean target registration error from an initial value of 3.3 to 1.5 mm. CONCLUSIONS: This result demonstrates that the 3D features promise to offer a robust and accurate solution for 3D ultrasound registration and to correct for brain shift in image-guided neurosurgery.
Jie Luo, Matthew Toews, Inês Machado, Sarah Frisken, Miaomiao Zhang, Frank Preiswerk, Alireza Sedghi, Hongyi Ding, Steve Pieper, Polina Golland, Alexandra Golby, Masashi Sugiyama, and William III M Wells. 9/2018. “A Feature-Driven Active Framework for Ultrasound-Based Brain Shift Compensation.” In MICCAI 2018, LNCS 11073: Pp. 30-38. Granada, Spain: Springer.Abstract
A reliable Ultrasound (US)-to-US registration method to compensate for brain shift would substantially improve Image-Guided Neurological Surgery. Developing such a registration method is very challenging, due to factors such as the tumor resection, the complexity of brain pathology and the demand for fast computation. We propose a novel feature-driven active registration framework. Here, landmarks and their displacement are first estimated from a pair of US images using corresponding local image features. Subsequently, a Gaussian Process (GP) model is used to interpolate a dense deformation field from the sparse landmarks. Kernels of the GP are estimated by using variograms and a discrete grid search method. If necessary, the user can actively add new landmarks based on the image context and visualization of the uncertainty measure provided by the GP to further improve the result. We retrospectively demonstrate our registration framework as a robust and accurate brain shift compensation solution on clinical data.
Luo MICCAI 2018
Guillermo Gallardo, William M Wells III, Rachid Deriche, and Demian Wassermann. 4/2018. “Groupwise Structural Parcellation of the Whole Cortex: A Logistic Random Effects Model Based Approach.” Neuroimage, 170, Pp. 307-20.Abstract

Current theories hold that brain function is highly related to long-range physical connections through axonal bundles, namely extrinsic connectivity. However, obtaining a groupwise cortical parcellation based on extrinsic connectivity remains challenging. Current parcellation methods are computationally expensive; need tuning of several parameters or rely on ad-hoc constraints. Furthermore, none of these methods present a model for the cortical extrinsic connectivity of the cortex. To tackle these problems, we propose a parsimonious model for the extrinsic connectivity and an efficient parceling technique based on clustering of tractograms. Our technique allows the creation of single subject and groupwise parcellations of the whole cortex. The parcellations obtained with our technique are in agreement with structural and functional parcellations in the literature. In particular, the motor and sensory cortex are subdivided in agreement with the human homunculus of Penfield. We illustrate this by comparing our resulting parcels with the motor strip mapping included in the Human Connectome Project data.

Matthew Toews and William M Wells. 1/2018. “Phantomless Auto-Calibration and Online Calibration Assessment for a Tracked Freehand 2-D Ultrasound Probe.” IEEE Trans Med Imaging, 37, 1, Pp. 262-72.Abstract
This paper presents a method for automatically calibrating and assessing the calibration quality of an externally tracked 2-D ultrasound (US) probe by scanning arbitrary, natural tissues, as opposed a specialized calibration phantom as is the typical practice. A generative topic model quantifies the posterior probability of calibration parameters conditioned on local 2-D image features arising from a generic underlying substrate. Auto-calibration is achieved by identifying the maximum a-posteriori image-to-probe transform, and calibration quality is assessed online in terms of the posterior probability of the current image-to-probe transform. Both are closely linked to the 3-D point reconstruction error (PRE) in aligning feature observations arising from the same underlying physical structure in different US images. The method is of practical importance in that it operates simply by scanning arbitrary textured echogenic structures, e.g., in-vivo tissues in the context of the US-guided procedures, without requiring specialized calibration procedures or equipment. Observed data take the form of local scale-invariant features that can be extracted and fit to the model in near real-time. Experiments demonstrate the method on a public data set of in vivo human brain scans of 14 unique subjects acquired in the context of neurosurgery. Online calibration assessment can be performed at approximately 3 Hz for the US images of pixels. Auto-calibration achieves an internal mean PRE of 1.2 mm and a discrepancy of [2 mm, 6 mm] in comparison to the calibration via a standard phantom-based method.
Anna Custo, Dimitri Van De Ville, William M Wells, Miralena I Tomescu, Denis Brunet, and Christoph M Michel. 12/2017. “Electroencephalographic Resting-State Networks: Source Localization of Microstates.” Brain Connect, 7, 10, Pp. 671-82.Abstract
Using electroencephalography (EEG) to elucidate the spontaneous activation of brain resting-state networks (RSNs) is nontrivial as the signal of interest is of low amplitude and it is difficult to distinguish the underlying neural sources. Using the principles of electric field topographical analysis, it is possible to estimate the meta-stable states of the brain (i.e., the resting-state topographies, so-called microstates). We estimated seven resting-state topographies explaining the EEG data set with k-means clustering (N = 164, 256 electrodes). Using a method specifically designed to localize the sources of broadband EEG scalp topographies by matching sensor and source space temporal patterns, we demonstrated that we can estimate the EEG RSNs reliably by measuring the reproducibility of our findings. After subtracting their mean from the seven EEG RSNs, we identified seven state-specific networks. The mean map includes regions known to be densely anatomically and functionally connected (superior frontal, superior parietal, insula, and anterior cingulate cortices). While the mean map can be interpreted as a "router," crosslinking multiple functional networks, the seven state-specific RSNs partly resemble and extend previous functional magnetic resonance imaging-based networks estimated as the hemodynamic correlates of four canonical EEG microstates.
Miaomiao Zhang, William M Wells, and Polina Golland. 10/2017. “Probabilistic Modeling of Anatomical Variability using a Low Dimensional Parameterization of Diffeomorphisms.” Med Image Anal, 41, Pp. 55-62.Abstract
We present an efficient probabilistic model of anatomical variability in a linear space of initial velocities of diffeomorphic transformations and demonstrate its benefits in clinical studies of brain anatomy. To overcome the computational challenges of the high dimensional deformation-based descriptors, we develop a latent variable model for principal geodesic analysis (PGA) based on a low dimensional shape descriptor that effectively captures the intrinsic variability in a population. We define a novel shape prior that explicitly represents principal modes as a multivariate complex Gaussian distribution on the initial velocities in a bandlimited space. We demonstrate the performance of our model on a set of 3D brain MRI scans from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. Our model yields a more compact representation of group variation at substantially lower computational cost than the state-of-the-art method such as tangent space PCA (TPCA) and probabilistic principal geodesic analysis (PPGA) that operate in the high dimensional image space.
Marc Niethammer, Kilian M Pohl, Firdaus Janoos, and William M Wells. 9/2017. “Active Mean Fields for Probabilistic Image Segmentation: Connections with Chan-Vese and Rudin-Osher-Fatemi Models.” SIAM J. Imaging Sci., 10, 3, Pp. 1069-1103.Abstract
Segmentation is a fundamental task for extracting semantically meaningful regions from an image. The goal of segmentation algorithms is to accurately assign object labels to each image location. However, image noise, shortcomings of algorithms, and image ambiguities cause uncertainty in label assignment. Estimating this uncertainty is important in multiple application domains, such as segmenting tumors from medical images for radiation treatment planning. One way to estimate these uncertainties is through the computation of posteriors of Bayesian models, which is computationally prohibitive for many practical applications. However, most computationally efficient methods fail to estimate label uncertainty. We therefore propose in this paper the active mean fields (AMF) approach, a technique based on Bayesian modeling that uses a mean-field approximation to efficiently compute a segmentation and its corresponding uncertainty. Based on a variational formulation, the resulting convex model combines any label-likelihood measure with a prior on the length of the segmentation boundary. A specific implementation of that model is the Chan-Vese segmentation model, in which the binary segmentation task is defined by a Gaussian likelihood and a prior regularizing the length of the segmentation boundary. Furthermore, the Euler-Lagrange equations derived from the AMF model are equivalent to those of the popular Rudin-Osher-Fatemi (ROF) model for image denoising. Solutions to the AMF model can thus be implemented by directly utilizing highly efficient ROF solvers on log-likelihood ratio fields. We qualitatively assess the approach on synthetic data as well as on real natural and medical images. For a quantitative evaluation, we apply our approach to the tt icgbench dataset.
Jenna Schabdach, William M Wells, Michael Cho, and Kayhan N Batmanghelich. 6/2017. “A Likelihood-Free Approach for Characterizing Heterogeneous Diseases in Large-Scale Studies.” Inf Process Med Imaging, 10265, Pp. 170-183.Abstract
We propose a non-parametric approach for characterizing heterogeneous diseases in large-scale studies. We target diseases where multiple types of pathology present simultaneously in each subject and a more severe disease manifests as a higher level of tissue destruction. For each subject, we model theof local image descriptors as samples generated by an unknown subject-specific probability density. Instead of approximating the probability density via a parametric family, we propose to side step the parametric inference by directly estimating the divergence between subject densities. Our method maps the collection of local image descriptors to a signaturethat is used to predict a clinical measurement. We are able to interpret the prediction of the clinical variable in the population and individual levels by carefully studying the divergences. We illustrate an application this method on simulated data as well as on a large-scale lung CT study of Chronic Obstructive Pulmonary Disease (COPD). Our approach outperforms classical methods on both simulated and COPD data and demonstrates the state-of-the-art prediction on an important physiologic measure of airflow (the forced respiratory volume in one second, FEV1).
Lauren J O'Donnell, Yannick Suter, Laura Rigolo, Pegah Kahali, Fan Zhang, Isaiah Norton, Angela Albi, Olutayo Olubiyi, Antonio Meola, Walid I Essayed, Prashin Unadkat, Pelin Aksit Ciris, William M Wells III, Yogesh Rathi, Carl-Fredrik Westin, and Alexandra J Golby. 11/2016. “Automated White Matter Fiber Tract Identification in Patients with Brain Tumors.” Neuroimage Clin, 13, Pp. 138-53.Abstract

We propose a method for the automated identification of key white matter fiber tracts for neurosurgical planning, and we apply the method in a retrospective study of 18 consecutive neurosurgical patients with brain tumors. Our method is designed to be relatively robust to challenges in neurosurgical tractography, which include peritumoral edema, displacement, and mass effect caused by mass lesions. The proposed method has two parts. First, we learn a data-driven white matter parcellation or fiber cluster atlas using groupwise registration and spectral clustering of multi-fiber tractography from healthy controls. Key fiber tract clusters are identified in the atlas. Next, patient-specific fiber tracts are automatically identified using tractography-based registration to the atlas and spectral embedding of patient tractography. Results indicate good generalization of the data-driven atlas to patients: 80% of the 800 fiber clusters were identified in all 18 patients, and 94% of the 800 fiber clusters were found in 16 or more of the 18 patients. Automated subject-specific tract identification was evaluated by quantitative comparison to subject-specific motor and language functional MRI, focusing on the arcuate fasciculus (language) and corticospinal tracts (motor), which were identified in all patients. Results indicate good colocalization: 89 of 95, or 94%, of patient-specific language and motor activations were intersected by the corresponding identified tract. All patient-specific activations were within 3mm of the corresponding language or motor tract. Overall, our results indicate the potential of an automated method for identifying fiber tracts of interest for neurosurgical planning, even in patients with mass lesions.

Miaomiao Zhang, William M Wells, and Polina Golland. 10/2016. “Low-Dimensional Statistics of Anatomical Variability via Compact Representation of Image Deformations.” Med Image Comput Comput Assist Interv, 9902, Pp. 166-73.Abstract
Using image-based descriptors to investigate clinical hypotheses and therapeutic implications is challenging due to the notorious "curse of dimensionality" coupled with a small sample size. In this paper, we present a low-dimensional analysis of anatomical shape variability in the space of diffeomorphisms and demonstrate its benefits for clinical studies. To combat the high dimensionality of the deformation descriptors, we develop a probabilistic model of principal geodesic analysis in a bandlimited low-dimensional space that still captures the underlying variability of image data. We demonstrate the performance of our model on a set of 3D brain MRI scans from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. Our model yields a more compact representation of group variation at substantially lower computational cost than models based on the high-dimensional state-of-the-art approaches such as tangent space PCA (TPCA) and probabilistic principal geodesic analysis (PPGA).
Padmavathi Sundaram, Aapo Nummenmaa, William M Wells III, Darren Orbach, Daniel Orringer, Robert Mulkern, and Yoshio Okada. 5/2016. “Direct Neural Current Imaging in an Intact Cerebellum with Magnetic Resonance Imaging.” Neuroimage, 132, Pp. 477-90.Abstract

The ability to detect neuronal currents with high spatiotemporal resolution using magnetic resonance imaging (MRI) is important for studying human brain function in both health and disease. While significant progress has been made, we still lack evidence showing that it is possible to measure an MR signal time-locked to neuronal currents with a temporal waveform matching concurrently recorded local field potentials (LFPs). Also lacking is evidence that such MR data can be used to image current distribution in active tissue. Since these two results are lacking even in vitro, we obtained these data in an intact isolated whole cerebellum of turtle during slow neuronal activity mediated by metabotropic glutamate receptors using a gradient-echo EPI sequence (TR=100ms) at 4.7T. Our results show that it is possible (1) to reliably detect an MR phase shift time course matching that of the concurrently measured LFP evoked by stimulation of a cerebellar peduncle, (2) to detect the signal in single voxels of 0.1mm3, (3) to determine the spatial phase map matching the magnetic field distribution predicted by the LFP map, (4) to estimate the distribution of neuronal current in the active tissue from a group-average phase map, and (5) to provide a quantitatively accurate theoretical account of the measured phase shifts. The peak values of the detected MR phase shifts were 0.27-0.37°, corresponding to local magnetic field changes of 0.67-0.93nT (for TE=26ms). Our work provides an empirical basis for future extensions to in vivo imaging of neuronal currents.

Matthew Toews and William M Wells III. 4/2016. “Invariant Feature-Based Analysis of Medical Images: An Overview.” In IEEE Int Symp Biomed Imaging.
Jørn Bersvendsen, Matthew Toews, Adriyana Danudibroto, William M Wells III, Stig Urheim, Raúl San José Estépar, and Eigil Samset. 2/2016. “Robust Spatio-Temporal Registration of 4D Cardiac Ultrasound Sequences.” Proc SPIE Int Soc Opt Eng, 9790.Abstract

Registration of multiple 3D ultrasound sectors in order to provide an extended field of view is important for the appreciation of larger anatomical structures at high spatial and temporal resolution. In this paper, we present a method for fully automatic spatio-temporal registration between two partially overlapping 3D ultrasound sequences. The temporal alignment is solved by aligning the normalized cross correlation-over-time curves of the sequences. For the spatial alignment, corresponding 3D Scale Invariant Feature Transform (SIFT) features are extracted from all frames of both sequences independently of the temporal alignment. A rigid transform is then calculated by least squares minimization in combination with random sample consensus. The method is applied to 16 echocardiographic sequences of the left and right ventricles and evaluated against manually annotated temporal events and spatial anatomical landmarks. The mean distances between manually identified landmarks in the left and right ventricles after automatic registration were (mean ± SD) 4.3 ± 1.2 mm compared to a reference error of 2.8 ± 0.6 mm with manual registration. For the temporal alignment, the absolute errors in valvular event times were 14.4 ± 11.6 ms for Aortic Valve (AV) opening, 18.6 ± 16.0 ms for AV closing, and 34.6 ± 26.4 ms for mitral valve opening, compared to a mean inter-frame time of 29 ms.