This work presents a deformable point set registration algorithm that seeks an optimal set of radial basis functions to describe the registration. A novel, global optimization approach is introduced composed of simulated annealing with a particle filter based generator function to perform the registration. It is shown how constraints can be incorporated into this framework. A constraint on the deformation is enforced whose role is to ensure physically meaningful fields (i.e., invertible). Further, examples in which landmark constraints serve to guide the registration are shown. Results on 2D and 3D data demonstrate the algorithm's robustness to noise and missing information.
RATIONALE AND OBJECTIVES: Anatomy is an essential component of medical education as it is critical for the accurate diagnosis in organs and human systems. The mental representation of the shape and organization of different anatomical structures is a crucial step in the learning process. The purpose of this pilot study is to demonstrate the feasibility and benefits of developing innovative teaching modules for anatomy education of first-year medical students based on three-dimensional (3D) reconstructions from actual patient data.
MATERIALS AND METHODS: A total of 196 models of anatomical structures from 16 anonymized computed tomography datasets were generated using the 3D Slicer open-source software platform. The models focused on three anatomical areas: the mediastinum, the upper abdomen, and the pelvis. Online optional quizzes were offered to first-year medical students to assess their comprehension in the areas of interest. Specific tasks were designed for students to complete using the 3D models.
RESULTS: Scores of the quizzes confirmed a lack of understanding of 3D spatial relationships of anatomical structures despite standard instruction including dissection. Written task material and qualitative review by students suggested that interaction with 3D models led to a better understanding of the shape and spatial relationships among structures, and helped illustrate anatomical variations from one body to another.
CONCLUSIONS: The study demonstrates the feasibility of one possible approach to the generation of 3D models of the anatomy from actual patient data. The educational materials developed have the potential to supplement the teaching of complex anatomical regions and help demonstrate the anatomical variation among patients.
The research on staging of pre-symptomatic and prodromal phase of neurological disorders, e.g., Alzheimer's disease (AD), is essential for prevention of dementia. New strategies for AD staging with a focus on early detection, are demanded to optimize potential efficacy of disease-modifying therapies that can halt or slow the disease progression. Recently, neuroimaging are increasingly used as additional research-based markers to detect AD onset and predict conversion of MCI and normal control (NC) to AD. Researchers have proposed a variety of neuroimaging biomarkers to characterize the patterns of the pathology of AD and MCI, and suggested that multi-view neuroimaging biomarkers could lead to better performance than single-view biomarkers in AD staging. However, it is still unclear what leads to such synergy and how to preserve or maximize. In an attempt to answer these questions, we proposed a cross-view pattern analysis framework for investigating the synergy between different neuroimaging biomarkers. We quantitatively analyzed nine types of biomarkers derived from FDG-PET and T1-MRI, and evaluated their performance in a task of classifying AD, MCI, and NC subjects obtained from the ADNI baseline cohort. The experiment results showed that these biomarkers could depict the pathology of AD from different perspectives, and output distinct patterns that are significantly associated with the disease progression. Most importantly, we found that these features could be separated into clusters, each depicting a particular aspect; and the inter-cluster features could always achieve better performance than the intra-cluster features in AD staging.
Disentangling the tissue microstructural information from the diffusion magnetic resonance imaging (dMRI) measurements is quite important for extracting brain tissue specific measures. The autocorrelation function of diffusing spins is key for understanding the relation between dMRI signals and the acquisition gradient sequences. In this paper, we demonstrate that the autocorrelation of diffusion in restricted or bounded spaces can be well approximated by exponential functions. To this end, we propose to use the multivariate Ornstein-Uhlenbeck (OU) process to model the matrix-valued exponential autocorrelation function of three-dimensional diffusion processes with bounded trajectories. We present detailed analysis on the relation between the model parameters and the time-dependent apparent axon radius and provide a general model for dMRI signals from the frequency domain perspective. For our experimental setup, we model the diffusion signal as a mixture of two compartments that correspond to diffusing spins with bounded and unbounded trajectories, and analyze the corpus-callosum in an ex-vivo data set of a monkey brain.
PURPOSE: Tractography is the most anatomically accurate method for delineating white matter tracts in the brain, yet few studies have examined multiple tracts using tractography in patients with schizophrenia (SCZ). We analyze 5 white matter connections important in the pathophysiology of SCZ: uncinate fasciculus, cingulum bundle (CB), inferior longitudinal fasciculus (ILF), superior longitudinal fasciculus, and arcuate fasciculus (AF). Additionally, we investigate the relationship between diffusion tensor imaging (DTI) markers and neuropsychological measures.
METHODS: High-resolution DTI data were acquired on a 3 Tesla scanner in 30 patients with early-course SCZ and 30 healthy controls (HC) from the Boston Center for Intervention Development and Applied Research study. After manually guided tracts delineation, fractional anisotropy (FA), trace, radial diffusivity (RD), and axial diffusivity (AD) were calculated and averaged along each tract. The association of DTI measures with the Scales for the Assessment of Negative and Positive Symptoms and neuropsychological measures was evaluated.
RESULTS: Compared to HC, patients exhibited reduced FA and increased trace and RD in the right AF, CB, and ILF. A discriminant analysis showed the possible use of FA of these tracts for better future group membership classifications. FA and RD of the right ILF and AF were associated with positive symptoms while FA and RD of the right CB were associated with memory performance and processing speed.
CONCLUSION: We observed white matter alterations in the right CB, ILF, and AF, possibly caused by myelin disruptions. The structural abnormalities interact with cognitive performance, and are linked to clinical symptoms.
Content-based medical image retrieval (CBMIR) is an active research area for disease diagnosis and treatment but it can be problematic given the small visual variations between anatomical structures. We propose a retrieval method based on a bag-of-visual-words (BoVW) to identify discriminative characteristics between different medical images with Pruned Dictionary based on Latent Semantic Topic description. We refer to this as the PD-LST retrieval. Our method has two main components. First, we calculate a topic-word significance value for each visual word given a certain latent topic to evaluate how the word is connected to this latent topic. The latent topics are learnt, based on the relationship between the images and words, and are employed to bridge the gap between low-level visual features and high-level semantics. These latent topics describe the images and words semantically and can thus facilitate more meaningful comparisons between the words. Second, we compute an overall-word significance value to evaluate the significance of a visual word within the entire dictionary. We designed an iterative ranking method to measure overall-word significance by considering the relationship between all latent topics and words. The words with higher values are considered meaningful with more significant discriminative power in differentiating medical images. We evaluated our method on two public medical imaging datasets and it showed improved retrieval accuracy and efficiency.
BACKGROUND: The nigrosome-1 region of the substantia nigra (SN) undergoes the greatest and earliest dopaminergic neuron loss in Parkinson's disease (PD). As T2-weighted magnetic resonance imaging (MRI) scans are often collected with routine clinical MRI protocols, this investigation aims to determine whether T2-imaging changes in the nigrosome-1 are related to clinical measures of PD and to assess their potential as a more clinically accessible biomarker for PD.
METHODS: Voxel intensity ratios were calculated for T2-weighted MRI scans from 47 subjects from the Parkinson's Progression Markers Initiative database. Three approaches were used to delineate the SN and nigrosome-1: (1) manual segmentation, (2) automated segmentation, and (3) area voxel-based morphometry. Voxel intensity ratios were calculated from voxel intensity values taken from the nigrosome-1 and two areas of the remaining SN. Linear regression analyses were conducted relating voxel intensity ratios with the Movement Disorder Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS) sub-scores for each subject.
RESULTS: For manual segmentation, linear regression tests consistently identified the voxel intensity ratio derived from the dorsolateral SN and nigrosome-1 (IR2) as predictive of nBehav (p = 0.0377) and nExp (p = 0.03856). For automated segmentation, linear regression tests identified IR2 as predictive of Subscore IA (nBehav) (p = 0.01134), Subscore IB (nExp) (p = 0.00336), Score II (mExp) (p = 0.02125), and Score III (mSign) (p = 0.008139). For the voxel-based morphometric approach, univariate simple linear regression analysis identified IR2 as yielding significant results for nBehav (p = 0.003102), mExp (p = 0.0172), and mSign (p = 0.00393).
CONCLUSION: Neuroimaging biomarkers may be used as a proxy of changes in the nigrosome-1, measured by MDS-UPDRS scores as an indicator of the severity of PD. The voxel intensity ratio derived from the dorsolateral SN and nigrosome-1 was consistently predictive of non-motor complex behaviors in all three analyses and predictive of non-motor experiences of daily living, motor experiences of daily living, and motor signs of PD in two of the three analyses. These results suggest that T2 changes in the nigrosome-1 may relate to certain clinical measures of PD. T2 changes in the nigrosome-1 may be considered when developing a more accessible clinical diagnostic tool for patients with suspected PD.
BACKGROUND: There is growing evidence to suggest that delusions associated with schizophrenia arise from altered structural brain connectivity. The present study investigated whether structural changes in three major fasciculi that interconnect the limbic system - the cingulum bundle, uncinate fasciculus and fornix - are associated with delusions in chronic schizophrenia patients. METHODS: Free-water corrected Diffusion Tensor Imaging was used to investigate the association between delusions and both microstructural changes within these three fasciculi and extracellular changes in the surrounding free-water. Clinical data and diffusion MRI scans were obtained from 28 healthy controls and 86 schizophrenia patients, of whom 34 had present state delusions, 35 had a lifetime history but currently remitted delusions, and 17 had never experienced delusions. RESULTS: While present state and remitted delusions were found to be associated with reduced free-water corrected fractional anisotropy (FAT) and increased free-water corrected radial diffusivity (RDT) in the cingulum bundle bilaterally, extracellular free-water (FW) in the left cingulum bundle was found to be specifically associated with present state delusions in chronic schizophrenia. No changes were observed in the remaining tracts. CONCLUSIONS: These findings suggest that state and trait delusions in chronic schizophrenia are associated with microstructural processes, such as myelin abnormalities (as indicated by decreased FAT and increased RDT) in the cingulum bundle and that state delusions are additionally associated with extracellular processes such as neuroinflammation or atrophy (as indicated by increased FW) in the left cingulum bundle.
We propose a method for the automated identification of key white matter fiber tracts for neurosurgical planning, and we apply the method in a retrospective study of 18 consecutive neurosurgical patients with brain tumors. Our method is designed to be relatively robust to challenges in neurosurgical tractography, which include peritumoral edema, displacement, and mass effect caused by mass lesions. The proposed method has two parts. First, we learn a data-driven white matter parcellation or fiber cluster atlas using groupwise registration and spectral clustering of multi-fiber tractography from healthy controls. Key fiber tract clusters are identified in the atlas. Next, patient-specific fiber tracts are automatically identified using tractography-based registration to the atlas and spectral embedding of patient tractography. Results indicate good generalization of the data-driven atlas to patients: 80% of the 800 fiber clusters were identified in all 18 patients, and 94% of the 800 fiber clusters were found in 16 or more of the 18 patients. Automated subject-specific tract identification was evaluated by quantitative comparison to subject-specific motor and language functional MRI, focusing on the arcuate fasciculus (language) and corticospinal tracts (motor), which were identified in all patients. Results indicate good colocalization: 89 of 95, or 94%, of patient-specific language and motor activations were intersected by the corresponding identified tract. All patient-specific activations were within 3mm of the corresponding language or motor tract. Overall, our results indicate the potential of an automated method for identifying fiber tracts of interest for neurosurgical planning, even in patients with mass lesions.
Matching the bolus arrival time (BAT) of the arterial input function (AIF) and tissue residue function (TRF) is necessary for accurate pharmacokinetic (PK) modeling of dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI). We investigated the sensitivity of volume transfer constant ([Formula: see text]) and extravascular extracellular volume fraction ([Formula: see text]) to BAT and compared the results of four automatic BAT measurement methods in characterization of prostate and breast cancers. Variation in delay between AIF and TRF resulted in a monotonous change trend of [Formula: see text] and [Formula: see text] values. The results of automatic BAT estimators for clinical data were all comparable except for one BAT estimation method. Our results indicate that inaccuracies in BAT measurement can lead to variability among DCE-MRI PK model parameters, diminish the quality of model fit, and produce fewer valid voxels in a region of interest. Although the selection of the BAT method did not affect the direction of change in the treatment assessment cohort, we suggest that BAT measurement methods must be used consistently in the course of longitudinal studies to control measurement variability.
PURPOSE: The aim of this study was to present a tractography algorithm using a two-tensor unscented Kalman filter (UKF) to improve the modeling of the corticospinal tract (CST) by tracking through regions of peritumoral edema and crossing fibers. METHODS: Ten patients with brain tumors in the vicinity of motor cortex and evidence of significant peritumoral edema were retrospectively selected for the study. All patients underwent 3-T magnetic resonance imaging (MRI) including functional MRI (fMRI) and a diffusion-weighted data set with 31 directions. Fiber tracking was performed using both single-tensor streamline and two-tensor UKF tractography methods. A two-region-of-interest approach was used to delineate the CST. Results from the two tractography methods were compared visually and quantitatively. fMRI was applied to identify the functional fiber tracts. RESULTS: Single-tensor streamline tractography underestimated the extent of tracts running through the edematous areas and could only track the medial projections of the CST. In contrast, two-tensor UKF tractography tracked fanning projections of the CST despite peritumoral edema and crossing fibers. Based on visual inspection, the two-tensor UKF tractography delineated tracts that were closer to motor fMRI activations, and it was apparently more sensitive than single-tensor streamline tractography to define the tracts directed to the motor sites. The volume of the CST was significantly larger on two-tensor UKF than on single-tensor streamline tractography ([Formula: see text]). CONCLUSION: Two-tensor UKF tractography tracks a larger volume CST than single-tensor streamline tractography in the setting of peritumoral edema and crossing fibers in brain tumor patients.
Background. Imaging biomarkers hold tremendous promise for precision medicine clinical applications. Development of such biomarkers relies heavily on image post-processing tools for automated image quantitation. Their deployment in the context of clinical research necessitates interoperability with the clinical systems. Comparison with the established outcomes and evaluation tasks motivate integration of the clinical and imaging data, and the use of standardized approaches to support annotation and sharing of the analysis results and semantics. We developed the methodology and tools to support these tasks in Positron Emission Tomography and Computed Tomography (PET/CT) quantitative imaging (QI) biomarker development applied to head and neck cancer (HNC) treatment response assessment, using the Digital Imaging and Communications in Medicine (DICOM(®)) international standard and free open-source software. Methods. Quantitative analysis of PET/CT imaging data collected on patients undergoing treatment for HNC was conducted. Processing steps included Standardized Uptake Value (SUV) normalization of the images, segmentation of the tumor using manual and semi-automatic approaches, automatic segmentation of the reference regions, and extraction of the volumetric segmentation-based measurements. Suitable components of the DICOM standard were identified to model the various types of data produced by the analysis. A developer toolkit of conversion routines and an Application Programming Interface (API) were contributed and applied to create a standards-based representation of the data. Results. DICOM Real World Value Mapping, Segmentation and Structured Reporting objects were utilized for standards-compliant representation of the PET/CT QI analysis results and relevant clinical data. A number of correction proposals to the standard were developed. The open-source DICOM toolkit (DCMTK) was improved to simplify the task of DICOM encoding by introducing new API abstractions. Conversion and visualization tools utilizing this toolkit were developed. The encoded objects were validated for consistency and interoperability. The resulting dataset was deposited in the QIN-HEADNECK collection of The Cancer Imaging Archive (TCIA). Supporting tools for data analysis and DICOM conversion were made available as free open-source software. Discussion. We presented a detailed investigation of the development and application of the DICOM model, as well as the supporting open-source tools and toolkits, to accommodate representation of the research data in QI biomarker development. We demonstrated that the DICOM standard can be used to represent the types of data relevant in HNC QI biomarker development, and encode their complex relationships. The resulting annotated objects are amenable to data mining applications, and are interoperable with a variety of systems that support the DICOM standard.
The ability to detect neuronal currents with high spatiotemporal resolution using magnetic resonance imaging (MRI) is important for studying human brain function in both health and disease. While significant progress has been made, we still lack evidence showing that it is possible to measure an MR signal time-locked to neuronal currents with a temporal waveform matching concurrently recorded local field potentials (LFPs). Also lacking is evidence that such MR data can be used to image current distribution in active tissue. Since these two results are lacking even in vitro, we obtained these data in an intact isolated whole cerebellum of turtle during slow neuronal activity mediated by metabotropic glutamate receptors using a gradient-echo EPI sequence (TR=100ms) at 4.7T. Our results show that it is possible (1) to reliably detect an MR phase shift time course matching that of the concurrently measured LFP evoked by stimulation of a cerebellar peduncle, (2) to detect the signal in single voxels of 0.1mm3, (3) to determine the spatial phase map matching the magnetic field distribution predicted by the LFP map, (4) to estimate the distribution of neuronal current in the active tissue from a group-average phase map, and (5) to provide a quantitatively accurate theoretical account of the measured phase shifts. The peak values of the detected MR phase shifts were 0.27-0.37°, corresponding to local magnetic field changes of 0.67-0.93nT (for TE=26ms). Our work provides an empirical basis for future extensions to in vivo imaging of neuronal currents.
We introduce a generative probabilistic model for segmentation of brain lesions in multi-dimensional images that generalizes the EM segmenter, a common approach for modelling brain images using Gaussian mixtures and a probabilistic tissue atlas that employs expectation-maximization (EM), to estimate the label map for a new image. Our model augments the probabilistic atlas of the healthy tissues with a latent atlas of the lesion. We derive an estimation algorithm with closed-form EM update equations. The method extracts a latent atlas prior distribution and the lesion posterior distributions jointly from the image data. It delineates lesion areas individually in each channel, allowing for differences in lesion appearance across modalities, an important feature of many brain tumor imaging sequences. We also propose discriminative model extensions to map the output of the generative model to arbitrary labels with semantic and biological meaning, such as "tumor core" or "fluid-filled structure", but without a one-to-one correspondence to the hypo- or hyper-intense lesion areas identified by the generative model. We test the approach in two image sets: the publicly available BRATS set of glioma patient scans, and multimodal brain images of patients with acute and subacute ischemic stroke. We find the generative model that has been designed for tumor lesions to generalize well to stroke images, and the extended discriminative-discriminative model to be one of the top ranking methods in the BRATS evaluation.
In recent years evidence has accumulated to suggest that neuroinflammation might be an early pathology of schizophrenia that later leads to neurodegeneration, yet the exact role in the etiology, as well as the source of neuroinflammation, are still not known. The hypothesis of neuroinflammation involvement in schizophrenia is quickly gaining popularity, and thus it is imperative that we have reliable and reproducible tools and measures that are both sensitive, and, most importantly, specific to neuroinflammation. The development and use of appropriate human in vivo imaging methods can help in our understanding of the location and extent of neuroinflammation in different stages of the disorder, its natural time-course, and its relation to neurodegeneration. Thus far, there is little in vivo evidence derived from neuroimaging methods. This is likely the case because the methods that are specific and sensitive to neuroinflammation are relatively new or only just being developed. This paper provides a methodological review of both existing and emerging positron emission tomography and magnetic resonance imaging techniques that identify and characterize neuroinflammation. We describe \how these methods have been used in schizophrenia research. We also outline the shortcomings of existing methods, and we highlight promising future techniques that will likely improve state-of-the-art neuroimaging as a more refined approach for investigating neuroinflammation in schizophrenia.
The National Alliance for Medical Image Computing (NA-MIC) was launched in 2004 with the goal of investigating and developing an open source software infrastructure for the extraction of information and knowledge from medical images using computational methods. Several leading research and engineering groups participated in this effort that was funded by the US National Institutes of Health through a variety of infrastructure grants. This effort transformed 3D Slicer from an internal, Boston-based, academic research software application into a professionally maintained, robust, open source platform with an international leadership and developer and user communities. Critical improvements to the widely used underlying open source libraries and tools-VTK, ITK, CMake, CDash, DCMTK-were an additional consequence of this effort. This project has contributed to close to a thousand peer-reviewed publications and a growing portfolio of US and international funded efforts expanding the use of these tools in new medical computing applications every year. In this editorial, we discuss what we believe are gaps in the way medical image computing is pursued today; how a well-executed research platform can enable discovery, innovation and reproducible science ("Open Science"); and how our quest to build such a software platform has evolved into a productive and rewarding social engineering exercise in building an open-access community with a shared vision.
Diffusion MRI (dMRI) can provide invaluable information about the structure of different tissue types in the brain. Standard dMRI acquisitions facilitate a proper analysis (e.g. tracing) of medium-to-large white matter bundles. However, smaller fiber bundles connecting very small cortical or sub-cortical regions cannot be traced accurately in images with large voxel sizes. Yet, the ability to trace such fiber bundles is critical for several applications such as deep brain stimulation and neurosurgery. In this work, we propose a novel acquisition and reconstruction scheme for obtaining high spatial resolution dMRI images using multiple low resolution (LR) images, which is effective in reducing acquisition time while improving the signal-to-noise ratio (SNR). The proposed method called compressed-sensing super resolution reconstruction (CS-SRR), uses multiple overlapping thick-slice dMRI volumes that are under-sampled in q-space to reconstruct diffusion signal with complex orientations. The proposed method combines the twin concepts of compressed sensing and super-resolution to model the diffusion signal (at a given b-value) in a basis of spherical ridgelets with total-variation (TV) regularization to account for signal correlation in neighboring voxels. A computationally efficient algorithm based on the alternating direction method of multipliers (ADMM) is introduced for solving the CS-SRR problem. The performance of the proposed method is quantitatively evaluated on several in-vivo human data sets including a true SRR scenario. Our experimental results demonstrate that the proposed method can be used for reconstructing sub-millimeter super resolution dMRI data with very good data fidelity in clinically feasible acquisition time.
The structural heterogeneity of tumor tissue can be probed by diffusion MRI (dMRI) in terms of the variance of apparent diffusivities within a voxel. However, the link between the diffusional variance and the tissue heterogeneity is not well-established. To investigate this link we test the hypothesis that diffusional variance, caused by microscopic anisotropy and isotropic heterogeneity, is associated with variable cell eccentricity and cell density in brain tumors. We performed dMRI using a novel encoding scheme for diffusional variance decomposition (DIVIDE) in 7 meningiomas and 8 gliomas prior to surgery. The diffusional variance was quantified from dMRI in terms of the total mean kurtosis (MKT), and DIVIDE was used to decompose MKT into components caused by microscopic anisotropy (MKA) and isotropic heterogeneity (MKI). Diffusion anisotropy was evaluated in terms of the fractional anisotropy (FA) and microscopic fractional anisotropy (μFA). Quantitative microscopy was performed on the excised tumor tissue, where structural anisotropy and cell density were quantified by structure tensor analysis and cell nuclei segmentation, respectively. In order to validate the DIVIDE parameters they were correlated to the corresponding parameters derived from microscopy. We found an excellent agreement between the DIVIDE parameters and corresponding microscopy parameters; MKA correlated with cell eccentricity (r=0.95, p<10(-7)) and MKI with the cell density variance (r=0.83, p<10(-3)). The diffusion anisotropy correlated with structure tensor anisotropy on the voxel-scale (FA, r=0.80, p<10(-3)) and microscopic scale (μFA, r=0.93, p<10(-6)). A multiple regression analysis showed that the conventional MKT parameter reflects both variable cell eccentricity and cell density, and therefore lacks specificity in terms of microstructure characteristics. However, specificity was obtained by decomposing the two contributions; MKA was associated only to cell eccentricity, and MKI only to cell density variance. The variance in meningiomas was caused primarily by microscopic anisotropy (mean±s.d.) MKA=1.11±0.33 vs MKI=0.44±0.20 (p<10(-3)), whereas in the gliomas, it was mostly caused by isotropic heterogeneity MKI=0.57±0.30 vs MKA=0.26±0.11 (p<0.05). In conclusion, DIVIDE allows non-invasive mapping of parameters that reflect variable cell eccentricity and density. These results constitute convincing evidence that a link exists between specific aspects of tissue heterogeneity and parameters from dMRI. Decomposing effects of microscopic anisotropy and isotropic heterogeneity facilitates an improved interpretation of tumor heterogeneity as well as diffusion anisotropy on both the microscopic and macroscopic scale.
Retrieving medical images that present similar diseases is an active research area for diagnostics and therapy. However, it can be problematic given the visual variations between anatomical structures. In this paper, we propose a new feature extraction method for similarity computation in medical imaging. Instead of the low-level visual appearance, we design a CCA-PairLDA feature representation method to capture the similarity between images with high-level semantics. First, we extract the PairLDA topics to represent an image as a mixture of latent semantic topics in an image pair context. Second, we generate a CCA-correlation model to represent the semantic association between an image pair for similarity computation. While PairLDA adjusts the latent topics for all image pairs, CCA-correlation helps to associate an individual image pair. In this way, the semantic descriptions of an image pair are closely correlated, and naturally correspond to similarity computation between images. We evaluated our method on two public medical imaging datasets for image retrieval and showed improved performance.