Multimodal information integration & visualization: Optical imaging and MRI

We have developed a software platform for multimodal integration and visualization of diffuse optical tomography (DOT) and magnetic resonance imaging (MRI) of breast cancer. The image visualization platform allows multimodality 3D image visualization and manipulation of datasets, such as a variety of 3D rendering technique, and the ability to simultaneously control multiple fields of view. This platform enables quantitative and qualitative analysis of structural and functional diagnostic data, using both conventional & molecular imaging. The functional parameters, together with morphological parameters from MR can be suitably combined and correlated to the absolute diagnosis from histopathology. Fusion of the multimodal datasets will eventually lead to a significant improvement in the sensitivity and specificity of breast cancer detection. Fusion may also allow a priori structural information derived from MRI to be incorporated into the reconstruction of diffuse optical tomography images. We will present the early results of image visualization & registration on multimodal breast cancer data, DOT and MRI.