Introduction: Acquiring and analyzing medical images is often a routine and critical part of the initial diagnosis and tracking the recovery process of a cardiac patient. The goal during the examination process is to optimize patient wait time and accuracy of diagnoses. Currently, echocardiography and magnetic resonance imaging (MRI) consist of the mainstay of imaging modalities used in the diagnosis of congenital heart disease from the fetus to the adult. The ECHO provides a two-dimensional view of the heart structure, and an accurate view of blood flow by leveraging a continuous or pulsed wave Doppler. However, due to the movement produced in the ultrasound, ECHOs often produce poor resolution and field of view for the physician to work with. MRIs are therefore used in conjunction with an ECHO to yield a clearer anatomic description of the heart. This process of continuously swapping between ECHOs and MRIs however, results in an elongated time to accurately diagnose a patients condition

Goal: Hybridizing images, such as ECGs and MRIs, together will reduce the time needed to view and diagnose patients medical images, while enhancing the overall image quality.

Method: We will develop a system utilizing unsupervised machine-learning techniques including fuzzy logic and neural networks, to accurately fuse ECHOs and MRIs into a single view. The frame- work of our system will begin with an established set of enhancement filters, which will be selected and applied through fuzzy logic and algorithmic processes. Once enhanced, neural networks will be established to accurately determine placement of the ECHO onto the MRI. Using MATLAB programming platform and image processing technology, a medical image fusion of echocardiogram and MRI (E.MRI) can be formed by the following sequence: 1) segmentation of the color Doppler flow signal; 2) registration (both location and cardiac cycle) of color Doppler and magnetic resonance images; and 3) fusion of both color Doppler and magnetic resonance images using geometric transformation.

Conclusion: The resultant echocardiographic MRI yields important anatomic and hemodynamic information and facilitates the decision-making process for the cardiologist and cardiac surgeon. Future applications of the image fusion strategy can include three-dimensional images as well as image-directed therapy for congenital heart disease. With the success of this image fusion, we will be able to begin applying the system to other imaging combinations such as PET imaging with CT, extending the benefits of image hybridizations beyond cardiology. The ad- vent of multimodal medical image fusion with accompanying algorithms that will incorporate feature extraction and artificial intelligence, will herald a new era in medical imaging with more robust decision-making.


Author: Madison Pahl

Status: Project Concept