CA2394192A1 - Model-based registration of cardiac cta and mr acquisitions - Google Patents
Model-based registration of cardiac cta and mr acquisitions Download PDFInfo
- Publication number
- CA2394192A1 CA2394192A1 CA002394192A CA2394192A CA2394192A1 CA 2394192 A1 CA2394192 A1 CA 2394192A1 CA 002394192 A CA002394192 A CA 002394192A CA 2394192 A CA2394192 A CA 2394192A CA 2394192 A1 CA2394192 A1 CA 2394192A1
- Authority
- CA
- Canada
- Prior art keywords
- model
- images
- contours
- recited
- copied
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000000747 cardiac effect Effects 0.000 title description 6
- 238000000034 method Methods 0.000 claims abstract description 46
- 238000013519 translation Methods 0.000 claims abstract description 19
- 238000012876 topography Methods 0.000 claims abstract description 12
- 210000002216 heart Anatomy 0.000 claims description 51
- 210000005240 left ventricle Anatomy 0.000 claims description 12
- 239000008280 blood Substances 0.000 claims description 9
- 210000004369 blood Anatomy 0.000 claims description 9
- 230000011218 segmentation Effects 0.000 claims description 9
- 238000010009 beating Methods 0.000 claims description 2
- 210000004165 myocardium Anatomy 0.000 claims description 2
- 230000002107 myocardial effect Effects 0.000 description 11
- 238000003384 imaging method Methods 0.000 description 9
- 210000001519 tissue Anatomy 0.000 description 9
- 210000001835 viscera Anatomy 0.000 description 8
- 210000004351 coronary vessel Anatomy 0.000 description 6
- 210000000056 organ Anatomy 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 3
- 210000004204 blood vessel Anatomy 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 210000005242 cardiac chamber Anatomy 0.000 description 2
- 238000002591 computed tomography Methods 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 208000006029 Cardiomegaly Diseases 0.000 description 1
- 208000024172 Cardiovascular disease Diseases 0.000 description 1
- 241000282412 Homo Species 0.000 description 1
- 238000012307 MRI technique Methods 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 235000004240 Triticum spelta Nutrition 0.000 description 1
- 238000002583 angiography Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000013170 computed tomography imaging Methods 0.000 description 1
- 239000002872 contrast media Substances 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 210000005003 heart tissue Anatomy 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- DGAIEPBNLOQYER-UHFFFAOYSA-N iopromide Chemical compound COCC(=O)NC1=C(I)C(C(=O)NCC(O)CO)=C(I)C(C(=O)N(C)CC(O)CO)=C1I DGAIEPBNLOQYER-UHFFFAOYSA-N 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000010016 myocardial function Effects 0.000 description 1
- 238000002600 positron emission tomography Methods 0.000 description 1
- 230000003014 reinforcing effect Effects 0.000 description 1
- 239000000243 solution Substances 0.000 description 1
- VIDRYROWYFWGSY-UHFFFAOYSA-N sotalol hydrochloride Chemical compound Cl.CC(C)NCC(O)C1=CC=C(NS(C)(=O)=O)C=C1 VIDRYROWYFWGSY-UHFFFAOYSA-N 0.000 description 1
- 238000001356 surgical procedure Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4053—Super resolution, i.e. output image resolution higher than sensor resolution
- G06T3/4061—Super resolution, i.e. output image resolution higher than sensor resolution by injecting details from a different spectral band
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/38—Registration of image sequences
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
Abstract
A method for registration of magnetic resonance (MR) and computed topography (CT) images, in accordance with the present invention includes providing MR images having a region of interest delineated by first contours (blocks 100 and 104) and providing CT images having the region of interest delineated by second contours (blocks 102 and 104). A pre-existing model of the region of interest is also provided (block 106). The pre-existing model is fit to the first contours or the second contours to provide a first resultant model (block 107). The first resultant model is then copied to provide a copied model (block 108). The copied model is fit to the other of the first contour s and the second contours to provide a second resultant model (block 108). By rotating and translating the first resultant model and the second resultant model, the first resultant model and the second resultant model are register ed (block 110). The rotation and translation information are stored and applied to the images to provide registration between the MR images and the CT image s (block 112).
Description
MODEL-BASED REGISTRATION OF
CARDIAC CTA AND MR ACQUISITIONS
BACKGROUND
1. Technical Field This disclosure relates to imaging and more particularly, to a method and apparatus for registering magnetic resonance and CT scan images.
CARDIAC CTA AND MR ACQUISITIONS
BACKGROUND
1. Technical Field This disclosure relates to imaging and more particularly, to a method and apparatus for registering magnetic resonance and CT scan images.
2. Description of the Related Art Medical imaging of internal organs may be performed by non-invasive imaging procedures, such as computed topography (CT, or "Cat scan") and magnetic resonance (MR) imaging (MRI). These techniques provide useful information about internal organs which may be employed by medical personnel to make important health related decisions about a patients condition.
Although these techniques both provide useful information, each techniques may be limited by the by the type of information the technique can provide. For example, CT imaging provides topographical images of internal structures of tissue. This means the shape or geometry of an internal organ can be determined using the CT procedure. MR imaging on the other hand provides functional information about the tissue comprising the organ or internal structure. For example, MR images may be employed to determine whether tissue is alive or dead for a given internal organ.
Therefore, a need exists for a method and apparatus with the capability of combining MR and CT
information for an improved image having both shape and function information about organic structures and tissues.
SUMMARY OF THE INVENTION
A method for registration of magnetic resonance (MR) and computed topography (CT) images, in accordance with the present invention includes providing MR images having a region of interest delineated by first contours and providing CT images having the region of interest delineated by second contours. A pre-existing model of the region of interest is also provided. The pre-existing model is fit to the first contours or the second contours to provide a first resultant model. The first resultant model is then copied to provide a copied model. The copied model is fit to the other of the first contours and the second contours to provide a second resultant model. By rotating and translating the first resultant model and/or the second resultant model, the first resultant model and the second resultant model are registered. The rotation and translation information are stored and applied to the images to provide registration between the MR images and the CT
images.
In other methods, the step of providing MR images having a region of interest delineated by first contours preferably includes the step of providing MR images from a plurality of positions. The step of providing MR images having a region of interest delineated by first contours may include the step of manually delineating the region of interest or automatically delineating the region of interest by employing an segmentation algorithm. The step of providing CT images having the region of interest delineated by second contours may include the step of manually delineating the region of interest or automatically delineating the region of interest by employing an segmentation algorithm. The MR images and CT images are preferably acquired from a beating heart. The CT images may be acquired at a rate of greater than or equal to eight images per second.
In still other methods, the step of fitting the pre-existing model to one of the first contours and the second contours to provide a first resultant model may include the steps of rigidly translating and rotating the pre-existing model, adjusting global shape parameters of the pre-existing model and conforming a mesh of springs of the pre-existing model to accommodate individual features described by one of the first and second contours. The step of fitting the copif~d model may include the steps of rigidly translating and rotating the copied model, adjusting global shape parameters of the copied model and conforming a mesh of springs of the copied model to accommodate individual features described by the other of the first and second contours. The method may include the step of determining volumes of features in the MR and CT images by summing voxels in the first and second resultant models, respectively.
A method for registration of magnetic resonance (MR) and computed topography (CT) images, in accordance with the present invention includes providing MR and CT images of a heart, delineating an epicardial surface and an endocardial surface of the heart in the MR and CT images by designating contours on the images and providing a pre-existing heart model. The pre-existing heart model is fit to the contours in the MR images to provide an MR model, and the MR model is copied to provide a copied MR model. The copied MR model is fit to contours in the CR images to provide a CT model. One of the MR model and the CT model are rotated and translated to register the MR model and the CT model. The rotation and translation information are stored, and the rotation and translation information are applied to the MR and CT images to provide registration between the MR images and the CT images.
In other methods, the step of delineating an epicardial surface and an endocardial surface of the heart may includes the step of manually delineating the epicardial surface and the endocardial surface or automatically delineating the epicardial surface and the endocardial surface by employing an segmentation algorithm. The CT
images may be acquired at a rate of greater than or equal to eight images per second. The step of fitting the pre-existing model to the contours of the MR images may include the steps of rigidly translating and rotating the pre-existing model, adjusting global shape parameters of the pre-existing model and conforming a mesh of springs of the pre-existing model to accommodate individual features described by the contours in the MR images. The step of fitting the copied MR model to the contours of the CT images may include the steps of rigidly translating and rotating the copied MR model, adjusting global shape parameters of the copied MR model and conforming a mesh of springs of the copied MR model to accommodate individual features described by the contours in the CT images. The step of determining volumes of a left ventricle blood pool and myocardium in the MR and CT images by summing voxels in the MR and CT models, respectively, may be included.
The steps of the present invention may be implemented by a program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for registration of magnetic resonance (MR) and computed topography (CT) images.
A system for registration of magnetic resonance (MR) and computed topography (CT) images, in accordance with the present invention, includes means for delineating an epicardial surface and an endocardial surface of a heart in MR and CT images by designating contours on the images. A
pre-existing heart model is employed for fitting to the contours in the MR images to provide an MR model. Means for copying the MR model to provide a copied MR model is included. The copied MR model is fit to contours in the CR
images to provide a CT model. Means for rotating and translating the MR model and the CT model to register the MR
model and the CT model is included. A memory is employed for storing rotation and translation information such that the rotation and translation information is applied to the MR and CT images to provide registration between the MR
images and the CT images, and a display is included for viewing the registered MR images and CT images.
In alternate embodiments, the means for delineating may include a mouse and a graphical user interface. The means for copying may include a processor.
The means for rotating and translating may also include a processor. The pre-existing model preferably includes a mesh of springs to accommodate individual features described by the contours in the MR images. The copied MR model may includes a mesh of springs of the copied MR model to accommodate individual features described by the contours in the CT images. The MR and CT models may include voxels for determining volumes in the MR and CT.
These and other objects, features and advantages of the present invention will become apparent from the following detailed description of illustrative embodiments thereof, which is to be read in connection with the accompanying drawings.
BRIEF DESCRIPTION OF DRAWINGS
This disclosure will present in detail the following description of preferred embodiments with reference to the following figures wherein:
FIG. 1 is a block/flow diagram showing a system/method for registration of MR and CT images in accordance with the present invention;
FIG. 2 is a block diagram of an illustrative system for registration of MR and CT images in accordance with the present invention;
FIG. 3 depicts a pre-existing model fit to MR
contours to form a MR model in accordance with the present invention;
FIG. 4 depicts a copy of the MR model of FIG. 4 fit to contours in CT images to form a CT model in accordance with the present invention;
FIG. 5 dex-icts the MR model of FIG. 4 and the CT
model of FIG. 5 translated and rotated to fit each other in accordance with the present invention;
FIG. 6 depicts the MR images and the CT images translated and rotated to provide registration in accordance with the present invention;
FIG. 7 depicts a volume rendered heart with coronary arteries visible which includes registered MR and CT images in accordance with the present invention.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
The present invention provides a method and apparatus for combining information and images taken during computed topography angiography (CTA) and magnetic resonance (MR) imaging. The present invention exploits the CTA and MRI techniques to provide a more useful image of internal organs, such as, for example, the heart. In particularly useful embodiments of the present invention, a living heart is imaged by CTA and MRI and the images are registered and merged to provide both structural and functional information about the heart. Advantageously, CTA and MR images applied to the cardiac domain provide both complementary and reinforcing information.
CTA reconstructions employing retrospective gating techniques are of adequate resolution to recover coronary arteries. However, due to the inability of some patients to maintain breath-holds, total spatial coverage is not always possible. MR images, on the other hand, are typically of much lower resolution but can be acquired from arbitrary axes for complete (if sparse) coverage. MR images, in addition, include information relating to the function of the underlying tissue. The present invention provides a novel, clinically viable technique for registering LTA and MR images and thereby couple the high spatial resolution of coronary artery LTA with the myocardial function provided by MRI. The method also provides for the computation of heart chamber volumes.
The present invention will now be described in terms of imaging of the heart. The present invention is much broader, however, and relates to combining any images or image sets taken from different imaging techniques, for example, positron emission tomography (PET) or single photon emission computer tomography (SPELT). It should be understood that the elements shown in FIG. 1 may be implemented in various forms of hardware, software or combinations thereof. Preferably, these elements are implemented on one or more appropriately programmed general purpose digital computers having a processor and memory and input/output interfaces.
Referring now in specific detail to the drawings in which like reference numerals identify similar or identical elements throughout the several views, and initially to FIG. 1, a block/flow diagram for a system/method of the present invention is shown. In block 100, a magnetic resonance image (MRI) of a myocardial region is obtained by employing a MRI device, such as, for example, a 1.5 T Symphony MR scanner, commercially available form Siemens Aktiengesellschaft. Data is collected for an image of the myocardial region and stored for further processing as will be described. Other organs or internal structures may also be imaged. Multiple images are preferably obtained from different locations to provide as complete a three dimensional image of the cardial region as possible.
However, the present invention may also be employed to view a particular location or area of a heart. In this case, the number of images may be fewer or the images may be focused about a particular region of interest. In one embodiment about 10 images, each from a different position are employed to construct a three dimensional model of the cardial region.
In block 102, a computed topography acquisition (CTA) of a myocardial region is obtained by employing a CT
device, such as, for example, a SOMATOM scanner, commercially available form Siemens Aktiengesellschaft.
Data is collected for a time dependant image of the same myocardial region as imaged by CT and stored for further processing as will be described. Other organs or internal structures may also be imaged. Multiple images are preferably obtained at a rate of about eight images per second. Higher rates are preferred; however, lower rates may also be employed. Since the heart in a normal human beats 60-70 times per minute, high sample rates are preferred for this organ. With higher sample rates, heart images are advantageously provided with higher resolution and a three dimensional image of the myocardial region is achieved and stored with greater accuracy. The images are employed to construct a three dimensional model of the myocardial region or a portion thereof.
In block 104, CT and MR images include more information than is needed. For analysis of a heart, since the CT and MR images include the entire myocardial region, portions of the image that are not of interest may be eliminated from the image data. This may be performed manually by reviewing the images and placing a border or contour around a region of interest to delineate the area of interest in each image. In one embodiment, contours are drawn on an endocardial surface and an epicardial surface of a heart. In a particularly useful embodiment, a left ventricle (LV) or other heart chamber is imaged. In this case, the LV endocardial and epicardial surfaces in both MR
and CT acquisitions are delineated. Contours may be drawn in all of the MR images and in approximately ten MPRs (multiple planar reformattings) taken from the CT volume.
The region of interest may be delineated automatically by running an image-processing algorithm to differentiate the region of interest from other areas and properly identify the region of interest in each image by providing contours.
This delineation may be performed to isolate an entire heart for imaging in accordance with the present invention.
The boundary or contour of the area of interest is spatially defined relative to a coordinate system. In this way, each image may be correlated to the other images and a three dimensional image of the region of interest is obtained for both the CT and MR images.
In block 106, a model is provided which is to be fit to the MR image data. In one embodiment, the model is a digital model of a three dimensional heart with typical geometrical features and sizes. The model includes an endocardial surface and an epicardial surface, and preferably includes a mesh of nodes constrained by springs (virtual springs) to provide the capability to manipulate the model to conform to contours as will be described below.
Models may be selected according to the circumstances. For example, a model may be employed for patients with enlarged hearts, or diseased hearts. Models employed may be generated as described in commonly assigned U.S. Patent Nos.
Although these techniques both provide useful information, each techniques may be limited by the by the type of information the technique can provide. For example, CT imaging provides topographical images of internal structures of tissue. This means the shape or geometry of an internal organ can be determined using the CT procedure. MR imaging on the other hand provides functional information about the tissue comprising the organ or internal structure. For example, MR images may be employed to determine whether tissue is alive or dead for a given internal organ.
Therefore, a need exists for a method and apparatus with the capability of combining MR and CT
information for an improved image having both shape and function information about organic structures and tissues.
SUMMARY OF THE INVENTION
A method for registration of magnetic resonance (MR) and computed topography (CT) images, in accordance with the present invention includes providing MR images having a region of interest delineated by first contours and providing CT images having the region of interest delineated by second contours. A pre-existing model of the region of interest is also provided. The pre-existing model is fit to the first contours or the second contours to provide a first resultant model. The first resultant model is then copied to provide a copied model. The copied model is fit to the other of the first contours and the second contours to provide a second resultant model. By rotating and translating the first resultant model and/or the second resultant model, the first resultant model and the second resultant model are registered. The rotation and translation information are stored and applied to the images to provide registration between the MR images and the CT
images.
In other methods, the step of providing MR images having a region of interest delineated by first contours preferably includes the step of providing MR images from a plurality of positions. The step of providing MR images having a region of interest delineated by first contours may include the step of manually delineating the region of interest or automatically delineating the region of interest by employing an segmentation algorithm. The step of providing CT images having the region of interest delineated by second contours may include the step of manually delineating the region of interest or automatically delineating the region of interest by employing an segmentation algorithm. The MR images and CT images are preferably acquired from a beating heart. The CT images may be acquired at a rate of greater than or equal to eight images per second.
In still other methods, the step of fitting the pre-existing model to one of the first contours and the second contours to provide a first resultant model may include the steps of rigidly translating and rotating the pre-existing model, adjusting global shape parameters of the pre-existing model and conforming a mesh of springs of the pre-existing model to accommodate individual features described by one of the first and second contours. The step of fitting the copif~d model may include the steps of rigidly translating and rotating the copied model, adjusting global shape parameters of the copied model and conforming a mesh of springs of the copied model to accommodate individual features described by the other of the first and second contours. The method may include the step of determining volumes of features in the MR and CT images by summing voxels in the first and second resultant models, respectively.
A method for registration of magnetic resonance (MR) and computed topography (CT) images, in accordance with the present invention includes providing MR and CT images of a heart, delineating an epicardial surface and an endocardial surface of the heart in the MR and CT images by designating contours on the images and providing a pre-existing heart model. The pre-existing heart model is fit to the contours in the MR images to provide an MR model, and the MR model is copied to provide a copied MR model. The copied MR model is fit to contours in the CR images to provide a CT model. One of the MR model and the CT model are rotated and translated to register the MR model and the CT model. The rotation and translation information are stored, and the rotation and translation information are applied to the MR and CT images to provide registration between the MR images and the CT images.
In other methods, the step of delineating an epicardial surface and an endocardial surface of the heart may includes the step of manually delineating the epicardial surface and the endocardial surface or automatically delineating the epicardial surface and the endocardial surface by employing an segmentation algorithm. The CT
images may be acquired at a rate of greater than or equal to eight images per second. The step of fitting the pre-existing model to the contours of the MR images may include the steps of rigidly translating and rotating the pre-existing model, adjusting global shape parameters of the pre-existing model and conforming a mesh of springs of the pre-existing model to accommodate individual features described by the contours in the MR images. The step of fitting the copied MR model to the contours of the CT images may include the steps of rigidly translating and rotating the copied MR model, adjusting global shape parameters of the copied MR model and conforming a mesh of springs of the copied MR model to accommodate individual features described by the contours in the CT images. The step of determining volumes of a left ventricle blood pool and myocardium in the MR and CT images by summing voxels in the MR and CT models, respectively, may be included.
The steps of the present invention may be implemented by a program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for registration of magnetic resonance (MR) and computed topography (CT) images.
A system for registration of magnetic resonance (MR) and computed topography (CT) images, in accordance with the present invention, includes means for delineating an epicardial surface and an endocardial surface of a heart in MR and CT images by designating contours on the images. A
pre-existing heart model is employed for fitting to the contours in the MR images to provide an MR model. Means for copying the MR model to provide a copied MR model is included. The copied MR model is fit to contours in the CR
images to provide a CT model. Means for rotating and translating the MR model and the CT model to register the MR
model and the CT model is included. A memory is employed for storing rotation and translation information such that the rotation and translation information is applied to the MR and CT images to provide registration between the MR
images and the CT images, and a display is included for viewing the registered MR images and CT images.
In alternate embodiments, the means for delineating may include a mouse and a graphical user interface. The means for copying may include a processor.
The means for rotating and translating may also include a processor. The pre-existing model preferably includes a mesh of springs to accommodate individual features described by the contours in the MR images. The copied MR model may includes a mesh of springs of the copied MR model to accommodate individual features described by the contours in the CT images. The MR and CT models may include voxels for determining volumes in the MR and CT.
These and other objects, features and advantages of the present invention will become apparent from the following detailed description of illustrative embodiments thereof, which is to be read in connection with the accompanying drawings.
BRIEF DESCRIPTION OF DRAWINGS
This disclosure will present in detail the following description of preferred embodiments with reference to the following figures wherein:
FIG. 1 is a block/flow diagram showing a system/method for registration of MR and CT images in accordance with the present invention;
FIG. 2 is a block diagram of an illustrative system for registration of MR and CT images in accordance with the present invention;
FIG. 3 depicts a pre-existing model fit to MR
contours to form a MR model in accordance with the present invention;
FIG. 4 depicts a copy of the MR model of FIG. 4 fit to contours in CT images to form a CT model in accordance with the present invention;
FIG. 5 dex-icts the MR model of FIG. 4 and the CT
model of FIG. 5 translated and rotated to fit each other in accordance with the present invention;
FIG. 6 depicts the MR images and the CT images translated and rotated to provide registration in accordance with the present invention;
FIG. 7 depicts a volume rendered heart with coronary arteries visible which includes registered MR and CT images in accordance with the present invention.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
The present invention provides a method and apparatus for combining information and images taken during computed topography angiography (CTA) and magnetic resonance (MR) imaging. The present invention exploits the CTA and MRI techniques to provide a more useful image of internal organs, such as, for example, the heart. In particularly useful embodiments of the present invention, a living heart is imaged by CTA and MRI and the images are registered and merged to provide both structural and functional information about the heart. Advantageously, CTA and MR images applied to the cardiac domain provide both complementary and reinforcing information.
CTA reconstructions employing retrospective gating techniques are of adequate resolution to recover coronary arteries. However, due to the inability of some patients to maintain breath-holds, total spatial coverage is not always possible. MR images, on the other hand, are typically of much lower resolution but can be acquired from arbitrary axes for complete (if sparse) coverage. MR images, in addition, include information relating to the function of the underlying tissue. The present invention provides a novel, clinically viable technique for registering LTA and MR images and thereby couple the high spatial resolution of coronary artery LTA with the myocardial function provided by MRI. The method also provides for the computation of heart chamber volumes.
The present invention will now be described in terms of imaging of the heart. The present invention is much broader, however, and relates to combining any images or image sets taken from different imaging techniques, for example, positron emission tomography (PET) or single photon emission computer tomography (SPELT). It should be understood that the elements shown in FIG. 1 may be implemented in various forms of hardware, software or combinations thereof. Preferably, these elements are implemented on one or more appropriately programmed general purpose digital computers having a processor and memory and input/output interfaces.
Referring now in specific detail to the drawings in which like reference numerals identify similar or identical elements throughout the several views, and initially to FIG. 1, a block/flow diagram for a system/method of the present invention is shown. In block 100, a magnetic resonance image (MRI) of a myocardial region is obtained by employing a MRI device, such as, for example, a 1.5 T Symphony MR scanner, commercially available form Siemens Aktiengesellschaft. Data is collected for an image of the myocardial region and stored for further processing as will be described. Other organs or internal structures may also be imaged. Multiple images are preferably obtained from different locations to provide as complete a three dimensional image of the cardial region as possible.
However, the present invention may also be employed to view a particular location or area of a heart. In this case, the number of images may be fewer or the images may be focused about a particular region of interest. In one embodiment about 10 images, each from a different position are employed to construct a three dimensional model of the cardial region.
In block 102, a computed topography acquisition (CTA) of a myocardial region is obtained by employing a CT
device, such as, for example, a SOMATOM scanner, commercially available form Siemens Aktiengesellschaft.
Data is collected for a time dependant image of the same myocardial region as imaged by CT and stored for further processing as will be described. Other organs or internal structures may also be imaged. Multiple images are preferably obtained at a rate of about eight images per second. Higher rates are preferred; however, lower rates may also be employed. Since the heart in a normal human beats 60-70 times per minute, high sample rates are preferred for this organ. With higher sample rates, heart images are advantageously provided with higher resolution and a three dimensional image of the myocardial region is achieved and stored with greater accuracy. The images are employed to construct a three dimensional model of the myocardial region or a portion thereof.
In block 104, CT and MR images include more information than is needed. For analysis of a heart, since the CT and MR images include the entire myocardial region, portions of the image that are not of interest may be eliminated from the image data. This may be performed manually by reviewing the images and placing a border or contour around a region of interest to delineate the area of interest in each image. In one embodiment, contours are drawn on an endocardial surface and an epicardial surface of a heart. In a particularly useful embodiment, a left ventricle (LV) or other heart chamber is imaged. In this case, the LV endocardial and epicardial surfaces in both MR
and CT acquisitions are delineated. Contours may be drawn in all of the MR images and in approximately ten MPRs (multiple planar reformattings) taken from the CT volume.
The region of interest may be delineated automatically by running an image-processing algorithm to differentiate the region of interest from other areas and properly identify the region of interest in each image by providing contours.
This delineation may be performed to isolate an entire heart for imaging in accordance with the present invention.
The boundary or contour of the area of interest is spatially defined relative to a coordinate system. In this way, each image may be correlated to the other images and a three dimensional image of the region of interest is obtained for both the CT and MR images.
In block 106, a model is provided which is to be fit to the MR image data. In one embodiment, the model is a digital model of a three dimensional heart with typical geometrical features and sizes. The model includes an endocardial surface and an epicardial surface, and preferably includes a mesh of nodes constrained by springs (virtual springs) to provide the capability to manipulate the model to conform to contours as will be described below.
Models may be selected according to the circumstances. For example, a model may be employed for patients with enlarged hearts, or diseased hearts. Models employed may be generated as described in commonly assigned U.S. Patent Nos.
5,923,770 and 5,883,630, both incorporated herein by reference. In block 107, contours generated for CT images or MR images are fit to the pre-existing heart model. In one embodiment, the endocardial and epicardial surfaces of the model are fit to the contours generated in block 104 for a heart. The model is capable of deforming' to the contours in at least three ways: The model may rigidly translate and rotate. The model may adjust it global shape parameters (e. g., heart wall thickness, apex to base distance, blood pool depth, etc.). Once the global shape is settled, the model may act as a mesh of springs to conform to individual dips and bumps described by the MR contours. The new model that results will now be referred to as the MR model.
In block 108, a copy of the MR model is made. The copy of the MR model is fit to the CT contours provided in block 104. The endocardial and epicardial surfaces of the copy of the MR model are fit to the CT contours. The copy of the MR model is capable of deforming to the contours in at least three ways: The copy of the MR model may rigidly translate and rotate. The copy of the MR model may adjust it global shape parameters (e. g., heart wall thickness, apex to base distance, blood pool depth, etc.). Once the global shape is settled, the copy of the MR model may act as a mesh of springs to conform to individual dips and bumps described by the CT contours. The new model that results will now be referred to as the CT model.
In block 110, the MR model of block 106 is now fit to the CT model of block 108. The fitting process includes only translation and rotation to line up th.e two models.
The translation and rotation information is recorded.
In block 112, the translation and. recorded in block 110 are applied to the MR images to align the MR
images to the CT images collected in blocks 100 and 102, respectively. This completes the registration of the MR images to CT images.
In block 114, volume determinations or other analysis is performed. For example, blood pool volume and myocardial tissue volume may be computed from either the MR or CT models by determining for each voxel in an acquisition, whether it lies inside or outside the model surface. Those voxels lying inside the endocardial surface contribute to the blood pool volume. Those voxels lying inside the epicardial surface but outside the endocardial surface contribute to the myocardial tissue volume. A voxel is a unit of graphic information that defines a point in three-dimensional space. Each vowel has a volume associated therewith, which can be added or subtracted to derive the needed volumes from the image.
Advantageously, the registered CT and MR
images provide structural and functional information about internal organs, such as the heart. In one application, the registered image is employed to determine enfarcted heart tissue (MR image) along with positions of coronary arteries or other blood vessels in the heart (CT image). Advantageously, this information is made available on a single registered image volume. The present invention yields an invaluable tool for heart patients. In one useful embodiment, a diseased heart may be analyzed for blood vessels, which are candidates for bypass surgery. By providing the capability of viewing where dead or damaged tissues are located and the state of the blood vessels supplying (or not supplying) blood thereto, the registered images of the present invention provide a physician or health specialist with additional information not previously available.
Referring to FIG. 2, an illustrative apparatus 200 for registering CT and MR images is shown. MRI images are obtained for a subject by employing MRI scanner 202. CT
images are obtained for a CT scanner 204 for the same subject. The CT images and the MR images may be acquired at different times at different locations. It is preferable, however, that the subject provide a relatively similar state. For example, the internal organ which is mapped should be in an approximately the same state for both imaging processes to ensure proper registration. The subject is preferably a heart, such as a human heart, however other organs of humans or animals may be included.
MR and CT data are input to a processor 206.
Processor 206 may include a graphical user interface (GUI) which permits a user to manually draw a border or contour around a region of interest in the MR images and the CT
images. Alternately, a segmentation algorithm may be employed to differentiate regions of interest and draw contours for MR and CT images automatically without user interaction. Segmentation algorithms known to those skilled in the art may be employed. Processor 206 is coupled to a memory 210 stores the image data as well as one or more models 208 to fit to the contours drawn in the CT and MR
images. An MR model 212 and a copy 214 are generated by processor 206 and stored in memory 210. The MR model copy 214 is fit to CT images to form a CT model 216. The MR
model 212 and the CT model 216 and then compared by processor 206 to determine rotational and translating differences. These differences are stored and the CT and MR
models are adjusted to provide registration in accordance with the present invention.
A display 220 is included for displaying the images, providing interface information in the form of a graphical user interface (GUI) for drawing contours, etc.
and displaying the registered image. An interface device or devices 222 are also included which may include a keyboard, mouse, or other devices known in the art.
ILLUSTRATIVE EXAMPLE:
The present invention was employed to register CT
and MR images of a human left ventricle. A patient with cardiovascular disease was imaged on a 1.5 T MR scanner (Symphony, Siemens Medical Systems, Erlangen, Germany) using a phased array body coil. A breath-hold 2D tine view-shared segmented FLASH sequence was used to evaluate wall motion.
Short-axis 10 mm thick slices were obtained from the base to the apex of the heart with an in-plane interpolated image resolution equal to 1.17 x 1.17 mmz. Fifteen cardiac phases were acquired during the cardiac cycle at each position.
Three long-axis views were also obtained with an interpolated image resolution equal to 1.25 x 1.25 mm2.
The patient was then imaged on a multi-slice CT scanner (SOMATOM Plus 4 Volume Zoom, Siemens Medical Systems, Erlangen, Germany). Retrospectively ECG-gated contrast-enhanced spiral scans were used to obtain CTA
images of the coronary arteries. A 120 ml volume of Ultravist 240 (commercially available from, Berlex, Inc. of Wayne, NJ) was administered as a contrast agent for highlighting certain regions of the images. Axial images were obtained 22 seconds after injection from the apex to the base of the heart with a scanner collimation of 4x1 mm. Complete coverage of the left ventricle was not possible because of limitations on scan time (<40 sec). Images were reconstructed from data collected during a 250 msec time window in late diastole. Images were reconstructed with a slice width of 1.25 mm and an in-plane image resolution of 0.44 x 0.44 mm2.
Referring to FIGS. 3-6, prior to registration, the LV endocardial and epicardial surfaces in both acquisitions were manually delineated. Contours were drawn in all of the MR images and in approximately ten MPRs (labeled 301 in FIGS. 3-6) taken from the CT
volume. Note that the CT contours may not be closed due to the incomplete coverage of the LV in this example. Given the contours, the present invention is completely automatic and includes four stages depicted by FIGS. 3-6.
As shown in FIG. 3, a pre-existing model 303 of an LV made up of an endocardial surface 304 and an epicardial surface 306 is fit to the contours drawn on the MR images 308. The model is capable of deforming to the contours in three ways: It may rigidly translate and rotate. It may adjust its global shape parameters (e. g., heart wall thickness, apex to base distance, blood pool depth). Once the global shape has settled, it may act as a mesh of springs to conform to the individual dips and bumps described by the contours. The resulting model is an MR Model 307.
As shown in FIG. 4, a copy 309 of the MR model is made. This model is fit to CT contours of image 310 using the same technique described for FIG. 3. This model is the CT Model 312. As shown in FIG. 5, the surface of MR model 307 is fit to the surface of CT
model 312 via translation and rotation only to provide an aligned image 311. As shown in FIG. 6, the translation and rotation used in FIG. 5 are applied to the MR acquisition to align it to the CT acquisition completing the registration to form a complete model 315.
'To exploit the information made available by registering the acquisitions, a good visualization environment should be used. In one embodiment, a variant of the FLY-THROUGH package, included in 3D
VIRTUOSO, available from Siemens Aktiengesellschaft may be employed to fuse a volume rendered CTA acquisition with multiple MPRs taken from the MR acquisition.
The pre-existing model used for fitting to MR
contours as shown in FIG. 3 serves two functions.
First, because the shape of the pre-existing model is that of a typical LV, in those regions where there is no data, a reasonable hypothesis is available as to what the shape should be. This is contrasted with approaches for constructing a heart model where contours delineating the myocardial borders are simply "stitched" together. This might result in a flattened apex, for example, if only short axis contours are used. Second, in those regions where data is available, the present invention starts closer to the correct solution resulting in a faster, better fit.
The contours of pre-existing model 303 are constrained by a mesh of springs (virtual springs); this mesh of spring constraints is carried through the other models as well.
In FIG. 4, a copy of the MR model is fit to the CT contours rather than the other way around (i.e., fitting a model to the CT contours, copying it, and fitting that model to the MR contours). This approach is taken because it is assumed that although the MR
acquisition is sparse, the MR acquisition is more likely to completely cover the LV or other internal organ. The CT contours, as mentioned, may be incomplete. Thus, the MR model shape provides a good starting point for the fit to the CT contours. It is to be understood that the present invention may first fit the CT contours to the pre-existing model, if sufficient data is available.
In the example, the MR and CTA acquisitions were registered with an RMS error of < 5mm based on the distance between the MR and CT model surfaces. The volume of the blood pool taken from the MR model was 237 ml with a myocardial tissue volume of 232 ml. All the images shown include voxels which may be employed for further analysis of the models.
Referring to FIG. ~, a volume rendered heart 400 from CTA data, highlighting coronary arteries 402, is shown with two MPR planes 404 taken from registered MR acquisition in accordance with the present invention.
Having described preferred embodiments model-based registration of cardiac CTA and MR acquisitions (which are intended to be illustrative and not limiting), it is noted that modifications and variations can be made by persons skilled in the art in light of the above teachings. It is therefore to be understood that changes may be made in the particular embodiments of the invention disclosed which are within the scope and spirit of the invention as outlined by the appended claims. Having thus described the invention with the details and particularity required by the patent laws, what is claimed and desired protected by Letters Patent is set forth in the appended claims.
In block 108, a copy of the MR model is made. The copy of the MR model is fit to the CT contours provided in block 104. The endocardial and epicardial surfaces of the copy of the MR model are fit to the CT contours. The copy of the MR model is capable of deforming to the contours in at least three ways: The copy of the MR model may rigidly translate and rotate. The copy of the MR model may adjust it global shape parameters (e. g., heart wall thickness, apex to base distance, blood pool depth, etc.). Once the global shape is settled, the copy of the MR model may act as a mesh of springs to conform to individual dips and bumps described by the CT contours. The new model that results will now be referred to as the CT model.
In block 110, the MR model of block 106 is now fit to the CT model of block 108. The fitting process includes only translation and rotation to line up th.e two models.
The translation and rotation information is recorded.
In block 112, the translation and. recorded in block 110 are applied to the MR images to align the MR
images to the CT images collected in blocks 100 and 102, respectively. This completes the registration of the MR images to CT images.
In block 114, volume determinations or other analysis is performed. For example, blood pool volume and myocardial tissue volume may be computed from either the MR or CT models by determining for each voxel in an acquisition, whether it lies inside or outside the model surface. Those voxels lying inside the endocardial surface contribute to the blood pool volume. Those voxels lying inside the epicardial surface but outside the endocardial surface contribute to the myocardial tissue volume. A voxel is a unit of graphic information that defines a point in three-dimensional space. Each vowel has a volume associated therewith, which can be added or subtracted to derive the needed volumes from the image.
Advantageously, the registered CT and MR
images provide structural and functional information about internal organs, such as the heart. In one application, the registered image is employed to determine enfarcted heart tissue (MR image) along with positions of coronary arteries or other blood vessels in the heart (CT image). Advantageously, this information is made available on a single registered image volume. The present invention yields an invaluable tool for heart patients. In one useful embodiment, a diseased heart may be analyzed for blood vessels, which are candidates for bypass surgery. By providing the capability of viewing where dead or damaged tissues are located and the state of the blood vessels supplying (or not supplying) blood thereto, the registered images of the present invention provide a physician or health specialist with additional information not previously available.
Referring to FIG. 2, an illustrative apparatus 200 for registering CT and MR images is shown. MRI images are obtained for a subject by employing MRI scanner 202. CT
images are obtained for a CT scanner 204 for the same subject. The CT images and the MR images may be acquired at different times at different locations. It is preferable, however, that the subject provide a relatively similar state. For example, the internal organ which is mapped should be in an approximately the same state for both imaging processes to ensure proper registration. The subject is preferably a heart, such as a human heart, however other organs of humans or animals may be included.
MR and CT data are input to a processor 206.
Processor 206 may include a graphical user interface (GUI) which permits a user to manually draw a border or contour around a region of interest in the MR images and the CT
images. Alternately, a segmentation algorithm may be employed to differentiate regions of interest and draw contours for MR and CT images automatically without user interaction. Segmentation algorithms known to those skilled in the art may be employed. Processor 206 is coupled to a memory 210 stores the image data as well as one or more models 208 to fit to the contours drawn in the CT and MR
images. An MR model 212 and a copy 214 are generated by processor 206 and stored in memory 210. The MR model copy 214 is fit to CT images to form a CT model 216. The MR
model 212 and the CT model 216 and then compared by processor 206 to determine rotational and translating differences. These differences are stored and the CT and MR
models are adjusted to provide registration in accordance with the present invention.
A display 220 is included for displaying the images, providing interface information in the form of a graphical user interface (GUI) for drawing contours, etc.
and displaying the registered image. An interface device or devices 222 are also included which may include a keyboard, mouse, or other devices known in the art.
ILLUSTRATIVE EXAMPLE:
The present invention was employed to register CT
and MR images of a human left ventricle. A patient with cardiovascular disease was imaged on a 1.5 T MR scanner (Symphony, Siemens Medical Systems, Erlangen, Germany) using a phased array body coil. A breath-hold 2D tine view-shared segmented FLASH sequence was used to evaluate wall motion.
Short-axis 10 mm thick slices were obtained from the base to the apex of the heart with an in-plane interpolated image resolution equal to 1.17 x 1.17 mmz. Fifteen cardiac phases were acquired during the cardiac cycle at each position.
Three long-axis views were also obtained with an interpolated image resolution equal to 1.25 x 1.25 mm2.
The patient was then imaged on a multi-slice CT scanner (SOMATOM Plus 4 Volume Zoom, Siemens Medical Systems, Erlangen, Germany). Retrospectively ECG-gated contrast-enhanced spiral scans were used to obtain CTA
images of the coronary arteries. A 120 ml volume of Ultravist 240 (commercially available from, Berlex, Inc. of Wayne, NJ) was administered as a contrast agent for highlighting certain regions of the images. Axial images were obtained 22 seconds after injection from the apex to the base of the heart with a scanner collimation of 4x1 mm. Complete coverage of the left ventricle was not possible because of limitations on scan time (<40 sec). Images were reconstructed from data collected during a 250 msec time window in late diastole. Images were reconstructed with a slice width of 1.25 mm and an in-plane image resolution of 0.44 x 0.44 mm2.
Referring to FIGS. 3-6, prior to registration, the LV endocardial and epicardial surfaces in both acquisitions were manually delineated. Contours were drawn in all of the MR images and in approximately ten MPRs (labeled 301 in FIGS. 3-6) taken from the CT
volume. Note that the CT contours may not be closed due to the incomplete coverage of the LV in this example. Given the contours, the present invention is completely automatic and includes four stages depicted by FIGS. 3-6.
As shown in FIG. 3, a pre-existing model 303 of an LV made up of an endocardial surface 304 and an epicardial surface 306 is fit to the contours drawn on the MR images 308. The model is capable of deforming to the contours in three ways: It may rigidly translate and rotate. It may adjust its global shape parameters (e. g., heart wall thickness, apex to base distance, blood pool depth). Once the global shape has settled, it may act as a mesh of springs to conform to the individual dips and bumps described by the contours. The resulting model is an MR Model 307.
As shown in FIG. 4, a copy 309 of the MR model is made. This model is fit to CT contours of image 310 using the same technique described for FIG. 3. This model is the CT Model 312. As shown in FIG. 5, the surface of MR model 307 is fit to the surface of CT
model 312 via translation and rotation only to provide an aligned image 311. As shown in FIG. 6, the translation and rotation used in FIG. 5 are applied to the MR acquisition to align it to the CT acquisition completing the registration to form a complete model 315.
'To exploit the information made available by registering the acquisitions, a good visualization environment should be used. In one embodiment, a variant of the FLY-THROUGH package, included in 3D
VIRTUOSO, available from Siemens Aktiengesellschaft may be employed to fuse a volume rendered CTA acquisition with multiple MPRs taken from the MR acquisition.
The pre-existing model used for fitting to MR
contours as shown in FIG. 3 serves two functions.
First, because the shape of the pre-existing model is that of a typical LV, in those regions where there is no data, a reasonable hypothesis is available as to what the shape should be. This is contrasted with approaches for constructing a heart model where contours delineating the myocardial borders are simply "stitched" together. This might result in a flattened apex, for example, if only short axis contours are used. Second, in those regions where data is available, the present invention starts closer to the correct solution resulting in a faster, better fit.
The contours of pre-existing model 303 are constrained by a mesh of springs (virtual springs); this mesh of spring constraints is carried through the other models as well.
In FIG. 4, a copy of the MR model is fit to the CT contours rather than the other way around (i.e., fitting a model to the CT contours, copying it, and fitting that model to the MR contours). This approach is taken because it is assumed that although the MR
acquisition is sparse, the MR acquisition is more likely to completely cover the LV or other internal organ. The CT contours, as mentioned, may be incomplete. Thus, the MR model shape provides a good starting point for the fit to the CT contours. It is to be understood that the present invention may first fit the CT contours to the pre-existing model, if sufficient data is available.
In the example, the MR and CTA acquisitions were registered with an RMS error of < 5mm based on the distance between the MR and CT model surfaces. The volume of the blood pool taken from the MR model was 237 ml with a myocardial tissue volume of 232 ml. All the images shown include voxels which may be employed for further analysis of the models.
Referring to FIG. ~, a volume rendered heart 400 from CTA data, highlighting coronary arteries 402, is shown with two MPR planes 404 taken from registered MR acquisition in accordance with the present invention.
Having described preferred embodiments model-based registration of cardiac CTA and MR acquisitions (which are intended to be illustrative and not limiting), it is noted that modifications and variations can be made by persons skilled in the art in light of the above teachings. It is therefore to be understood that changes may be made in the particular embodiments of the invention disclosed which are within the scope and spirit of the invention as outlined by the appended claims. Having thus described the invention with the details and particularity required by the patent laws, what is claimed and desired protected by Letters Patent is set forth in the appended claims.
Claims (32)
1. A method for registration of magnetic resonance (MR) and computed topography (CT) images comprising the steps of:
providing MR images having a region of interest delineated by first contours;
providing CT images having the region of interest delineated by second contours;
providing a pre-existing model of the region of interest;
fitting the pre-existing model to one of the first contours and the second contours to provide a first resultant model;
copying the first resultant model to provide a copied model;
fitting the copied model to the other of the first contours and the second contours to provide a second resultant model;
rotating and translating one of the first resultant model and the second resultant model to register the first resultant model and the second resultant model;
storing rotation and translation information; and applying the rotation and translation information to the images to provide registration between the MR images and the CT images.
providing MR images having a region of interest delineated by first contours;
providing CT images having the region of interest delineated by second contours;
providing a pre-existing model of the region of interest;
fitting the pre-existing model to one of the first contours and the second contours to provide a first resultant model;
copying the first resultant model to provide a copied model;
fitting the copied model to the other of the first contours and the second contours to provide a second resultant model;
rotating and translating one of the first resultant model and the second resultant model to register the first resultant model and the second resultant model;
storing rotation and translation information; and applying the rotation and translation information to the images to provide registration between the MR images and the CT images.
2. The method as recited in claim 1, wherein the step of providing MR images having a region of interest delineated by first contours includes the step of providing MR images from a plurality of positions.
3. The method as recited in claim 1, wherein the step of providing MR images having a region of interest delineated by first contours includes the step of manually delineating the region of interest.
4. The method as recited in claim 1, wherein the step of providing MR images having a region of interest delineated by first contours includes the step of automatically delineating the region of interest by employing an segmentation algorithm.
5. The method as recited in claim 1, wherein the step of providing CT images having the region of interest delineated by second contours includes the step of manually delineating the region of interest.
6. The method as recited in claim 1, wherein the step of providing CT images having the region of interest delineated by second contours includes the step of automatically delineating the region of interest by employing an segmentation algorithm.
7. The method as recited in claim 1, wherein the MR images and CT images are acquired of a beating heart.
8. The method as recited in claim 7, wherein the CT images are acquired at a rate of greater than or equal to 8 images per second.
9. The method as recited in claim 1, wherein the step of fitting the pre-existing model to one of the first contours and the second contours to provide a first resultant model includes the steps of:
rigidly translating and rotating the pre-existing model;
adjusting global shape parameters of the pre-existing model; and conforming a mesh of springs of the pre-existing model to accommodate individual features described by one of the first and second contours.
rigidly translating and rotating the pre-existing model;
adjusting global shape parameters of the pre-existing model; and conforming a mesh of springs of the pre-existing model to accommodate individual features described by one of the first and second contours.
10. The method as recited in claim 1, wherein the step of fitting the copied model includes the steps of:
rigidly translating and rotating the copied model;
adjusting global shape parameters of the copied model; and conforming a mesh of springs of the copied model to accommodate individual features described by the other of the first and second contours.
rigidly translating and rotating the copied model;
adjusting global shape parameters of the copied model; and conforming a mesh of springs of the copied model to accommodate individual features described by the other of the first and second contours.
11. The method as recited in claim 1, further comprising the step of determining volumes of features in the MR and CT images by summing voxels in the first and second resultant models, respectively.
12. A method for registration of magnetic resonance (MR) and computed topography (CT) images comprising the steps of:
providing MR and CT images of a heart;
delineating an epicardial surface and an endocardial surface of the heart in the MR and CT images by designating contours on the images;
providing a pre-existing heart model;
fitting the pre-existing heart model to the contours in the MR images to provide an MR model;
copying the MR model to provide a copied MR model;
fitting the copied MR model to contours in the CR
images to provide a CT model;
rotating and translating one of the MR model and the CT model to register the MR model and the CT model;
storing rotation and translation information; and applying the rotation and translation information to the MR and CT images to provide registration between the MR images and the CT images.
providing MR and CT images of a heart;
delineating an epicardial surface and an endocardial surface of the heart in the MR and CT images by designating contours on the images;
providing a pre-existing heart model;
fitting the pre-existing heart model to the contours in the MR images to provide an MR model;
copying the MR model to provide a copied MR model;
fitting the copied MR model to contours in the CR
images to provide a CT model;
rotating and translating one of the MR model and the CT model to register the MR model and the CT model;
storing rotation and translation information; and applying the rotation and translation information to the MR and CT images to provide registration between the MR images and the CT images.
13. The method as recited in claim 12, wherein the step of delineating an epicardial surface and an endocardial surface of the heart includes the step of manually delineating the epicardial surface and the endocardial surface.
14. The method as recited in claim 12, wherein the step of delineating an epicardial surface and an endocardial surface of the heart includes the step of automatically delineating the epicardial surface and the endocardial surface by employing an segmentation algorithm.
15. The method as recited in claim 12, wherein the CT images are acquired at a rate of greater than or equal to 8 images per second.
16. The method as recited in claim 1, wherein the step of fitting the pre-existing model to the contours of the MR images includes the steps of:
rigidly translating and rotating the pre-existing model;
adjusting global shape parameters of the pre-existing model; and conforming a mesh of springs of the pre-existing model to accommodate individual features described by the contours in the MR images.
rigidly translating and rotating the pre-existing model;
adjusting global shape parameters of the pre-existing model; and conforming a mesh of springs of the pre-existing model to accommodate individual features described by the contours in the MR images.
17. The method as recited in claim 12, wherein the step of fitting the copied MR model to the contours of the CT images includes the steps of:
rigidly translating and rotating the copied MR model;
adjusting global shape parameters of the copied MR model; and conforming a mesh of springs of the copied MR
model to accommodate individual features described by the contours in the CT images.
rigidly translating and rotating the copied MR model;
adjusting global shape parameters of the copied MR model; and conforming a mesh of springs of the copied MR
model to accommodate individual features described by the contours in the CT images.
18. The method as recited in claim 12, further comprising the step of determining volumes of a left ventricle blood pool and myocardium in the MR and CT images by summing voxels in the MR and CT models, respectively.
19. A program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for registration of magnetic resonance (MR) and computed topography (CT) images, the method steps comprising:
providing MR and CT images of a heart;
delineating an epicardial surface and an endocardial surface of the heart in the MR and CT images by designating contours on the images;
providing a pre-existing heart model;
fitting the pre-existing heart model to the contours in the MR images to provide an MR model;
copying the MR model to provide a copied MR model;
fitting the copied MR model to contours in the CR
images to provide a CT model;
rotating and translating one of the MR model and the CT model to register the MR model and the CT model;
storing rotation and translation information; and applying the rotation and translation information to the MR and CT images to provide registration between the MR images and the CT images.
providing MR and CT images of a heart;
delineating an epicardial surface and an endocardial surface of the heart in the MR and CT images by designating contours on the images;
providing a pre-existing heart model;
fitting the pre-existing heart model to the contours in the MR images to provide an MR model;
copying the MR model to provide a copied MR model;
fitting the copied MR model to contours in the CR
images to provide a CT model;
rotating and translating one of the MR model and the CT model to register the MR model and the CT model;
storing rotation and translation information; and applying the rotation and translation information to the MR and CT images to provide registration between the MR images and the CT images.
20. The program storage device as recited in claim 19, wherein the step of delineating an epicardial surface and an endocardial surface of the heart includes the step of manually delineating the epicardial surface and the endocardial surface.
21. The program storage device as recited in claim 19, wherein the step of delineating an epicardial surface and an endocardial surface of the heart includes the step of automatically delineating the epicardial surface and the endocardial surface by employing an segmentation algorithm.
22. The program storage device as recited in claim 19, wherein the CT images are acquired at a rate of greater than or equal to 8 images per second.
23. The program storage device as recited in claim 19, wherein the step of fitting the pre-existing model to the contours of the MR images includes the steps of:
rigidly translating and rotating the pre-existing model;
adjusting global shape parameters of the pre-existing model; and conforming a mesh of springs of the pre-existing model to accommodate individual features described by the contours in the MR images.
rigidly translating and rotating the pre-existing model;
adjusting global shape parameters of the pre-existing model; and conforming a mesh of springs of the pre-existing model to accommodate individual features described by the contours in the MR images.
24. The method as recited in claim 19, wherein the step of fitting the copied MR model to the contours of the CT images includes the steps of:
rigidly translating and rotating the copied MR model;
adjusting global shape parameters of the copied MR model; and conforming a mesh of springs of the copied MR
model to accommodate individual features described by the contours in the CT images.
rigidly translating and rotating the copied MR model;
adjusting global shape parameters of the copied MR model; and conforming a mesh of springs of the copied MR
model to accommodate individual features described by the contours in the CT images.
25. The program storage device as recited in claim 19, further comprising the step of determining volumes in the MR and CT images by employing voxels in the MR and CT
models, respectively.
models, respectively.
26. A system for registration of magnetic resonance (MR) and computed topography (CT) images, comprising:
means for delineating an epicardial surface and an endocardial surface of a heart in MR and CT images by designating contours on the images;
a pre-existing heart model for fitting to the contours in the MR images to provide an MR model;
means for copying the MR model to provide a copied MR model, the copied MR model for fitting to contours in the CR images to provide a CT model;
means for rotating and translating the MR model and the CT model to register the MR model and the CT model;
a memory for storing rotation and translation information such that the rotation and translation information is applied to the MR and CT images to provide registration between the MR images and the CT images; and a display for viewing the registered MR images and CT images.
means for delineating an epicardial surface and an endocardial surface of a heart in MR and CT images by designating contours on the images;
a pre-existing heart model for fitting to the contours in the MR images to provide an MR model;
means for copying the MR model to provide a copied MR model, the copied MR model for fitting to contours in the CR images to provide a CT model;
means for rotating and translating the MR model and the CT model to register the MR model and the CT model;
a memory for storing rotation and translation information such that the rotation and translation information is applied to the MR and CT images to provide registration between the MR images and the CT images; and a display for viewing the registered MR images and CT images.
27. The system as recited in claim 26, wherein the means for delineating includes a mouse and a graphical user interface.
28. The system as recited in claim 26, wherein the means for copying includes a processor.
29. The system as recited in claim 26, wherein the means for rotating and translating includes a processor.
30. The system as recited in claim 26, wherein the pre-existing model includes a mesh of springs to accommodate individual features described by the contours in the MR images.
31. The system as recited in claim 26, wherein the copied MR model includes a mesh of springs of the copied MR model to accommodate individual features described by the contours in the CT images.
32. The system as recited in claim 26, wherein the MR and CT models include voxels for determining volumes in the MR and CT.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US09/460,746 | 1999-12-14 | ||
| US09/460,746 US6563941B1 (en) | 1999-12-14 | 1999-12-14 | Model-based registration of cardiac CTA and MR acquisitions |
| PCT/US2000/033565 WO2001045047A1 (en) | 1999-12-14 | 2000-12-12 | Model-based registration of cardiac cta and mr acquisitions |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2394192A1 true CA2394192A1 (en) | 2001-06-21 |
Family
ID=23829921
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002394192A Abandoned CA2394192A1 (en) | 1999-12-14 | 2000-12-12 | Model-based registration of cardiac cta and mr acquisitions |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US6563941B1 (en) |
| EP (1) | EP1238368B1 (en) |
| JP (1) | JP2003517361A (en) |
| CA (1) | CA2394192A1 (en) |
| DE (1) | DE60020876T2 (en) |
| WO (1) | WO2001045047A1 (en) |
Families Citing this family (52)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001291091A (en) * | 2000-01-31 | 2001-10-19 | Mitsubishi Electric Corp | Device and method for processing image |
| US7031504B1 (en) * | 2000-09-26 | 2006-04-18 | Vital Images, Inc. | Image data based retrospective temporal selection of medical images |
| DE10052535A1 (en) * | 2000-10-23 | 2002-05-08 | Siemens Ag | Diagnostic system for the playback of images from such as medical tomography uses mouse input |
| DE10054814A1 (en) * | 2000-11-04 | 2002-05-08 | Philips Corp Intellectual Pty | Images registration method e.g. for medical image matching, magnetic resonance tomography, involves transforming discrete images into registered images |
| US6844884B2 (en) * | 2000-12-27 | 2005-01-18 | Ge Medical Systems Global Technology Company, Llc | Multi-plane graphic prescription interface and method |
| US7327862B2 (en) * | 2001-04-30 | 2008-02-05 | Chase Medical, L.P. | System and method for facilitating cardiac intervention |
| US7526112B2 (en) * | 2001-04-30 | 2009-04-28 | Chase Medical, L.P. | System and method for facilitating cardiac intervention |
| US6816607B2 (en) * | 2001-05-16 | 2004-11-09 | Siemens Corporate Research, Inc. | System for modeling static and dynamic three dimensional anatomical structures by 3-D models |
| US7006862B2 (en) * | 2001-07-17 | 2006-02-28 | Accuimage Diagnostics Corp. | Graphical user interfaces and methods for retrospectively gating a set of images |
| US7142703B2 (en) * | 2001-07-17 | 2006-11-28 | Cedara Software (Usa) Limited | Methods and software for self-gating a set of images |
| US7209779B2 (en) | 2001-07-17 | 2007-04-24 | Accuimage Diagnostics Corp. | Methods and software for retrospectively gating a set of images |
| JP2005521502A (en) * | 2002-04-03 | 2005-07-21 | セガミ エス．エー．アール．エル． | Overlay of chest and abdominal image modalities |
| US7117026B2 (en) * | 2002-06-12 | 2006-10-03 | Koninklijke Philips Electronics N.V. | Physiological model based non-rigid image registration |
| US20040044282A1 (en) * | 2002-08-28 | 2004-03-04 | Mixon Lonnie Mark | Medical imaging systems and methods |
| US7289841B2 (en) | 2002-10-25 | 2007-10-30 | Koninklijke Philips Electronics N.V. | Method and apparatus for volumetric cardiac computed tomography imaging |
| US6991605B2 (en) * | 2002-12-18 | 2006-01-31 | Siemens Medical Solutions Usa, Inc. | Three-dimensional pictograms for use with medical images |
| US20050043609A1 (en) * | 2003-01-30 | 2005-02-24 | Gregory Murphy | System and method for facilitating cardiac intervention |
| EP1593087A4 (en) * | 2003-01-30 | 2006-10-04 | Chase Medical Lp | A method and system for image processing and contour assessment |
| EP1890261B1 (en) * | 2006-08-14 | 2009-02-18 | BrainLAB AG | Registration of MR data using generic models |
| FR2855292B1 (en) * | 2003-05-22 | 2005-12-09 | Inst Nat Rech Inf Automat | DEVICE AND METHOD FOR REAL TIME REASONING OF PATTERNS ON IMAGES, IN PARTICULAR FOR LOCALIZATION GUIDANCE |
| US20050008208A1 (en) * | 2003-06-25 | 2005-01-13 | Brett Cowan | Acquisition-time modeling for automated post-processing |
| WO2005023086A2 (en) * | 2003-08-25 | 2005-03-17 | University Of North Carolina At Chapel Hill | Systems, methods, and computer program products for analysis of vessel attributes for diagnosis, disease staging, and surgical planning |
| DE10340546B4 (en) * | 2003-09-01 | 2006-04-20 | Siemens Ag | Method and apparatus for visually assisting electrophysiology catheter application in the heart |
| DE10340544B4 (en) * | 2003-09-01 | 2006-08-03 | Siemens Ag | Device for visual support of electrophysiology catheter application in the heart |
| US20070014452A1 (en) * | 2003-12-01 | 2007-01-18 | Mitta Suresh | Method and system for image processing and assessment of a state of a heart |
| DE10357205A1 (en) * | 2003-12-08 | 2005-07-14 | Siemens Ag | Method for generating result images of an examination object |
| US8326086B2 (en) * | 2003-12-11 | 2012-12-04 | Koninklijke Philips Electronics N.V. | Elastic image registration |
| JP3989896B2 (en) * | 2003-12-25 | 2007-10-10 | ザイオソフト株式会社 | Medical image processing apparatus, region of interest extraction method, and program |
| US7333643B2 (en) | 2004-01-30 | 2008-02-19 | Chase Medical, L.P. | System and method for facilitating cardiac intervention |
| JP2007526033A (en) * | 2004-02-13 | 2007-09-13 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Apparatus and method for registering an image of a structured object |
| US7366336B2 (en) * | 2004-03-09 | 2008-04-29 | Siemens Medical Solutions Usa, Inc. | System to link periodic X-ray images |
| US7388976B2 (en) * | 2004-03-09 | 2008-06-17 | Siemens Medical Solutions Usa, Inc. | Time-based system to link periodic X-ray images |
| US7711405B2 (en) * | 2004-04-28 | 2010-05-04 | Siemens Corporation | Method of registering pre-operative high field closed magnetic resonance images with intra-operative low field open interventional magnetic resonance images |
| US8010175B2 (en) * | 2004-05-05 | 2011-08-30 | Siemens Medical Solutions Usa, Inc. | Patient-specific coronary territory mapping |
| US7394920B2 (en) * | 2004-05-19 | 2008-07-01 | Invia, Llc | Automated computer-implemented method and system for reorienting emission computer tomographic myocardial perfusion images |
| US7339585B2 (en) * | 2004-07-19 | 2008-03-04 | Pie Medical Imaging B.V. | Method and apparatus for visualization of biological structures with use of 3D position information from segmentation results |
| US7639896B2 (en) * | 2004-08-09 | 2009-12-29 | Carestream Health, Inc. | Multimodal image registration using compound mutual information |
| WO2006036842A2 (en) * | 2004-09-24 | 2006-04-06 | The University Of North Carolina At Chapel Hill | Methods, systems, and computer program products for hierarchical registration between a blood vessel and tissue surface model for a subject and blood vessel and tissue surface image for the subject |
| US7715627B2 (en) * | 2005-03-25 | 2010-05-11 | Siemens Medical Solutions Usa, Inc. | Automatic determination of the standard cardiac views from volumetric data acquisitions |
| US7352370B2 (en) * | 2005-06-02 | 2008-04-01 | Accuray Incorporated | Four-dimensional volume of interest |
| RU2446843C2 (en) * | 2006-08-01 | 2012-04-10 | Конинклейке Филипс Электроникс, Н.В. | Biologically targeted adaptive therapy planning |
| EP1892671A3 (en) * | 2006-08-23 | 2009-07-29 | Medison Co., Ltd. | System and method for determining the volume of an object by image processing |
| US7996060B2 (en) * | 2006-10-09 | 2011-08-09 | Biosense Webster, Inc. | Apparatus, method, and computer software product for registration of images of an organ using anatomical features outside the organ |
| DE102007001684B4 (en) * | 2007-01-11 | 2023-01-26 | Sicat Gmbh & Co. Kg | Image Registration |
| JP5523681B2 (en) * | 2007-07-05 | 2014-06-18 | 株式会社東芝 | Medical image processing device |
| US8121364B2 (en) | 2008-06-20 | 2012-02-21 | General Electric Company | System and methods for computer aided analysis of images |
| DE102009006147A1 (en) * | 2008-12-23 | 2010-06-24 | Siemens Aktiengesellschaft | Model generator for cardiological diseases |
| WO2011058948A1 (en) * | 2009-11-13 | 2011-05-19 | イマグノーシス株式会社 | Medical three-dimensional image display-orientation adjustment device and adjustment program |
| US20140126789A1 (en) * | 2011-06-10 | 2014-05-08 | Hideyuki Ban | Image diagnosis assisting apparatus, and method |
| WO2013046090A1 (en) | 2011-09-26 | 2013-04-04 | Koninklijke Philips Electronics N.V. | Medical image system and method |
| DE102012106890A1 (en) * | 2012-07-30 | 2014-01-30 | Carl Zeiss Microscopy Gmbh | Three-dimensional representation of objects |
| EP3264365A1 (en) * | 2016-06-28 | 2018-01-03 | Siemens Healthcare GmbH | Method and device for registration of a first image data set and a second image data set of a target region of a patient |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5151856A (en) * | 1989-08-30 | 1992-09-29 | Technion R & D Found. Ltd. | Method of displaying coronary function |
| US5273040A (en) * | 1991-11-14 | 1993-12-28 | Picker International, Inc. | Measurement of vetricle volumes with cardiac MRI |
| EP0602730B1 (en) * | 1992-12-18 | 2002-06-19 | Koninklijke Philips Electronics N.V. | Registration of Volumetric images which are relatively elastically deformed by matching surfaces |
| US5839440A (en) | 1994-06-17 | 1998-11-24 | Siemens Corporate Research, Inc. | Three-dimensional image registration method for spiral CT angiography |
| US5647360A (en) | 1995-06-30 | 1997-07-15 | Siemens Corporate Research, Inc. | Digital subtraction angiography for 3D diagnostic imaging |
| US5831719A (en) * | 1996-04-12 | 1998-11-03 | Holometrics, Inc. | Laser scanning system |
| US6175655B1 (en) * | 1996-09-19 | 2001-01-16 | Integrated Medical Systems, Inc. | Medical imaging system for displaying, manipulating and analyzing three-dimensional images |
| US5923770A (en) | 1996-09-30 | 1999-07-13 | Siemens Corporate Research, Inc. | 3D cardiac motion recovery system using tagged MR images |
| US5883630A (en) | 1996-12-20 | 1999-03-16 | Siemens Corporation Research, Inc. | Incompressibility constraints for inferring 3-D motion from 2-D projected displacements in a thick-walled ellipsoid with a geodesic-based tessellation |
| US5926568A (en) * | 1997-06-30 | 1999-07-20 | The University Of North Carolina At Chapel Hill | Image object matching using core analysis and deformable shape loci |
-
1999
- 1999-12-14 US US09/460,746 patent/US6563941B1/en not_active Expired - Lifetime
-
2000
- 2000-12-12 WO PCT/US2000/033565 patent/WO2001045047A1/en active IP Right Grant
- 2000-12-12 JP JP2001546065A patent/JP2003517361A/en not_active Withdrawn
- 2000-12-12 CA CA002394192A patent/CA2394192A1/en not_active Abandoned
- 2000-12-12 DE DE60020876T patent/DE60020876T2/en not_active Expired - Fee Related
- 2000-12-12 EP EP00984198A patent/EP1238368B1/en not_active Expired - Lifetime
Also Published As
| Publication number | Publication date |
|---|---|
| EP1238368B1 (en) | 2005-06-15 |
| DE60020876D1 (en) | 2005-07-21 |
| US6563941B1 (en) | 2003-05-13 |
| EP1238368A1 (en) | 2002-09-11 |
| JP2003517361A (en) | 2003-05-27 |
| WO2001045047A1 (en) | 2001-06-21 |
| DE60020876T2 (en) | 2005-12-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP1238368B1 (en) | Model-based registration of cardiac cta and mr acquisitions | |
| Rueckert et al. | Nonrigid registration using free-form deformations: application to breast MR images | |
| US5647360A (en) | Digital subtraction angiography for 3D diagnostic imaging | |
| US5889524A (en) | Reconstruction of three-dimensional objects using labeled piecewise smooth subdivision surfaces | |
| US8014578B2 (en) | Method and system for image segmentation using models | |
| US7778686B2 (en) | Method and apparatus for medical intervention procedure planning and location and navigation of an intervention tool | |
| JP5404277B2 (en) | MEDICAL IMAGE DATA ALIGNMENT DEVICE, METHOD, AND PROGRAM | |
| US7689261B2 (en) | Cardiac display methods and apparatus | |
| EP2054860B1 (en) | Selection of datasets from 3d renderings for viewing | |
| JP2003503136A (en) | Methods and systems for measuring organ characteristics | |
| JP2005521502A (en) | Overlay of chest and abdominal image modalities | |
| EP1593093A1 (en) | Method for the reconstruction of three-dimensional objects | |
| US20050113664A1 (en) | Cardiac display methods and apparatus | |
| Park et al. | Volumetric heart modeling and analysis | |
| AMK Berlin et al. | Display and analysis of 4-D medical images | |
| von Berg et al. | Surface based cardiac and respiratory motion extraction for pulmonary structures from multi-phase CT | |
| Yang et al. | Automatic left ventricle segmentation based on multiatlas registration in 4D CT images | |
| van Stralen et al. | Left Ventricular Volume Estimation in Cardiac Three-dimensional Ultrasound: A Semiautomatic Border Detection Approach1 | |
| Bani-Hashemi et al. | Warped matching for digital subtraction of CT-angiography studies | |
| Keil et al. | Dynamic cone beam reconstruction using a new level set formulation | |
| Chou et al. | Image fusion for visualization of hepatic vasculature and tumors | |
| Salgo | Three-dimensional echocardiography | |
| Hu et al. | Left ventricular 4D echocardiogram motion and shape analysis | |
| Mullick et al. | 3-dimensional visualization of pose determination: application to SPECT imaging (Proceedings Only) | |
| Skrinjar et al. | 3D Medical Imaging |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| FZDE | Discontinued |