CA2270357A1 - Apparatus for matching x-ray images with reference images - Google Patents
Apparatus for matching x-ray images with reference images Download PDFInfo
- Publication number
- CA2270357A1 CA2270357A1 CA002270357A CA2270357A CA2270357A1 CA 2270357 A1 CA2270357 A1 CA 2270357A1 CA 002270357 A CA002270357 A CA 002270357A CA 2270357 A CA2270357 A CA 2270357A CA 2270357 A1 CA2270357 A1 CA 2270357A1
- Authority
- CA
- Canada
- Prior art keywords
- dpis
- dsis
- images
- generating
- portal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V10/757—Matching configurations of points or features
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N5/00—Radiation therapy
- A61N5/10—X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy
- A61N5/1048—Monitoring, verifying, controlling systems and methods
- A61N5/1064—Monitoring, verifying, controlling systems and methods for adjusting radiation treatment in response to monitoring
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10081—Computed x-ray tomography [CT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S378/00—X-ray or gamma ray systems or devices
- Y10S378/901—Computer tomography program or processor
Abstract
X-ray images (53) such as radiotherapy portal images and simulation images (45) are matched by apparatus (27) which digitizes the images and automatically processes the digitized signals to generate matched digitized signals which can be displayed for comparison. The digitized images are first coarse aligned (33) using a transform generated from seed points selected interactively (110) from the two images or through detection and identification (120) of x-ray opaque fiducials placed on the patient. A fine alignment (35) is then performed by first selecting intersecting regions of the two images (150) and enhancing those regions (154). Secondly, an updated transform is generated (160) using robust motion flow in these regions at successive ascending levels of resolution. The updated transform is then used to align the images (167) which are displayed for comparison. The updated transform can also be used to control the radiotherapy equipment (140).
Description
-I-APPARATUS FOR MATCHING X-RAY IMAGES WITH REFERENCE
IMAGES
BACKGROUND OF THE INVENTION
Field of the Invention This invention relates to matching similar x-ray images and has particular application to computer controlled radiotherapy apparatus for automatically matching on-line the portal images generated during radiotherapy treatment on a treatment machine with simulation images generated prior to treatment on a simulation machine for determining that the desired target is actually being irradiated for the purposes of assessment, andlor controlling the treatment equipment.
Back rg ound Information There are medical applications which require matching of x-ray images. For instance, in computer controlled radiotherapy, treatment beams of high energy radiation are directed at a tumor from a number of directions so as to maximize irradiation of the tumor while minimizing exposure of healthy tissue ' 15 surrounding the tumor. Such radiotherapy treatment typically has two distinct phases: the simulation phase, and the actual treatment phase. In the simulation phase, the patient is placed on equipment similar to the treatment equipment except that it does not generate the high energy radiation beam. The simulation equipment is successively positioned to simulate the delivery of the sequence of treatment beams prescribed by the treating oncologist. This assures that the equipment can be positioned to deliver the required treatment beams and progressively move from one treatment beam to the next without collision between the equipment and the patient or between movable components of the equipment. During this procedure a low dosage x-ray image called the simulation image is taken. This simulation image, which generally has good contrast and detail because of the low energy of the x-ray beam used (in the kiloelectronvolt range) helps the oncologist to locate the position of the tumor and thereby establish the positions of the equipment components for delivering the successive treatment beams.
During the actual treatment phase, the patient is placed in the exact same position on the equipment as in the simulation before the regular-dosage x-ray radiation, typically in the megaelectronvolt range, is used to treat the patient.
During this phase, another x-ray image is taken, which is called the portal image.
After completion of the treatment, the simulation and portal images are compared by an expert to determine whether the tumor, as identified in the simulation image, has been adequately treated with radiation in the portal image.
If the coverage is not complete, the patient is scheduled for a corrective treatment.
The current accepted procedure involves the manual comparison of the portal and simulation images. Accurate manual comparison is quite challenging given the fact that the two x-rays are usually taken by different equipment and at different levels of radiation exposure. The latter fact implies that the tumor area is usually not visible in the portal x-ray, and thus the matching of the portal image with that of the simulation has to rely on manual estimation of dimensions from anatomical landmarks, which will not be clearly visible.
Conventionally, the portal images have been generated by using x-ray film which has to be developed. This is not a serious drawback where only a single or a few treatment beams are utilized. However, this x-ray film is a serious limitation in computer controlled radiotherapy where a large number of treatment beams are used. Electronic portal imagers have been developed which generate a digitized image which can be displayed' on an electronic display device.
Unfortunately, the same problems exist as to the contrast and definition in the portal image generated electronically.
The problem of matching portal images with simulation images is compounded by the fact that the images have differences in orientation caused by skewing, scaling differences, rotation, translation and differences in perspective and.
curvature.
In stereotactic radiology, digitized computed tomography x-ray images - and magnetic resonance images (MRI) have been automatically matched by applying scaling derived from known fixed dimensions of a steel frame which appears in both images. Such fixed landmarks of known dimensions are not available in conventional radiotherapy images.
There is a need, therefore, for apparatus for automatically matching x-ray images and particularly for matching portal images with simulation images in radiotherapy.
There is also a need for such apparatus which can match the portal and simulation images on-line for multiple treatment beams.
There is further need for such apparatus which can match portal images and simulation images having widely different contrast and definition and differences caused by skewing, rotation, scaling, perspective or curvature.
There is an additional need for apparatus for obtaining and maintaining alignment of a patient during computed controlled radiotherapy or for terminating the radiation beam if alignment becomes unacceptable.
SUMMARY OF THE INVENTION
These needs and others are satisfied by the invention which is directed to apparatus for automatically matching an x-ray image with a reference image, and particularly for matching the portal image with a simulation image for determining whether radiotherapy treatment has been adequate or for matching successive portal images for controlling operation of the radiotherapy equipment. In matching images, digitizing means digitizes the x-ray image such as the portal image to generate a first set of digital image signals or digital portal image signals (DPIS) in the case of the portal image. The digitizing means also digitizes the reference image such as the simulation image to generate second digital image signals or digital simulation signals (DSIS). Processing means process these digital image signals to . 30 generate matched digital image signals. The processing is performed without any prior knowledge of the physical dimensions of any of the features in the images.
Output means generate for instance a display from the matched digital image signals and/or control the treatment/diagnosis equipment.
IMAGES
BACKGROUND OF THE INVENTION
Field of the Invention This invention relates to matching similar x-ray images and has particular application to computer controlled radiotherapy apparatus for automatically matching on-line the portal images generated during radiotherapy treatment on a treatment machine with simulation images generated prior to treatment on a simulation machine for determining that the desired target is actually being irradiated for the purposes of assessment, andlor controlling the treatment equipment.
Back rg ound Information There are medical applications which require matching of x-ray images. For instance, in computer controlled radiotherapy, treatment beams of high energy radiation are directed at a tumor from a number of directions so as to maximize irradiation of the tumor while minimizing exposure of healthy tissue ' 15 surrounding the tumor. Such radiotherapy treatment typically has two distinct phases: the simulation phase, and the actual treatment phase. In the simulation phase, the patient is placed on equipment similar to the treatment equipment except that it does not generate the high energy radiation beam. The simulation equipment is successively positioned to simulate the delivery of the sequence of treatment beams prescribed by the treating oncologist. This assures that the equipment can be positioned to deliver the required treatment beams and progressively move from one treatment beam to the next without collision between the equipment and the patient or between movable components of the equipment. During this procedure a low dosage x-ray image called the simulation image is taken. This simulation image, which generally has good contrast and detail because of the low energy of the x-ray beam used (in the kiloelectronvolt range) helps the oncologist to locate the position of the tumor and thereby establish the positions of the equipment components for delivering the successive treatment beams.
During the actual treatment phase, the patient is placed in the exact same position on the equipment as in the simulation before the regular-dosage x-ray radiation, typically in the megaelectronvolt range, is used to treat the patient.
During this phase, another x-ray image is taken, which is called the portal image.
After completion of the treatment, the simulation and portal images are compared by an expert to determine whether the tumor, as identified in the simulation image, has been adequately treated with radiation in the portal image.
If the coverage is not complete, the patient is scheduled for a corrective treatment.
The current accepted procedure involves the manual comparison of the portal and simulation images. Accurate manual comparison is quite challenging given the fact that the two x-rays are usually taken by different equipment and at different levels of radiation exposure. The latter fact implies that the tumor area is usually not visible in the portal x-ray, and thus the matching of the portal image with that of the simulation has to rely on manual estimation of dimensions from anatomical landmarks, which will not be clearly visible.
Conventionally, the portal images have been generated by using x-ray film which has to be developed. This is not a serious drawback where only a single or a few treatment beams are utilized. However, this x-ray film is a serious limitation in computer controlled radiotherapy where a large number of treatment beams are used. Electronic portal imagers have been developed which generate a digitized image which can be displayed' on an electronic display device.
Unfortunately, the same problems exist as to the contrast and definition in the portal image generated electronically.
The problem of matching portal images with simulation images is compounded by the fact that the images have differences in orientation caused by skewing, scaling differences, rotation, translation and differences in perspective and.
curvature.
In stereotactic radiology, digitized computed tomography x-ray images - and magnetic resonance images (MRI) have been automatically matched by applying scaling derived from known fixed dimensions of a steel frame which appears in both images. Such fixed landmarks of known dimensions are not available in conventional radiotherapy images.
There is a need, therefore, for apparatus for automatically matching x-ray images and particularly for matching portal images with simulation images in radiotherapy.
There is also a need for such apparatus which can match the portal and simulation images on-line for multiple treatment beams.
There is further need for such apparatus which can match portal images and simulation images having widely different contrast and definition and differences caused by skewing, rotation, scaling, perspective or curvature.
There is an additional need for apparatus for obtaining and maintaining alignment of a patient during computed controlled radiotherapy or for terminating the radiation beam if alignment becomes unacceptable.
SUMMARY OF THE INVENTION
These needs and others are satisfied by the invention which is directed to apparatus for automatically matching an x-ray image with a reference image, and particularly for matching the portal image with a simulation image for determining whether radiotherapy treatment has been adequate or for matching successive portal images for controlling operation of the radiotherapy equipment. In matching images, digitizing means digitizes the x-ray image such as the portal image to generate a first set of digital image signals or digital portal image signals (DPIS) in the case of the portal image. The digitizing means also digitizes the reference image such as the simulation image to generate second digital image signals or digital simulation signals (DSIS). Processing means process these digital image signals to . 30 generate matched digital image signals. The processing is performed without any prior knowledge of the physical dimensions of any of the features in the images.
Output means generate for instance a display from the matched digital image signals and/or control the treatment/diagnosis equipment.
The processing means includes coarse alignment means which first effect a coarse alignment between the digital portal image signals and the digital simulation image signals. Coarse alignment is initiated by selecting seed points in the portal image represented by the DPIS and in the simulation image represented by the DSIS. Selection of the seed points can be done either interactively using a pointing device such as a mouse to select what appear to be corresponding points on displays of the two images, or automatically through use of x-ray opaque fiducials placed on the patient. In either case, the seed points are used to compute a transform between the two images. Means are then used to apply the transform to one of the sets of digital image signals to transform points in that image to the coordinates of the other image thereby producing coarse aligned DPIS and DSIS.
Following coarse alignment, a fine alignment is performed. In implementing the fine alignment, the coarse aligned DPIS and DSIS are first prepared by selecting selected DPIS and selected DSIS for regions of the images which intersect or overlap, and preferably for a region of regular shape such as a rectangle within the intersecting regions of the images. The digital image signals for these regions are then enhanced to produce prepared images with similar dynamic range and pixel intensities. The fine alignment means includes means generating an updated transform from the prepared DPIS and DSIS, and means applying the updated transform to either the coarse or prepared DPIS and DSIS
to generate the matched DPIS and DSIS.
The means generating the updated transform comprises means generating motion flow components from the prepared DPIS and DSIS and calculating means calculating the updated transform from the motion flow components. Preferably the means generating the motion flow components generates motion flow gradient components and the calculating means comprises means applying a robust optimization to calculate the updated transform. The means generating updated transform uses successive ascending levels of resolution of the prepared DPIS and DSIS to generate the updated transform.
In the tracking mode, the updated transform is used to track movement between successive sets of digital portal image signals. Tracking can be used to terminate the radiation if patient movement exceeds specified limits, or could be used to operate the patient positioning assembly to maintain the radiation beam in proper alignment with the area to be treated.
The invention can also be used to match x-ray images with other reference images which could be another x-ray image or another type of image.
BRIEF DESCRIPTION OF THE DRAWINGS
A full understanding of the invention can be gained from the following description of the preferred embodiments when read in conjunction with the accompanying drawings in which:
Figure 1 is a schematic diagram of apparatus for implementing the invention.
Figure 2a is a simplified illustration of a simulation image to which the invention can be applied.
Figure 2b is a simplified illustration of a portal image to which the invention may be applied.
Figure 2c is a simplified illustration of a display superimposing the simulation and portal images of Figures 2a and 2b utilizing the invention.
Figures 3-11 are flow charts of software utilized to implement the invention in the apparatus of Figure 1.
DESCRIPTION OF THE PREFERRED EMBODIMENT
The invention is directed to matching x-ray images with reference images and will be described as applied to matching portal images generated in computer controlled radiotherapy with simulation images. However, it will be understood that the invention has wide application in matching other x-ray images such as those used in diagnosis, for example. As will be seen, the invention also has application for tracking motion in successive portal images such as for controlling positioning of a patient or gating of the radiation beam.
Referring to Figure 1, a simulation setup 1 is used for determining the location of the region such as a tumor within a patient 3 to be treated and for setting up the sequence of treatment beams. The setup equipment includes a gantry 5 mounted for rotation about a horizontal pivot 7 supported by a machine base 9.
A low energy, in the kiloelectronvolt range, x-ray beam 11 is directed by a collimator 13 mounted on the gantry 5 along a path which extends transversely through an extension of the pivot 7.
Following coarse alignment, a fine alignment is performed. In implementing the fine alignment, the coarse aligned DPIS and DSIS are first prepared by selecting selected DPIS and selected DSIS for regions of the images which intersect or overlap, and preferably for a region of regular shape such as a rectangle within the intersecting regions of the images. The digital image signals for these regions are then enhanced to produce prepared images with similar dynamic range and pixel intensities. The fine alignment means includes means generating an updated transform from the prepared DPIS and DSIS, and means applying the updated transform to either the coarse or prepared DPIS and DSIS
to generate the matched DPIS and DSIS.
The means generating the updated transform comprises means generating motion flow components from the prepared DPIS and DSIS and calculating means calculating the updated transform from the motion flow components. Preferably the means generating the motion flow components generates motion flow gradient components and the calculating means comprises means applying a robust optimization to calculate the updated transform. The means generating updated transform uses successive ascending levels of resolution of the prepared DPIS and DSIS to generate the updated transform.
In the tracking mode, the updated transform is used to track movement between successive sets of digital portal image signals. Tracking can be used to terminate the radiation if patient movement exceeds specified limits, or could be used to operate the patient positioning assembly to maintain the radiation beam in proper alignment with the area to be treated.
The invention can also be used to match x-ray images with other reference images which could be another x-ray image or another type of image.
BRIEF DESCRIPTION OF THE DRAWINGS
A full understanding of the invention can be gained from the following description of the preferred embodiments when read in conjunction with the accompanying drawings in which:
Figure 1 is a schematic diagram of apparatus for implementing the invention.
Figure 2a is a simplified illustration of a simulation image to which the invention can be applied.
Figure 2b is a simplified illustration of a portal image to which the invention may be applied.
Figure 2c is a simplified illustration of a display superimposing the simulation and portal images of Figures 2a and 2b utilizing the invention.
Figures 3-11 are flow charts of software utilized to implement the invention in the apparatus of Figure 1.
DESCRIPTION OF THE PREFERRED EMBODIMENT
The invention is directed to matching x-ray images with reference images and will be described as applied to matching portal images generated in computer controlled radiotherapy with simulation images. However, it will be understood that the invention has wide application in matching other x-ray images such as those used in diagnosis, for example. As will be seen, the invention also has application for tracking motion in successive portal images such as for controlling positioning of a patient or gating of the radiation beam.
Referring to Figure 1, a simulation setup 1 is used for determining the location of the region such as a tumor within a patient 3 to be treated and for setting up the sequence of treatment beams. The setup equipment includes a gantry 5 mounted for rotation about a horizontal pivot 7 supported by a machine base 9.
A low energy, in the kiloelectronvolt range, x-ray beam 11 is directed by a collimator 13 mounted on the gantry 5 along a path which extends transversely through an extension of the pivot 7.
The patient 3 is supported on a patient positioning assembly 15 which includes a couch 17 mounted on a support 19 for three dimensional translation relative to the support. The support 19, in turn, is mounted on a turntable 21.
Through translation of the couch 17, rotation of the turntable 21 and rotation of the gantry 5 about the pivot 7, a plurality of treatment beams can be simulated.
By sequencing the simulation equipment 1 through the positions required to generate the successive beams, it can be determined whether a11 of the required beams can be achieved and whether sequencing the movement of the equipment between beams must be adjusted to avoid collisions between the equipment and the patient or between components of the equipment.
The low energy x-ray beam 11 is used to generate simulation images by placement of an x-ray film 23 in line with the x-ray beam 11 on the other side of the patient 3 from the collimator 13. This simulation image is used to position the area of the patient to be treated, such as a tumor, at the isocenter of the setup, which is the intersection of the beam 11 with a projection of the pivot axis 7.
Following completion of the simulation, the patient 3 is transferred to the treatment setup 1 . As shown, the treatment setup at 1' is similar to the simulation setup l, except that the x-ray beam 11' is in the megaelectronvolt range.
A portal image is generated by the treatment setup 1 ' . This portal image can be captured by an x-ray film as in the simulation setup; however, it is preferred that an electronic portal imager 25 be used. If available, an electronic imager could also be used in place of the x-ray film 23 in the simulation setup 1.
As discussed above, the simulation image and the portal image can be quite different. One of the main reasons for this is the difference in the energy of the beams 11 and 11' . The invention can be used to match the simulation and portal images to determine if the treatment dosage was delivered to the proper treatment area. It can also be used to detect patient movement during treatment to terminate generation of the x-ray beam 11 ' i f a movement exceeds proper limits, or to maneuver the equipment to maintain proper alignment.
The image matching system 27 includes a digitizer 29 which digitizes the simulation image such as produced on the x-ray film 23 and the portal image such as that generated by the electronic portal imager 25. In a more general sense, WO 98/l9272 PCT/US97119538 -7_ the matching system 27 matches an x-ray image, such as the portal image, with a reference image such as the simulation image.
The image matching system 27 further includes a processor 31 which includes a module for coarse alignment 33 followed by a module for fine alignment S 3S. The output of the processor can be matched portal (x-ray) and simulation (reference) images which are displayed on a display device 37. Associated with the display device 37 are interface devices 39 which can include a keyboard 41 and a pointing device 43, such as a mouse or a trackball.
Figures 2a-2c illustrate that the invention can be used to match a portal x-ray image with a simulation reference image. Figure 2a represents a simulation image 4S generated using the simulation setup 1. The low energy x-rays used for this image produce an image with good contrast and detail, so that the outline 47 of the patient and bony structure 49 are shown as well as the tumor S 1.
Figure 2b illustrates the portal image which being taken with the higher energy 1S treatment beam shows the treated area SS as a uniform dark spot. The irregular edge of the treated area SS is produced by the leaves used in the collimator 13 to conform the beam 11' generally to the shape of the tumor. The remainder of the portal image SS shows little detail and does not indicate the location of the bones.
As can be seen, the two images 4S and S3 can be translated relative to each other, scaled differently, skewed and rotated (by 90~ in the example). The two images can also be different in perspective and in curvature.
The coarse alignment module 33 produces a general alignment of the two images, and then the fine alignment module 3S uses robust motion flow to rapidly and accurately complete matching of the images. The display device 37 can 2S present the matched images in different ways. In one embodiment, the display 37 alternates between the two images at about ~ to 20 Hz, but usually about 12 Hz, so that the observer views the images superimposed as a composite image S9, as shown in Figure 2c. As can be seen in the example, the treated area SS' in the matched portal image, overlays the tumor S 1 ' in the matched simulation image. In another type of display (not shown), the outline of the treated area from the portal image is projected onto the processed simulation image) so that it can be seen if the targeted tumor was in fact treated.
_g_ In performing the coarse alignment, a coarse transformation is applied.
to the digitized x-ray or portal image signals (DPIS) to convert them to the coordinate system of the digital reference or simulation image signals (DSIS).
As will be seen, the information needed to generate this transformation can be generated interactively through selection of what appear to be corresponding points in the two images by the operator interactively using a pointer device 43 or automatically using x-ray opaque fiducials 61 which are placed on the patient in both the simulation setup and the treatment setup (see Figure 1 ) . The points so generated in either case are referred to as seed points. The coarse transform H from the portal image coordinates to the simulation coordinates is:
RotSkewScale RotSkewScale translation SimltlatlOllz ~ U z /lOrlalx simulations = RotSkewScale~ RotSkewScale~ translation, ~ portah, (EQ~ 1) The (x y) vector denotes the column and row coordinates of the center of each of the seed points in the corresponding portal and simulation images.
The four RotSkewScale components of the matrix describe the full affine transformation that is needed to coarsely align the images. In this stage, the placement of the fiducial or the interactive selection of the seed points need not be accurate as the next stage is able to accommodate for reasonably small deviations.
Using the results of the coarse alignment, the portal image is warped toward the simulation image. Then, overlapping regions of the two images are computer enhanced so that the corresponding intensity levels are similar.
Finally, the motion-flow, or the fine-scale transform is computed so that the portal image glides on the gradient of dissimilarity toward the simulation image. In this stage, a more comprehensive transformation model is used in which the input position vector is represented by:
1 x y 0 0 0 x2 x ~ y 0 (EQ.2) X(x) _ 0 0 0 1 x y x ~ y y2 x2 and the transformation matrix is represented by:
E .3 Q = ~ao a~ a2 a3 a4 a5 po p1 c~ ( Q ) so that the result is:
a (x~Q)=X (x) ' Q (EQ' 4) where0 portal (x;Q) = a (x;Q) and portal (x) = X (x) . The parameters a o through a 5 include the affine transform as in the coarse alignment, whereas the parameters po, pl include the perspective transformation, and c covers the deformation that can be caused by breathing, etc.
To recover the parameters of the vector Q we formulate the image dissimilarity as a result of motion-flow, or distance between the two images.
1(x~t) = I(x - (X(x) ' Qf~+1)) (EQ. 5) for 'dx E f , where f is the region of the image we compute the transformation over.
In (EQ. 5), I(x) is the intensity function at point x, the image at t + 1 is the portal image, and at t is the simulation image. By using various derivation techniques, we ' formulate the motion-flow using the gradient (or dissimilarity gradient) as below:
al ~I(X(x) ~ Qf) + at = 0 (EQ. 6) for dx E f .
In this stage, a robust regression method is employed, using unconstrained optimization, to calculate the elements of Q (see {EQ. 3)). This technique enables us to cope with the 'reasonably small' deviations from the coarse alignment stage, as well as any residual dissimilarity between the two images.
Using the robust technique ensures that only the dominant transformation will be recovered without running into the risk of being affected by the noise and residual errors.
Figures 3-11 are flow charts of software which implements the invention. Figure 3 illustrates the main routine 100 which includes performing a coarse alignment, either interactively at block 110 or automatically at block 120.
In both cases a rough approximation of the transformation between the portal image and the simulation image is calculated using Equation 1. The user then has the option of determining whether the rough approximation has provided a satisfactory alignment of the images at 130. If so, the procedure is completed. If not, a fine alignment is performed. As discussed, the invention can also be used to track patient movement, in which case the transformation between the two images is utilized at 140 to roughly determine the updated position of the fiducials. If requested by the user in image matching and during tracking, the images are prepared for the fine alignment at 150. The refined image transformation is then calculated at l60 and if the image matching mode is selected as determined at 170, the transform is accomplished and the images are displayed at 180 in the manner discussed above. If the tracking mode has been selected at 190, the routine returns to 140 for generating the next position. The user again has the final decision at 200 to determine whether the image matching is satisfactory. If not, the routine returns to 110 and the rough calculation is re-initiated.
The procedure for calculating the rough approximation of the transformation interactively called for at block I 10 in Figure 3 is illustrated in detail in Figure 4. The user selects corresponding seed points or areas in the portal image and the simulation image using, for instance, the mouse 43 as indicated at 111. The selected areas or points are then used to compute the rough transformation between the portal image and the simulation image by calling a procedure A as indicated at 112. This rough transform is then used to transform the portal image to simulation image coordinates by calling procedure B as indicated at 113. The images are then displayed on the monitor 37 as indicated at 114.
The details of procedure A used to calculate the rough transform are shown in Figure 5 . If the user has indicated an area as determined at A 1, the system automatically selects random points from inside the area as corresponding as indicated at A2. Then, or if the user has selected points rather than an area, the corresponding point pairs are used to calculate the transform parameters using the least squares (LSQ) method as indicated at A3.
The details of procedure B for transforming the portal to simulation coordinates is shown in Figure 5. First, the row and column limits of the resulting transformed portal image are determined at Bl using the transformation matrix H, which is the inverse of Equation 1. The resulting portal image is then raster scanned at B2, and for each pixel the location is determined using the transformation. The intensity value for each pixel is calculated next using linear interpolation between the surrounding pixel locations in the original portal image.
The routine 120 for performing the coarse alignment automatically using fiducials on the patient is shown in Figure 7. The x-ray opaque fiducials 61 are detected in both the portal and simulation images at 12l and the corresponding markers are identified at 122. The image transform is then computed at 123 using procedure A of Figure 5 and the centroid of each of the markers as the seed points.
The portal image is then transformed at 124 to simulation coordinates using the computed transformation and procedure B of Figure 6. When in the matching mode as determined at 125, the images are displayed at l26 in the manner discussed above in connection with Figures 2a-c.
The routine 150 for preparing the coarse aligned digital image signals for fine alignment is shown in Figure 8. First, the region of intersection over overlap between the simulation and portal images is calculated at 151 using the transformation of Equation 1. Next, the largest rectangular region that fits within the intersection region is calculated at l52. Other regular geometric shapes, such as a square and so forth, could be used in place of the rectangle. New images representing the rectangular intersection region of the portal and simulation image are formed at 153. These resulting images are then enhanced at 154 to generate prepared digital image signals. Various forms of enhancement such as histogram equalization, Iapalcian of the Gaussian, high-pass filtering and other techniques are used to produce the prepared images with similar dynamic range and pixel intensities.
Figure 9 illustrates the routine 160 for calculating the updated transformation for a fine alignment. This process is performed at several levels of resolution of the digital image signals beginning with the lowest resolution, which in the example is about one-eighth resolution. Thus, at l61 the images at the lowest resolution for the prepared portal and simulation images are formed. These images are updated using the latest updated transformation parameters, that is, transformation parameters calculated at the previous level of resolution, at 162. An important part of the invention is that robust motion flow is used to perform the fine alignment. In particular, the motion flow gradient components are generated at 163.
Application of motion flow using gradient components is described by M. J.
Black and P. Anandan in a paper entitled, "A Framework For The Robust Estimation Of Optical Flow" published in Proc. 4th Intl. Conf. on Computer Vision (ICCV 93), Berlin, Germany, May 1993. Motion flow is applied to the motion required to cause pixels on one image to flow into alignment with corresponding pixels in the other image. Robust motion applies to the motion by which most of the pixels which have moved have moved similarly, while there may be others exhibiting different motion. The updated image transformation parameters are then calculated at 164 using robust optimization. If the upper limit of resolution has not been reached as determined at 165, then the resolution is incremented at 166 and updated transformation parameters are recalculated at the new level of resolution.
When the highest level of resolution has been reached at 165, the final transformation matrix Q is generated at 167. The details of the routine for calculating the updated image transformation parameters using robust optimization of block l64 in Figure 9 is shown in Figure 10. As described in the paper by Black and Anandan discussed above, the robust motion is represented by data points called inliers. Those exhibiting other motion are identified as outliers. In the present invention, the data points are the pixel values. The pixels are successively separated into inliers and outliers based upon their contribution to a consistent motion flow vector. The pixels in the inlier set are used to calculate the dominant motion flow, and their contribution to it is dependent on their weight factors which are calculated during the robust optimization.
Referring particularly to Figure 10, a loop is entered at 164.1 where each of the inlier points is marked using individual weight factors.
Initially, the weight factors of the pixels are all set to 1 so that all of the pixels are inliers. At 164.2, an optimization parameter, Q, which determines the sensitivity of the procedure to outliers is set. The weight factors are dependent on this parameter, Q.
The lower the value of Q, the more points are eliminated as inliers and the closer the inliers become to the current estimate of the motion flow vector. Hence, a large 6 is used initially so that all points are included. On successive loops, Q is lowered to eliminate more and more outliers. This lowering of Q is referred to as Q
scheduling. The Q scheduling must be done carefully. If 6 is lowered too fast, a solution may be missed, while on the other hand, lowering Q too slowly increases the processing time. In accordance with the invention, 6 is lowered depending upon the largest error in the motion flow parameters. Following this, another loop is entered at 164.3 in which each of the inlier data points is used in the calculation of the updated values for the transformation parameters of the Q matrix at 164.4.
The equations used at 164.4 are derived preferably using the conjugate gradient, although gradient descent can also be used. In addition, motion flow and robust statistics are used in deriving equations fox determining the transformation parameters. The error in the transformation parameters, which is the change from the last calculation, as well as Q, are used at l64.5 to adjust the weight factors for the pixels. When a11 of the inlier data points/pixels have been used as determined at 164.3, a check is made at 164.6 to determine if the solution has converged to the desired degree. If not, the routine returns to 164.1 and the inlier data points are again marked using the updated weight factors.
Figure 11 illustrates the tracking routine on 140. As indicated at 141, the incremental updates and the transform H and/or Q are combined so that the transform always relates back to the original simulation or reference image.
On the initial pass through the tracking routine, the then current portal image replaces the simulation image if used, and then a new portal image is acquired at 143. As tracking continues, successive portal images are matched with the next preceding portal image to generate the updated transform. As indicated at 144, the successive positions of the fiducials or changes in the pattern of the fiducials from successive portal images is used to generate cracking signals for controlling the radiotherapy equipment such as turning the beam on and off and/or driving the patient positioning assembly.
While specific embodiments of the invention have been described in detail, it will be appreciated by those skilled in the art that various modifications and alternatives to those details could be developed in light of the overall teachings of the disclosure. Accordingly, the particular arrangements disclosed are meant to be illustrative only and not limiting as to the scope of invention which is to be given the full breadth of the claims appended and any and all equivalents thereof.
Through translation of the couch 17, rotation of the turntable 21 and rotation of the gantry 5 about the pivot 7, a plurality of treatment beams can be simulated.
By sequencing the simulation equipment 1 through the positions required to generate the successive beams, it can be determined whether a11 of the required beams can be achieved and whether sequencing the movement of the equipment between beams must be adjusted to avoid collisions between the equipment and the patient or between components of the equipment.
The low energy x-ray beam 11 is used to generate simulation images by placement of an x-ray film 23 in line with the x-ray beam 11 on the other side of the patient 3 from the collimator 13. This simulation image is used to position the area of the patient to be treated, such as a tumor, at the isocenter of the setup, which is the intersection of the beam 11 with a projection of the pivot axis 7.
Following completion of the simulation, the patient 3 is transferred to the treatment setup 1 . As shown, the treatment setup at 1' is similar to the simulation setup l, except that the x-ray beam 11' is in the megaelectronvolt range.
A portal image is generated by the treatment setup 1 ' . This portal image can be captured by an x-ray film as in the simulation setup; however, it is preferred that an electronic portal imager 25 be used. If available, an electronic imager could also be used in place of the x-ray film 23 in the simulation setup 1.
As discussed above, the simulation image and the portal image can be quite different. One of the main reasons for this is the difference in the energy of the beams 11 and 11' . The invention can be used to match the simulation and portal images to determine if the treatment dosage was delivered to the proper treatment area. It can also be used to detect patient movement during treatment to terminate generation of the x-ray beam 11 ' i f a movement exceeds proper limits, or to maneuver the equipment to maintain proper alignment.
The image matching system 27 includes a digitizer 29 which digitizes the simulation image such as produced on the x-ray film 23 and the portal image such as that generated by the electronic portal imager 25. In a more general sense, WO 98/l9272 PCT/US97119538 -7_ the matching system 27 matches an x-ray image, such as the portal image, with a reference image such as the simulation image.
The image matching system 27 further includes a processor 31 which includes a module for coarse alignment 33 followed by a module for fine alignment S 3S. The output of the processor can be matched portal (x-ray) and simulation (reference) images which are displayed on a display device 37. Associated with the display device 37 are interface devices 39 which can include a keyboard 41 and a pointing device 43, such as a mouse or a trackball.
Figures 2a-2c illustrate that the invention can be used to match a portal x-ray image with a simulation reference image. Figure 2a represents a simulation image 4S generated using the simulation setup 1. The low energy x-rays used for this image produce an image with good contrast and detail, so that the outline 47 of the patient and bony structure 49 are shown as well as the tumor S 1.
Figure 2b illustrates the portal image which being taken with the higher energy 1S treatment beam shows the treated area SS as a uniform dark spot. The irregular edge of the treated area SS is produced by the leaves used in the collimator 13 to conform the beam 11' generally to the shape of the tumor. The remainder of the portal image SS shows little detail and does not indicate the location of the bones.
As can be seen, the two images 4S and S3 can be translated relative to each other, scaled differently, skewed and rotated (by 90~ in the example). The two images can also be different in perspective and in curvature.
The coarse alignment module 33 produces a general alignment of the two images, and then the fine alignment module 3S uses robust motion flow to rapidly and accurately complete matching of the images. The display device 37 can 2S present the matched images in different ways. In one embodiment, the display 37 alternates between the two images at about ~ to 20 Hz, but usually about 12 Hz, so that the observer views the images superimposed as a composite image S9, as shown in Figure 2c. As can be seen in the example, the treated area SS' in the matched portal image, overlays the tumor S 1 ' in the matched simulation image. In another type of display (not shown), the outline of the treated area from the portal image is projected onto the processed simulation image) so that it can be seen if the targeted tumor was in fact treated.
_g_ In performing the coarse alignment, a coarse transformation is applied.
to the digitized x-ray or portal image signals (DPIS) to convert them to the coordinate system of the digital reference or simulation image signals (DSIS).
As will be seen, the information needed to generate this transformation can be generated interactively through selection of what appear to be corresponding points in the two images by the operator interactively using a pointer device 43 or automatically using x-ray opaque fiducials 61 which are placed on the patient in both the simulation setup and the treatment setup (see Figure 1 ) . The points so generated in either case are referred to as seed points. The coarse transform H from the portal image coordinates to the simulation coordinates is:
RotSkewScale RotSkewScale translation SimltlatlOllz ~ U z /lOrlalx simulations = RotSkewScale~ RotSkewScale~ translation, ~ portah, (EQ~ 1) The (x y) vector denotes the column and row coordinates of the center of each of the seed points in the corresponding portal and simulation images.
The four RotSkewScale components of the matrix describe the full affine transformation that is needed to coarsely align the images. In this stage, the placement of the fiducial or the interactive selection of the seed points need not be accurate as the next stage is able to accommodate for reasonably small deviations.
Using the results of the coarse alignment, the portal image is warped toward the simulation image. Then, overlapping regions of the two images are computer enhanced so that the corresponding intensity levels are similar.
Finally, the motion-flow, or the fine-scale transform is computed so that the portal image glides on the gradient of dissimilarity toward the simulation image. In this stage, a more comprehensive transformation model is used in which the input position vector is represented by:
1 x y 0 0 0 x2 x ~ y 0 (EQ.2) X(x) _ 0 0 0 1 x y x ~ y y2 x2 and the transformation matrix is represented by:
E .3 Q = ~ao a~ a2 a3 a4 a5 po p1 c~ ( Q ) so that the result is:
a (x~Q)=X (x) ' Q (EQ' 4) where0 portal (x;Q) = a (x;Q) and portal (x) = X (x) . The parameters a o through a 5 include the affine transform as in the coarse alignment, whereas the parameters po, pl include the perspective transformation, and c covers the deformation that can be caused by breathing, etc.
To recover the parameters of the vector Q we formulate the image dissimilarity as a result of motion-flow, or distance between the two images.
1(x~t) = I(x - (X(x) ' Qf~+1)) (EQ. 5) for 'dx E f , where f is the region of the image we compute the transformation over.
In (EQ. 5), I(x) is the intensity function at point x, the image at t + 1 is the portal image, and at t is the simulation image. By using various derivation techniques, we ' formulate the motion-flow using the gradient (or dissimilarity gradient) as below:
al ~I(X(x) ~ Qf) + at = 0 (EQ. 6) for dx E f .
In this stage, a robust regression method is employed, using unconstrained optimization, to calculate the elements of Q (see {EQ. 3)). This technique enables us to cope with the 'reasonably small' deviations from the coarse alignment stage, as well as any residual dissimilarity between the two images.
Using the robust technique ensures that only the dominant transformation will be recovered without running into the risk of being affected by the noise and residual errors.
Figures 3-11 are flow charts of software which implements the invention. Figure 3 illustrates the main routine 100 which includes performing a coarse alignment, either interactively at block 110 or automatically at block 120.
In both cases a rough approximation of the transformation between the portal image and the simulation image is calculated using Equation 1. The user then has the option of determining whether the rough approximation has provided a satisfactory alignment of the images at 130. If so, the procedure is completed. If not, a fine alignment is performed. As discussed, the invention can also be used to track patient movement, in which case the transformation between the two images is utilized at 140 to roughly determine the updated position of the fiducials. If requested by the user in image matching and during tracking, the images are prepared for the fine alignment at 150. The refined image transformation is then calculated at l60 and if the image matching mode is selected as determined at 170, the transform is accomplished and the images are displayed at 180 in the manner discussed above. If the tracking mode has been selected at 190, the routine returns to 140 for generating the next position. The user again has the final decision at 200 to determine whether the image matching is satisfactory. If not, the routine returns to 110 and the rough calculation is re-initiated.
The procedure for calculating the rough approximation of the transformation interactively called for at block I 10 in Figure 3 is illustrated in detail in Figure 4. The user selects corresponding seed points or areas in the portal image and the simulation image using, for instance, the mouse 43 as indicated at 111. The selected areas or points are then used to compute the rough transformation between the portal image and the simulation image by calling a procedure A as indicated at 112. This rough transform is then used to transform the portal image to simulation image coordinates by calling procedure B as indicated at 113. The images are then displayed on the monitor 37 as indicated at 114.
The details of procedure A used to calculate the rough transform are shown in Figure 5 . If the user has indicated an area as determined at A 1, the system automatically selects random points from inside the area as corresponding as indicated at A2. Then, or if the user has selected points rather than an area, the corresponding point pairs are used to calculate the transform parameters using the least squares (LSQ) method as indicated at A3.
The details of procedure B for transforming the portal to simulation coordinates is shown in Figure 5. First, the row and column limits of the resulting transformed portal image are determined at Bl using the transformation matrix H, which is the inverse of Equation 1. The resulting portal image is then raster scanned at B2, and for each pixel the location is determined using the transformation. The intensity value for each pixel is calculated next using linear interpolation between the surrounding pixel locations in the original portal image.
The routine 120 for performing the coarse alignment automatically using fiducials on the patient is shown in Figure 7. The x-ray opaque fiducials 61 are detected in both the portal and simulation images at 12l and the corresponding markers are identified at 122. The image transform is then computed at 123 using procedure A of Figure 5 and the centroid of each of the markers as the seed points.
The portal image is then transformed at 124 to simulation coordinates using the computed transformation and procedure B of Figure 6. When in the matching mode as determined at 125, the images are displayed at l26 in the manner discussed above in connection with Figures 2a-c.
The routine 150 for preparing the coarse aligned digital image signals for fine alignment is shown in Figure 8. First, the region of intersection over overlap between the simulation and portal images is calculated at 151 using the transformation of Equation 1. Next, the largest rectangular region that fits within the intersection region is calculated at l52. Other regular geometric shapes, such as a square and so forth, could be used in place of the rectangle. New images representing the rectangular intersection region of the portal and simulation image are formed at 153. These resulting images are then enhanced at 154 to generate prepared digital image signals. Various forms of enhancement such as histogram equalization, Iapalcian of the Gaussian, high-pass filtering and other techniques are used to produce the prepared images with similar dynamic range and pixel intensities.
Figure 9 illustrates the routine 160 for calculating the updated transformation for a fine alignment. This process is performed at several levels of resolution of the digital image signals beginning with the lowest resolution, which in the example is about one-eighth resolution. Thus, at l61 the images at the lowest resolution for the prepared portal and simulation images are formed. These images are updated using the latest updated transformation parameters, that is, transformation parameters calculated at the previous level of resolution, at 162. An important part of the invention is that robust motion flow is used to perform the fine alignment. In particular, the motion flow gradient components are generated at 163.
Application of motion flow using gradient components is described by M. J.
Black and P. Anandan in a paper entitled, "A Framework For The Robust Estimation Of Optical Flow" published in Proc. 4th Intl. Conf. on Computer Vision (ICCV 93), Berlin, Germany, May 1993. Motion flow is applied to the motion required to cause pixels on one image to flow into alignment with corresponding pixels in the other image. Robust motion applies to the motion by which most of the pixels which have moved have moved similarly, while there may be others exhibiting different motion. The updated image transformation parameters are then calculated at 164 using robust optimization. If the upper limit of resolution has not been reached as determined at 165, then the resolution is incremented at 166 and updated transformation parameters are recalculated at the new level of resolution.
When the highest level of resolution has been reached at 165, the final transformation matrix Q is generated at 167. The details of the routine for calculating the updated image transformation parameters using robust optimization of block l64 in Figure 9 is shown in Figure 10. As described in the paper by Black and Anandan discussed above, the robust motion is represented by data points called inliers. Those exhibiting other motion are identified as outliers. In the present invention, the data points are the pixel values. The pixels are successively separated into inliers and outliers based upon their contribution to a consistent motion flow vector. The pixels in the inlier set are used to calculate the dominant motion flow, and their contribution to it is dependent on their weight factors which are calculated during the robust optimization.
Referring particularly to Figure 10, a loop is entered at 164.1 where each of the inlier points is marked using individual weight factors.
Initially, the weight factors of the pixels are all set to 1 so that all of the pixels are inliers. At 164.2, an optimization parameter, Q, which determines the sensitivity of the procedure to outliers is set. The weight factors are dependent on this parameter, Q.
The lower the value of Q, the more points are eliminated as inliers and the closer the inliers become to the current estimate of the motion flow vector. Hence, a large 6 is used initially so that all points are included. On successive loops, Q is lowered to eliminate more and more outliers. This lowering of Q is referred to as Q
scheduling. The Q scheduling must be done carefully. If 6 is lowered too fast, a solution may be missed, while on the other hand, lowering Q too slowly increases the processing time. In accordance with the invention, 6 is lowered depending upon the largest error in the motion flow parameters. Following this, another loop is entered at 164.3 in which each of the inlier data points is used in the calculation of the updated values for the transformation parameters of the Q matrix at 164.4.
The equations used at 164.4 are derived preferably using the conjugate gradient, although gradient descent can also be used. In addition, motion flow and robust statistics are used in deriving equations fox determining the transformation parameters. The error in the transformation parameters, which is the change from the last calculation, as well as Q, are used at l64.5 to adjust the weight factors for the pixels. When a11 of the inlier data points/pixels have been used as determined at 164.3, a check is made at 164.6 to determine if the solution has converged to the desired degree. If not, the routine returns to 164.1 and the inlier data points are again marked using the updated weight factors.
Figure 11 illustrates the tracking routine on 140. As indicated at 141, the incremental updates and the transform H and/or Q are combined so that the transform always relates back to the original simulation or reference image.
On the initial pass through the tracking routine, the then current portal image replaces the simulation image if used, and then a new portal image is acquired at 143. As tracking continues, successive portal images are matched with the next preceding portal image to generate the updated transform. As indicated at 144, the successive positions of the fiducials or changes in the pattern of the fiducials from successive portal images is used to generate cracking signals for controlling the radiotherapy equipment such as turning the beam on and off and/or driving the patient positioning assembly.
While specific embodiments of the invention have been described in detail, it will be appreciated by those skilled in the art that various modifications and alternatives to those details could be developed in light of the overall teachings of the disclosure. Accordingly, the particular arrangements disclosed are meant to be illustrative only and not limiting as to the scope of invention which is to be given the full breadth of the claims appended and any and all equivalents thereof.
Claims (26)
1. Apparatus (27) for automatically matching an x-ray image (53) with a reference image (45), said apparatus comprising:
means (29) digitizing said x-ray image (53) and reference image (45) to generate first digital image signals and second digital image signals, respectively;
processing means (31) processing said first and second digital signals without input of any physical dimensions of any features within said images to generate matched digital image signals; and output means (37) generating an output from said matched digital image signals.
means (29) digitizing said x-ray image (53) and reference image (45) to generate first digital image signals and second digital image signals, respectively;
processing means (31) processing said first and second digital signals without input of any physical dimensions of any features within said images to generate matched digital image signals; and output means (37) generating an output from said matched digital image signals.
2. The apparatus (27) of Claim 1 wherein said processing means (31) comprises coarse alignment means (33) generating coarse aligned digital images signals from said first and second digital image signals, and fine alignment means (35, 160) generating a transform between said coarse aligned digital image signals for overlapping regions of said x-ray and reference images utilizing robust motion flow, and means (167) applying said transform to one of said coarse aligned digital image signals to generate said matched digital image signals.
3. The apparatus (27) of Claim 2 wherein said fine alignment means (35) comprises means (154) enhancing said coarse aligned digital image signals to generate prepared coarse aligned image signals having similar dynamic ranges and intensities, and means (160) generating said transform between said prepared coarse aligned digital image signals utilizing robust motion flow.
4. The apparatus (27) of claim 1, wherein said x-ray image (53) is a portal image and said reference image (45) is a simulation image and said means (29) digitizing said portal image and said simulation image generates said digital image signals and second digital image signals as digital portal image signals (DPIS) and digital simulation image signals (DSIS), respectively, and wherein said processing means (31) comprises coarse alignment means (33) generating coarse aligned DPIS and DSIS from said DPIS and DSIS, and fine alignment means (35) generating said matched DPIS and DSIS from said coarse aligned DPIS and DSIS
for overlapping regions of said simulation and portal images.
for overlapping regions of said simulation and portal images.
5. The apparatus (27) of Claim 4, wherein said coarse alignment means (33) comprises means (111, 121, 122) selecting corresponding seed points in said portal image (53) represented by said DPIS and said simulation image (45) represented by said DSIS, means (112, 123) computing a transform between said portal image (53) and said simulation image (45) from said corresponding seed points, and means (113, 124) applying said transform to one of said DPIS said DSIS
to generate with the other of said DPIS and DSIS said coarse aligned DPIS and DSIS.
to generate with the other of said DPIS and DSIS said coarse aligned DPIS and DSIS.
6. The apparatus (27) of Claim 5, wherein said means (111) selecting corresponding seed points comprises interactive means (43) selecting corresponding points in displays generated from said DPIS and DSIS.
7. The apparatus (27) of Claim 5, wherein said means ( 121, 122) selecting corresponding seed points comprises means (121) detecting x-ray opaque fiducials in said DPIS and said DSIS, and means (122) identifying corresponding fiducials in said DPIS and DSIS as said corresponding seed points.
8. The apparatus (27) of Claim 5, wherein said fine alignment means (33) comprises means (150) generating prepared DPIS and DSIS from said coarse aligned DPIS and DSIS, means (161-165) generating an updated transform from said prepared DPIS and DSIS, and means (167) applying said updated transform to one of said coarse and prepared DPIS and DSIS to generate said matched DPIS and DSIS.
9. The apparatus (27) of Claim 4, wherein said fine alignment means (33) comprises means (150) generating prepared DPIS and DSIS from said coarse aligned DPIS and DSIS, means (161-165) generating an updated transform from said prepared DPIS and DSIS, and means (167) applying said updated transform to one of said coarse and prepared DPIS and DSIS to generate said matched DPIS and DSIS.
10. The apparatus (27) of Claim 9, wherein said means (150) generating said prepared DPIS and DSIS comprises means (151, 152) selecting selected DPIS
and selected DSIS for regions of images represented by said DPIS and DSIS
which intersect.
and selected DSIS for regions of images represented by said DPIS and DSIS
which intersect.
11. The apparatus (27) of Claim 10, wherein said means (150) generating said prepared DPIS and DSIS further includes means (154) enhancing said selected DPIS and DSIS.
12. The apparatus (27) of Claim 11, wherein said means (151 , 152) selecting said selected DPIS and selected DSIS further includes means (152) selecting DPIS and DSIS within a portion of regions of images represented by said DPIS and DSIS, which have a predetermined regular shape.
13. The apparatus (27) of Claim 9, wherein said means (161-165) generating said updated transform comprises means generating motion flow components (163) from said prepared DPIS and DSIS and calculating means (164) calculating said updated transform from said motion flow components.
14. The apparatus (27) of Claim 13, wherein said means (163) generating motion flow components generates motion flow gradient components, and said calculating means (164) comprises means applying a robust optimization to calculate said updated transform.
15. The apparatus (27) of Claim 14, wherein said means (161 -165) generating said updated transform comprises means (161, 162, 166) utilizing said means (163) generating motion flow gradient components and said calculating means (164) repetitively using successive ascending levels of resolution of said prepared DPIS and DSIS.
16. The apparatus (27) of Claim 9, wherein said means (161 -165) generating said updated transform comprises means (161, 162, 166) using successive ascending levels of resolution of said prepared DPIS and DSIS to generate said updated transform.
17. The apparatus (27) of Claim 9, wherein said means (161-166) generating said updated transform comprises means (164) applying robust motion flow to said prepared DPIS and DSIS.
18. The apparatus (27) of Claim 17, wherein said means (164) applying robust motion flow to said prepared DPIS and DSIS applies robust motion flow to successive ascending levels of resolution of said DPIS and DSIS.
19. The apparatus (27) of any of claims 1 through 18, wherein said output means (37, 140) comprises display means generating a display (59) from said matched digital image signals DPIS and DSIS.
20. The apparatus (20) of claim 1, wherein said x-ray image (53) and reference image (45) are successive portal images, said means (29) digitizing said successive portal images generates said first digital image signals and second digital image signals as successive sets of digital portal image signals (DPIS) and said processing means (31) comprises tracking means (140, 150, 160) tracking movement between said successive sets of DPIS.
21. The apparatus (27) of Claim 20, wherein said tracking means (140, 150, 160) comprises means (160) generating an updated transform between successive portal images (53) by applying robust motion flow to said successive sets of DPIS and means (140) using said updated transform to track said movement between said successive sets of DPIS.
22. The apparatus (27) of Claim 21, wherein said means (160) generating said updated transform comprises means (163) generating motion flow components from said successive sets of DPIS, and means (164) calculating said updated transform between successive portal images using said motion flow components.
23. The apparatus (27) of Claim 22, wherein said means (163) generating motion flow components generates motion flow gradient components, and wherein said calculating means (164) comprises means applying a robust optimization to calculate said updated transform.
24. The apparatus (27) of Claim 23, wherein said means (160) generating said updated transform comprises means (166) utilizing said means (163) generating motion flow gradient components and said calculating means (164) repetitively using successive ascending levels of resolution of said successive sets of DPIS.
25. The apparatus (27) of any of claims 20 through 24, wherein said output means (37, 140) comprises positioning means (15') positioning a patient relative to a radiation beam (11) which generates said portal image (53), and means controlling said positioning means (15') in response to movement tracked by said tracking means (140).
26. The apparatus (27) of any of claims 20 through 24, wherein said output means (37, 140) includes means (9') controlling generation of a radiation beam (11) producing said portal image (53) in response to movement tracked by said tracking means (140).
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US08/739,622 US5784431A (en) | 1996-10-29 | 1996-10-29 | Apparatus for matching X-ray images with reference images |
| US08/739,622 | 1996-10-29 | ||
| PCT/US1997/019538 WO1998019272A1 (en) | 1996-10-29 | 1997-10-28 | Apparatus for matching x-ray images with reference images |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2270357A1 true CA2270357A1 (en) | 1998-05-07 |
Family
ID=24973119
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002270357A Abandoned CA2270357A1 (en) | 1996-10-29 | 1997-10-28 | Apparatus for matching x-ray images with reference images |
Country Status (8)
| Country | Link |
|---|---|
| US (1) | US5784431A (en) |
| EP (1) | EP0934573A1 (en) |
| JP (1) | JP2001503176A (en) |
| KR (1) | KR20000052875A (en) |
| CN (1) | CN1235684A (en) |
| AU (1) | AU5002997A (en) |
| CA (1) | CA2270357A1 (en) |
| WO (1) | WO1998019272A1 (en) |
Families Citing this family (117)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU3880397A (en) * | 1996-07-11 | 1998-02-09 | Board Of Trustees Of The Leland Stanford Junior University | High-speed inter-modality image registration via iterative feature matching |
| US6597818B2 (en) | 1997-05-09 | 2003-07-22 | Sarnoff Corporation | Method and apparatus for performing geo-spatial registration of imagery |
| US6512857B1 (en) * | 1997-05-09 | 2003-01-28 | Sarnoff Corporation | Method and apparatus for performing geo-spatial registration |
| GB9724110D0 (en) * | 1997-11-15 | 1998-01-14 | Elekta Ab | Analysis of radiographic images |
| GB2360684B (en) * | 1997-11-15 | 2001-12-19 | Elekta Ab | Analysis of radiographic images |
| US6279579B1 (en) * | 1998-10-23 | 2001-08-28 | Varian Medical Systems, Inc. | Method and system for positioning patients for medical treatment procedures |
| US6973202B2 (en) * | 1998-10-23 | 2005-12-06 | Varian Medical Systems Technologies, Inc. | Single-camera tracking of an object |
| US6937696B1 (en) | 1998-10-23 | 2005-08-30 | Varian Medical Systems Technologies, Inc. | Method and system for predictive physiological gating |
| US7158610B2 (en) * | 2003-09-05 | 2007-01-02 | Varian Medical Systems Technologies, Inc. | Systems and methods for processing x-ray images |
| US8788020B2 (en) | 1998-10-23 | 2014-07-22 | Varian Medical Systems, Inc. | Method and system for radiation application |
| US6621889B1 (en) * | 1998-10-23 | 2003-09-16 | Varian Medical Systems, Inc. | Method and system for predictive physiological gating of radiation therapy |
| AU771104B2 (en) | 1998-10-23 | 2004-03-11 | Varian Medical Systems Technologies, Inc. | Method and system for physiological gating of radiation therapy |
| US6980679B2 (en) * | 1998-10-23 | 2005-12-27 | Varian Medical System Technologies, Inc. | Method and system for monitoring breathing activity of a subject |
| US6754374B1 (en) | 1998-12-16 | 2004-06-22 | Surgical Navigation Technologies, Inc. | Method and apparatus for processing images with regions representing target objects |
| DE69943026D1 (en) * | 1998-12-16 | 2011-01-20 | Michael I Miller | METHOD AND DEVICE FOR PROCESSING IMAGES WITH REGIONS REPRESENTING TARGET OBJECTS |
| US6694057B1 (en) | 1999-01-27 | 2004-02-17 | Washington University | Method and apparatus for processing images with curves |
| US6778850B1 (en) * | 1999-03-16 | 2004-08-17 | Accuray, Inc. | Frameless radiosurgery treatment system and method |
| US6501981B1 (en) * | 1999-03-16 | 2002-12-31 | Accuray, Inc. | Apparatus and method for compensating for respiratory and patient motions during treatment |
| US6587601B1 (en) | 1999-06-29 | 2003-07-01 | Sarnoff Corporation | Method and apparatus for performing geo-spatial registration using a Euclidean representation |
| JP2003536134A (en) * | 2000-06-02 | 2003-12-02 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Method and apparatus for merging images into a composite image |
| US6909792B1 (en) * | 2000-06-23 | 2005-06-21 | Litton Systems, Inc. | Historical comparison of breast tissue by image processing |
| KR100453509B1 (en) * | 2000-08-25 | 2004-10-20 | (주)바이오메디시스 | method for attaching memo to a digital dental X-ray image and sending the attached one by email, and recording medium storing program for the same |
| US6422750B1 (en) * | 2000-12-22 | 2002-07-23 | Ge Medical Systems Global Technology Company, Llc | Digital x-ray imager alignment method |
| US7769430B2 (en) * | 2001-06-26 | 2010-08-03 | Varian Medical Systems, Inc. | Patient visual instruction techniques for synchronizing breathing with a medical procedure |
| US6810107B2 (en) * | 2001-11-02 | 2004-10-26 | Siemens Medical Solutions Usa, Inc. | System and method for measuring beam quality and dosimetry using electronic portal imaging |
| US6810108B2 (en) | 2001-11-02 | 2004-10-26 | Siemens Medical Solutions Usa, Inc. | System and method for positioning an electronic portal imaging device |
| US6839404B2 (en) * | 2001-11-02 | 2005-01-04 | Siemens Medical Solutions Usa, Inc. | System and method for positioning an electric portal imaging device |
| US20030086596A1 (en) * | 2001-11-07 | 2003-05-08 | Medical Metrics, Inc. | Method, computer software, and system for tracking, stabilizing, and reporting motion between vertebrae |
| EP1459257B1 (en) * | 2001-12-07 | 2016-08-31 | Koninklijke Philips N.V. | Medical viewing system and method for spatially enhancing structures in noisy images |
| DE10160611A1 (en) * | 2001-12-11 | 2003-06-26 | Siemens Ag | Medical imaging facility |
| ES2217210T3 (en) * | 2002-02-22 | 2004-11-01 | Brainlab Ag | REDUCED HEIGHT CALIBRATION INSTRUMENT. |
| EP1348394B1 (en) | 2002-03-27 | 2006-02-22 | BrainLAB AG | Planning or navigation assistance by generic obtained patient data with two-dimensional adaptation |
| EP1348393B1 (en) | 2002-03-27 | 2007-03-21 | BrainLAB AG | Medical navigation or pre-operative treatment planning supported by generic patient data |
| ES2277087T3 (en) * | 2002-07-09 | 2007-07-01 | Aecc Enterprises Limited | METHOD FOR REPRESENTATION WITH IMAGES THE RELATIVE MOVEMENT OF SKELETAL SEGMENTS. |
| US20040068182A1 (en) * | 2002-09-18 | 2004-04-08 | Misra Satrajit Chandra | Digitally reconstruced portal image and radiation therapy workflow incorporating the same |
| US20060111630A1 (en) * | 2002-12-11 | 2006-05-25 | Thomas Netsch | Method of tomographic imaging |
| US7412029B2 (en) * | 2003-06-25 | 2008-08-12 | Varian Medical Systems Technologies, Inc. | Treatment planning, simulation, and verification system |
| US20050054910A1 (en) * | 2003-07-14 | 2005-03-10 | Sunnybrook And Women's College Health Sciences Centre | Optical image-based position tracking for magnetic resonance imaging applications |
| US7873403B2 (en) * | 2003-07-15 | 2011-01-18 | Brainlab Ag | Method and device for determining a three-dimensional form of a body from two-dimensional projection images |
| US20050053267A1 (en) * | 2003-09-05 | 2005-03-10 | Varian Medical Systems Technologies, Inc. | Systems and methods for tracking moving targets and monitoring object positions |
| US8571639B2 (en) * | 2003-09-05 | 2013-10-29 | Varian Medical Systems, Inc. | Systems and methods for gating medical procedures |
| FI20031835A (en) * | 2003-12-15 | 2005-06-16 | Instrumentarium Corp | Procedure and system for locating a reference mark in digital projection images |
| WO2005081178A1 (en) * | 2004-02-17 | 2005-09-01 | Yeda Research & Development Co., Ltd. | Method and apparatus for matching portions of input images |
| JP2006014931A (en) * | 2004-07-01 | 2006-01-19 | Fuji Photo Film Co Ltd | Image diagnostic reading support system, image positioning device, image output device, and program |
| AU2005267078B8 (en) | 2004-07-21 | 2009-05-07 | Mevion Medical Systems, Inc. | A programmable radio frequency waveform generator for a synchrocyclotron |
| US20060074305A1 (en) * | 2004-09-30 | 2006-04-06 | Varian Medical Systems Technologies, Inc. | Patient multimedia display |
| DE102005016256B3 (en) * | 2005-04-08 | 2006-06-08 | Siemens Ag | Displaying preoperative three-dimensional images with two-dimensional x-ray image acquisition involves repeatedly generating two-dimensional representations with varying parameters and displaying them on a screen |
| WO2006113323A2 (en) | 2005-04-13 | 2006-10-26 | University Of Maryland, Baltimore | Techniques for compensating movement of a treatment target in a patient |
| US9119541B2 (en) * | 2005-08-30 | 2015-09-01 | Varian Medical Systems, Inc. | Eyewear for patient prompting |
| EP2389981A3 (en) | 2005-11-18 | 2012-03-07 | Still River Systems, Inc. | Charged particle radiation therapy |
| US7564950B2 (en) * | 2006-02-17 | 2009-07-21 | Siemens Medical Solutions Usa, Inc. | Multi-leaf collimator based field size clipping for automatic adaptation to allowed image area |
| US8676293B2 (en) * | 2006-04-13 | 2014-03-18 | Aecc Enterprises Ltd. | Devices, systems and methods for measuring and evaluating the motion and function of joint structures and associated muscles, determining suitability for orthopedic intervention, and evaluating efficacy of orthopedic intervention |
| US7676061B2 (en) * | 2006-05-02 | 2010-03-09 | Telesis Technologies, Inc. | Laser safety system |
| EP2029018A2 (en) * | 2006-06-01 | 2009-03-04 | Philips Intellectual Property & Standards GmbH | Hierarchical motion estimation |
| EP1868157A1 (en) | 2006-06-14 | 2007-12-19 | BrainLAB AG | Shape reconstruction using X-ray images |
| US7848592B2 (en) | 2006-07-31 | 2010-12-07 | Carestream Health, Inc. | Image fusion for radiation therapy |
| US8160364B2 (en) * | 2007-02-16 | 2012-04-17 | Raytheon Company | System and method for image registration based on variable region of interest |
| WO2008139374A1 (en) * | 2007-05-11 | 2008-11-20 | Philips Intellectual Property & Standards Gmbh | Method for planning 2d x-ray examinations |
| US7953247B2 (en) * | 2007-05-21 | 2011-05-31 | Snap-On Incorporated | Method and apparatus for wheel alignment |
| WO2009012577A1 (en) * | 2007-07-20 | 2009-01-29 | Resonant Medical Inc. | Methods and systems for compensating for changes in anatomy of radiotherapy patients |
| NO2190530T3 (en) * | 2007-09-13 | 2018-04-07 | ||
| DK2197547T3 (en) * | 2007-09-13 | 2014-07-07 | Toby D Henderson | IMAGING POSITIONING SYSTEM AND HAVING ROBOT LOCATED D-ARM |
| US7933380B2 (en) * | 2007-09-28 | 2011-04-26 | Varian Medical Systems International Ag | Radiation systems and methods using deformable image registration |
| US20090099481A1 (en) | 2007-10-10 | 2009-04-16 | Adam Deitz | Devices, Systems and Methods for Measuring and Evaluating the Motion and Function of Joints and Associated Muscles |
| US8933650B2 (en) | 2007-11-30 | 2015-01-13 | Mevion Medical Systems, Inc. | Matching a resonant frequency of a resonant cavity to a frequency of an input voltage |
| US8581523B2 (en) | 2007-11-30 | 2013-11-12 | Mevion Medical Systems, Inc. | Interrupted particle source |
| CN101903885A (en) * | 2007-12-18 | 2010-12-01 | 皇家飞利浦电子股份有限公司 | Consistency metric based image registration |
| US8825136B2 (en) * | 2008-03-14 | 2014-09-02 | Baylor Research Institute | System and method for pre-planning a radiation treatment |
| US8170319B2 (en) * | 2008-09-05 | 2012-05-01 | Siemens Medical Solutions Usa, Inc. | Motion detection by direct imaging during radiotherapy |
| US20100061596A1 (en) * | 2008-09-05 | 2010-03-11 | Varian Medical Systems Technologies, Inc. | Video-Based Breathing Monitoring Without Fiducial Tracking |
| US10667727B2 (en) * | 2008-09-05 | 2020-06-02 | Varian Medical Systems, Inc. | Systems and methods for determining a state of a patient |
| US8394007B2 (en) * | 2008-10-31 | 2013-03-12 | Toby D Henderson | Inclined beamline motion mechanism |
| JP2010183976A (en) * | 2009-02-10 | 2010-08-26 | Mitsubishi Heavy Ind Ltd | Radiotherapy apparatus controller and irradiation method |
| US8437577B2 (en) * | 2009-03-05 | 2013-05-07 | Tektronix, Inc. | Methods and systems for image registration |
| US9138163B2 (en) | 2009-09-25 | 2015-09-22 | Ortho Kinematics, Inc. | Systems and devices for an integrated imaging system with real-time feedback loop and methods therefor |
| US8758263B1 (en) | 2009-10-31 | 2014-06-24 | Voxel Rad, Ltd. | Systems and methods for frameless image-guided biopsy and therapeutic intervention |
| US10657613B2 (en) * | 2010-06-17 | 2020-05-19 | Koninklijke Philips N.V. | Identity matching of patient records |
| US9014485B2 (en) * | 2010-07-21 | 2015-04-21 | Armin E. Moehrle | Image reporting method |
| EP2651295A4 (en) | 2010-12-13 | 2015-11-18 | Ortho Kinematics Inc | Methods, systems and devices for clinical data reporting and surgical navigation |
| US8837791B2 (en) * | 2010-12-22 | 2014-09-16 | Kabushiki Kaisha Toshiba | Feature location method and system |
| WO2012129653A1 (en) | 2011-03-31 | 2012-10-04 | Soboleski Donald A | Method and device for comparing radiographic images |
| JP5693388B2 (en) * | 2011-06-10 | 2015-04-01 | 三菱電機株式会社 | Image collation device, patient positioning device, and image collation method |
| RU2014138059A (en) * | 2012-02-21 | 2016-04-10 | Конинклейке Филипс Н.В. | ADAPTIVE RADIOTHERAPY WITH SPECTRAL VISUALIZATION AND TRACKING OF INTERESTING TISSUE |
| CN102670234B (en) * | 2012-05-17 | 2013-11-20 | 西安一体医疗科技有限公司 | Gamma radiation beam position verifying device and method |
| CN102697561A (en) * | 2012-05-17 | 2012-10-03 | 深圳市一体医疗科技股份有限公司 | Non-invasive in-vitro tumor positioning system and method by fixing mark points |
| US10254739B2 (en) | 2012-09-28 | 2019-04-09 | Mevion Medical Systems, Inc. | Coil positioning system |
| EP3581242B1 (en) | 2012-09-28 | 2022-04-06 | Mevion Medical Systems, Inc. | Adjusting energy of a particle beam |
| US9155186B2 (en) | 2012-09-28 | 2015-10-06 | Mevion Medical Systems, Inc. | Focusing a particle beam using magnetic field flutter |
| WO2014052718A2 (en) | 2012-09-28 | 2014-04-03 | Mevion Medical Systems, Inc. | Focusing a particle beam |
| TW201424467A (en) | 2012-09-28 | 2014-06-16 | Mevion Medical Systems Inc | Controlling intensity of a particle beam |
| CN104822417B (en) | 2012-09-28 | 2018-04-13 | 梅维昂医疗系统股份有限公司 | Control system for particle accelerator |
| EP3581243A1 (en) | 2012-09-28 | 2019-12-18 | Mevion Medical Systems, Inc. | Controlling particle therapy |
| WO2014052708A2 (en) | 2012-09-28 | 2014-04-03 | Mevion Medical Systems, Inc. | Magnetic shims to alter magnetic fields |
| WO2014052716A2 (en) | 2012-09-28 | 2014-04-03 | Mevion Medical Systems, Inc. | Magnetic field regenerator |
| KR101440826B1 (en) * | 2013-02-05 | 2014-09-23 | 광주과학기술원 | Image registration method and apparatus |
| US8791656B1 (en) | 2013-05-31 | 2014-07-29 | Mevion Medical Systems, Inc. | Active return system |
| US9730308B2 (en) | 2013-06-12 | 2017-08-08 | Mevion Medical Systems, Inc. | Particle accelerator that produces charged particles having variable energies |
| CN110237447B (en) | 2013-09-27 | 2021-11-02 | 梅维昂医疗系统股份有限公司 | Particle therapy system |
| WO2015085252A1 (en) * | 2013-12-06 | 2015-06-11 | Sonitrack Systems, Inc. | Radiotherapy dose assessment and adaptation using online imaging |
| US9962560B2 (en) | 2013-12-20 | 2018-05-08 | Mevion Medical Systems, Inc. | Collimator and energy degrader |
| US10675487B2 (en) | 2013-12-20 | 2020-06-09 | Mevion Medical Systems, Inc. | Energy degrader enabling high-speed energy switching |
| US9661736B2 (en) | 2014-02-20 | 2017-05-23 | Mevion Medical Systems, Inc. | Scanning system for a particle therapy system |
| US9950194B2 (en) | 2014-09-09 | 2018-04-24 | Mevion Medical Systems, Inc. | Patient positioning system |
| EP3034000A1 (en) * | 2014-12-16 | 2016-06-22 | Agfa Healthcare | Motion correction method in dual energy radiography |
| US20160354161A1 (en) | 2015-06-05 | 2016-12-08 | Ortho Kinematics, Inc. | Methods for data processing for intra-operative navigation systems |
| US10786689B2 (en) | 2015-11-10 | 2020-09-29 | Mevion Medical Systems, Inc. | Adaptive aperture |
| CN109803723B (en) | 2016-07-08 | 2021-05-14 | 迈胜医疗设备有限公司 | Particle therapy system |
| US10881466B2 (en) | 2016-08-29 | 2021-01-05 | Covidien Lp | Systems, methods, and computer-readable media of providing distance, orientation feedback and motion compensation while navigating in 3D |
| US11103730B2 (en) | 2017-02-23 | 2021-08-31 | Mevion Medical Systems, Inc. | Automated treatment in particle therapy |
| US11478662B2 (en) | 2017-04-05 | 2022-10-25 | Accuray Incorporated | Sequential monoscopic tracking |
| WO2019006253A1 (en) | 2017-06-30 | 2019-01-03 | Mevion Medical Systems, Inc. | Configurable collimator controlled using linear motors |
| US11471217B2 (en) | 2017-12-11 | 2022-10-18 | Covidien Lp | Systems, methods, and computer-readable media for improved predictive modeling and navigation |
| KR102110136B1 (en) * | 2018-11-07 | 2020-05-13 | 한국항공대학교산학협력단 | Video stitching apparatus and method using homography based on feature point accumulation |
| CN109656502A (en) * | 2018-11-30 | 2019-04-19 | 贵州电网有限责任公司 | GIS device digital radiographic double screen shade of gray compares diagnostic method and device automatically |
| US10806339B2 (en) | 2018-12-12 | 2020-10-20 | Voxel Rad, Ltd. | Systems and methods for treating cancer using brachytherapy |
| US11291861B2 (en) | 2019-03-08 | 2022-04-05 | Mevion Medical Systems, Inc. | Delivery of radiation by column and generating a treatment plan therefor |
| CN111161297B (en) * | 2019-12-31 | 2023-06-16 | 上海联影医疗科技股份有限公司 | Method and device for determining edge of beam limiter and X-ray system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5099846A (en) * | 1988-12-23 | 1992-03-31 | Hardy Tyrone L | Method and apparatus for video presentation from a variety of scanner imaging sources |
| US4995068A (en) * | 1989-10-02 | 1991-02-19 | S&S Inficon, Inc. | Radiation therapy imaging apparatus |
| DE4207632C2 (en) * | 1992-03-11 | 1995-07-20 | Bodenseewerk Geraetetech | Device and method for positioning a body part for treatment purposes |
-
1996
- 1996-10-29 US US08/739,622 patent/US5784431A/en not_active Expired - Lifetime
-
1997
- 1997-10-28 JP JP10520700A patent/JP2001503176A/en active Pending
- 1997-10-28 WO PCT/US1997/019538 patent/WO1998019272A1/en not_active Application Discontinuation
- 1997-10-28 CN CN97199273A patent/CN1235684A/en active Pending
- 1997-10-28 KR KR1019990703726A patent/KR20000052875A/en not_active Application Discontinuation
- 1997-10-28 EP EP97912971A patent/EP0934573A1/en not_active Withdrawn
- 1997-10-28 CA CA002270357A patent/CA2270357A1/en not_active Abandoned
- 1997-10-28 AU AU50029/97A patent/AU5002997A/en not_active Abandoned
Also Published As
| Publication number | Publication date |
|---|---|
| WO1998019272A1 (en) | 1998-05-07 |
| EP0934573A1 (en) | 1999-08-11 |
| US5784431A (en) | 1998-07-21 |
| KR20000052875A (en) | 2000-08-25 |
| AU5002997A (en) | 1998-05-22 |
| CN1235684A (en) | 1999-11-17 |
| JP2001503176A (en) | 2001-03-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5784431A (en) | Apparatus for matching X-ray images with reference images | |
| Gilhuijs et al. | Automatic on‐line inspection of patient setup in radiation therapy using digital portal images | |
| US10444855B2 (en) | Imaging system and method for use in surgical and interventional medical procedures | |
| US7480399B2 (en) | Apparatus and method for determining measure of similarity between images | |
| Penney et al. | Validation of a two‐to three‐dimensional registration algorithm for aligning preoperative CT images and intraoperative fluoroscopy images | |
| Penney et al. | A comparison of similarity measures for use in 2-D-3-D medical image registration | |
| US7453984B2 (en) | Real-time target confirmation for radiation therapy | |
| EP2992819B1 (en) | Weighted surface-to-surface mapping | |
| JP4271941B2 (en) | Method for enhancing a tomographic projection image of a patient | |
| EP2175931B1 (en) | Systems for compensating for changes in anatomy of radiotherapy patients | |
| Hristov et al. | A grey‐level image alignment algorithm for registration of portal images and digitally reconstructed radiographs | |
| US6144759A (en) | Method of determining the transformation between an object and its three-dimensional representation, and device for carrying out the method | |
| US9672640B2 (en) | Method for interactive manual matching and real-time projection calculation in imaging | |
| EP1640922A2 (en) | Method of calculating the intersection of a radiation beam with a model surface | |
| KR20050059245A (en) | Method and apparatus for target position verification | |
| WO1998002091A1 (en) | High-speed inter-modality image registration via iterative feature matching | |
| CN104025119A (en) | Imaging system and method for use in surgical and interventional medical procedures | |
| US11941179B2 (en) | Imaging system and method for use in surgical and interventional medical procedures | |
| Penney | Registration of tomographic images to X-ray projections for use in image guided interventions | |
| Munbodh et al. | Automated 2D‐3D registration of a radiograph and a cone beam CT using line‐segment enhancement a | |
| Leszczynski et al. | An image registration scheme applied to verification of radiation therapy. | |
| Weese et al. | 2D/3D registration and motion tracking for surgical interventions | |
| Cheong et al. | Markerless tumor motion tracking in cine images from megavoltage electronic portal imaging device | |
| WO2022120714A1 (en) | Image segmentation method and apparatus, image guidance system, and radiotherapy system | |
| Selby et al. | Pose estimation of eyes for particle beam treatment of tumors |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FZDE | Discontinued |