CA2454861C - Miniature bone-attached surgical robot - Google Patents
Miniature bone-attached surgical robot Download PDFInfo
- Publication number
- CA2454861C CA2454861C CA2454861A CA2454861A CA2454861C CA 2454861 C CA2454861 C CA 2454861C CA 2454861 A CA2454861 A CA 2454861A CA 2454861 A CA2454861 A CA 2454861A CA 2454861 C CA2454861 C CA 2454861C
- Authority
- CA
- Canada
- Prior art keywords
- robot
- image
- surgical
- dimensional image
- bone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/16—Bone cutting, breaking or removal means other than saws, e.g. Osteoclasts; Drills or chisels for bones; Trepans
- A61B17/17—Guides or aligning means for drills, mills, pins or wires
- A61B17/1739—Guides or aligning means for drills, mills, pins or wires specially adapted for particular parts of the body
- A61B17/1757—Guides or aligning means for drills, mills, pins or wires specially adapted for particular parts of the body for the spine
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/70—Manipulators specially adapted for use in surgery
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/70—Manipulators specially adapted for use in surgery
- A61B34/72—Micromanipulators
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
- A61B6/58—Testing, adjusting or calibrating apparatus or devices for radiation diagnosis
- A61B6/582—Calibration
- A61B6/583—Calibration using calibration phantoms
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/70—Manipulators specially adapted for use in surgery
- A61B34/74—Manipulators with manual electric input means
- A61B2034/742—Joysticks
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10T—TECHNICAL SUBJECTS COVERED BY FORMER US CLASSIFICATION
- Y10T74/00—Machine element or mechanism
- Y10T74/20—Control lever and linkage systems
- Y10T74/20207—Multiple controlling elements for single controlled element
- Y10T74/20305—Robotic arm
Abstract
A miniature surgical robot and a method for using it are disclosed. The miniature surgical robot attaches directly with the bone of a patient. Two-dimensional X-ray images of the robot on the bone are registered with three-dimensional images of the bone. This locates the robot precisely on the bone of the patient. The robot is then directed to the pre-operative determined positions based on a pre-operative plan by the surgeon. The robot then moves to the requested surgical site and aligns a sleeve through which the surgeon can insert a surgical tool.
Description
MINIATURE BONE-ATTACHED
SURGICAL ROBOT
TECHNICAL FIELD
The present invention relates to a robotic device. Particularly, this invention relates to a robotic device that attaches to a bone of the patient and aids or performs surgical procedures.
BACKGROUND OF THE INVENTION
Generally, robots are used in many different industries for many different applications. One industry, for example, is the medical industry that uses robots in applications including assisting the surgeon during surgical procedures.
Robots are especially suited for some surgical tasks because they can be constructed to be very steady, computer controlled, and precise in their movements. Characteristics such as these can be especially helpful during surgery on sensitive areas, such as, for example, the vertebral column but are applicable throughout the body.
Typical vertebral column surgical procedures include vertebral fusion, insertion of medical devices such as pedicle screws, discography, percutaneous discectomy, or the like. These procedures typically require a large invasive operation that exposes the patient to a high risk of infection, excessive trauma, fluid loss, post operative pain, scaring, and a lengthy recovery time. Some difficulties relating to surgery on the vertebral column include micro-movement of the vertebral column during the operation, inherently small target objects of the procedure such as the pedicles, extremely delicate nearby nerve tissue, and limited operating room space because large equipment is needed to aid in the procedure, such as C-arm X-ray devices. Furthermore, the patient and operating room staff are exposed to large doses of radiation because these procedures require repeated X-raying and/or fluoroscoping of the surgical site so the surgeon can view the position of surgical tools or implants relative to non-visible body parts.
A need exists for a device that can assist minimally invasive surgery with low radiation exposure while allowing the surgeon to precisely align and control or monitor the surgical procedure. Some prior art devices have attempted to accomplish this however, these devices are either too complicated, not sufficiently accurate, or consume too much operating room space.
One such device is disclosed in U.S. Patent No. 6,226,548. This device combines a navigation system, a bone mounted apparatus, and surgical tools that communicate with the navigation system. This apparatus primarily consists of a clamp that attaches to the patient's spine and extends outward forming a reference arc bearing emitters or a tracking means. All the surgical tools used in this procedure are fitted with emitters or a tracking means similar to the reference arc. The surgical suite is fitted with a navigation system capable of recognizing the emitters or tracking means of the reference arc and surgical tools, a computer system for interpreting the location of the tools, and a video display for the surgeon. After surgically placing the clamp and reference arc on the patient a CT or MRI is taken creating a three-dimensional image of the patient with the attached device. When the patient is in place in the surgical suite with the attached reference arc the navigation system locates the arc and the surgical tools and displays them, relative to each other, on the three-dimensional CT scan.
While the device disclosed in the '548 patent offers some advantages in terms of accuracy and reduced trauma, the advantages of this type of prior art device are limited. The critical part of a surgical tool that must be monitored is the working end of the tool, whether that be a screwdriver or a drill bit or the like. These cannot be tracked with such prior art systems. Transmitters or emitters cannot be attached to the working ends of tools so the computer must estimate the location of the working end by locating the tool generally and extrapolating. This causes inaccuracy and errors that cannot be tolerated in spinal surgery or other high accuracy procedures where the smallest error can result in a serious and permanent outcome. Also, prior art devices
SURGICAL ROBOT
TECHNICAL FIELD
The present invention relates to a robotic device. Particularly, this invention relates to a robotic device that attaches to a bone of the patient and aids or performs surgical procedures.
BACKGROUND OF THE INVENTION
Generally, robots are used in many different industries for many different applications. One industry, for example, is the medical industry that uses robots in applications including assisting the surgeon during surgical procedures.
Robots are especially suited for some surgical tasks because they can be constructed to be very steady, computer controlled, and precise in their movements. Characteristics such as these can be especially helpful during surgery on sensitive areas, such as, for example, the vertebral column but are applicable throughout the body.
Typical vertebral column surgical procedures include vertebral fusion, insertion of medical devices such as pedicle screws, discography, percutaneous discectomy, or the like. These procedures typically require a large invasive operation that exposes the patient to a high risk of infection, excessive trauma, fluid loss, post operative pain, scaring, and a lengthy recovery time. Some difficulties relating to surgery on the vertebral column include micro-movement of the vertebral column during the operation, inherently small target objects of the procedure such as the pedicles, extremely delicate nearby nerve tissue, and limited operating room space because large equipment is needed to aid in the procedure, such as C-arm X-ray devices. Furthermore, the patient and operating room staff are exposed to large doses of radiation because these procedures require repeated X-raying and/or fluoroscoping of the surgical site so the surgeon can view the position of surgical tools or implants relative to non-visible body parts.
A need exists for a device that can assist minimally invasive surgery with low radiation exposure while allowing the surgeon to precisely align and control or monitor the surgical procedure. Some prior art devices have attempted to accomplish this however, these devices are either too complicated, not sufficiently accurate, or consume too much operating room space.
One such device is disclosed in U.S. Patent No. 6,226,548. This device combines a navigation system, a bone mounted apparatus, and surgical tools that communicate with the navigation system. This apparatus primarily consists of a clamp that attaches to the patient's spine and extends outward forming a reference arc bearing emitters or a tracking means. All the surgical tools used in this procedure are fitted with emitters or a tracking means similar to the reference arc. The surgical suite is fitted with a navigation system capable of recognizing the emitters or tracking means of the reference arc and surgical tools, a computer system for interpreting the location of the tools, and a video display for the surgeon. After surgically placing the clamp and reference arc on the patient a CT or MRI is taken creating a three-dimensional image of the patient with the attached device. When the patient is in place in the surgical suite with the attached reference arc the navigation system locates the arc and the surgical tools and displays them, relative to each other, on the three-dimensional CT scan.
While the device disclosed in the '548 patent offers some advantages in terms of accuracy and reduced trauma, the advantages of this type of prior art device are limited. The critical part of a surgical tool that must be monitored is the working end of the tool, whether that be a screwdriver or a drill bit or the like. These cannot be tracked with such prior art systems. Transmitters or emitters cannot be attached to the working ends of tools so the computer must estimate the location of the working end by locating the tool generally and extrapolating. This causes inaccuracy and errors that cannot be tolerated in spinal surgery or other high accuracy procedures where the smallest error can result in a serious and permanent outcome. Also, prior art devices
2 such as these are hand held by the surgeon and thus, limited in accuracy to the surgeon's ability to hold and align the tool.
Furthermore, when using this system, the user must be cautious to not block the line-or-sight between the tool mounted emitters or receivers, the reference arc bearing emitters or receivers, and the navigation system. This can severely limit the ability of the surgeon or surgical team as the tool may actually limit their ability to aid the patient. Also, while such prior art systems do reduce the incision size, they complicate the surgical procedure. Usually a patient is brought into a surgical suite ready for a procedure, the procedure is performed, completed, and the patient leaves.
However, the '548 patent system requires the patient to be put through a surgical procedure to affix the clamp and referencing arc, then the patient is transported to a CT
or MRI, then transported back to the surgical suite in a non-sterile condition for the substantial portion of the procedure to commence. Finally, this system has many components, such as the navigation system and the computer output unit, that clutter up the already limited space in the surgical suite.
Therefore, there is a need in the art for a device with high precision and accuracy that can assist the surgeon in aligning the working end of the surgical tool such that delicate procedures can be preformed percutaneously,with minimal radiation exposure to both the patient and the surgical staff.
According to the present invention, there is provided a system for performing a surgical procedure at a surgical site, comprising:
a surgical robot for manipulating a tool to said surgical site;
an attachment member configured and dimensioned to mount the surgical robot on a bone associated with said surgical site;
an image referencing element adapted to be attached in a known manner to either of said robot and said attachment member; and a controller programmed to direct the robot to position the surgical tool at the surgical site,
Furthermore, when using this system, the user must be cautious to not block the line-or-sight between the tool mounted emitters or receivers, the reference arc bearing emitters or receivers, and the navigation system. This can severely limit the ability of the surgeon or surgical team as the tool may actually limit their ability to aid the patient. Also, while such prior art systems do reduce the incision size, they complicate the surgical procedure. Usually a patient is brought into a surgical suite ready for a procedure, the procedure is performed, completed, and the patient leaves.
However, the '548 patent system requires the patient to be put through a surgical procedure to affix the clamp and referencing arc, then the patient is transported to a CT
or MRI, then transported back to the surgical suite in a non-sterile condition for the substantial portion of the procedure to commence. Finally, this system has many components, such as the navigation system and the computer output unit, that clutter up the already limited space in the surgical suite.
Therefore, there is a need in the art for a device with high precision and accuracy that can assist the surgeon in aligning the working end of the surgical tool such that delicate procedures can be preformed percutaneously,with minimal radiation exposure to both the patient and the surgical staff.
According to the present invention, there is provided a system for performing a surgical procedure at a surgical site, comprising:
a surgical robot for manipulating a tool to said surgical site;
an attachment member configured and dimensioned to mount the surgical robot on a bone associated with said surgical site;
an image referencing element adapted to be attached in a known manner to either of said robot and said attachment member; and a controller programmed to direct the robot to position the surgical tool at the surgical site,
3 wherein said controller is adapted to enable the system to perform the following steps:
utilizing an initial three dimensional image of said surgical site to provide a surgical plan of said procedure;
generating at least two intraoperative images of said surgical site including said image referencing element;
correlating said at least two intraoperative images to form a pseudo three dimensional image, including said image referencing element;
selecting a window from said pseudo three dimensional image and registering said window with a similarly selected window from said initial three dimensional image; and correlating said pseudo three dimensional image with said initial three dimensional image such that said image referencing element is located with respect to the surgical plan.
According to the present invention, there is also provided a system for performing a surgical procedure at a surgical site, comprising:
a surgical robot for manipulating a tool to said surgical site, said robot having at least one of known dimensions, and markers attached to it in predetermined locations;
an attachment member configured and dimensioned to mount the surgical robot on a bone associated with said surgical site;
an image referencing element adapted to be attached in a known manner to either of said robot and said attachment member; and a controller programmed to direct the robot to position the surgical tool at the surgical site, wherein said controller is adapted to enable the system to perform the following steps:
utilizing an initial three dimensional image of said surgical site to provide a surgical plan of said procedure;
3a generating at least two intraoperative images of said surgical site including at least one of said known dimensions of said robot and said markers attached in predetermined locations to said robot;
correlating said at least two intraoperative images to form a pseudo three dimensional image, including at least one of said known dimensions of said robot and said markers;
selecting a window from said pseudo three dimensional image and registering said window with a similarly selected window from said initial three dimensional image; and correlating said pseudo three dimensional image with said initial three dimensional image such that said robot is located with respect to the surgical plan.
According to the present invention, there is further provided a system for performing a procedure at a surgical site, said system comprising:
a surgical robot adapted to carry a surgical tool;
an attachment member configured and dimensioned to mount said surgical robot on a bone associated with said surgical site, such that said robot's position relative to said bone is unchanged with motion of said bone; and a controller correlating an initial image including said surgical site, with an intraoperative image including said surgical site and at least one of said surgical robot or its attachment member, such that the position of said robot is registered to said initial image, wherein said controller utilizes said registration of said position of said robot to said initial image to direct said robot to manipulate said surgical tool to perform on said bone, said procedure planned using said initial image.
Preferably the present is directed to a device and method for assisting-in surgical procedures. According to. the invention, a robot is disclosed that precisely positions a surgical tool with respect to a surgical site. The robot attaches to the bone of a patient with a clamp or with wires such as K-wires. Actuators extend from the robot base and move away from and toward the base member. This manipulates 3b balls that rotate within spherical swivel joints that in turn align a sleeve.
A surgical tool such as a screw driver or a drill bit is inserted through the sleeve and thus is precisely aligned with a site requiring surgery.
Preferably, the present invention also includes a method for using the robot to assist in surgical procedures. Initially, three dimensional images are taken of the patient and the surgeon performs pre-operative planning of the procedure to be done on the 3c images. This creates parameters that will later be used to direct the robot to the location where the surgical procedure is required. The robot is then attached to the patient by the clamp or the k-wire. C-arm images are taken of the patient with the attached clamp and these images are co-registered and calibrated such that a precise image of the bone with the robot attached is generated. This image is then registered, or matched, with the three dimensional image. This is accomplished in a highly efficient and accurate manner by taking small windows of the images where the surgery is to take place and registering these small portions. The small windows are chosen off the images by locating the bone attached clamp and selecting a window according to pre-operative calculation of the bone-robot attachment location.
After these windows are chosen and registered, the remaining bone is registered by aligning the registered windows. At this point the robot is located precisely on the bone of the patient in the three dimensional image and can be manipulated by the surgeon to a pre-operative planned location for percutaneous insertion of surgical tools, medical devices, or implants.
BRIEF DESCRIPTION OF THE DRAWINGS
For a better understanding of the nature, objects, and function of the present invention, reference should be made to the following detailed description in conjunction with the accompanying drawings, in which:
FIG. 1 is an overview of an embodiment of a surgical system showing a control unit with a display, C-arm with a calibration phantom attached, and a robot used for aligning surgical tools attached to- the patient according to the present invention;
FIG. 2 is a perspective view showing a miniature surgical robot attached to a bone and aligning a surgical tool in an embodiment of the invention;
FIG. 3 is a perspective view showing a clamp for attaching to a bone and adaptor for receiving a robot in an embodiment of the invention;
FIG. 4 is a cross-sectional view of FIG. 3;
FIG. 5 is a flow chart of an embodiment of the method of using the present invention;
FIG. 6 is a perspective view of an image referencing plate with three referencing markers attached;
utilizing an initial three dimensional image of said surgical site to provide a surgical plan of said procedure;
generating at least two intraoperative images of said surgical site including said image referencing element;
correlating said at least two intraoperative images to form a pseudo three dimensional image, including said image referencing element;
selecting a window from said pseudo three dimensional image and registering said window with a similarly selected window from said initial three dimensional image; and correlating said pseudo three dimensional image with said initial three dimensional image such that said image referencing element is located with respect to the surgical plan.
According to the present invention, there is also provided a system for performing a surgical procedure at a surgical site, comprising:
a surgical robot for manipulating a tool to said surgical site, said robot having at least one of known dimensions, and markers attached to it in predetermined locations;
an attachment member configured and dimensioned to mount the surgical robot on a bone associated with said surgical site;
an image referencing element adapted to be attached in a known manner to either of said robot and said attachment member; and a controller programmed to direct the robot to position the surgical tool at the surgical site, wherein said controller is adapted to enable the system to perform the following steps:
utilizing an initial three dimensional image of said surgical site to provide a surgical plan of said procedure;
3a generating at least two intraoperative images of said surgical site including at least one of said known dimensions of said robot and said markers attached in predetermined locations to said robot;
correlating said at least two intraoperative images to form a pseudo three dimensional image, including at least one of said known dimensions of said robot and said markers;
selecting a window from said pseudo three dimensional image and registering said window with a similarly selected window from said initial three dimensional image; and correlating said pseudo three dimensional image with said initial three dimensional image such that said robot is located with respect to the surgical plan.
According to the present invention, there is further provided a system for performing a procedure at a surgical site, said system comprising:
a surgical robot adapted to carry a surgical tool;
an attachment member configured and dimensioned to mount said surgical robot on a bone associated with said surgical site, such that said robot's position relative to said bone is unchanged with motion of said bone; and a controller correlating an initial image including said surgical site, with an intraoperative image including said surgical site and at least one of said surgical robot or its attachment member, such that the position of said robot is registered to said initial image, wherein said controller utilizes said registration of said position of said robot to said initial image to direct said robot to manipulate said surgical tool to perform on said bone, said procedure planned using said initial image.
Preferably the present is directed to a device and method for assisting-in surgical procedures. According to. the invention, a robot is disclosed that precisely positions a surgical tool with respect to a surgical site. The robot attaches to the bone of a patient with a clamp or with wires such as K-wires. Actuators extend from the robot base and move away from and toward the base member. This manipulates 3b balls that rotate within spherical swivel joints that in turn align a sleeve.
A surgical tool such as a screw driver or a drill bit is inserted through the sleeve and thus is precisely aligned with a site requiring surgery.
Preferably, the present invention also includes a method for using the robot to assist in surgical procedures. Initially, three dimensional images are taken of the patient and the surgeon performs pre-operative planning of the procedure to be done on the 3c images. This creates parameters that will later be used to direct the robot to the location where the surgical procedure is required. The robot is then attached to the patient by the clamp or the k-wire. C-arm images are taken of the patient with the attached clamp and these images are co-registered and calibrated such that a precise image of the bone with the robot attached is generated. This image is then registered, or matched, with the three dimensional image. This is accomplished in a highly efficient and accurate manner by taking small windows of the images where the surgery is to take place and registering these small portions. The small windows are chosen off the images by locating the bone attached clamp and selecting a window according to pre-operative calculation of the bone-robot attachment location.
After these windows are chosen and registered, the remaining bone is registered by aligning the registered windows. At this point the robot is located precisely on the bone of the patient in the three dimensional image and can be manipulated by the surgeon to a pre-operative planned location for percutaneous insertion of surgical tools, medical devices, or implants.
BRIEF DESCRIPTION OF THE DRAWINGS
For a better understanding of the nature, objects, and function of the present invention, reference should be made to the following detailed description in conjunction with the accompanying drawings, in which:
FIG. 1 is an overview of an embodiment of a surgical system showing a control unit with a display, C-arm with a calibration phantom attached, and a robot used for aligning surgical tools attached to- the patient according to the present invention;
FIG. 2 is a perspective view showing a miniature surgical robot attached to a bone and aligning a surgical tool in an embodiment of the invention;
FIG. 3 is a perspective view showing a clamp for attaching to a bone and adaptor for receiving a robot in an embodiment of the invention;
FIG. 4 is a cross-sectional view of FIG. 3;
FIG. 5 is a flow chart of an embodiment of the method of using the present invention;
FIG. 6 is a perspective view of an image referencing plate with three referencing markers attached;
4 FIG. 7 is a perspective view of a spacer used to extend the clamp; and FIG. 8 is a perspective view showing a miniature surgical robot for aligning a surgical tool attached to a bone by K-wires in an embodiment of the invention.
Like reference numerals refer to corresponding elements throughout the several drawings.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
Referring to the illustrations and particularly to FIG. 1 it can be seen that a preferred embodiment of the present invention generally includes an image guided, robot assisted, surgical system. Included in this system generally, as shown in FIG. 1, is a bone attached surgical robot 30; a control unit 10 that matches data from CT scans and C-arm images to locate robot 30 on the patient's bone and allows a surgeon to control robot 30, through the use of a mouse, joystick, touch screen, or the like; and video display 20. Control unit 10 generally includes a CPU and user interface communicating with display 20 and robot 30.
FIG. 2 illustrates robot 30 according to one embodiment of the present invention attached with clamp 40 to vertebra 50. Robot 30 aligns sleeve 60 through which surgical tool 70 such as a screwdriver, drill bit, Kirschner wire (K-wire), or the like can be inserted and precisely aligned with a site requiring a surgical procedure and thus, the operation can be conducted percutaneously or in traditional open procedures.
In a preferred embodiment of the invention, robot 30 includes base 35 that sits vertically on clamp adaptor 45. At least two pair of actuators 80 extend from base 35.
The actuators 80 extend from the base 35 forming-a fixed angle 85 between base 35:
and actuator 80. This angle is generally between about 15 -90 degrees and more preferably about 45 degrees. In one preferred embodiment, the points of attachment of actuators 80 are spaced apart by about 50 mm in the Z direction and about 50 mm in the Y direction. Each actuator 80 is capable of operating independently from the other actuators 80. Actuator 80 is similar to known linear actuators and includes a housing, a motor, a lead screw, an electrical connection, and a position sensor such as an optical encoder, an LVDT, or the like. In a preferred embodiment each actuator is approximately 5 mm in diameter and approximately 35 mm in length.
The end of actuator 80 that is not fixedly attached to base 35 contains hinge joint 90. Hinge joint 90 links actuator 80 to rigid member 100. Ina preferred embodiment member 100 is about 4 mm in diameter and 40 mm in length. Hinge joint 90 permits member 100 to freely rotate through about 270 degrees on an axis that runs parallel to base 35. The other end of the rigid member 100 is fixed with solid connection 105 to ring member 110. There is no movement between rigid member 100 and ring member 110 at solid connection 105.
Upper ring member 11OA and lower ring member 110B, solidly connected to individual rigid members 100, come together at spherical swivel joint 120.
Each ring member 110 forms one half of an outer race of spherical swivel joint 120. Ring members 110 are free to rotate with respect to one another, but are held fixedly from separating in the Z axis direction. Contained between upper ring member 110A
and lower ring member 110B, and free to swivel, is ball 130. Passing through ball 130 is sleeve 60. Sleeve 60 passes through both upper and lower balls 130, forming an aligning axis through which surgical tool 70 is passed. As actuators 80 extend and retract, hinge joints 90 freely rotate about the Z axis and balls 130 swivel in the spherical swivel joints 120 formed by upper and lower ring members 110. A
hollow axis is formed by the sleeve passing through each of upper and lower balls 130 such that a surgical tool 70 can be inserted through and be accurately aligned with the working location.
According to the present invention the above described robot 30 is just one example of a robot configured for surgical assistance that may be utilized with the system according to the present invention. Other robot configurations that could satisfy the same tasks include, for example; parallel robots constructed- to-the required dimensions. Such robots maybe defined by their joint types, e.g. a universal spherical revolute (USR) robot, a revolute spherical prismatic (RSP) robot, or a double circular triangular (DCT) robot.
The USR robot has three identical kinematic chains, each with two links, connecting the base and the moving platform. The connection at the base platform is by a universal joint and the moving platform is connected by a revolute joint, then these two links are connected by a spherical joint.
The RSPR robot has three identical kinematic chains each with two links connecting the base and the moving platform. The lower link is connected through a revolute joint, the upper link, a prismatic actuator is attached tho the lower link with a spherical joint and to the moving platform with a revolute joint.
The DCT robot is a new structure composed of planar mechanisms, each with 3 degrees of freedom. These two planar mechanisms comprise a stationary circle and a moving triangle to theoretically provide higher orientation capacity.
Further details are described in Simaan, et al., "Design Considerations of new types of Six-Degrees-of-Freedom Parallel Manipulators," IEEE International Conference on Robotics and Automation, Belgium, 1998. In general there are numerous structures of parallel robots. One skilled in the art will appreciate that any robot with multiple degrees of freedom may be utilized for surgical assistance.
In a preferred embodiment of the invention, robot 30 is attached with the bone of a patient by clamp 40. As shown in FIG. 3 and 4, clamp 40 comprises bone clamping portion 42 and clamp adaptor 45. Initially, handles 210 extend from clamp 40 and allow a user to hold, align, and affix clamp 40 onto a bone of the patient. The base of the handles 210 fit over nuts 220, shown in FIG. 4, located on clamp 40.
When clamp 40 is in place, the user pushes handles 210 toward each other to close jaws 230 onto the selected bone. When handles 210 are fully closed, or pushed together, a first locking (described below) occurs and clamp 40, is locked in place on the bone. The user then rotates handles 210 in a clockwise direction, turning and tightening nuts 220. Nuts 220 tighten down on threaded studs 250 and pinch clamp adaptor 45 onto bone clamping portion 42. This causes a second locking of clamp 40 into place on the bone. The base of each threaded stud-250 has a spherical mating .surface 255 so that when clamp adaptor 45 is tightened down onto. bone clamping portion 42 the clamp adaptor can self align itself on spherical mating surface 255 of stud 250. This allows the top surface of clamp adaptor 45 to maintain a horizontal surface for receiving the robot base 35. The handles, 210, are then removed by pulling straight up and away from the clamp 40. Protruding from the top surface of clamp adaptor 45 are connection pins 200. Connection pins 200 align with receiving holes in robot base 35 and when inserted lock robot 30 into place by some type of a snap ring or spring and ball bearing or plunger ball/pin.
With reference specifically to FIG. 4, it can be seen that threaded studs 250 are embedded in levers 260. Left and right levers 260 are connected together by upper 7a center hinge 280. The other end of levers 260 connect with respective jaws 230 through side axis hinge 270. Left and right jaws 230 are connected together by main pivot 290 around which the jaws rotate. When a user pushes handles 210 together to close jaws 230, upper center hinge 280 is pushed downward and at the same time side axis hinges 270. rotate around the main pivot 290. The first locking occurs when upper center hinge 280 is pushed below the center line formed between left and right side axis hinges 270, and clamp 40 locks onto the bone. When clamp 40 is in the fully closed and locked position, jaws 230 are parallel to each other and separated by a set distance. The set closing distance between jaws 230 can be altered for different bone attachment applications by exchanging re-moveable jaw inserts 240 with the same of a different thickness.
FIG. 7 illustrates spacer 900 that can be attached to the top surface of clamp adaptor 45 to ensure that robot 30 remains above the working area and out of any tissue that might occur when a patient has unusual body proportions. Spacer attaches to connector pins 200 of clamp adaptor 45 and provides connector pins 910, similar to connector pins 200, for robot 30 attachment to the top surface of the spacer 900.
Above described clamp 40 is an example of one embodiment according to the invention by which a robot may be attached to a bone for assisting in a surgical procedure. Other attachment devices can also be incorporated with a robot such as, for example, K-wire connections. FIG. 8 illustrates such a K-wire connection. K-wires 950 are inserted into-the bone by standard surgical procedures. Robot base 35 contains an elongated slot through which K-wires 950 are inserted. Screw 960 can-then-be turned and tighten pinch plate 970 against robot base 35 pinching K-wires 950 between pinch plate 970 and robot base 35 holding robot 30 tight with respect to K-wires 950 and bone 50.
FIG. 5 illustrates the registration system used to establish the position of the robot on the bone. Initially there is a pre-operative step 400. This step 400 consists of taking a three-dimensional scan 410 of the patient, such as a CT or MRI scan.
A
surgeon then performs pre-operative planning 420 on the three-dimensional scan. For example, if the procedure to be done is a fracture fixation, the surgeon will study the three-dimensional image and the condition of the bone, choose the proper implant from a database containing implants of all types and sizes based on the present application, and electronically position and insert the implant, the screw, or the like.
The parameters generated by the pre-operative planning 420 are stored in the control unit 10 for positioning the robot 30 during the actual surgical procedure.
In an exemplary embodiment, the three-dimensional imaging may be accomplished through manipulation of triangle vertices using linear interpolation of the acquired three dimensional data. An algorithm can be used to create triangle models of constant density surfaces from the three dimensional data while providing a high-resolution three dimensional surface construction so that the models have extensive detail and accuracy. There are four steps to accomplish this, the last three steps being resolvable by one algorithm. The four steps are: data acquisition, image processing, surface construction, and display.
The data acquisition is performed through standard medical imaging techniques which provide information from the patient either through computed tomography (CT), magnetic resonance (MR) or single photon emission computed tomography (SPECT). The next step, image processing is achieved by use of algorithms. The surface is then constructed through a three dimensional model, this surface is then displayed using realistic image that provides for shading and ray casting.
An algorithm known as the marching cubes algorithm may be used to assist in refining the surface so that it provides a more realistic picture for the surgeon. The surface construction is essentially a two step process of first locating the surface, -which corresponds to. a user-specified value, and then calculating no ms at each vertex of each triangle. This algorithm utilizes cubes created from pixels to process local vertices and the intersections. First, the surface corresponding to a user specified value is located and triangles created, then the algorithm determines how the surface intersects the cube that was created from the pixels. This process is accomplished by assigning the vertices of each cube a value and comparing it to the value of the surface.
The process results in 256 possible ways for the surface to intersect the cube.
However, two symmetries of the cube, topology and rotational symmetry, are used to reduce the number of possibilities to fourteen. After the number of cases is reduced an index is created for each of the fourteen possible cases. This index allows for the identification of surface intersections and then linear interpolation can be utilized to develop the surface. A surface of constant density has a zero gradient component along the surface tangential direction, so the direction of the gradient vector is normal to the surface. From this knowledge, the surface normal vector can be determined assuming the magnitude of the gradient vector is nonzero. Because the surface of interest is between tissues of different densities, the gradient vector is nonzero. The gradient vector is the derivative of the density function. Therefore to approximate the gradient vector, the gradient vector is estimated at the cube vertices and then linearly interpolated at the point of intersection. This estimation is accomplished using the differences of the densities at a given pixel and dividing that by the lengths of the cube edges. The calculation results in the unit normal which is then linearly interpolated to the point of intersection. The unit normal is calculated for each triangle vertex and the algorithm uses this unit normal to produce Gourad-shaded images. The marching cubes algorithm creates a surface from a three dimensional data set and has been applied to two dimension data from CT, MR, and SPECT scans to successfully give a resulting three dimensional view for medical applications. More details of the image reconstruction process are described for example in Lorensen et al., "Marching Cubes:
a high resolution 3D surface reconstruction algorithm," Computer Graphics 21 (1987) 163-169.
With reference now to FIG. 1, 5, and 6 the next step is initial calibration of the C-arm 450. A phantom 320 (FIG. 1) is attached to the lens of the C-arm device and a blank C-arm image is taken, step 460, FIG. 5. The phantom 320 is used to correct for the distortion associated with the C-arm image. - The phantom contains several reference objects and a large number of small reference objects. The control unit automatically recognizes the reference objects and creates distortion correction maps and calibrates intrinsic parameters to correct for the imprecise C-ann image.
Systems such as these for calibration are known in the art.
One such method for distortion correction utilizes a system which combines an x-ray camera connected to a control computer with an infrared tracking system linked to the control computer. In this method of distortion correction, the training of distortion parameters is combined with infrared tracking. The x-ray camera is calibrated, to correct for the distortion caused by the earth's magnetic fields, such 10a distortion is dependent on the camera's position. Using the x-ray camera infrared tracking system, there are three steps for successful camera calibration to remove the distortions. The first step calibrates the x-ray camera by use of a fixed three dimensional coordinate system represented by a static calibration object and a second calibration object to determine the distortion properties. Distinct markers are used for each calibration object . The camera images are then smoothed and a set of connected regions in the image is obtained. Error minimization between the actual and the anticipated projections of the markers is accomplished by use of a cubic polynomial.
This step, also referred to as coupled calibration, performs an error minimization between the anticipated and actual projections of the calibration markers, it utilizes a cubic distortion model to correct the resultant bending of the straight line into an S
curve. Measurements are taken between the distorted actual image point and the projected point. Although this provides for some distortion correction, still, the camera parameters must be decoupled to correct for divergence, local minima, and the dependency of the coupled calibration on the initialization.
The second step, also known as decoupled parameters, need not be done intra-operatively as the infrared system is static, and the correction can be made based upon a fixed camera placement. The image is placed in the surface of calibration dish and the distortion parameters are determined. The correction polynomials applied are only partially cubic and are linearly dependent on the distortion parameters. The resulting function is quadratic and is solved analytically.
The final step eliminates the need for intra-operative calibration and marker detection. The-actual camera placement and the corresponding distortion parameters from the earlier steps are utilized in what is referred to as the "learning mode." The "learning mode" constitutes taking pre-operative images and computing the corresponding distortion correction parameters by spline interpolation. The calibration is accomplished by using a pointer tracking system and matching the pre and intra-operative contours. This last step of the overall calibration method works however, only if the intra-operative viewing angles are limited to those in close vicinity to the pre-operative viewing angles. Further details of such a distortion correction system are described, for example, in Brack et al., "Accurate X-ray Navigation in Computer-Assisted Surgery", Proc. Of the 12th Int. Symp. On Computer Assisted Radiology and Surgery, H. Lemke, et al., eds., Springer, 1998.
Another method of distortion correction can be implemented for use with fluoroscopic images according to a preferred embodiment of the invention.
Fluoroscopic x-ray images are frequently used in the medical field, but are plagued by substantial distortions which must be corrected in order to effectively utilize these images. These distortions, which include small radial distortions and scaling deviations, are a result of both C-arm armamature deflection and orientation.
Fluoroscopic images must be dewarped, which may be accomplished by computing a dewarped map from a reference image The distortion can be modeled either across the entire image as a single function or by tessellating the image view of the. field into triangles or quadrilaterals and then computing individual distortion functions, which are determined by using bilinear interpolation. Since the individual distortion functions are more adaptable, this local method is often preferred. To determine the distortion factors, the necessary parameters are the relative position and the orientation of the camera with respect to the imaging plane, the focal length, the image center location, and the image scaling and radial distortion coefficients. The relationship between these parameters is obtained by formulating the transformation from the world coordinate to the camera coordinates, transforming the three dimensional camera coordinates into two dimensional coordinates in an ideal image and then adding radial distortion, shifting-and scale. The equations are solved for the relative position and orientation parameters by resolving a set of linear equations.
Based on the solved parameters, the remaining parameters are derived. The least squares.
method is then used to incorporate additional points. Since the C-arm distortion is orientation dependent, the process must be completed for a variety of orientations, focusing on the extremes to ensure correction parameters cover the entire field. More details of the process are described, for example in Yaniv et al., "Fluoroscopic Image Processing for Computer-Aided Orthopaedic Surgery", Proc. l' Int. Conf. On Medical Computing and Computer-Assisted Intervention, Lecture Notes in Computer Science 1496, Elsevier, et al., eds., 1998, which is incorporated herein by reference.
Furthermore, images may be enhanced by improvement in control and alignment of the C-arm. This type of improvement can be accomplished by the creation of a local coordinate system. A local coordinate system may be attached to the surgical tool, the patient, and the C-arm. Then the coordinate system of the surgical tool is converted to the coordinate system of the two dimensional C-arm image coordinate system. The transformation between the surgical tool and the ultimate image is provided in real-time by the various position sensors. The basis for the transformation is a linear cone beam projection model. The conversion of the C-arm projection from three dimensional space to two dimensional image is obtained preoperatively during the C-arm calibration. The constant projection parameters of the C-arm are acquired using a calibration probe containing steel spheres which is equipped with LED sensors. From these sensors, the position of each sphere can be calculated and subsequently assigned a corresponding position in the two dimensional image. The resulting system of equations are solved using an error minimizing algorithm. To further minimize errors resulting from stress-dependent deformation of the C-arm frame, additional LEDs are mounted to track the actual camera position for updating at the time of image acquisition. To the extent there is additional distortion in the image intensifier-TV chain of the C-arm, resulting in stationary pin cushion distortion, and also a small variable amount of distortion caused by magnetic fields, a bilinear interpolation algorithm may be used for correction- Further details are described in Hofstetter et al., "Fluoroscopy Based Surgical Navigation -Concept and Clinical Applications", Proc. 11`'' Int. Symp. on Computer Assisted Radiology and Surgery, H.U. Lemke, et al., eds., Springer 1997.
A further method for three dimensional camera calibration utilizes a two step technique. Utilizing this two step approach, a real constraint or equation that is only a function of a subset of the calibration parameters is implemented. This reduces the dimensionality of the unknown parameter space.
The first step computes the three dimensional orientation and position. In this part of the process the distorted image coordinates are computed from the relationship between the distance between coordinate and the image center and an uncertainty determined.
The second step computes the effective focal length, distortion coefficients and third dimension position. These parameters are calculated from the relationship between the calibration points, the distances and the transformation matrix and rotation matrix from the first step.
This two step method is referred to as the "radial alignment constraint" and it is only a function of relative rotation and translation between the camera and the calibration points. The method is distinguishable from other methods in that the order of the transformation from the three dimensional camera coordinate to the image coordinate is rotation followed by translation as opposed to the reverse.
Another benefit of this method is that it can be completed in real time. Furthermore, this method can also be used for calibrating a camera using monoview noncoplanar points and multiple viewing positions. Additional details are described in Tsai et al., "A
Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses", IEEE Journal of Robotics and Automation, Vol. RA-3, No. 4, August 1987 which is incorporated herein by reference.
One of ordinary skill in the art will appreciate these aforementioned methods of calibration are exemplary and not limiting on the C-arm calibration method that may be employed by the present invention.
Next, the patient is brought into the operating room, a small incision is made according to standard surgical practice at the site where clamp 40 is to be attached, and the clamp is attached tothe selected-bone using handles as described above, step 462, FIG. 5. Handles 210 are then removed from the clamp 40. An image referencing plate 800 (FIG. 6) is attached to clamp 40, step 465, FIG. 5, by receiving holes that receive connector pins 200. The image referencing plate 800 (FIG. 6) has three referencing markers 810 on it that show up very clear and precise in the C-arm image. The distance and angle between the referencing markers 810 are known such that the C-arm image can be calibrated in a secondary calibration step, step 465, to accurately represent actual size of the image. At least two, but preferably three C-arm images are taken of the patient with the attached clamp 40 and image referencing plate 800.
These C-arm images are taken from different angles, preferably 0, 45, and 90 degrees, connector pins 200. The image referencing plate 800 (FIG. 6) has three referencing markers 810 on it that show up very clear and precise in the C-arm image. The distance and angle between the referencing markers 810 are known such that the C-arm image can be calibrated in a secondary calibration step, step 465, to accurately represent actual size of the image. At least two, but preferably three C-arm images are taken of the patient with the attached clamp 40 and image referencing plate 800.
These C-arm images are taken from different angles, preferably 0, 45, and 90 degrees, 14a scaling factor.
From these coordinates, the translation vectors and rotation factors are calculated. Using the translation vectors and rotation factors, the rotational matrix is determined.
The second step computes the effective focal length, distortion coefficients and third dimension position. These parameters are calculated from the relationship between the calibration points, the distances and the transformation matrix and rotation matrix from the first step.
This two step method is referred to as the "radial alignment constraint" and it is only a function of relative rotation and translation between the camera and the calibration points. The method is distinguishable from other methods in that the order of the transformation from the three dimensional camera coordinate to the image coordinate is rotation followed by translation as opposed to the reverse.
Another benefit of this method is that it can be completed in real time. Furthermore, this method can also be used for calibrating a camera using monoview noncoplanar points and multiple viewing positions. Additional details are described in Tsai et al., "A
Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses", IEEE Journal of Robotics and Automation, Vol. RA-3, No. 4, august 1987.
One of ordinary skill in the art will appreciate these aforementioned methods of calibration are exemplary and not limiting on the C-arm calibration method that may be employed by the present invention..
Next, the patient is brought into the operating room, a small incision is made according to standard surgical practice at the site where clamp 40 is to be attached, and the clamp is attached to-the selected bone using handles as described above, step 462, FIG. S. Handles 210 are then removed from the clamp 40. An image referencing plate 800 (FIG. 6) is attached to clamp 40, step 465, FIG. 5, by receiving holes that receive step 470, FIG. 5.
In another embodiment of the present invention the secondary calibration step, step 465B, can be accomplished by attaching the robot 30 to the clamp and taking multiple C-arm images. By knowing the dimensions, or by placing referencing markers on robot 30 and knowing the distance and angle between the referencing markers the C-arm images can be calibrated in a secondary calibration step, step 465B.
The next step of the process is co-registration, step 500. The C-arm images are transferred into the control unitlO as data, step 502. At each location an image is taken from, the position of the C-arm is recorded, step 504, into the control unit 10.
The data of the images, step 502, and the position of the C-arm, step 504, are correlated by knowing the position from which each images was taken, step 504, and by aligning the referencing markers 810 (FIG. 6) from the image referencing plate 800 (FIG. 6). Thus, an accurate, pseudo three-dimensional image of the surgical site with the clamp 40 attached to the bone is generated. This stage can be referred to as robot to bone registration or co-registration.
According to a preferred embodiment of the invention, bone to bone registration next occurs in step 600. Step 600 is a process of estimating and matching the true surface contours or the objects in the images. Registration methods are either based on geometry or intensity of the image. Geometric based registration is achieved by finding features in the two dimensional fluoroscopic images and matching these features with corresponding features in the three dimensional image, acquired, for example, from a CT scan dataset, MRi image, ultrasound image or from a CAD - --model. The features canbe known landmarks (anatomical landmarks or implanted fiducials), or contour points in the fluoroscopic image, matched with the registered object's surface. An algorithm that may be used to compute the transformation is the Iterative Closest Point (ICP) algorithm. The ICP algorithm is an iterative alignment algorithm that works in three phases: first it establishes correspondence between pairs of features in the two structures that are to be aligned based on proximity, next it estimates the rigid transformation that best maps the first member of the pair onto the second and third, it applies that transformation to all features in the first structure.
These three steps are then reapplied until convergence is concluded. The ICP
algorithm relies on a convergence theorem. The key differentiation between the least squares registration and the ICP is the least squares generically reduces the average distance between corresponding points during each iteration whereas the closest point determination generally reduces the distance for each point individually.
Further details on the use of the ICP algorithm are described in Besl et al., "A
Method for Registration of 3D Shapes", IEEE Trans. on Pattern Analysis and Machine Intelligence, 1992, 14(2), 239--255. The input to the algorithm are sets of back-projected rays from the fluoroscopic images, and a model of the registered object.
The algorithm iteratively computes a transformation that approximates the ray sets to the model. For landmark registration, a match between each ray and the corresponding landmark is defined before searching for the transformation.
Contour registration selects a new surface point to match with each ray on every iteration.
Preferably, the registration process uses two or more fluoroscopic images.
One method of automatic registration can be represented by a cooperative approach between registration and segmentation of preoperative surface models and intra-operative x-ray images. The cooperative approach undertakes four steps:
presegmentation, transformation, extraction, and error minimization.
Presegmentation extracts contour points. These contour points correspond to pixels with large variations in grey-level intensity. The contour points are organized in chains of connected pixels with like grey level intensity resultings in automatic edge detection of an image. Then initial registration completes the segmentation to extract likely contours on x-ray images. This is done by identifying multiple pixels on anatomical landmarks and defining these pixels on x-ray images, thus ensuring the same -landmarks are selected on the three dimensional surface model. These two sets of matched pixels are used cooperatively to estimate the initial transformation.
The automatic edge detection results in an excessive number of contour points therefore it is necessary to eliminate pixels which do not correspond to contour points that are of interest. From the automatic edge detection weight must be given to each pixel in order to determine the likelihood that it is a real contour pixel; this determination is made by summing the gradient value, the size of the connected component and a distance factor. The first two components come from the x-ray image while the third depends upon information from the initial registration process. The distance calculation is performed utilizing an algorithm which minimizes energy and distance to account for internal and external contours, one such algorithm that may be used is the Levenberb Marquardt algorithm. Further details of preferred registration procedures are described in Hamadeh, et al., "Towards automatic registration between CT and X-ray images: cooperation between 3D/2D registration and 2D edge detection, " Medical robotics and computer assisted surgery, 1995, Wiley 39-46 and Hamadeh, et al., "Automated 3-Dimensional Computed Tomographic and Fluoroscopic Image Registration", Computer Aided Surgery, 1998, 3.
According to the registration method described above, anatomical landmarks in the images are detected and matched manually. Based on this match, an approximated initial guess is computed, with ray intersections, which are three dimensional points in the registration environment, being matched with the model's landmarks. Then, the object's contour in the two dimensional image is registered with the model's surface.
A likelihood estimator is used to remove outliers, or pixels not in the contour, from the sample point set. A signed distance function is defined to overcome any internal contours problems. The overall in-vitro accuracy of this method can be better than 2mm.
While most registration processes involve multiple images, in one alternative, a single fluoroscopic image may be used. The use of a single fluoroscopic image may still achieved an accuracy of about 3mm. This single fluoroscopic image technique is based on a combinatorial search among matches of three points and three rays. -The match with minimal average distance for the registration is then selected.
These points and rays are used to determine two initial registrations. In such a technique, both points and lines may be used to represent data. In the single fluoroscopic model, the three points and the three rays are registered and from this, two three-point registrations, designated by triangles can be found. From the triangle's vertices, non-linear functions can be established and then solved for the two unknowns by applying the Levenberg-Marquardt algorithm. From these points the line can be determined and the point-line correspondence can be solved. The lines are then fixed while the points are permuted resulting in three points in the back-projected lines.
Horn's method is then used for the transformation into a frame and the ICP algorithm is implemented to determine the best match points for the registration. Further details of this technique are described in Tang, "Method for Intensity-based Registration with CT Images," Masters Thesis: Department of Computer Science, Queen University, Ontario Canada, 1999.
In a further alternative according to the invention, intensity-based registration is achieved by comparing fluoroscopic images with simulated X-rays (digitally reconstructed radiographs, or DRR's) from an estimated position. In this alternative, three types of coordinate systems are involved in the registration process:
the CT
coordinate system, the world coordinate system, and the radiographic coordinate system. The registration process consists of determining the CT to world transformation matrix , also known as the volume transformation matrix.
For each radiograph, the radiograph to world transformation matrix is derived.
An iterative procedure is used to adjust the translation and orientation of the computed tomography (CT) data in the world coordinate system until a best match with the DRR
is found. Next the radiographic to world transformation os accomplished.
Translation, rotation, and scaling matrices are applied to the available data to complete and validate the registration. From these matrix calculations, the world coordinate of any voxel, three dimensional pixel, can be calculated.
To achieve the best match between the CT and the DRR, two elements are required, a cost function (the inverse of measure of similarity) and an algorithm for minimizing the cost function. Two costs functions are considered: the cross correlation of the pixel values and the magnitude of the scalar product of the gradient.
The -cross correlation -is a function of the Pearson's product-movement coefficient and the number of nonvoid pixels. The gradient is a function of the product of the gradients in the plain radiographs and the DRR weighted by the number of pixels. The relative merit of the cost functions is analyzed in the vicinity of the stereotactic registration point. The stereotactic registration error and the extent of parameter space around the minimum devoid of local minima along the axis are the applicable criteria.
A minimization algorithm based on patient orientation during the image acquisition and the assumption that the CT and radiographic acquisitions are such that the x-rays are nearly parallel to the CT slices is most effective in solving the registration problem.
The registration process as described in this alternative can be completed either semi-automatically or automatically. In semi-automatic registration, a mouse driven interface can be used to initiate the registration process and provide for the rotation and translation of the CT parameters. Automatic registration can be accomplished by utilization of biscalar algorithms for translation, complimented by Powell's algorithm for exploration of the full six-dimensional rotation parameter. The method of automatic registration comprises eleven steps: an eight-step orientation algorithm followed by the three-step six-dimensional minimization algorithm. Further details are described in Lemieux et al., "Patient-to computed-tomography image registration method based digitally reconstructed radiographs", Medical Physics, 21, 1994, 1760.
Another type of registration that may be implemented in the invention is intensity based registration. Intensity based registration is utilized to develop an improved automatic beam alignment process for frameless image-guided radiosurgery.
I I I
Utilizing this mode of registration, radiographs acquired during patient treatment can be coordinated with DRRs generated from a CT study representative of hypothetical patient positions which involve three translations and three rotations. This method of registration has three parts: developing a means of exploring the range of possible patient positions; identifying those elements of images that effectively capture the patient pose; and using a comparison statistic or cost function for the two sets of image feature data to indicate when the best match has been accomplished. There are three ways to analyze DRRs and complete the match for this method of registration:
the matched filter area correlation; the interpolative area correlation; and the iterative reprojection. The preferred method is the iterative reprojection because it is executed in real time. Along with the necessary correlation corrections, the comparison between the DRRs and the radiographs poses the problem of pattern recognition which must also be resolved during registration. The image data used is referred to as feature vectors; these vectors may be primitive or highly sophisticated. The registration algorithm provides for an independent check on the edge detection process as well as the region of interest. The registration algorithm employs six free parameters to minimize the chi-statistic which is consists of the weighted vector components. The minimization problem is nonlinear and solved with a hybrid algoritm that starts with a gradient search and processes to a Taylor series approximation. Using the iterative reprojection method, and algorithm may be designed such that the registration process is completely automated, reliable, and speedy, however, it is necessary to identify the areas of interest prior to registration.
Further details on such techniques are described for example, in Murphy, M.
"An automatic six-degree-of freedom image registration algorithm for image-guided frameless stereotactic surgery", Medical Physics, 24(6), June 1997.
When the camera position guess and the actual position are very close, the original and reconstructed image are very similar. Pixel intensity information is used to define a measure of similarity between the datasets. The similarity measure can include intensity values, cross-correlation, histogram correlation, and mutual information. The algorithm proceeds in three steps. The input is a CT data set, intrinsic camera parameters, one or more fluoroscopic images and an initial camera position estimate for each image. In the first step, the algorithm generates one DRR
for each given camera position. In the second step, a dissimilarity measure is computed between the real and reconstructed image. In the third step, new camera poses are computed that best reduce the dissimilarity between the images. The process is repeated until convergence is reached. The parametric space of camera positions in then searched incrementally from an initial configuration. The space is six-dimensional (three rotations and three translations). The advantages of this technique is that no segmentation is necessary. However, the search space is six-dimensional, and can contain many local minima.
A benefit of the present invention is that it can utilize either of the above described registration methods. By utilizing the dimensions of the bone attached robot and its attachment location, the initial location of the window is a very good guess of the location and therefore the intensity based method can be utilized. Thus, according to the present invention, a faster and more accurate registration process is accomplished as between the fluoroscopic and three dimensional images. This is done in step 600, and occurs very quickly and with a high degree of accuracy because the registration process is performed on small windows of the images, rather than the images as a whole. Preferably windows are selected that specifically relate to the 20a known location of the robot and/or its support member. Windows of about 20 mm by 20 mm located approximately adjacent to the clamp location, according to pre-operative calculation of the bone-robot attachment location, are selected from the C-arm (fluoroscopic) image data, step 610. For example, these windows maybe selected as the area above the attached clamp 40 in the C-arm image and the tip of the transverse process of the vertebra covering the area where the surgical procedure is to take place. Generally, the same windows are chosen from both the pseudo three-dimensional hybrid C-arm image, step 510, and also from the CT image (three dimensional image), step 410. The small windows chosen from the C-arm images and the CT scan image are then laid over each other and matched or registered by the control unit, step 620, as described above. Focusing only on a small window of the C-arm image rather than looking for a matching anatomical landmark in the entire image, makes the process occur very fast and with the high degree of accuracy needed for precise procedures such as vertebra surgery.
Next, the remaining portion of the CT and C-arm image of the bones are overlaid, the registration windows are aligned, and the remaining bone is registered, step 630. Since the windows have already been accurately registered this step occurs quickly and also with a high degree of accuracy. Now clamp 40 is located precisely on the bone, step 640, of the CT image. Next, the user attaches robot 30 to clamp 40 and thus, robot 30 is located precisely with respect to the bone, step 645.
After robot 30 is co-registered 500 and registered 600, its position is known relative to the patient's bone and therefore can move to align with the pre-operatively picked location such that the operation can virtually take place on the control unit.
The user selects a pre-operatively planned location and task from step 420 by use of a joystick, mouse, touch screen, or the like, step 710. The robot 30 responds and moves sleeve 60 into position, step 720, such that when the user inserts a surgical tool 70 through the opening in the sleeve 60 the surgical tool 70 will be precisely aligned with the location requiring the surgical procedure, step 730. The surgeon can then insert a selected surgical tool 70 and operate without opening the surgical site to see the placement of the surgical tool because the surgeon can verify the positioning of the surgical tool 70 on the control unit 10 and display 20. Thus operating percutaneously or in general open procedures, with a high degree of accuracy, low trauma, small incisions, low chance of infection, and minimal exposure to radiation. A
further benefit of this system is that because the robot is miniature it can be freely attached to the bone of a patient and move with the body. Therefore, the robot system does not need a dynamic referencing device to maintain orientation with the body once it is registered. This creates a more precise and less complicated system that is versatile and user friendly as the surgeon can manipulate the patient into different surgical positions without disturbing the robot system.
The present invention is illustrated herein by reference to a spinal vertebra attachment. However, it will be appreciated by those in the art that the teachings of the present invention are equally applicable to other bone attachments.
Like reference numerals refer to corresponding elements throughout the several drawings.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
Referring to the illustrations and particularly to FIG. 1 it can be seen that a preferred embodiment of the present invention generally includes an image guided, robot assisted, surgical system. Included in this system generally, as shown in FIG. 1, is a bone attached surgical robot 30; a control unit 10 that matches data from CT scans and C-arm images to locate robot 30 on the patient's bone and allows a surgeon to control robot 30, through the use of a mouse, joystick, touch screen, or the like; and video display 20. Control unit 10 generally includes a CPU and user interface communicating with display 20 and robot 30.
FIG. 2 illustrates robot 30 according to one embodiment of the present invention attached with clamp 40 to vertebra 50. Robot 30 aligns sleeve 60 through which surgical tool 70 such as a screwdriver, drill bit, Kirschner wire (K-wire), or the like can be inserted and precisely aligned with a site requiring a surgical procedure and thus, the operation can be conducted percutaneously or in traditional open procedures.
In a preferred embodiment of the invention, robot 30 includes base 35 that sits vertically on clamp adaptor 45. At least two pair of actuators 80 extend from base 35.
The actuators 80 extend from the base 35 forming-a fixed angle 85 between base 35:
and actuator 80. This angle is generally between about 15 -90 degrees and more preferably about 45 degrees. In one preferred embodiment, the points of attachment of actuators 80 are spaced apart by about 50 mm in the Z direction and about 50 mm in the Y direction. Each actuator 80 is capable of operating independently from the other actuators 80. Actuator 80 is similar to known linear actuators and includes a housing, a motor, a lead screw, an electrical connection, and a position sensor such as an optical encoder, an LVDT, or the like. In a preferred embodiment each actuator is approximately 5 mm in diameter and approximately 35 mm in length.
The end of actuator 80 that is not fixedly attached to base 35 contains hinge joint 90. Hinge joint 90 links actuator 80 to rigid member 100. Ina preferred embodiment member 100 is about 4 mm in diameter and 40 mm in length. Hinge joint 90 permits member 100 to freely rotate through about 270 degrees on an axis that runs parallel to base 35. The other end of the rigid member 100 is fixed with solid connection 105 to ring member 110. There is no movement between rigid member 100 and ring member 110 at solid connection 105.
Upper ring member 11OA and lower ring member 110B, solidly connected to individual rigid members 100, come together at spherical swivel joint 120.
Each ring member 110 forms one half of an outer race of spherical swivel joint 120. Ring members 110 are free to rotate with respect to one another, but are held fixedly from separating in the Z axis direction. Contained between upper ring member 110A
and lower ring member 110B, and free to swivel, is ball 130. Passing through ball 130 is sleeve 60. Sleeve 60 passes through both upper and lower balls 130, forming an aligning axis through which surgical tool 70 is passed. As actuators 80 extend and retract, hinge joints 90 freely rotate about the Z axis and balls 130 swivel in the spherical swivel joints 120 formed by upper and lower ring members 110. A
hollow axis is formed by the sleeve passing through each of upper and lower balls 130 such that a surgical tool 70 can be inserted through and be accurately aligned with the working location.
According to the present invention the above described robot 30 is just one example of a robot configured for surgical assistance that may be utilized with the system according to the present invention. Other robot configurations that could satisfy the same tasks include, for example; parallel robots constructed- to-the required dimensions. Such robots maybe defined by their joint types, e.g. a universal spherical revolute (USR) robot, a revolute spherical prismatic (RSP) robot, or a double circular triangular (DCT) robot.
The USR robot has three identical kinematic chains, each with two links, connecting the base and the moving platform. The connection at the base platform is by a universal joint and the moving platform is connected by a revolute joint, then these two links are connected by a spherical joint.
The RSPR robot has three identical kinematic chains each with two links connecting the base and the moving platform. The lower link is connected through a revolute joint, the upper link, a prismatic actuator is attached tho the lower link with a spherical joint and to the moving platform with a revolute joint.
The DCT robot is a new structure composed of planar mechanisms, each with 3 degrees of freedom. These two planar mechanisms comprise a stationary circle and a moving triangle to theoretically provide higher orientation capacity.
Further details are described in Simaan, et al., "Design Considerations of new types of Six-Degrees-of-Freedom Parallel Manipulators," IEEE International Conference on Robotics and Automation, Belgium, 1998. In general there are numerous structures of parallel robots. One skilled in the art will appreciate that any robot with multiple degrees of freedom may be utilized for surgical assistance.
In a preferred embodiment of the invention, robot 30 is attached with the bone of a patient by clamp 40. As shown in FIG. 3 and 4, clamp 40 comprises bone clamping portion 42 and clamp adaptor 45. Initially, handles 210 extend from clamp 40 and allow a user to hold, align, and affix clamp 40 onto a bone of the patient. The base of the handles 210 fit over nuts 220, shown in FIG. 4, located on clamp 40.
When clamp 40 is in place, the user pushes handles 210 toward each other to close jaws 230 onto the selected bone. When handles 210 are fully closed, or pushed together, a first locking (described below) occurs and clamp 40, is locked in place on the bone. The user then rotates handles 210 in a clockwise direction, turning and tightening nuts 220. Nuts 220 tighten down on threaded studs 250 and pinch clamp adaptor 45 onto bone clamping portion 42. This causes a second locking of clamp 40 into place on the bone. The base of each threaded stud-250 has a spherical mating .surface 255 so that when clamp adaptor 45 is tightened down onto. bone clamping portion 42 the clamp adaptor can self align itself on spherical mating surface 255 of stud 250. This allows the top surface of clamp adaptor 45 to maintain a horizontal surface for receiving the robot base 35. The handles, 210, are then removed by pulling straight up and away from the clamp 40. Protruding from the top surface of clamp adaptor 45 are connection pins 200. Connection pins 200 align with receiving holes in robot base 35 and when inserted lock robot 30 into place by some type of a snap ring or spring and ball bearing or plunger ball/pin.
With reference specifically to FIG. 4, it can be seen that threaded studs 250 are embedded in levers 260. Left and right levers 260 are connected together by upper 7a center hinge 280. The other end of levers 260 connect with respective jaws 230 through side axis hinge 270. Left and right jaws 230 are connected together by main pivot 290 around which the jaws rotate. When a user pushes handles 210 together to close jaws 230, upper center hinge 280 is pushed downward and at the same time side axis hinges 270. rotate around the main pivot 290. The first locking occurs when upper center hinge 280 is pushed below the center line formed between left and right side axis hinges 270, and clamp 40 locks onto the bone. When clamp 40 is in the fully closed and locked position, jaws 230 are parallel to each other and separated by a set distance. The set closing distance between jaws 230 can be altered for different bone attachment applications by exchanging re-moveable jaw inserts 240 with the same of a different thickness.
FIG. 7 illustrates spacer 900 that can be attached to the top surface of clamp adaptor 45 to ensure that robot 30 remains above the working area and out of any tissue that might occur when a patient has unusual body proportions. Spacer attaches to connector pins 200 of clamp adaptor 45 and provides connector pins 910, similar to connector pins 200, for robot 30 attachment to the top surface of the spacer 900.
Above described clamp 40 is an example of one embodiment according to the invention by which a robot may be attached to a bone for assisting in a surgical procedure. Other attachment devices can also be incorporated with a robot such as, for example, K-wire connections. FIG. 8 illustrates such a K-wire connection. K-wires 950 are inserted into-the bone by standard surgical procedures. Robot base 35 contains an elongated slot through which K-wires 950 are inserted. Screw 960 can-then-be turned and tighten pinch plate 970 against robot base 35 pinching K-wires 950 between pinch plate 970 and robot base 35 holding robot 30 tight with respect to K-wires 950 and bone 50.
FIG. 5 illustrates the registration system used to establish the position of the robot on the bone. Initially there is a pre-operative step 400. This step 400 consists of taking a three-dimensional scan 410 of the patient, such as a CT or MRI scan.
A
surgeon then performs pre-operative planning 420 on the three-dimensional scan. For example, if the procedure to be done is a fracture fixation, the surgeon will study the three-dimensional image and the condition of the bone, choose the proper implant from a database containing implants of all types and sizes based on the present application, and electronically position and insert the implant, the screw, or the like.
The parameters generated by the pre-operative planning 420 are stored in the control unit 10 for positioning the robot 30 during the actual surgical procedure.
In an exemplary embodiment, the three-dimensional imaging may be accomplished through manipulation of triangle vertices using linear interpolation of the acquired three dimensional data. An algorithm can be used to create triangle models of constant density surfaces from the three dimensional data while providing a high-resolution three dimensional surface construction so that the models have extensive detail and accuracy. There are four steps to accomplish this, the last three steps being resolvable by one algorithm. The four steps are: data acquisition, image processing, surface construction, and display.
The data acquisition is performed through standard medical imaging techniques which provide information from the patient either through computed tomography (CT), magnetic resonance (MR) or single photon emission computed tomography (SPECT). The next step, image processing is achieved by use of algorithms. The surface is then constructed through a three dimensional model, this surface is then displayed using realistic image that provides for shading and ray casting.
An algorithm known as the marching cubes algorithm may be used to assist in refining the surface so that it provides a more realistic picture for the surgeon. The surface construction is essentially a two step process of first locating the surface, -which corresponds to. a user-specified value, and then calculating no ms at each vertex of each triangle. This algorithm utilizes cubes created from pixels to process local vertices and the intersections. First, the surface corresponding to a user specified value is located and triangles created, then the algorithm determines how the surface intersects the cube that was created from the pixels. This process is accomplished by assigning the vertices of each cube a value and comparing it to the value of the surface.
The process results in 256 possible ways for the surface to intersect the cube.
However, two symmetries of the cube, topology and rotational symmetry, are used to reduce the number of possibilities to fourteen. After the number of cases is reduced an index is created for each of the fourteen possible cases. This index allows for the identification of surface intersections and then linear interpolation can be utilized to develop the surface. A surface of constant density has a zero gradient component along the surface tangential direction, so the direction of the gradient vector is normal to the surface. From this knowledge, the surface normal vector can be determined assuming the magnitude of the gradient vector is nonzero. Because the surface of interest is between tissues of different densities, the gradient vector is nonzero. The gradient vector is the derivative of the density function. Therefore to approximate the gradient vector, the gradient vector is estimated at the cube vertices and then linearly interpolated at the point of intersection. This estimation is accomplished using the differences of the densities at a given pixel and dividing that by the lengths of the cube edges. The calculation results in the unit normal which is then linearly interpolated to the point of intersection. The unit normal is calculated for each triangle vertex and the algorithm uses this unit normal to produce Gourad-shaded images. The marching cubes algorithm creates a surface from a three dimensional data set and has been applied to two dimension data from CT, MR, and SPECT scans to successfully give a resulting three dimensional view for medical applications. More details of the image reconstruction process are described for example in Lorensen et al., "Marching Cubes:
a high resolution 3D surface reconstruction algorithm," Computer Graphics 21 (1987) 163-169.
With reference now to FIG. 1, 5, and 6 the next step is initial calibration of the C-arm 450. A phantom 320 (FIG. 1) is attached to the lens of the C-arm device and a blank C-arm image is taken, step 460, FIG. 5. The phantom 320 is used to correct for the distortion associated with the C-arm image. - The phantom contains several reference objects and a large number of small reference objects. The control unit automatically recognizes the reference objects and creates distortion correction maps and calibrates intrinsic parameters to correct for the imprecise C-ann image.
Systems such as these for calibration are known in the art.
One such method for distortion correction utilizes a system which combines an x-ray camera connected to a control computer with an infrared tracking system linked to the control computer. In this method of distortion correction, the training of distortion parameters is combined with infrared tracking. The x-ray camera is calibrated, to correct for the distortion caused by the earth's magnetic fields, such 10a distortion is dependent on the camera's position. Using the x-ray camera infrared tracking system, there are three steps for successful camera calibration to remove the distortions. The first step calibrates the x-ray camera by use of a fixed three dimensional coordinate system represented by a static calibration object and a second calibration object to determine the distortion properties. Distinct markers are used for each calibration object . The camera images are then smoothed and a set of connected regions in the image is obtained. Error minimization between the actual and the anticipated projections of the markers is accomplished by use of a cubic polynomial.
This step, also referred to as coupled calibration, performs an error minimization between the anticipated and actual projections of the calibration markers, it utilizes a cubic distortion model to correct the resultant bending of the straight line into an S
curve. Measurements are taken between the distorted actual image point and the projected point. Although this provides for some distortion correction, still, the camera parameters must be decoupled to correct for divergence, local minima, and the dependency of the coupled calibration on the initialization.
The second step, also known as decoupled parameters, need not be done intra-operatively as the infrared system is static, and the correction can be made based upon a fixed camera placement. The image is placed in the surface of calibration dish and the distortion parameters are determined. The correction polynomials applied are only partially cubic and are linearly dependent on the distortion parameters. The resulting function is quadratic and is solved analytically.
The final step eliminates the need for intra-operative calibration and marker detection. The-actual camera placement and the corresponding distortion parameters from the earlier steps are utilized in what is referred to as the "learning mode." The "learning mode" constitutes taking pre-operative images and computing the corresponding distortion correction parameters by spline interpolation. The calibration is accomplished by using a pointer tracking system and matching the pre and intra-operative contours. This last step of the overall calibration method works however, only if the intra-operative viewing angles are limited to those in close vicinity to the pre-operative viewing angles. Further details of such a distortion correction system are described, for example, in Brack et al., "Accurate X-ray Navigation in Computer-Assisted Surgery", Proc. Of the 12th Int. Symp. On Computer Assisted Radiology and Surgery, H. Lemke, et al., eds., Springer, 1998.
Another method of distortion correction can be implemented for use with fluoroscopic images according to a preferred embodiment of the invention.
Fluoroscopic x-ray images are frequently used in the medical field, but are plagued by substantial distortions which must be corrected in order to effectively utilize these images. These distortions, which include small radial distortions and scaling deviations, are a result of both C-arm armamature deflection and orientation.
Fluoroscopic images must be dewarped, which may be accomplished by computing a dewarped map from a reference image The distortion can be modeled either across the entire image as a single function or by tessellating the image view of the. field into triangles or quadrilaterals and then computing individual distortion functions, which are determined by using bilinear interpolation. Since the individual distortion functions are more adaptable, this local method is often preferred. To determine the distortion factors, the necessary parameters are the relative position and the orientation of the camera with respect to the imaging plane, the focal length, the image center location, and the image scaling and radial distortion coefficients. The relationship between these parameters is obtained by formulating the transformation from the world coordinate to the camera coordinates, transforming the three dimensional camera coordinates into two dimensional coordinates in an ideal image and then adding radial distortion, shifting-and scale. The equations are solved for the relative position and orientation parameters by resolving a set of linear equations.
Based on the solved parameters, the remaining parameters are derived. The least squares.
method is then used to incorporate additional points. Since the C-arm distortion is orientation dependent, the process must be completed for a variety of orientations, focusing on the extremes to ensure correction parameters cover the entire field. More details of the process are described, for example in Yaniv et al., "Fluoroscopic Image Processing for Computer-Aided Orthopaedic Surgery", Proc. l' Int. Conf. On Medical Computing and Computer-Assisted Intervention, Lecture Notes in Computer Science 1496, Elsevier, et al., eds., 1998, which is incorporated herein by reference.
Furthermore, images may be enhanced by improvement in control and alignment of the C-arm. This type of improvement can be accomplished by the creation of a local coordinate system. A local coordinate system may be attached to the surgical tool, the patient, and the C-arm. Then the coordinate system of the surgical tool is converted to the coordinate system of the two dimensional C-arm image coordinate system. The transformation between the surgical tool and the ultimate image is provided in real-time by the various position sensors. The basis for the transformation is a linear cone beam projection model. The conversion of the C-arm projection from three dimensional space to two dimensional image is obtained preoperatively during the C-arm calibration. The constant projection parameters of the C-arm are acquired using a calibration probe containing steel spheres which is equipped with LED sensors. From these sensors, the position of each sphere can be calculated and subsequently assigned a corresponding position in the two dimensional image. The resulting system of equations are solved using an error minimizing algorithm. To further minimize errors resulting from stress-dependent deformation of the C-arm frame, additional LEDs are mounted to track the actual camera position for updating at the time of image acquisition. To the extent there is additional distortion in the image intensifier-TV chain of the C-arm, resulting in stationary pin cushion distortion, and also a small variable amount of distortion caused by magnetic fields, a bilinear interpolation algorithm may be used for correction- Further details are described in Hofstetter et al., "Fluoroscopy Based Surgical Navigation -Concept and Clinical Applications", Proc. 11`'' Int. Symp. on Computer Assisted Radiology and Surgery, H.U. Lemke, et al., eds., Springer 1997.
A further method for three dimensional camera calibration utilizes a two step technique. Utilizing this two step approach, a real constraint or equation that is only a function of a subset of the calibration parameters is implemented. This reduces the dimensionality of the unknown parameter space.
The first step computes the three dimensional orientation and position. In this part of the process the distorted image coordinates are computed from the relationship between the distance between coordinate and the image center and an uncertainty determined.
The second step computes the effective focal length, distortion coefficients and third dimension position. These parameters are calculated from the relationship between the calibration points, the distances and the transformation matrix and rotation matrix from the first step.
This two step method is referred to as the "radial alignment constraint" and it is only a function of relative rotation and translation between the camera and the calibration points. The method is distinguishable from other methods in that the order of the transformation from the three dimensional camera coordinate to the image coordinate is rotation followed by translation as opposed to the reverse.
Another benefit of this method is that it can be completed in real time. Furthermore, this method can also be used for calibrating a camera using monoview noncoplanar points and multiple viewing positions. Additional details are described in Tsai et al., "A
Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses", IEEE Journal of Robotics and Automation, Vol. RA-3, No. 4, August 1987 which is incorporated herein by reference.
One of ordinary skill in the art will appreciate these aforementioned methods of calibration are exemplary and not limiting on the C-arm calibration method that may be employed by the present invention.
Next, the patient is brought into the operating room, a small incision is made according to standard surgical practice at the site where clamp 40 is to be attached, and the clamp is attached tothe selected-bone using handles as described above, step 462, FIG. 5. Handles 210 are then removed from the clamp 40. An image referencing plate 800 (FIG. 6) is attached to clamp 40, step 465, FIG. 5, by receiving holes that receive connector pins 200. The image referencing plate 800 (FIG. 6) has three referencing markers 810 on it that show up very clear and precise in the C-arm image. The distance and angle between the referencing markers 810 are known such that the C-arm image can be calibrated in a secondary calibration step, step 465, to accurately represent actual size of the image. At least two, but preferably three C-arm images are taken of the patient with the attached clamp 40 and image referencing plate 800.
These C-arm images are taken from different angles, preferably 0, 45, and 90 degrees, connector pins 200. The image referencing plate 800 (FIG. 6) has three referencing markers 810 on it that show up very clear and precise in the C-arm image. The distance and angle between the referencing markers 810 are known such that the C-arm image can be calibrated in a secondary calibration step, step 465, to accurately represent actual size of the image. At least two, but preferably three C-arm images are taken of the patient with the attached clamp 40 and image referencing plate 800.
These C-arm images are taken from different angles, preferably 0, 45, and 90 degrees, 14a scaling factor.
From these coordinates, the translation vectors and rotation factors are calculated. Using the translation vectors and rotation factors, the rotational matrix is determined.
The second step computes the effective focal length, distortion coefficients and third dimension position. These parameters are calculated from the relationship between the calibration points, the distances and the transformation matrix and rotation matrix from the first step.
This two step method is referred to as the "radial alignment constraint" and it is only a function of relative rotation and translation between the camera and the calibration points. The method is distinguishable from other methods in that the order of the transformation from the three dimensional camera coordinate to the image coordinate is rotation followed by translation as opposed to the reverse.
Another benefit of this method is that it can be completed in real time. Furthermore, this method can also be used for calibrating a camera using monoview noncoplanar points and multiple viewing positions. Additional details are described in Tsai et al., "A
Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses", IEEE Journal of Robotics and Automation, Vol. RA-3, No. 4, august 1987.
One of ordinary skill in the art will appreciate these aforementioned methods of calibration are exemplary and not limiting on the C-arm calibration method that may be employed by the present invention..
Next, the patient is brought into the operating room, a small incision is made according to standard surgical practice at the site where clamp 40 is to be attached, and the clamp is attached to-the selected bone using handles as described above, step 462, FIG. S. Handles 210 are then removed from the clamp 40. An image referencing plate 800 (FIG. 6) is attached to clamp 40, step 465, FIG. 5, by receiving holes that receive step 470, FIG. 5.
In another embodiment of the present invention the secondary calibration step, step 465B, can be accomplished by attaching the robot 30 to the clamp and taking multiple C-arm images. By knowing the dimensions, or by placing referencing markers on robot 30 and knowing the distance and angle between the referencing markers the C-arm images can be calibrated in a secondary calibration step, step 465B.
The next step of the process is co-registration, step 500. The C-arm images are transferred into the control unitlO as data, step 502. At each location an image is taken from, the position of the C-arm is recorded, step 504, into the control unit 10.
The data of the images, step 502, and the position of the C-arm, step 504, are correlated by knowing the position from which each images was taken, step 504, and by aligning the referencing markers 810 (FIG. 6) from the image referencing plate 800 (FIG. 6). Thus, an accurate, pseudo three-dimensional image of the surgical site with the clamp 40 attached to the bone is generated. This stage can be referred to as robot to bone registration or co-registration.
According to a preferred embodiment of the invention, bone to bone registration next occurs in step 600. Step 600 is a process of estimating and matching the true surface contours or the objects in the images. Registration methods are either based on geometry or intensity of the image. Geometric based registration is achieved by finding features in the two dimensional fluoroscopic images and matching these features with corresponding features in the three dimensional image, acquired, for example, from a CT scan dataset, MRi image, ultrasound image or from a CAD - --model. The features canbe known landmarks (anatomical landmarks or implanted fiducials), or contour points in the fluoroscopic image, matched with the registered object's surface. An algorithm that may be used to compute the transformation is the Iterative Closest Point (ICP) algorithm. The ICP algorithm is an iterative alignment algorithm that works in three phases: first it establishes correspondence between pairs of features in the two structures that are to be aligned based on proximity, next it estimates the rigid transformation that best maps the first member of the pair onto the second and third, it applies that transformation to all features in the first structure.
These three steps are then reapplied until convergence is concluded. The ICP
algorithm relies on a convergence theorem. The key differentiation between the least squares registration and the ICP is the least squares generically reduces the average distance between corresponding points during each iteration whereas the closest point determination generally reduces the distance for each point individually.
Further details on the use of the ICP algorithm are described in Besl et al., "A
Method for Registration of 3D Shapes", IEEE Trans. on Pattern Analysis and Machine Intelligence, 1992, 14(2), 239--255. The input to the algorithm are sets of back-projected rays from the fluoroscopic images, and a model of the registered object.
The algorithm iteratively computes a transformation that approximates the ray sets to the model. For landmark registration, a match between each ray and the corresponding landmark is defined before searching for the transformation.
Contour registration selects a new surface point to match with each ray on every iteration.
Preferably, the registration process uses two or more fluoroscopic images.
One method of automatic registration can be represented by a cooperative approach between registration and segmentation of preoperative surface models and intra-operative x-ray images. The cooperative approach undertakes four steps:
presegmentation, transformation, extraction, and error minimization.
Presegmentation extracts contour points. These contour points correspond to pixels with large variations in grey-level intensity. The contour points are organized in chains of connected pixels with like grey level intensity resultings in automatic edge detection of an image. Then initial registration completes the segmentation to extract likely contours on x-ray images. This is done by identifying multiple pixels on anatomical landmarks and defining these pixels on x-ray images, thus ensuring the same -landmarks are selected on the three dimensional surface model. These two sets of matched pixels are used cooperatively to estimate the initial transformation.
The automatic edge detection results in an excessive number of contour points therefore it is necessary to eliminate pixels which do not correspond to contour points that are of interest. From the automatic edge detection weight must be given to each pixel in order to determine the likelihood that it is a real contour pixel; this determination is made by summing the gradient value, the size of the connected component and a distance factor. The first two components come from the x-ray image while the third depends upon information from the initial registration process. The distance calculation is performed utilizing an algorithm which minimizes energy and distance to account for internal and external contours, one such algorithm that may be used is the Levenberb Marquardt algorithm. Further details of preferred registration procedures are described in Hamadeh, et al., "Towards automatic registration between CT and X-ray images: cooperation between 3D/2D registration and 2D edge detection, " Medical robotics and computer assisted surgery, 1995, Wiley 39-46 and Hamadeh, et al., "Automated 3-Dimensional Computed Tomographic and Fluoroscopic Image Registration", Computer Aided Surgery, 1998, 3.
According to the registration method described above, anatomical landmarks in the images are detected and matched manually. Based on this match, an approximated initial guess is computed, with ray intersections, which are three dimensional points in the registration environment, being matched with the model's landmarks. Then, the object's contour in the two dimensional image is registered with the model's surface.
A likelihood estimator is used to remove outliers, or pixels not in the contour, from the sample point set. A signed distance function is defined to overcome any internal contours problems. The overall in-vitro accuracy of this method can be better than 2mm.
While most registration processes involve multiple images, in one alternative, a single fluoroscopic image may be used. The use of a single fluoroscopic image may still achieved an accuracy of about 3mm. This single fluoroscopic image technique is based on a combinatorial search among matches of three points and three rays. -The match with minimal average distance for the registration is then selected.
These points and rays are used to determine two initial registrations. In such a technique, both points and lines may be used to represent data. In the single fluoroscopic model, the three points and the three rays are registered and from this, two three-point registrations, designated by triangles can be found. From the triangle's vertices, non-linear functions can be established and then solved for the two unknowns by applying the Levenberg-Marquardt algorithm. From these points the line can be determined and the point-line correspondence can be solved. The lines are then fixed while the points are permuted resulting in three points in the back-projected lines.
Horn's method is then used for the transformation into a frame and the ICP algorithm is implemented to determine the best match points for the registration. Further details of this technique are described in Tang, "Method for Intensity-based Registration with CT Images," Masters Thesis: Department of Computer Science, Queen University, Ontario Canada, 1999.
In a further alternative according to the invention, intensity-based registration is achieved by comparing fluoroscopic images with simulated X-rays (digitally reconstructed radiographs, or DRR's) from an estimated position. In this alternative, three types of coordinate systems are involved in the registration process:
the CT
coordinate system, the world coordinate system, and the radiographic coordinate system. The registration process consists of determining the CT to world transformation matrix , also known as the volume transformation matrix.
For each radiograph, the radiograph to world transformation matrix is derived.
An iterative procedure is used to adjust the translation and orientation of the computed tomography (CT) data in the world coordinate system until a best match with the DRR
is found. Next the radiographic to world transformation os accomplished.
Translation, rotation, and scaling matrices are applied to the available data to complete and validate the registration. From these matrix calculations, the world coordinate of any voxel, three dimensional pixel, can be calculated.
To achieve the best match between the CT and the DRR, two elements are required, a cost function (the inverse of measure of similarity) and an algorithm for minimizing the cost function. Two costs functions are considered: the cross correlation of the pixel values and the magnitude of the scalar product of the gradient.
The -cross correlation -is a function of the Pearson's product-movement coefficient and the number of nonvoid pixels. The gradient is a function of the product of the gradients in the plain radiographs and the DRR weighted by the number of pixels. The relative merit of the cost functions is analyzed in the vicinity of the stereotactic registration point. The stereotactic registration error and the extent of parameter space around the minimum devoid of local minima along the axis are the applicable criteria.
A minimization algorithm based on patient orientation during the image acquisition and the assumption that the CT and radiographic acquisitions are such that the x-rays are nearly parallel to the CT slices is most effective in solving the registration problem.
The registration process as described in this alternative can be completed either semi-automatically or automatically. In semi-automatic registration, a mouse driven interface can be used to initiate the registration process and provide for the rotation and translation of the CT parameters. Automatic registration can be accomplished by utilization of biscalar algorithms for translation, complimented by Powell's algorithm for exploration of the full six-dimensional rotation parameter. The method of automatic registration comprises eleven steps: an eight-step orientation algorithm followed by the three-step six-dimensional minimization algorithm. Further details are described in Lemieux et al., "Patient-to computed-tomography image registration method based digitally reconstructed radiographs", Medical Physics, 21, 1994, 1760.
Another type of registration that may be implemented in the invention is intensity based registration. Intensity based registration is utilized to develop an improved automatic beam alignment process for frameless image-guided radiosurgery.
I I I
Utilizing this mode of registration, radiographs acquired during patient treatment can be coordinated with DRRs generated from a CT study representative of hypothetical patient positions which involve three translations and three rotations. This method of registration has three parts: developing a means of exploring the range of possible patient positions; identifying those elements of images that effectively capture the patient pose; and using a comparison statistic or cost function for the two sets of image feature data to indicate when the best match has been accomplished. There are three ways to analyze DRRs and complete the match for this method of registration:
the matched filter area correlation; the interpolative area correlation; and the iterative reprojection. The preferred method is the iterative reprojection because it is executed in real time. Along with the necessary correlation corrections, the comparison between the DRRs and the radiographs poses the problem of pattern recognition which must also be resolved during registration. The image data used is referred to as feature vectors; these vectors may be primitive or highly sophisticated. The registration algorithm provides for an independent check on the edge detection process as well as the region of interest. The registration algorithm employs six free parameters to minimize the chi-statistic which is consists of the weighted vector components. The minimization problem is nonlinear and solved with a hybrid algoritm that starts with a gradient search and processes to a Taylor series approximation. Using the iterative reprojection method, and algorithm may be designed such that the registration process is completely automated, reliable, and speedy, however, it is necessary to identify the areas of interest prior to registration.
Further details on such techniques are described for example, in Murphy, M.
"An automatic six-degree-of freedom image registration algorithm for image-guided frameless stereotactic surgery", Medical Physics, 24(6), June 1997.
When the camera position guess and the actual position are very close, the original and reconstructed image are very similar. Pixel intensity information is used to define a measure of similarity between the datasets. The similarity measure can include intensity values, cross-correlation, histogram correlation, and mutual information. The algorithm proceeds in three steps. The input is a CT data set, intrinsic camera parameters, one or more fluoroscopic images and an initial camera position estimate for each image. In the first step, the algorithm generates one DRR
for each given camera position. In the second step, a dissimilarity measure is computed between the real and reconstructed image. In the third step, new camera poses are computed that best reduce the dissimilarity between the images. The process is repeated until convergence is reached. The parametric space of camera positions in then searched incrementally from an initial configuration. The space is six-dimensional (three rotations and three translations). The advantages of this technique is that no segmentation is necessary. However, the search space is six-dimensional, and can contain many local minima.
A benefit of the present invention is that it can utilize either of the above described registration methods. By utilizing the dimensions of the bone attached robot and its attachment location, the initial location of the window is a very good guess of the location and therefore the intensity based method can be utilized. Thus, according to the present invention, a faster and more accurate registration process is accomplished as between the fluoroscopic and three dimensional images. This is done in step 600, and occurs very quickly and with a high degree of accuracy because the registration process is performed on small windows of the images, rather than the images as a whole. Preferably windows are selected that specifically relate to the 20a known location of the robot and/or its support member. Windows of about 20 mm by 20 mm located approximately adjacent to the clamp location, according to pre-operative calculation of the bone-robot attachment location, are selected from the C-arm (fluoroscopic) image data, step 610. For example, these windows maybe selected as the area above the attached clamp 40 in the C-arm image and the tip of the transverse process of the vertebra covering the area where the surgical procedure is to take place. Generally, the same windows are chosen from both the pseudo three-dimensional hybrid C-arm image, step 510, and also from the CT image (three dimensional image), step 410. The small windows chosen from the C-arm images and the CT scan image are then laid over each other and matched or registered by the control unit, step 620, as described above. Focusing only on a small window of the C-arm image rather than looking for a matching anatomical landmark in the entire image, makes the process occur very fast and with the high degree of accuracy needed for precise procedures such as vertebra surgery.
Next, the remaining portion of the CT and C-arm image of the bones are overlaid, the registration windows are aligned, and the remaining bone is registered, step 630. Since the windows have already been accurately registered this step occurs quickly and also with a high degree of accuracy. Now clamp 40 is located precisely on the bone, step 640, of the CT image. Next, the user attaches robot 30 to clamp 40 and thus, robot 30 is located precisely with respect to the bone, step 645.
After robot 30 is co-registered 500 and registered 600, its position is known relative to the patient's bone and therefore can move to align with the pre-operatively picked location such that the operation can virtually take place on the control unit.
The user selects a pre-operatively planned location and task from step 420 by use of a joystick, mouse, touch screen, or the like, step 710. The robot 30 responds and moves sleeve 60 into position, step 720, such that when the user inserts a surgical tool 70 through the opening in the sleeve 60 the surgical tool 70 will be precisely aligned with the location requiring the surgical procedure, step 730. The surgeon can then insert a selected surgical tool 70 and operate without opening the surgical site to see the placement of the surgical tool because the surgeon can verify the positioning of the surgical tool 70 on the control unit 10 and display 20. Thus operating percutaneously or in general open procedures, with a high degree of accuracy, low trauma, small incisions, low chance of infection, and minimal exposure to radiation. A
further benefit of this system is that because the robot is miniature it can be freely attached to the bone of a patient and move with the body. Therefore, the robot system does not need a dynamic referencing device to maintain orientation with the body once it is registered. This creates a more precise and less complicated system that is versatile and user friendly as the surgeon can manipulate the patient into different surgical positions without disturbing the robot system.
The present invention is illustrated herein by reference to a spinal vertebra attachment. However, it will be appreciated by those in the art that the teachings of the present invention are equally applicable to other bone attachments.
Claims (24)
1. A system for performing a surgical procedure at a surgical site, comprising:
a surgical robot for manipulating a tool to said surgical site;
an attachment member configured and dimensioned to mount the surgical robot on a bone associated with said surgical site;
an image referencing element adapted to be attached in a known manner to either of said robot and said attachment member; and a controller programmed to direct the robot to position the surgical tool at the surgical site, wherein said controller is adapted to enable the system to perform the following steps:
utilizing an initial three dimensional image of said surgical site to provide a surgical plan of said procedure;
generating at least two intraoperative images of said surgical site including said image referencing element;
correlating said at least two intraoperative images to form a pseudo three dimensional image, including said image referencing element;
selecting a window from said pseudo three dimensional image and registering said window with a similarly selected window from said initial three dimensional image; and correlating said pseudo three dimensional image with said initial three dimensional image such that said image referencing element is located with respect to the surgical plan.
a surgical robot for manipulating a tool to said surgical site;
an attachment member configured and dimensioned to mount the surgical robot on a bone associated with said surgical site;
an image referencing element adapted to be attached in a known manner to either of said robot and said attachment member; and a controller programmed to direct the robot to position the surgical tool at the surgical site, wherein said controller is adapted to enable the system to perform the following steps:
utilizing an initial three dimensional image of said surgical site to provide a surgical plan of said procedure;
generating at least two intraoperative images of said surgical site including said image referencing element;
correlating said at least two intraoperative images to form a pseudo three dimensional image, including said image referencing element;
selecting a window from said pseudo three dimensional image and registering said window with a similarly selected window from said initial three dimensional image; and correlating said pseudo three dimensional image with said initial three dimensional image such that said image referencing element is located with respect to the surgical plan.
2. The system according to claim 1, wherein said window is selected in the region of the attachment member.
3. The system according to claim 1, wherein said generating an initial three dimensional image comprises at least one of generating a magnetic resonance image, generating a Computerized Tomography image, generating an ultrasound image and generating an image by extracting the image from a CAD model.
4. The system according to claim 1, wherein said intraoperative images of the surgical site comprise C-arm X-ray images.
5. The system according to claim 1, wherein said correlating the pseudo three dimensional image with the initial three dimensional image comprises registering additional windows of said initial three dimensional image with additional windows of said pseudo three dimensional image.
6. The system according to claim 5, wherein said registering step is based on matching of geometric features in said window of said pseudo three dimensional image with geometric features in said similarly selected window from said initial three dimensional image.
7. A system for performing a surgical procedure at a surgical site, comprising:
a surgical robot for manipulating a tool to said surgical site, said robot having at least one of known dimensions, and markers attached to it in predetermined locations;
an attachment member configured and dimensioned to mount the surgical robot on a bone associated with said surgical site;
an image referencing element adapted to be attached in a known manner to either of said robot and said attachment member; and a controller programmed to direct the robot to position the surgical tool at the surgical site, wherein said controller is adapted to enable the system to perform the following steps:
utilizing an initial three dimensional image of said surgical site to provide a surgical plan of said procedure;
generating at least two intraoperative images of said surgical site including at least one of said known dimensions of said robot and said markers attached in predetermined locations to said robot;
correlating said at least two intraoperative images to form a pseudo three dimensional image, including at least one of said known dimensions of said robot and said markers;
selecting a window from said pseudo three dimensional image and registering said window with a similarly selected window from said initial three dimensional image; and correlating said pseudo three dimensional image with said initial three dimensional image such that said robot is located with respect to the surgical plan.
a surgical robot for manipulating a tool to said surgical site, said robot having at least one of known dimensions, and markers attached to it in predetermined locations;
an attachment member configured and dimensioned to mount the surgical robot on a bone associated with said surgical site;
an image referencing element adapted to be attached in a known manner to either of said robot and said attachment member; and a controller programmed to direct the robot to position the surgical tool at the surgical site, wherein said controller is adapted to enable the system to perform the following steps:
utilizing an initial three dimensional image of said surgical site to provide a surgical plan of said procedure;
generating at least two intraoperative images of said surgical site including at least one of said known dimensions of said robot and said markers attached in predetermined locations to said robot;
correlating said at least two intraoperative images to form a pseudo three dimensional image, including at least one of said known dimensions of said robot and said markers;
selecting a window from said pseudo three dimensional image and registering said window with a similarly selected window from said initial three dimensional image; and correlating said pseudo three dimensional image with said initial three dimensional image such that said robot is located with respect to the surgical plan.
8. The system according to claim 7, wherein said window is selected in the region of the attachment member.
9. The system according to claim 7, wherein said generating an initial three dimensional image comprises at least one of generating a magnetic resonance image, generating a Computerized Tomography image, generating an ultrasound image and generating an image by extracting an image from a CAD model.
10. The system according to claim 7, wherein said intraoperative images of the surgical site comprise C-arm X-ray images.
11. The system according to claim 7, wherein said correlating the pseudo three dimensional image with the initial three dimensional image comprises registering additional windows of said initial three dimensional image with additional windows of said pseudo three dimensional image.
12. The system according to claim 11, wherein said registering step is based on matching of geometric features in said window of said pseudo three dimensional image with geometric features in said similarly selected window from said initial three dimensional image.
13. A system for performing a procedure at a surgical site, said system comprising:
a surgical robot adapted to carry a surgical tool;
an attachment member configured and dimensioned to mount said surgical robot on a bone associated with said surgical site, such that said robot's position relative to said bone is unchanged with motion of said bone; and a controller correlating an initial image including said surgical site, with an intraoperative image including said surgical site and at least one of said surgical robot or its attachment member, such that the position of said robot is registered to said initial image, wherein said controller utilizes said registration of said position of said robot to said initial image to direct said robot to manipulate said surgical tool to perform on said bone, said procedure planned using said initial image.
a surgical robot adapted to carry a surgical tool;
an attachment member configured and dimensioned to mount said surgical robot on a bone associated with said surgical site, such that said robot's position relative to said bone is unchanged with motion of said bone; and a controller correlating an initial image including said surgical site, with an intraoperative image including said surgical site and at least one of said surgical robot or its attachment member, such that the position of said robot is registered to said initial image, wherein said controller utilizes said registration of said position of said robot to said initial image to direct said robot to manipulate said surgical tool to perform on said bone, said procedure planned using said initial image.
14. The system according to claim 13, wherein said controller directs said robot to manipulate said surgical tool to perform on said bone, an operation planned using said initial image, without the need for a dynamic referencing device to maintain orientation of said robot relative to the position of said bone during said operation.
15. The system according to claim 13, wherein said robot is controlled to manipulate said surgical tool through use of at least one of a mouse, a joystick and a touch-screen.
16. The system according to claim 13, wherein said surgical tool comprises at least one of a cutting member, a drilling member, a screwdriver, a drill bit and a Kirschner wire.
17. The system according to claim 13, wherein said surgical tool is carried in a surgical tool guide.
18. The system according to claim 13, wherein said robot is configured and dimensioned such that it can be fully supported on said bone.
19. The system according to claim 13, wherein said attachment member is either one of a bone clamp and at least a pair of Kirschner-wires.
20. The system according to claim 17, wherein said surgical tool guide is a sleeve adapted for insertion of said surgical tool.
21. The system according to claim 13, wherein said robot comprises a miniature parallel robot.
22. The system according to claim 13, wherein said robot comprises at least 3 actuators mounted on a base member, said actuators being configured for translational or rotational movement.
23. The system according to claim 13, wherein said attachment member comprises a robot receiving adaptor mounted on a bone attachment portion.
24. The system according to claim 23, wherein said bone attachment portion comprises either one of a clamp having at least two jaws shaped to clamp onto said bone or at least one wire configured and dimensioned to be received in a bone hole.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/912,687 US6837892B2 (en) | 2000-07-24 | 2001-07-24 | Miniature bone-mounted surgical robot |
US09/912,687 | 2001-07-24 | ||
PCT/IL2002/000399 WO2003009768A1 (en) | 2001-07-24 | 2002-05-22 | Miniature bone-attached surgical robot |
Publications (2)
Publication Number | Publication Date |
---|---|
CA2454861A1 CA2454861A1 (en) | 2003-02-06 |
CA2454861C true CA2454861C (en) | 2011-04-26 |
Family
ID=25432274
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA2454861A Expired - Lifetime CA2454861C (en) | 2001-07-24 | 2002-05-22 | Miniature bone-attached surgical robot |
Country Status (6)
Country | Link |
---|---|
US (4) | US6837892B2 (en) |
EP (1) | EP1414362B1 (en) |
JP (1) | JP2004535884A (en) |
AT (1) | ATE541529T1 (en) |
CA (1) | CA2454861C (en) |
WO (1) | WO2003009768A1 (en) |
Families Citing this family (266)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7635390B1 (en) | 2000-01-14 | 2009-12-22 | Marctec, Llc | Joint replacement component having a modular articulating surface |
US6837892B2 (en) * | 2000-07-24 | 2005-01-04 | Mazor Surgical Technologies Ltd. | Miniature bone-mounted surgical robot |
KR20030002219A (en) * | 2001-06-30 | 2003-01-08 | 한국과학기술원 | Femur clamping robot mount for robotic total hip arthroplasty |
US7708741B1 (en) | 2001-08-28 | 2010-05-04 | Marctec, Llc | Method of preparing bones for knee replacement surgery |
US8010180B2 (en) | 2002-03-06 | 2011-08-30 | Mako Surgical Corp. | Haptic guidance system and method |
US9155544B2 (en) | 2002-03-20 | 2015-10-13 | P Tech, Llc | Robotic systems and methods |
EP1534141B1 (en) * | 2002-06-17 | 2013-08-07 | Mazor Robotics Ltd. | Robot for use with orthopaedic inserts |
AU2003268554A1 (en) * | 2002-09-09 | 2004-03-29 | Z-Kat, Inc. | Image guided interventional method and apparatus |
AU2003272660B2 (en) | 2002-09-26 | 2008-03-20 | Depuy Products, Inc. | Method and apparatus for controlling a surgical burr in the performance of an orthopaedic procedure |
US20050267354A1 (en) * | 2003-02-04 | 2005-12-01 | Joel Marquart | System and method for providing computer assistance with spinal fixation procedures |
DE10322738A1 (en) * | 2003-05-20 | 2004-12-16 | Siemens Ag | Markerless automatic 2D C scan and preoperative 3D image fusion procedure for medical instrument use uses image based registration matrix generation |
DE10335388B4 (en) * | 2003-07-25 | 2006-06-22 | Aesculap Ag & Co. Kg | Set of surgical referencing devices |
US7209538B2 (en) | 2003-08-07 | 2007-04-24 | Xoran Technologies, Inc. | Intraoperative stereo imaging system |
DE10340151A1 (en) * | 2003-08-26 | 2005-04-21 | Aesculap Ag & Co Kg | Surgical holding device |
EP1677679A1 (en) * | 2003-10-03 | 2006-07-12 | Xoran Technologies, Inc. | Ct imaging system for robotic intervention |
KR101062593B1 (en) | 2003-10-06 | 2011-09-06 | 메이저 서기컬 테크놀로지스 엘티디. | Devices for fixation of the spine of the vertebrae |
US20050107687A1 (en) * | 2003-11-14 | 2005-05-19 | Anderson Peter T. | System and method for distortion reduction in an electromagnetic tracker |
DE10353700B4 (en) * | 2003-11-18 | 2008-04-03 | Universität Heidelberg | Device for path control of a medical instrument and control unit therefor |
EP1725916B1 (en) * | 2004-02-04 | 2012-11-21 | Mazor Robotics Ltd. | Verification system for robot pose |
US7235076B2 (en) * | 2004-02-20 | 2007-06-26 | Pacheco Hector O | Method of improving pedicle screw placement in spinal surgery |
DE102004010332B3 (en) * | 2004-02-25 | 2005-10-20 | Aesculap Ag & Co Kg | Surgical holder for holding and positioning a surgical instrument comprises a frame having a first holding arm guide for holding and guiding a first holding arm |
US20060135959A1 (en) * | 2004-03-22 | 2006-06-22 | Disc Dynamics, Inc. | Nuclectomy method and apparatus |
US7300432B2 (en) * | 2004-04-21 | 2007-11-27 | Depuy Products, Inc. | Apparatus for securing a sensor to a surgical instrument for use in computer guided orthopaedic surgery |
US7620223B2 (en) * | 2004-04-22 | 2009-11-17 | Siemens Medical Solutions Usa, Inc. | Method and system for registering pre-procedural images with intra-procedural images using a pre-computed knowledge base |
US7366278B2 (en) * | 2004-06-30 | 2008-04-29 | Accuray, Inc. | DRR generation using a non-linear attenuation model |
US7327865B2 (en) * | 2004-06-30 | 2008-02-05 | Accuray, Inc. | Fiducial-less tracking with non-rigid image registration |
US7231076B2 (en) * | 2004-06-30 | 2007-06-12 | Accuray, Inc. | ROI selection in image registration |
US7426318B2 (en) * | 2004-06-30 | 2008-09-16 | Accuray, Inc. | Motion field generation for non-rigid image registration |
US7522779B2 (en) * | 2004-06-30 | 2009-04-21 | Accuray, Inc. | Image enhancement method and system for fiducial-less tracking of treatment targets |
CA2513202C (en) * | 2004-07-23 | 2015-03-31 | Mehran Anvari | Multi-purpose robotic operating system and method |
US8016835B2 (en) * | 2004-08-06 | 2011-09-13 | Depuy Spine, Inc. | Rigidly guided implant placement with control assist |
US8182491B2 (en) * | 2004-08-06 | 2012-05-22 | Depuy Spine, Inc. | Rigidly guided implant placement |
US7734119B2 (en) * | 2004-09-21 | 2010-06-08 | General Electric Company | Method and system for progressive multi-resolution three-dimensional image reconstruction using region of interest information |
US8361128B2 (en) | 2004-09-30 | 2013-01-29 | Depuy Products, Inc. | Method and apparatus for performing a computer-assisted orthopaedic procedure |
US20090264939A9 (en) * | 2004-12-16 | 2009-10-22 | Martz Erik O | Instrument set and method for performing spinal nuclectomy |
EP1855607B1 (en) * | 2005-01-13 | 2017-10-25 | Mazor Robotics Ltd. | Image-guided robotic system for keyhole neurosurgery |
US9943372B2 (en) | 2005-04-18 | 2018-04-17 | M.S.T. Medical Surgery Technologies Ltd. | Device having a wearable interface for improving laparoscopic surgery and methods for use thereof |
US8414475B2 (en) * | 2005-04-18 | 2013-04-09 | M.S.T. Medical Surgery Technologies Ltd | Camera holder device and method thereof |
US9295379B2 (en) * | 2005-04-18 | 2016-03-29 | M.S.T. Medical Surgery Technologies Ltd. | Device and methods of improving laparoscopic surgery |
US7789874B2 (en) * | 2005-05-03 | 2010-09-07 | Hansen Medical, Inc. | Support assembly for robotic catheter system |
US7330578B2 (en) | 2005-06-23 | 2008-02-12 | Accuray Inc. | DRR generation and enhancement using a dedicated graphics device |
US7881771B2 (en) * | 2005-08-03 | 2011-02-01 | The Hong Kong Polytechnic University | Bone reposition device, method and system |
US7983777B2 (en) * | 2005-08-19 | 2011-07-19 | Mark Melton | System for biomedical implant creation and procurement |
US20070118055A1 (en) * | 2005-11-04 | 2007-05-24 | Smith & Nephew, Inc. | Systems and methods for facilitating surgical procedures involving custom medical implants |
US7895899B2 (en) * | 2005-12-03 | 2011-03-01 | Kelly Brian P | Multi-axis, programmable spine testing system |
DE102005059804A1 (en) * | 2005-12-14 | 2007-07-05 | Siemens Ag | Navigation of inserted medical instrument in a patient, e.g. a catheter, uses initial three dimensional image of the target zone to give a number of two-dimensional images for comparison with fluoroscopic images taken during the operation |
US8219177B2 (en) * | 2006-02-16 | 2012-07-10 | Catholic Healthcare West | Method and system for performing invasive medical procedures using a surgical robot |
US8219178B2 (en) * | 2007-02-16 | 2012-07-10 | Catholic Healthcare West | Method and system for performing invasive medical procedures using a surgical robot |
US8010181B2 (en) * | 2006-02-16 | 2011-08-30 | Catholic Healthcare West | System utilizing radio frequency signals for tracking and improving navigation of slender instruments during insertion in the body |
US10893912B2 (en) | 2006-02-16 | 2021-01-19 | Globus Medical Inc. | Surgical tool systems and methods |
US10653497B2 (en) | 2006-02-16 | 2020-05-19 | Globus Medical, Inc. | Surgical tool systems and methods |
US10357184B2 (en) | 2012-06-21 | 2019-07-23 | Globus Medical, Inc. | Surgical tool systems and method |
WO2007099511A2 (en) * | 2006-03-03 | 2007-09-07 | Syddansk Universitet | Programmable robot and user interface |
JP4717683B2 (en) * | 2006-03-30 | 2011-07-06 | 株式会社日立メディコ | Medical image display device |
US20070276491A1 (en) * | 2006-05-24 | 2007-11-29 | Disc Dynamics, Inc. | Mold assembly for intervertebral prosthesis |
US8092536B2 (en) * | 2006-05-24 | 2012-01-10 | Disc Dynamics, Inc. | Retention structure for in situ formation of an intervertebral prosthesis |
WO2007143859A1 (en) * | 2006-06-14 | 2007-12-21 | Macdonald Dettwiler & Associates Inc. | Surgical manipulator with right-angle pulley drive mechanisms |
US8560047B2 (en) * | 2006-06-16 | 2013-10-15 | Board Of Regents Of The University Of Nebraska | Method and apparatus for computer aided surgery |
US20080037843A1 (en) * | 2006-08-11 | 2008-02-14 | Accuray Incorporated | Image segmentation for DRR generation and image registration |
CN101542240A (en) | 2006-09-25 | 2009-09-23 | 马佐尔外科技术公司 | C-arm computerized tomography system |
US8394144B2 (en) * | 2006-09-25 | 2013-03-12 | Mazor Surgical Technologies Ltd. | System for positioning of surgical inserts and tools |
CN100435735C (en) * | 2006-09-30 | 2008-11-26 | 南方医科大学 | Human body orthopedic navigation system |
US8126239B2 (en) * | 2006-10-20 | 2012-02-28 | Siemens Aktiengesellschaft | Registering 2D and 3D data using 3D ultrasound data |
DE202006019649U1 (en) | 2006-12-22 | 2007-08-16 | Brainlab Ag | Guiding tube -fixing device for attaching or fixing guiding tube at structure for supplying substance, has mounting element, fixed joint in fastening element and fixed holding device on joint |
DE102007011568A1 (en) * | 2007-03-08 | 2008-09-11 | Cas Innovations Ag | Medical clamp, in particular spinal clamp |
US8444631B2 (en) | 2007-06-14 | 2013-05-21 | Macdonald Dettwiler & Associates Inc | Surgical manipulator |
EP2033670B1 (en) * | 2007-07-17 | 2015-09-02 | Brainlab AG | Attachment device for medical purposes, in particular for attaching a reference geometry for navigation-assisted operations to a body, in particular to a bone |
EP2923664B1 (en) * | 2007-10-17 | 2019-01-02 | ARO Medical ApS | Systems and apparatuses for torsional stabilisation |
US9101431B2 (en) | 2007-11-01 | 2015-08-11 | Stephen B. Murphy | Guide for acetabular component positioning |
US10335236B1 (en) | 2007-11-01 | 2019-07-02 | Stephen B. Murphy | Surgical system using a registration device |
US8267938B2 (en) | 2007-11-01 | 2012-09-18 | Murphy Stephen B | Method and apparatus for determining acetabular component positioning |
US8986309B1 (en) | 2007-11-01 | 2015-03-24 | Stephen B. Murphy | Acetabular template component and method of using same during hip arthrosplasty |
US9679499B2 (en) * | 2008-09-15 | 2017-06-13 | Immersion Medical, Inc. | Systems and methods for sensing hand motion by measuring remote displacement |
DE102008052680A1 (en) | 2008-10-22 | 2010-04-29 | Surgitaix Ag | Device for the controlled adjustment of a surgical positioning unit |
WO2010064234A2 (en) * | 2008-12-01 | 2010-06-10 | Mazor Surgical Technologies Ltd. | Robot guided oblique spinal stabilization |
WO2010109384A1 (en) * | 2009-03-27 | 2010-09-30 | Koninklijke Philips Electronics N.V. | Improvements to medical imaging |
US9168106B2 (en) | 2009-05-05 | 2015-10-27 | Blue Ortho | Device and method for instrument adjustment in computer assisted surgery |
EP2429421B1 (en) | 2009-05-06 | 2015-06-24 | Blue Ortho | Reduced invasivity fixation system for trackers in computer assisted surgery |
WO2011001292A1 (en) | 2009-06-30 | 2011-01-06 | Blue Ortho | Adjustable guide in computer assisted orthopaedic surgery |
ES2382774B1 (en) * | 2010-02-12 | 2013-04-26 | Universitat Pompeu Fabra | METHOD FOR OBTAINING A THREE-DIMENSIONAL RECONSTRUCTION FROM ONE OR MORE PROJECTIVE VIEWS, AND USE OF THE SAME |
EP2566392A4 (en) * | 2010-05-04 | 2015-07-15 | Pathfinder Therapeutics Inc | System and method for abdominal surface matching using pseudo-features |
CA2743937A1 (en) * | 2010-06-22 | 2011-12-22 | Queen's University At Kingston | C-arm pose estimation using intensity-based registration of imaging modalities |
US8942789B2 (en) * | 2010-10-07 | 2015-01-27 | Siemens Aktiengesellschaft | 2D3D overlay on a CPR basis for aneurysm repair |
EP2453325A1 (en) | 2010-11-16 | 2012-05-16 | Universal Robots ApS | Method and means for controlling a robot |
US9921712B2 (en) | 2010-12-29 | 2018-03-20 | Mako Surgical Corp. | System and method for providing substantially stable control of a surgical tool |
US9119655B2 (en) | 2012-08-03 | 2015-09-01 | Stryker Corporation | Surgical manipulator capable of controlling a surgical instrument in multiple modes |
DE102011003642A1 (en) * | 2011-02-04 | 2012-08-09 | Siemens Aktiengesellschaft | Method for supporting minimally invasive engagement for insertion of mounting unit, involves using data bank containing geometric information of different medicinal mounting units |
WO2012131660A1 (en) | 2011-04-01 | 2012-10-04 | Ecole Polytechnique Federale De Lausanne (Epfl) | Robotic system for spinal and other surgeries |
US9498231B2 (en) | 2011-06-27 | 2016-11-22 | Board Of Regents Of The University Of Nebraska | On-board tool tracking system and methods of computer assisted surgery |
US11911117B2 (en) | 2011-06-27 | 2024-02-27 | Board Of Regents Of The University Of Nebraska | On-board tool tracking system and methods of computer assisted surgery |
CN106913366B (en) | 2011-06-27 | 2021-02-26 | 内布拉斯加大学评议会 | On-tool tracking system and computer-assisted surgery method |
US11561762B2 (en) * | 2011-08-21 | 2023-01-24 | Asensus Surgical Europe S.A.R.L. | Vocally actuated surgical control system |
US9204939B2 (en) | 2011-08-21 | 2015-12-08 | M.S.T. Medical Surgery Technologies Ltd. | Device and method for assisting laparoscopic surgery—rule based approach |
US10866783B2 (en) | 2011-08-21 | 2020-12-15 | Transenterix Europe S.A.R.L. | Vocally activated surgical control system |
US9757206B2 (en) | 2011-08-21 | 2017-09-12 | M.S.T. Medical Surgery Technologies Ltd | Device and method for assisting laparoscopic surgery—rule based approach |
EP2750620B1 (en) | 2011-09-02 | 2017-04-26 | Stryker Corporation | Surgical instrument including a cutting accessory extending from a housing and actuators that establish the position of the cutting accessory relative to the housing |
US9795282B2 (en) | 2011-09-20 | 2017-10-24 | M.S.T. Medical Surgery Technologies Ltd | Device and method for maneuvering endoscope |
BR112014007077A2 (en) | 2011-09-28 | 2017-04-11 | Universal Robots As | "method for robot calibration and method for converting a work program" |
WO2013084221A1 (en) | 2011-12-05 | 2013-06-13 | Mazor Robotics Ltd. | Active bed mount for surgical robot |
US9956042B2 (en) | 2012-01-13 | 2018-05-01 | Vanderbilt University | Systems and methods for robot-assisted transurethral exploration and intervention |
US20130197354A1 (en) * | 2012-01-30 | 2013-08-01 | Siemens Aktiengesellschaft | Minimally invasive treatment of mitral regurgitation |
US9539726B2 (en) * | 2012-04-20 | 2017-01-10 | Vanderbilt University | Systems and methods for safe compliant insertion and hybrid force/motion telemanipulation of continuum robots |
WO2013158983A1 (en) | 2012-04-20 | 2013-10-24 | Vanderbilt University | Robotic device for establishing access channel |
WO2013158974A1 (en) | 2012-04-20 | 2013-10-24 | Vanderbilt University | Dexterous wrists for surgical intervention |
US11135026B2 (en) | 2012-05-11 | 2021-10-05 | Peter L. Bono | Robotic surgical system |
US10758315B2 (en) | 2012-06-21 | 2020-09-01 | Globus Medical Inc. | Method and system for improving 2D-3D registration convergence |
US11857149B2 (en) | 2012-06-21 | 2024-01-02 | Globus Medical, Inc. | Surgical robotic systems with target trajectory deviation monitoring and related methods |
US11399900B2 (en) | 2012-06-21 | 2022-08-02 | Globus Medical, Inc. | Robotic systems providing co-registration using natural fiducials and related methods |
US11298196B2 (en) | 2012-06-21 | 2022-04-12 | Globus Medical Inc. | Surgical robotic automation with tracking markers and controlled tool advancement |
US11864745B2 (en) | 2012-06-21 | 2024-01-09 | Globus Medical, Inc. | Surgical robotic system with retractor |
US10231791B2 (en) | 2012-06-21 | 2019-03-19 | Globus Medical, Inc. | Infrared signal based position recognition system for use with a robot-assisted surgery |
WO2013192598A1 (en) | 2012-06-21 | 2013-12-27 | Excelsius Surgical, L.L.C. | Surgical robot platform |
US10136954B2 (en) | 2012-06-21 | 2018-11-27 | Globus Medical, Inc. | Surgical tool systems and method |
US10624710B2 (en) | 2012-06-21 | 2020-04-21 | Globus Medical, Inc. | System and method for measuring depth of instrumentation |
US11317971B2 (en) | 2012-06-21 | 2022-05-03 | Globus Medical, Inc. | Systems and methods related to robotic guidance in surgery |
US11045267B2 (en) | 2012-06-21 | 2021-06-29 | Globus Medical, Inc. | Surgical robotic automation with tracking markers |
US11116576B2 (en) | 2012-06-21 | 2021-09-14 | Globus Medical Inc. | Dynamic reference arrays and methods of use |
US10799298B2 (en) * | 2012-06-21 | 2020-10-13 | Globus Medical Inc. | Robotic fluoroscopic navigation |
US11857266B2 (en) | 2012-06-21 | 2024-01-02 | Globus Medical, Inc. | System for a surveillance marker in robotic-assisted surgery |
US11253327B2 (en) | 2012-06-21 | 2022-02-22 | Globus Medical, Inc. | Systems and methods for automatically changing an end-effector on a surgical robot |
US11864839B2 (en) | 2012-06-21 | 2024-01-09 | Globus Medical Inc. | Methods of adjusting a virtual implant and related surgical navigation systems |
US11793570B2 (en) | 2012-06-21 | 2023-10-24 | Globus Medical Inc. | Surgical robotic automation with tracking markers |
US11607149B2 (en) | 2012-06-21 | 2023-03-21 | Globus Medical Inc. | Surgical tool systems and method |
US11395706B2 (en) | 2012-06-21 | 2022-07-26 | Globus Medical Inc. | Surgical robot platform |
US10350013B2 (en) | 2012-06-21 | 2019-07-16 | Globus Medical, Inc. | Surgical tool systems and methods |
AU2013296278B2 (en) | 2012-08-03 | 2018-06-14 | Stryker Corporation | Systems and methods for robotic surgery |
US9820818B2 (en) | 2012-08-03 | 2017-11-21 | Stryker Corporation | System and method for controlling a surgical manipulator based on implant parameters |
US9226796B2 (en) | 2012-08-03 | 2016-01-05 | Stryker Corporation | Method for detecting a disturbance as an energy applicator of a surgical instrument traverses a cutting path |
US20140081659A1 (en) | 2012-09-17 | 2014-03-20 | Depuy Orthopaedics, Inc. | Systems and methods for surgical and interventional planning, support, post-operative follow-up, and functional recovery tracking |
JP6131606B2 (en) * | 2013-01-21 | 2017-05-24 | 株式会社島津製作所 | Radiation imaging apparatus and image processing method therefor |
US9672640B2 (en) * | 2013-01-24 | 2017-06-06 | Varian Medical Systems International Ag | Method for interactive manual matching and real-time projection calculation in imaging |
US9044863B2 (en) | 2013-02-06 | 2015-06-02 | Steelcase Inc. | Polarized enhanced confidentiality in mobile camera applications |
WO2014127353A1 (en) * | 2013-02-18 | 2014-08-21 | The Research Foundation For The State University Of New York | End effector for surgical system and method of use thereof |
EP2996611B1 (en) | 2013-03-13 | 2019-06-26 | Stryker Corporation | Systems and software for establishing virtual constraint boundaries |
AU2014240998B2 (en) | 2013-03-13 | 2018-09-20 | Stryker Corporation | System for arranging objects in an operating room in preparation for surgical procedures |
US10105149B2 (en) | 2013-03-15 | 2018-10-23 | Board Of Regents Of The University Of Nebraska | On-board tool tracking system and methods of computer assisted surgery |
US9289247B2 (en) * | 2013-03-15 | 2016-03-22 | Kyphon SÀRL | Surgical tool holder |
KR101418212B1 (en) | 2013-03-26 | 2014-07-10 | 박일형 | Minimally invasive surgery apparatus having manipulator for treating fractures |
US20150015582A1 (en) * | 2013-07-15 | 2015-01-15 | Markus Kaiser | Method and system for 2d-3d image registration |
CN103479376B (en) * | 2013-08-29 | 2015-10-28 | 中国科学院长春光学精密机械与物理研究所 | The complete corresponding fusion method of X-ray image in a kind of preoperative CT data and art |
FR3010628B1 (en) | 2013-09-18 | 2015-10-16 | Medicrea International | METHOD FOR REALIZING THE IDEAL CURVATURE OF A ROD OF A VERTEBRAL OSTEOSYNTHESIS EQUIPMENT FOR STRENGTHENING THE VERTEBRAL COLUMN OF A PATIENT |
US9283048B2 (en) | 2013-10-04 | 2016-03-15 | KB Medical SA | Apparatus and systems for precise guidance of surgical tools |
FR3012030B1 (en) | 2013-10-18 | 2015-12-25 | Medicrea International | METHOD FOR REALIZING THE IDEAL CURVATURE OF A ROD OF A VERTEBRAL OSTEOSYNTHESIS EQUIPMENT FOR STRENGTHENING THE VERTEBRAL COLUMN OF A PATIENT |
US10076385B2 (en) | 2013-12-08 | 2018-09-18 | Mazor Robotics Ltd. | Method and apparatus for alerting a user to sensed lateral forces upon a guide-sleeve in a robot surgical system |
CA2932600C (en) | 2013-12-15 | 2022-05-10 | Mazor Robotics Ltd. | Semi-rigid bone attachment robotic surgery system |
EP3094272B1 (en) | 2014-01-15 | 2021-04-21 | KB Medical SA | Notched apparatus for guidance of an insertable instrument along an axis during spinal surgery |
US10039605B2 (en) | 2014-02-11 | 2018-08-07 | Globus Medical, Inc. | Sterile handle for controlling a robotic surgical system from a sterile field |
WO2015131904A1 (en) | 2014-03-04 | 2015-09-11 | Universal Robots A/S | Safety system for industrial robot |
US10004562B2 (en) | 2014-04-24 | 2018-06-26 | Globus Medical, Inc. | Surgical instrument holder for use with a robotic surgical system |
CN106456082B (en) * | 2014-06-06 | 2020-11-24 | 皇家飞利浦有限公司 | Imaging system for vertebral level |
EP3169252A1 (en) | 2014-07-14 | 2017-05-24 | KB Medical SA | Anti-skid surgical instrument for use in preparing holes in bone tissue |
WO2016049301A1 (en) | 2014-09-26 | 2016-03-31 | Teradyne, Inc. | Grasping gripper |
US10013808B2 (en) | 2015-02-03 | 2018-07-03 | Globus Medical, Inc. | Surgeon head-mounted display apparatuses |
WO2016131903A1 (en) | 2015-02-18 | 2016-08-25 | KB Medical SA | Systems and methods for performing minimally invasive spinal surgery with a robotic surgical system using a percutaneous technique |
EP3319761A4 (en) | 2015-07-08 | 2019-03-06 | Universal Robots A/S | Method for extending end user programming of an industrial robot with third party contributions |
US10646298B2 (en) | 2015-07-31 | 2020-05-12 | Globus Medical, Inc. | Robot arm and methods of use |
US10058394B2 (en) | 2015-07-31 | 2018-08-28 | Globus Medical, Inc. | Robot arm and methods of use |
US10080615B2 (en) | 2015-08-12 | 2018-09-25 | Globus Medical, Inc. | Devices and methods for temporary mounting of parts to bone |
EP3136345A1 (en) * | 2015-08-24 | 2017-03-01 | FEI Company | Positional error correction in a tomographic imaging apparatus |
CN105213031B (en) * | 2015-08-26 | 2017-11-28 | 温州医科大学附属第二医院 | A kind of vertebra posting |
EP3344179B1 (en) | 2015-08-31 | 2021-06-30 | KB Medical SA | Robotic surgical systems |
US10034716B2 (en) | 2015-09-14 | 2018-07-31 | Globus Medical, Inc. | Surgical robotic systems and methods thereof |
US9911225B2 (en) * | 2015-09-29 | 2018-03-06 | Siemens Healthcare Gmbh | Live capturing of light map image sequences for image-based lighting of medical data |
US9771092B2 (en) | 2015-10-13 | 2017-09-26 | Globus Medical, Inc. | Stabilizer wheel assembly and methods of use |
US10058393B2 (en) | 2015-10-21 | 2018-08-28 | P Tech, Llc | Systems and methods for navigation and visualization |
CN108136586A (en) * | 2015-10-27 | 2018-06-08 | 松下知识产权经营株式会社 | Handling device |
AU2016349705B2 (en) | 2015-11-04 | 2021-07-29 | Medicrea International | Methods and Apparatus for spinal reconstructive surgery and measuring spinal length and intervertebral spacing, tension and rotation |
US10220515B2 (en) * | 2015-11-30 | 2019-03-05 | Seiko Epson Corporation | Robot and control method for robot |
DE102015223921A1 (en) * | 2015-12-01 | 2017-06-01 | Siemens Healthcare Gmbh | Method for operating a medical robotic device and medical robotic device |
EP3397188B1 (en) | 2015-12-31 | 2020-09-09 | Stryker Corporation | System and methods for preparing surgery on a patient at a target site defined by a virtual object |
CN114098979A (en) | 2016-01-11 | 2022-03-01 | 马佐尔机器人有限公司 | Surgical robot system |
US10842453B2 (en) | 2016-02-03 | 2020-11-24 | Globus Medical, Inc. | Portable medical imaging system |
US10448910B2 (en) | 2016-02-03 | 2019-10-22 | Globus Medical, Inc. | Portable medical imaging system |
US11058378B2 (en) | 2016-02-03 | 2021-07-13 | Globus Medical, Inc. | Portable medical imaging system |
US11883217B2 (en) | 2016-02-03 | 2024-01-30 | Globus Medical, Inc. | Portable medical imaging system and method |
US10117632B2 (en) | 2016-02-03 | 2018-11-06 | Globus Medical, Inc. | Portable medical imaging system with beam scanning collimator |
US11064904B2 (en) | 2016-02-29 | 2021-07-20 | Extremity Development Company, Llc | Smart drill, jig, and method of orthopedic surgery |
EP3988027A1 (en) | 2016-03-13 | 2022-04-27 | Vuze Medical Ltd. | Apparatus and methods for use with skeletal procedures |
US10866119B2 (en) | 2016-03-14 | 2020-12-15 | Globus Medical, Inc. | Metal detector for detecting insertion of a surgical device into a hollow tube |
TWI805545B (en) | 2016-04-12 | 2023-06-21 | 丹麥商環球機器人公司 | Method and computer program product for programming a robot by demonstration |
US20180036086A1 (en) * | 2016-08-03 | 2018-02-08 | Amith Derek Mendonca | Novel robotic surgical device |
US11051886B2 (en) * | 2016-09-27 | 2021-07-06 | Covidien Lp | Systems and methods for performing a surgical navigation procedure |
US11653979B2 (en) | 2016-10-27 | 2023-05-23 | Leucadia 6, Llc | Intraoperative fluoroscopic registration of vertebral bodies |
WO2018102718A1 (en) | 2016-12-02 | 2018-06-07 | Vanderbilt University | Steerable endoscope with continuum manipulator |
WO2018109556A1 (en) | 2016-12-12 | 2018-06-21 | Medicrea International | Systems and methods for patient-specific spinal implants |
WO2018112025A1 (en) | 2016-12-16 | 2018-06-21 | Mako Surgical Corp. | Techniques for modifying tool operation in a surgical robotic system based on comparing actual and commanded states of the tool relative to a surgical site |
JP7233841B2 (en) | 2017-01-18 | 2023-03-07 | ケービー メディカル エスアー | Robotic Navigation for Robotic Surgical Systems |
CN110430836A (en) * | 2017-03-15 | 2019-11-08 | 安托踏实公司 | For the system in spinal surgery relative to object axis guidance Surigical tool |
US11071594B2 (en) | 2017-03-16 | 2021-07-27 | KB Medical SA | Robotic navigation of robotic surgical systems |
EP3606461B1 (en) | 2017-04-02 | 2022-10-19 | Mazor Robotics Ltd. | Three dimensional robotic bioprinter |
JP2020518312A (en) | 2017-04-21 | 2020-06-25 | メディクレア インターナショナル | A system that provides intraoperative tracking to assist spinal surgery |
US11033341B2 (en) | 2017-05-10 | 2021-06-15 | Mako Surgical Corp. | Robotic spine surgery system and methods |
EP4344658A2 (en) | 2017-05-10 | 2024-04-03 | MAKO Surgical Corp. | Robotic spine surgery system |
US11221497B2 (en) | 2017-06-05 | 2022-01-11 | Steelcase Inc. | Multiple-polarization cloaking |
WO2019012520A1 (en) * | 2017-07-08 | 2019-01-17 | Vuze Medical Ltd. | Apparatus and methods for use with image-guided skeletal procedures |
US10675094B2 (en) | 2017-07-21 | 2020-06-09 | Globus Medical Inc. | Robot surgical platform |
WO2019055701A1 (en) | 2017-09-13 | 2019-03-21 | Vanderbilt University | Continuum robots with multi-scale motion through equilibrium modulation |
EP3700439A2 (en) | 2017-10-23 | 2020-09-02 | Bono, Peter L. | Rotary oscillating and linearly reciprocating surgical tool |
US11794338B2 (en) | 2017-11-09 | 2023-10-24 | Globus Medical Inc. | Robotic rod benders and related mechanical and motor housings |
US11382666B2 (en) | 2017-11-09 | 2022-07-12 | Globus Medical Inc. | Methods providing bend plans for surgical rods and related controllers and computer program products |
US10898252B2 (en) | 2017-11-09 | 2021-01-26 | Globus Medical, Inc. | Surgical robotic systems for bending surgical rods, and related methods and devices |
US11134862B2 (en) | 2017-11-10 | 2021-10-05 | Globus Medical, Inc. | Methods of selecting surgical implants and related devices |
CN110769773A (en) * | 2017-11-16 | 2020-02-07 | 直观外科手术操作公司 | Master/slave registration and control for remote operation |
US10918422B2 (en) | 2017-12-01 | 2021-02-16 | Medicrea International | Method and apparatus for inhibiting proximal junctional failure |
US11173000B2 (en) | 2018-01-12 | 2021-11-16 | Peter L. Bono | Robotic surgical control system |
WO2019144904A1 (en) * | 2018-01-29 | 2019-08-01 | The University Of Hong Kong | Robotic stereotactic system for mri-guided neurosurgery |
US11364004B2 (en) | 2018-02-08 | 2022-06-21 | Covidien Lp | System and method for pose estimation of an imaging device and for determining the location of a medical device with respect to a target |
US20190254753A1 (en) | 2018-02-19 | 2019-08-22 | Globus Medical, Inc. | Augmented reality navigation systems for use with robotic surgical systems and methods of their use |
US11106124B2 (en) | 2018-02-27 | 2021-08-31 | Steelcase Inc. | Multiple-polarization cloaking for projected and writing surface view screens |
US10573023B2 (en) | 2018-04-09 | 2020-02-25 | Globus Medical, Inc. | Predictive visualization of medical imaging scanner component movement |
US10966736B2 (en) * | 2018-05-21 | 2021-04-06 | Warsaw Orthopedic, Inc. | Spinal implant system and methods of use |
US11337742B2 (en) | 2018-11-05 | 2022-05-24 | Globus Medical Inc | Compliant orthopedic driver |
EP3876860A1 (en) | 2018-11-06 | 2021-09-15 | Bono, Peter L. | Robotic surgical system and method |
US11278360B2 (en) | 2018-11-16 | 2022-03-22 | Globus Medical, Inc. | End-effectors for surgical robotic systems having sealed optical components |
US11744655B2 (en) | 2018-12-04 | 2023-09-05 | Globus Medical, Inc. | Drill guide fixtures, cranial insertion fixtures, and related methods and robotic systems |
US11602402B2 (en) | 2018-12-04 | 2023-03-14 | Globus Medical, Inc. | Drill guide fixtures, cranial insertion fixtures, and related methods and robotic systems |
US11065065B2 (en) * | 2019-02-22 | 2021-07-20 | Warsaw Orthopedic, Inc. | Spinal implant system and methods of use |
US11918313B2 (en) | 2019-03-15 | 2024-03-05 | Globus Medical Inc. | Active end effectors for surgical robots |
US11419616B2 (en) | 2019-03-22 | 2022-08-23 | Globus Medical, Inc. | System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices |
US11806084B2 (en) | 2019-03-22 | 2023-11-07 | Globus Medical, Inc. | System for neuronavigation registration and robotic trajectory guidance, and related methods and devices |
US11571265B2 (en) | 2019-03-22 | 2023-02-07 | Globus Medical Inc. | System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices |
US20200297357A1 (en) | 2019-03-22 | 2020-09-24 | Globus Medical, Inc. | System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices |
US11317978B2 (en) | 2019-03-22 | 2022-05-03 | Globus Medical, Inc. | System for neuronavigation registration and robotic trajectory guidance, robotic surgery, and related methods and devices |
US11382549B2 (en) | 2019-03-22 | 2022-07-12 | Globus Medical, Inc. | System for neuronavigation registration and robotic trajectory guidance, and related methods and devices |
US11877801B2 (en) | 2019-04-02 | 2024-01-23 | Medicrea International | Systems, methods, and devices for developing patient-specific spinal implants, treatments, operations, and/or procedures |
US11925417B2 (en) | 2019-04-02 | 2024-03-12 | Medicrea International | Systems, methods, and devices for developing patient-specific spinal implants, treatments, operations, and/or procedures |
US11045179B2 (en) | 2019-05-20 | 2021-06-29 | Global Medical Inc | Robot-mounted retractor system |
US20220313363A1 (en) * | 2019-06-24 | 2022-10-06 | Dm1 Llc | Optical System And Apparatus For Instrument Projection And Tracking |
US11628023B2 (en) | 2019-07-10 | 2023-04-18 | Globus Medical, Inc. | Robotic navigational system for interbody implants |
US11399965B2 (en) | 2019-09-09 | 2022-08-02 | Warsaw Orthopedic, Inc. | Spinal implant system and methods of use |
US11571171B2 (en) | 2019-09-24 | 2023-02-07 | Globus Medical, Inc. | Compound curve cable chain |
US11890066B2 (en) | 2019-09-30 | 2024-02-06 | Globus Medical, Inc | Surgical robot with passive end effector |
US11426178B2 (en) | 2019-09-27 | 2022-08-30 | Globus Medical Inc. | Systems and methods for navigating a pin guide driver |
US11864857B2 (en) | 2019-09-27 | 2024-01-09 | Globus Medical, Inc. | Surgical robot with passive end effector |
WO2021070188A1 (en) * | 2019-10-11 | 2021-04-15 | Beyeonics Surgical Ltd. | System and method for improved electronic assisted medical procedures |
US11510684B2 (en) | 2019-10-14 | 2022-11-29 | Globus Medical, Inc. | Rotary motion passive end effector for surgical robots in orthopedic surgeries |
US11457984B1 (en) | 2019-12-02 | 2022-10-04 | Arc Specialties, Inc. | Surgical process for knee replacement and knee resurfacing process therefor |
US11890205B2 (en) | 2019-12-13 | 2024-02-06 | Warsaw Orthopedic, Inc. | Spinal implant system and methods of use |
EP4081153A1 (en) | 2019-12-23 | 2022-11-02 | Mazor Robotics Ltd. | Multi-arm robotic system for spine surgery with imaging guidance |
US11769251B2 (en) | 2019-12-26 | 2023-09-26 | Medicrea International | Systems and methods for medical image analysis |
US11382699B2 (en) | 2020-02-10 | 2022-07-12 | Globus Medical Inc. | Extended reality visualization of optical tool tracking volume for computer assisted navigation in surgery |
US20210251591A1 (en) * | 2020-02-17 | 2021-08-19 | Globus Medical, Inc. | System and method of determining optimal 3-dimensional position and orientation of imaging device for imaging patient bones |
US11207150B2 (en) | 2020-02-19 | 2021-12-28 | Globus Medical, Inc. | Displaying a virtual model of a planned instrument attachment to ensure correct selection of physical instrument attachment |
US11452492B2 (en) | 2020-04-21 | 2022-09-27 | Mazor Robotics Ltd. | System and method for positioning an imaging device |
US20210322112A1 (en) * | 2020-04-21 | 2021-10-21 | Mazor Robotics Ltd. | System and method for aligning an imaging device |
US11253216B2 (en) | 2020-04-28 | 2022-02-22 | Globus Medical Inc. | Fixtures for fluoroscopic imaging systems and related navigation systems and methods |
US11882217B1 (en) | 2020-04-30 | 2024-01-23 | Verily Life Sciences Llc | Surgical robotic tool authorization system |
US11382700B2 (en) | 2020-05-08 | 2022-07-12 | Globus Medical Inc. | Extended reality headset tool tracking and control |
US11153555B1 (en) | 2020-05-08 | 2021-10-19 | Globus Medical Inc. | Extended reality headset camera system for computer assisted navigation in surgery |
US11510750B2 (en) | 2020-05-08 | 2022-11-29 | Globus Medical, Inc. | Leveraging two-dimensional digital imaging and communication in medicine imagery in three-dimensional extended reality applications |
US11317973B2 (en) | 2020-06-09 | 2022-05-03 | Globus Medical, Inc. | Camera tracking bar for computer assisted navigation during surgery |
US11382713B2 (en) | 2020-06-16 | 2022-07-12 | Globus Medical, Inc. | Navigated surgical system with eye to XR headset display calibration |
US11877807B2 (en) | 2020-07-10 | 2024-01-23 | Globus Medical, Inc | Instruments for navigated orthopedic surgeries |
US11793588B2 (en) | 2020-07-23 | 2023-10-24 | Globus Medical, Inc. | Sterile draping of robotic arms |
US11931113B2 (en) | 2020-08-03 | 2024-03-19 | Mazor Robotics Ltd. | Systems, devices, and methods for retractor interference avoidance |
US20230346393A1 (en) * | 2020-08-18 | 2023-11-02 | Integrity Implants Inc. D/B/A Accelus | Powered osteotome trepanation tool |
US11737831B2 (en) | 2020-09-02 | 2023-08-29 | Globus Medical Inc. | Surgical object tracking template generation for computer assisted navigation during surgical procedure |
US11523785B2 (en) | 2020-09-24 | 2022-12-13 | Globus Medical, Inc. | Increased cone beam computed tomography volume length without requiring stitching or longitudinal C-arm movement |
US11911112B2 (en) | 2020-10-27 | 2024-02-27 | Globus Medical, Inc. | Robotic navigational system |
US11941814B2 (en) | 2020-11-04 | 2024-03-26 | Globus Medical Inc. | Auto segmentation using 2-D images taken during 3-D imaging spin |
US11717350B2 (en) | 2020-11-24 | 2023-08-08 | Globus Medical Inc. | Methods for robotic assistance and navigation in spinal surgery and related systems |
US11857273B2 (en) | 2021-07-06 | 2024-01-02 | Globus Medical, Inc. | Ultrasonic robotic surgical navigation |
US11439444B1 (en) | 2021-07-22 | 2022-09-13 | Globus Medical, Inc. | Screw tower and rod reduction tool |
US20230134629A1 (en) * | 2021-11-02 | 2023-05-04 | Orthosoft Ulc | On-bone robotic system for computer-assisted surgery |
US11911115B2 (en) | 2021-12-20 | 2024-02-27 | Globus Medical Inc. | Flat panel registration fixture and method of using same |
WO2024035712A1 (en) * | 2022-08-08 | 2024-02-15 | Ohio State Innovation Foundation | Jigs and related methods for guiding a cutting instrument for controlled surgical cutting of a body portion of a patient |
Family Cites Families (64)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4457311A (en) * | 1982-09-03 | 1984-07-03 | Medtronic, Inc. | Ultrasound imaging system for scanning the human back |
US4791934A (en) * | 1986-08-07 | 1988-12-20 | Picker International, Inc. | Computer tomography assisted stereotactic surgery system and method |
US4979949A (en) * | 1988-04-26 | 1990-12-25 | The Board Of Regents Of The University Of Washington | Robot-aided system for surgery |
ES2085885T3 (en) * | 1989-11-08 | 1996-06-16 | George S Allen | MECHANICAL ARM FOR INTERACTIVE SURGERY SYSTEM DIRECTED BY IMAGES. |
CA2260688A1 (en) | 1989-11-21 | 1991-05-21 | I.S.G. Technologies, Inc. | Probe-correlated viewing of anatomical image data |
US5086401A (en) * | 1990-05-11 | 1992-02-04 | International Business Machines Corporation | Image-directed robotic system for precise robotic surgery including redundant consistency checking |
US6347240B1 (en) * | 1990-10-19 | 2002-02-12 | St. Louis University | System and method for use in displaying images of a body part |
ATE405223T1 (en) * | 1990-10-19 | 2008-09-15 | Univ St Louis | SYSTEM FOR LOCALIZING A SURGICAL PROBE RELATIVE TO THE HEAD |
DE4040307C2 (en) | 1990-12-17 | 1996-03-07 | Eden Medizinische Elektronik G | Device for positioning a Doppler signal generator and / or sensor |
US5281182A (en) * | 1991-05-15 | 1994-01-25 | Tomy Company, Ltd. | Remote control robot toy with torso and leg twist and torso tilt |
US5279309A (en) * | 1991-06-13 | 1994-01-18 | International Business Machines Corporation | Signaling device and method for monitoring positions in a surgical operation |
US5300080A (en) * | 1991-11-01 | 1994-04-05 | David Clayman | Stereotactic instrument guided placement |
DE4304570A1 (en) * | 1993-02-16 | 1994-08-18 | Mdc Med Diagnostic Computing | Device and method for preparing and supporting surgical procedures |
EP0699050B1 (en) * | 1993-04-26 | 2004-03-03 | St. Louis University | Indicating the position of a probe |
US5410638A (en) | 1993-05-03 | 1995-04-25 | Northwestern University | System for positioning a medical instrument within a biotic structure using a micromanipulator |
US5791231A (en) * | 1993-05-17 | 1998-08-11 | Endorobotics Corporation | Surgical robotic system and hydraulic actuator therefor |
IL107523A (en) | 1993-11-07 | 2000-01-31 | Ultraguide Ltd | Articulated needle guide for ultrasound imaging and method of using same |
EP0729322A4 (en) * | 1993-11-15 | 1999-06-16 | Urso Paul Steven D | Surgical procedures |
US5546942A (en) * | 1994-06-10 | 1996-08-20 | Zhang; Zhongman | Orthopedic robot and method for reduction of long-bone fractures |
US5695501A (en) * | 1994-09-30 | 1997-12-09 | Ohio Medical Instrument Company, Inc. | Apparatus for neurosurgical stereotactic procedures |
EP1201199B1 (en) * | 1994-10-07 | 2006-03-15 | St. Louis University | Surgical navigation systems including reference and localization frames |
US6246898B1 (en) * | 1995-03-28 | 2001-06-12 | Sonometrics Corporation | Method for carrying out a medical procedure using a three-dimensional tracking and imaging system |
US5814038A (en) * | 1995-06-07 | 1998-09-29 | Sri International | Surgical manipulator for a telerobotic system |
US5649956A (en) * | 1995-06-07 | 1997-07-22 | Sri International | System and method for releasably holding a surgical instrument |
US5690106A (en) * | 1995-06-30 | 1997-11-25 | Siemens Corporate Research, Inc. | Flexible image registration for rotational angiography |
US5806518A (en) * | 1995-09-11 | 1998-09-15 | Integrated Surgical Systems | Method and system for positioning surgical robot |
US5674221A (en) * | 1995-10-23 | 1997-10-07 | Orthopaedic Innovations, Inc. | External fixator with improved clamp and methods for use |
US5682886A (en) | 1995-12-26 | 1997-11-04 | Musculographics Inc | Computer-assisted surgical system |
US5769092A (en) * | 1996-02-22 | 1998-06-23 | Integrated Surgical Systems, Inc. | Computer-aided system for revision total hip replacement surgery |
US5799055A (en) | 1996-05-15 | 1998-08-25 | Northwestern University | Apparatus and method for planning a stereotactic surgical procedure using coordinated fluoroscopy |
US6009212A (en) | 1996-07-10 | 1999-12-28 | Washington University | Method and apparatus for image registration |
US5824085A (en) * | 1996-09-30 | 1998-10-20 | Integrated Surgical Systems, Inc. | System and method for cavity generation for surgical planning and initial placement of a bone prosthesis |
US6314310B1 (en) * | 1997-02-14 | 2001-11-06 | Biosense, Inc. | X-ray guided surgical location system with extended mapping volume |
US5993463A (en) * | 1997-05-15 | 1999-11-30 | Regents Of The University Of Minnesota | Remote actuation of trajectory guide |
US6752812B1 (en) * | 1997-05-15 | 2004-06-22 | Regent Of The University Of Minnesota | Remote actuation of trajectory guide |
US6096050A (en) * | 1997-09-19 | 2000-08-01 | Surgical Navigation Specialist Inc. | Method and apparatus for correlating a body with an image of the body |
US6226548B1 (en) * | 1997-09-24 | 2001-05-01 | Surgical Navigation Technologies, Inc. | Percutaneous registration apparatus and method for use in computer-assisted surgical navigation |
US5951475A (en) * | 1997-09-25 | 1999-09-14 | International Business Machines Corporation | Methods and apparatus for registering CT-scan data to multiple fluoroscopic images |
US6348058B1 (en) * | 1997-12-12 | 2002-02-19 | Surgical Navigation Technologies, Inc. | Image guided spinal surgery guide, system, and method for use thereof |
US5963612A (en) | 1997-12-31 | 1999-10-05 | Siemens Corporation Research, Inc. | Apparatus for C-arm calibration for 3D reconstruction in an imaging system utilizing planar transformation |
US6529765B1 (en) * | 1998-04-21 | 2003-03-04 | Neutar L.L.C. | Instrumented and actuated guidance fixture for sterotactic surgery |
US6546277B1 (en) * | 1998-04-21 | 2003-04-08 | Neutar L.L.C. | Instrument guidance system for spinal and other surgery |
US6298262B1 (en) | 1998-04-21 | 2001-10-02 | Neutar, Llc | Instrument guidance for stereotactic surgery |
FR2779339B1 (en) * | 1998-06-09 | 2000-10-13 | Integrated Surgical Systems Sa | MATCHING METHOD AND APPARATUS FOR ROBOTIC SURGERY, AND MATCHING DEVICE COMPRISING APPLICATION |
US6118845A (en) | 1998-06-29 | 2000-09-12 | Surgical Navigation Technologies, Inc. | System and methods for the reduction and elimination of image artifacts in the calibration of X-ray imagers |
WO2000007503A1 (en) * | 1998-08-04 | 2000-02-17 | Intuitive Surgical, Inc. | Manipulator positioning linkage for robotic surgery |
US6322567B1 (en) * | 1998-12-14 | 2001-11-27 | Integrated Surgical Systems, Inc. | Bone motion tracking system |
US6778850B1 (en) * | 1999-03-16 | 2004-08-17 | Accuray, Inc. | Frameless radiosurgery treatment system and method |
US6470207B1 (en) * | 1999-03-23 | 2002-10-22 | Surgical Navigation Technologies, Inc. | Navigational guidance via computer-assisted fluoroscopic imaging |
CA2306303A1 (en) * | 1999-04-23 | 2000-10-23 | Lutz T. Kynast | Microdrive for probes |
US6301495B1 (en) * | 1999-04-27 | 2001-10-09 | International Business Machines Corporation | System and method for intra-operative, image-based, interactive verification of a pre-operative surgical plan |
US6415171B1 (en) * | 1999-07-16 | 2002-07-02 | International Business Machines Corporation | System and method for fusing three-dimensional shape data on distorted images without correcting for distortion |
DE19936364A1 (en) | 1999-08-03 | 2001-02-15 | Siemens Ag | Identification and localisation of marks in a 3D medical scanning process |
US6442417B1 (en) * | 1999-11-29 | 2002-08-27 | The Board Of Trustees Of The Leland Stanford Junior University | Method and apparatus for transforming view orientations in image-guided surgery |
US7747312B2 (en) * | 2000-01-04 | 2010-06-29 | George Mason Intellectual Properties, Inc. | System and method for automatic shape registration and instrument tracking |
US6702821B2 (en) * | 2000-01-14 | 2004-03-09 | The Bonutti 2003 Trust A | Instrumentation for minimally invasive joint replacement and methods for using same |
US6711432B1 (en) * | 2000-10-23 | 2004-03-23 | Carnegie Mellon University | Computer-aided orthopedic surgery |
US6484049B1 (en) * | 2000-04-28 | 2002-11-19 | Ge Medical Systems Global Technology Company, Llc | Fluoroscopic tracking and visualization system |
US6837892B2 (en) * | 2000-07-24 | 2005-01-04 | Mazor Surgical Technologies Ltd. | Miniature bone-mounted surgical robot |
EP1197185B1 (en) * | 2000-10-11 | 2004-07-14 | Stryker Leibinger GmbH & Co. KG | Device for determining or tracking the position of a bone |
WO2002062199A2 (en) * | 2001-01-16 | 2002-08-15 | Microdexterity Systems, Inc. | Surgical manipulator |
US7063705B2 (en) * | 2001-06-29 | 2006-06-20 | Sdgi Holdings, Inc. | Fluoroscopic locator and registration device |
US7198630B2 (en) * | 2002-12-17 | 2007-04-03 | Kenneth I. Lipow | Method and apparatus for controlling a surgical robot to mimic, harmonize and enhance the natural neurophysiological behavior of a surgeon |
US7327872B2 (en) * | 2004-10-13 | 2008-02-05 | General Electric Company | Method and system for registering 3D models of anatomical regions with projection images of the same |
-
2001
- 2001-07-24 US US09/912,687 patent/US6837892B2/en not_active Expired - Lifetime
-
2002
- 2002-05-22 CA CA2454861A patent/CA2454861C/en not_active Expired - Lifetime
- 2002-05-22 WO PCT/IL2002/000399 patent/WO2003009768A1/en active Application Filing
- 2002-05-22 EP EP02735926A patent/EP1414362B1/en not_active Expired - Lifetime
- 2002-05-22 JP JP2003515165A patent/JP2004535884A/en active Pending
- 2002-05-22 AT AT02735926T patent/ATE541529T1/en active
-
2004
- 2004-10-15 US US10/965,100 patent/US20050171557A1/en not_active Abandoned
-
2010
- 2010-03-17 US US12/725,481 patent/US8571638B2/en not_active Expired - Lifetime
- 2010-03-17 US US12/725,487 patent/US10058338B2/en not_active Expired - Lifetime
Also Published As
Publication number | Publication date |
---|---|
US20020038118A1 (en) | 2002-03-28 |
US10058338B2 (en) | 2018-08-28 |
US8571638B2 (en) | 2013-10-29 |
EP1414362B1 (en) | 2012-01-18 |
US6837892B2 (en) | 2005-01-04 |
US20100204714A1 (en) | 2010-08-12 |
US20050171557A1 (en) | 2005-08-04 |
EP1414362A1 (en) | 2004-05-06 |
US20100198230A1 (en) | 2010-08-05 |
CA2454861A1 (en) | 2003-02-06 |
JP2004535884A (en) | 2004-12-02 |
ATE541529T1 (en) | 2012-02-15 |
WO2003009768A1 (en) | 2003-02-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA2454861C (en) | Miniature bone-attached surgical robot | |
Joskowicz et al. | FRACAS: a system for computer‐aided image‐guided long bone fracture surgery | |
Lavallee et al. | Computer-assisted spine surgery: a technique for accurate transpedicular screw fixation using CT data and a 3-D optical localizer | |
Yao et al. | A C-arm fluoroscopy-guided progressive cut refinement strategy using a surgical robot | |
Tomazevic et al. | 3-D/2-D registration of CT and MR to X-ray images | |
US8108072B2 (en) | Methods and systems for robotic instrument tool tracking with adaptive fusion of kinematics information and image information | |
US6782287B2 (en) | Method and apparatus for tracking a medical instrument based on image registration | |
US5951475A (en) | Methods and apparatus for registering CT-scan data to multiple fluoroscopic images | |
US8073528B2 (en) | Tool tracking systems, methods and computer products for image guided surgery | |
US20090088773A1 (en) | Methods of locating and tracking robotic instruments in robotic surgical systems | |
CN113316429A (en) | System and method for registration and navigation between coordinate systems | |
US20220142730A1 (en) | Fiducial marker | |
Šuligoj et al. | Automated marker localization in the planning phase of robotic neurosurgery | |
WO2021019369A1 (en) | Fiducial marker | |
Gao et al. | Fluoroscopic navigation for a surgical robotic system including a continuum manipulator | |
Haidegger | Probabilistic method to improve the accuracy of computer-integrated surgical systems | |
Doignon et al. | Pose estimation and feature tracking for robot assisted surgery with medical imaging | |
Šuligoj et al. | Influence of the localization strategy on the accuracy of a neurosurgical robot system | |
Maurin et al. | CTBot: A stereotactic-guided robotic assistant for percutaneous procedures of the abdomen | |
JP7258107B2 (en) | Automatic segmentation using 2D images taken during 3D imaging spins | |
Zheng et al. | A robust and accurate two-stage approach for automatic recovery of distal locking holes in computer-assisted intramedullary nailing of femoral shaft fractures | |
JP2021126521A (en) | System and method of determining optimal 3-dimensional position and orientation of imaging device for imaging patient bones | |
Naik et al. | Feature-based registration framework for pedicle screw trajectory registration between multimodal images | |
Grzeszczuk et al. | A fluoroscopic X-ray registration process for three-dimensional surgical navigation | |
Oentoro et al. | High-accuracy registration of intraoperative CT imaging |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
EEER | Examination request | ||
MKEX | Expiry |
Effective date: 20220524 |