WO2007120351A3 - Medical robotic system providing three-dimensional telestration - Google Patents

Medical robotic system providing three-dimensional telestration Download PDF

Info

Publication number
WO2007120351A3
WO2007120351A3 PCT/US2006/062381 US2006062381W WO2007120351A3 WO 2007120351 A3 WO2007120351 A3 WO 2007120351A3 US 2006062381 W US2006062381 W US 2006062381W WO 2007120351 A3 WO2007120351 A3 WO 2007120351A3
Authority
WO
WIPO (PCT)
Prior art keywords
telestration
robotic system
medical robotic
pair
view
Prior art date
Application number
PCT/US2006/062381
Other languages
French (fr)
Other versions
WO2007120351A2 (en
Inventor
Christopher Hasser
David Larkin
Brian Miller
Guanghua Zhang
William Nowlan
Original Assignee
Intuitive Surgical, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intuitive Surgical, Inc. filed Critical Intuitive Surgical, Inc.
Priority to EP16180658.3A priority Critical patent/EP3107286B1/en
Priority to CN2006800479931A priority patent/CN102143706B/en
Priority to EP06851012.2A priority patent/EP1965699B1/en
Priority to KR1020087016218A priority patent/KR101407986B1/en
Publication of WO2007120351A2 publication Critical patent/WO2007120351A2/en
Publication of WO2007120351A3 publication Critical patent/WO2007120351A3/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/70Manipulators specially adapted for use in surgery
    • A61B34/74Manipulators with manual electric input means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • A61B34/35Surgical robots for telesurgery
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/70Manipulators specially adapted for use in surgery
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B90/361Image-producing devices, e.g. surgical cameras
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37Surgical systems with images on a monitor during operation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364Correlation of different images or relation of image positions in respect to the body
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364Correlation of different images or relation of image positions in respect to the body
    • A61B2090/365Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364Correlation of different images or relation of image positions in respect to the body
    • A61B2090/367Correlation of different images or relation of image positions in respect to the body creating a 3D dataset from 2D images using position information

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Engineering & Computer Science (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Veterinary Medicine (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Robotics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Pathology (AREA)
  • Gynecology & Obstetrics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Endoscopes (AREA)
  • Electrically Operated Instructional Devices (AREA)
  • Manipulator (AREA)

Abstract

A medical robotic system provides 3D telestration over a 3D view of an anatomical structure by receiving a 2D telestration graphic input associated with one of a pair of stereoscopic images of the anatomical structure from a mentor surgeon, determining a corresponding 2D telestration graphic input in the other of the pair of stereoscopic images using a disparity map, blending the telestration graphic inputs into respective ones of the pair of stereoscopic images, and providing the blended results to a 3D display so that a 3D view of the telestration graphic input may be displayed as an overlay to a 3D view of the anatomical structure to an operating surgeon.
PCT/US2006/062381 2005-12-30 2006-12-20 Medical robotic system providing three-dimensional telestration WO2007120351A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP16180658.3A EP3107286B1 (en) 2005-12-30 2006-12-20 Medical robotic system providing three-dimensional telestration
CN2006800479931A CN102143706B (en) 2005-12-30 2006-12-20 Medical robotic system providing three-dimensional telestration
EP06851012.2A EP1965699B1 (en) 2005-12-30 2006-12-20 Medical robotic system providing three-dimensional telestration
KR1020087016218A KR101407986B1 (en) 2005-12-30 2006-12-20 Medical robotic system providing three-dimensional telestration

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/322,879 US20070167702A1 (en) 2005-12-30 2005-12-30 Medical robotic system providing three-dimensional telestration
US11/322,879 2005-12-30

Publications (2)

Publication Number Publication Date
WO2007120351A2 WO2007120351A2 (en) 2007-10-25
WO2007120351A3 true WO2007120351A3 (en) 2011-06-03

Family

ID=38264096

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/062381 WO2007120351A2 (en) 2005-12-30 2006-12-20 Medical robotic system providing three-dimensional telestration

Country Status (8)

Country Link
US (1) US20070167702A1 (en)
EP (2) EP1965699B1 (en)
JP (1) JP5373263B2 (en)
KR (1) KR101407986B1 (en)
CN (1) CN102143706B (en)
DE (1) DE102006059380A1 (en)
FR (1) FR2898264A1 (en)
WO (1) WO2007120351A2 (en)

Families Citing this family (200)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030061188A1 (en) * 1999-12-23 2003-03-27 Linus Wiebe General information management system
US9155544B2 (en) * 2002-03-20 2015-10-13 P Tech, Llc Robotic systems and methods
US8858425B2 (en) 2004-09-24 2014-10-14 Vivid Medical, Inc. Disposable endoscope and portable display
US8878924B2 (en) 2004-09-24 2014-11-04 Vivid Medical, Inc. Disposable microscope and portable display
US9033870B2 (en) 2004-09-24 2015-05-19 Vivid Medical, Inc. Pluggable vision module and portable display for endoscopy
US8827899B2 (en) * 2004-09-24 2014-09-09 Vivid Medical, Inc. Disposable endoscopic access device and portable display
US9526587B2 (en) * 2008-12-31 2016-12-27 Intuitive Surgical Operations, Inc. Fiducial marker design and detection for locating surgical instrument in images
US8971597B2 (en) * 2005-05-16 2015-03-03 Intuitive Surgical Operations, Inc. Efficient vision and kinematic data fusion for robotic surgical instruments and other applications
US9867669B2 (en) * 2008-12-31 2018-01-16 Intuitive Surgical Operations, Inc. Configuration marker design and detection for instrument tracking
US9492240B2 (en) * 2009-06-16 2016-11-15 Intuitive Surgical Operations, Inc. Virtual measurement tool for minimally invasive surgery
US10555775B2 (en) 2005-05-16 2020-02-11 Intuitive Surgical Operations, Inc. Methods and system for performing 3-D tool tracking by fusion of sensor and/or camera derived data during minimally invasive robotic surgery
US8073528B2 (en) 2007-09-30 2011-12-06 Intuitive Surgical Operations, Inc. Tool tracking systems, methods and computer products for image guided surgery
JP2009509582A (en) * 2005-09-22 2009-03-12 スリーエム イノベイティブ プロパティズ カンパニー Artifact reduction in 3D imaging
US7453227B2 (en) * 2005-12-20 2008-11-18 Intuitive Surgical, Inc. Medical robotic system with sliding mode control
WO2007111749A2 (en) 2005-12-20 2007-10-04 Intuitive Surgical, Inc. Method for handling an operator command exceeding a medical device state limitation in a medical robotic system
US9266239B2 (en) * 2005-12-27 2016-02-23 Intuitive Surgical Operations, Inc. Constraint based control in a minimally invasive surgical apparatus
US7907166B2 (en) * 2005-12-30 2011-03-15 Intuitive Surgical Operations, Inc. Stereo telestration for robotic surgery
KR101362647B1 (en) * 2007-09-07 2014-02-12 삼성전자주식회사 System and method for generating and palying three dimensional image file including two dimensional image
US8808164B2 (en) * 2008-03-28 2014-08-19 Intuitive Surgical Operations, Inc. Controlling a robotic surgical tool with a display monitor
US8155479B2 (en) 2008-03-28 2012-04-10 Intuitive Surgical Operations Inc. Automated panning and digital zooming for robotic surgical systems
US20100013910A1 (en) * 2008-07-21 2010-01-21 Vivid Medical Stereo viewer
US20100217991A1 (en) * 2008-08-14 2010-08-26 Seung Wook Choi Surgery robot system of server and client type
US8184880B2 (en) * 2008-12-31 2012-05-22 Intuitive Surgical Operations, Inc. Robust sparse image matching for robotic surgery
US8830224B2 (en) * 2008-12-31 2014-09-09 Intuitive Surgical Operations, Inc. Efficient 3-D telestration for local robotic proctoring
US10758314B2 (en) * 2011-12-12 2020-09-01 Jack Wade Enhanced video enabled software tools for medical environments
US9155592B2 (en) * 2009-06-16 2015-10-13 Intuitive Surgical Operations, Inc. Virtual measurement tool for minimally invasive surgery
US8406925B2 (en) 2009-07-01 2013-03-26 Honda Motor Co., Ltd. Panoramic attention for humanoid robots
JP5774596B2 (en) 2009-10-30 2015-09-09 ザ・ジョンズ・ホプキンス・ユニバーシティー Visual tracking / annotation of clinically important anatomical landmarks for surgical intervention
US8996173B2 (en) 2010-09-21 2015-03-31 Intuitive Surgical Operations, Inc. Method and apparatus for hand gesture control in a minimally invasive surgical system
US8543240B2 (en) 2009-11-13 2013-09-24 Intuitive Surgical Operations, Inc. Master finger tracking device and method of use in a minimally invasive surgical system
US8935003B2 (en) 2010-09-21 2015-01-13 Intuitive Surgical Operations Method and system for hand presence detection in a minimally invasive surgical system
BR112012011422B1 (en) 2009-11-13 2020-09-29 Intuitive Surgical Operations, Inc MINIMUM INVASIVE SURGICAL SYSTEM
US8682489B2 (en) 2009-11-13 2014-03-25 Intuitive Sugical Operations, Inc. Method and system for hand control of a teleoperated minimally invasive slave surgical instrument
US8521331B2 (en) 2009-11-13 2013-08-27 Intuitive Surgical Operations, Inc. Patient-side surgeon interface for a minimally invasive, teleoperated surgical instrument
WO2011069469A1 (en) * 2009-12-11 2011-06-16 Hospital Authority Stereoscopic visualization system for surgery
JP5805668B2 (en) 2010-01-26 2015-11-04 アータック メディカル (2013) リミテッド Articulated medical equipment
US9858475B2 (en) 2010-05-14 2018-01-02 Intuitive Surgical Operations, Inc. Method and system of hand segmentation and overlay using depth data
US10343283B2 (en) 2010-05-24 2019-07-09 Intouch Technologies, Inc. Telepresence robot system that can be accessed by a cellular phone
EP2577642A4 (en) * 2010-05-26 2016-06-08 Health Research Inc Method and system for minimally-invasive surgery training using tracking data
US9699438B2 (en) 2010-07-02 2017-07-04 Disney Enterprises, Inc. 3D graphic insertion for live action stereoscopic video
KR101235044B1 (en) * 2010-11-02 2013-02-21 서울대학교병원 (분사무소) Method of operation simulation and automatic operation device using 3d modelling
US10475240B2 (en) 2010-11-19 2019-11-12 Fanuc Robotics America Corporation System, method, and apparatus to display three-dimensional robotic workcell data
DE102012110508B4 (en) 2011-11-04 2022-05-12 Fanuc Robotics America Corp. Robot adjustment device with 3-D display
US8663209B2 (en) 2012-01-24 2014-03-04 William Harrison Zurn Vessel clearing apparatus, devices and methods
CN103379310A (en) * 2012-04-26 2013-10-30 哈尔滨工业大学深圳研究生院 Traffic accident medical treatment assistance system and method
US11871901B2 (en) 2012-05-20 2024-01-16 Cilag Gmbh International Method for situational awareness for surgical network or surgical network connected device capable of adjusting function based on a sensed situation or usage
JP6103827B2 (en) * 2012-06-14 2017-03-29 オリンパス株式会社 Image processing apparatus and stereoscopic image observation system
US9833207B2 (en) 2012-08-08 2017-12-05 William Harrison Zurn Analysis and clearing module, system and method
CN102961811A (en) * 2012-11-07 2013-03-13 上海交通大学 Trachea intubating system and method based on remotely operated mechanical arm
CN110279427B (en) 2012-12-10 2024-01-16 直观外科手术操作公司 Collision avoidance during controlled movement of movable arm of image acquisition device and steerable device
US9681982B2 (en) 2012-12-17 2017-06-20 Alcon Research, Ltd. Wearable user interface for use with ocular surgical console
US20140176661A1 (en) 2012-12-21 2014-06-26 G. Anthony Reina System and method for surgical telementoring and training with virtualized telestration and haptic holograms, including metadata tagging, encapsulation and saving multi-modal streaming medical imagery together with multi-dimensional [4-d] virtual mesh and multi-sensory annotation in standard file formats used for digital imaging and communications in medicine (dicom)
CN103077633A (en) 2013-01-11 2013-05-01 深圳超多维光电子有限公司 Three-dimensional virtual training system and method
US9962533B2 (en) 2013-02-14 2018-05-08 William Harrison Zurn Module for treatment of medical conditions; system for making module and methods of making module
US9443346B2 (en) 2013-07-23 2016-09-13 Mako Surgical Corp. Method and system for X-ray image generation
US11504192B2 (en) 2014-10-30 2022-11-22 Cilag Gmbh International Method of hub communication with surgical instrument systems
US10013808B2 (en) 2015-02-03 2018-07-03 Globus Medical, Inc. Surgeon head-mounted display apparatuses
EP3274986A4 (en) 2015-03-21 2019-04-17 Mine One GmbH Virtual 3d methods, systems and software
US10853625B2 (en) * 2015-03-21 2020-12-01 Mine One Gmbh Facial signature methods, systems and software
EP3435904A1 (en) * 2016-03-31 2019-02-06 Koninklijke Philips N.V. Image guided robot for catheter placement
JP2020502552A (en) * 2016-11-10 2020-01-23 シンク サージカル, インコーポレイテッド Remote teaching station
JP6869032B2 (en) * 2017-01-11 2021-05-12 株式会社トプコン Ophthalmic examination system
US11123150B2 (en) 2017-03-07 2021-09-21 Sony Corporation Information processing apparatus, assistance system, and information processing method
WO2018208823A1 (en) * 2017-05-09 2018-11-15 Boston Scientific Scimed, Inc. Operating room devices, methods, and systems
JP6476358B1 (en) * 2017-05-17 2019-02-27 Telexistence株式会社 Control device, robot control method, and robot control system
US11123070B2 (en) 2017-10-30 2021-09-21 Cilag Gmbh International Clip applier comprising a rotatable clip magazine
US11801098B2 (en) 2017-10-30 2023-10-31 Cilag Gmbh International Method of hub communication with surgical instrument systems
US11229436B2 (en) 2017-10-30 2022-01-25 Cilag Gmbh International Surgical system comprising a surgical tool and a surgical hub
US11317919B2 (en) 2017-10-30 2022-05-03 Cilag Gmbh International Clip applier comprising a clip crimping system
US11564756B2 (en) 2017-10-30 2023-01-31 Cilag Gmbh International Method of hub communication with surgical instrument systems
US11311342B2 (en) 2017-10-30 2022-04-26 Cilag Gmbh International Method for communicating with surgical instrument systems
US11291510B2 (en) 2017-10-30 2022-04-05 Cilag Gmbh International Method of hub communication with surgical instrument systems
US11510741B2 (en) 2017-10-30 2022-11-29 Cilag Gmbh International Method for producing a surgical instrument comprising a smart electrical system
US11026712B2 (en) 2017-10-30 2021-06-08 Cilag Gmbh International Surgical instruments comprising a shifting mechanism
US11911045B2 (en) 2017-10-30 2024-02-27 Cllag GmbH International Method for operating a powered articulating multi-clip applier
US10638089B2 (en) * 2017-12-11 2020-04-28 Foresight Imaging System and method of collaboratively communication on images via input illustrations and have those illustrations auto erase
US10944728B2 (en) 2017-12-28 2021-03-09 Ethicon Llc Interactive surgical systems with encrypted communication capabilities
US11051876B2 (en) 2017-12-28 2021-07-06 Cilag Gmbh International Surgical evacuation flow paths
US11202570B2 (en) 2017-12-28 2021-12-21 Cilag Gmbh International Communication hub and storage device for storing parameters and status of a surgical device to be shared with cloud based analytics systems
US11419667B2 (en) 2017-12-28 2022-08-23 Cilag Gmbh International Ultrasonic energy device which varies pressure applied by clamp arm to provide threshold control pressure at a cut progression location
US11559307B2 (en) 2017-12-28 2023-01-24 Cilag Gmbh International Method of robotic hub communication, detection, and control
US20190201042A1 (en) 2017-12-28 2019-07-04 Ethicon Llc Determining the state of an ultrasonic electromechanical system according to frequency shift
US11166772B2 (en) 2017-12-28 2021-11-09 Cilag Gmbh International Surgical hub coordination of control and communication of operating room devices
US11179208B2 (en) 2017-12-28 2021-11-23 Cilag Gmbh International Cloud-based medical analytics for security and authentication trends and reactive measures
US11304720B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Activation of energy devices
US10758310B2 (en) 2017-12-28 2020-09-01 Ethicon Llc Wireless pairing of a surgical device with another device within a sterile surgical field based on the usage and situational awareness of devices
US11257589B2 (en) 2017-12-28 2022-02-22 Cilag Gmbh International Real-time analysis of comprehensive cost of all instrumentation used in surgery utilizing data fluidity to track instruments through stocking and in-house processes
US11364075B2 (en) 2017-12-28 2022-06-21 Cilag Gmbh International Radio frequency energy device for delivering combined electrical signals
US11317937B2 (en) 2018-03-08 2022-05-03 Cilag Gmbh International Determining the state of an ultrasonic end effector
US11056244B2 (en) 2017-12-28 2021-07-06 Cilag Gmbh International Automated data scaling, alignment, and organizing based on predefined parameters within surgical networks
US11311306B2 (en) 2017-12-28 2022-04-26 Cilag Gmbh International Surgical systems for detecting end effector tissue distribution irregularities
US11013563B2 (en) 2017-12-28 2021-05-25 Ethicon Llc Drive arrangements for robot-assisted surgical platforms
US11937769B2 (en) 2017-12-28 2024-03-26 Cilag Gmbh International Method of hub communication, processing, storage and display
US11234756B2 (en) 2017-12-28 2022-02-01 Cilag Gmbh International Powered surgical tool with predefined adjustable control algorithm for controlling end effector parameter
US11896322B2 (en) 2017-12-28 2024-02-13 Cilag Gmbh International Sensing the patient position and contact utilizing the mono-polar return pad electrode to provide situational awareness to the hub
US11109866B2 (en) 2017-12-28 2021-09-07 Cilag Gmbh International Method for circular stapler control algorithm adjustment based on situational awareness
US11589888B2 (en) 2017-12-28 2023-02-28 Cilag Gmbh International Method for controlling smart energy devices
US11602393B2 (en) 2017-12-28 2023-03-14 Cilag Gmbh International Surgical evacuation sensing and generator control
US11672605B2 (en) * 2017-12-28 2023-06-13 Cilag Gmbh International Sterile field interactive control displays
US10987178B2 (en) 2017-12-28 2021-04-27 Ethicon Llc Surgical hub control arrangements
US11423007B2 (en) 2017-12-28 2022-08-23 Cilag Gmbh International Adjustment of device control programs based on stratified contextual data in addition to the data
US11304745B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Surgical evacuation sensing and display
US10595887B2 (en) 2017-12-28 2020-03-24 Ethicon Llc Systems for adjusting end effector parameters based on perioperative information
US11324557B2 (en) 2017-12-28 2022-05-10 Cilag Gmbh International Surgical instrument with a sensing array
US10898622B2 (en) 2017-12-28 2021-01-26 Ethicon Llc Surgical evacuation system with a communication circuit for communication between a filter and a smoke evacuation device
US20190201142A1 (en) 2017-12-28 2019-07-04 Ethicon Llc Automatic tool adjustments for robot-assisted surgical platforms
US11273001B2 (en) 2017-12-28 2022-03-15 Cilag Gmbh International Surgical hub and modular device response adjustment based on situational awareness
US10932872B2 (en) 2017-12-28 2021-03-02 Ethicon Llc Cloud-based medical analytics for linking of local usage trends with the resource acquisition behaviors of larger data set
US11786245B2 (en) 2017-12-28 2023-10-17 Cilag Gmbh International Surgical systems with prioritized data transmission capabilities
US11633237B2 (en) 2017-12-28 2023-04-25 Cilag Gmbh International Usage and technique analysis of surgeon / staff performance against a baseline to optimize device utilization and performance for both current and future procedures
US11571234B2 (en) 2017-12-28 2023-02-07 Cilag Gmbh International Temperature control of ultrasonic end effector and control system therefor
US11096693B2 (en) 2017-12-28 2021-08-24 Cilag Gmbh International Adjustment of staple height of at least one row of staples based on the sensed tissue thickness or force in closing
US11376002B2 (en) 2017-12-28 2022-07-05 Cilag Gmbh International Surgical instrument cartridge sensor assemblies
US11389164B2 (en) 2017-12-28 2022-07-19 Cilag Gmbh International Method of using reinforced flexible circuits with multiple sensors to optimize performance of radio frequency devices
US11304699B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Method for adaptive control schemes for surgical network control and interaction
US11284936B2 (en) 2017-12-28 2022-03-29 Cilag Gmbh International Surgical instrument having a flexible electrode
US11100631B2 (en) 2017-12-28 2021-08-24 Cilag Gmbh International Use of laser light and red-green-blue coloration to determine properties of back scattered light
US11291495B2 (en) 2017-12-28 2022-04-05 Cilag Gmbh International Interruption of energy due to inadvertent capacitive coupling
US11464559B2 (en) 2017-12-28 2022-10-11 Cilag Gmbh International Estimating state of ultrasonic end effector and control system therefor
US11857152B2 (en) 2017-12-28 2024-01-02 Cilag Gmbh International Surgical hub spatial awareness to determine devices in operating theater
US11304763B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Image capturing of the areas outside the abdomen to improve placement and control of a surgical device in use
US11666331B2 (en) 2017-12-28 2023-06-06 Cilag Gmbh International Systems for detecting proximity of surgical end effector to cancerous tissue
US10892995B2 (en) 2017-12-28 2021-01-12 Ethicon Llc Surgical network determination of prioritization of communication, interaction, or processing based on system or device needs
US11132462B2 (en) 2017-12-28 2021-09-28 Cilag Gmbh International Data stripping method to interrogate patient records and create anonymized record
US11432885B2 (en) 2017-12-28 2022-09-06 Cilag Gmbh International Sensing arrangements for robot-assisted surgical platforms
US11308075B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Surgical network, instrument, and cloud responses based on validation of received dataset and authentication of its source and integrity
US11832899B2 (en) 2017-12-28 2023-12-05 Cilag Gmbh International Surgical systems with autonomously adjustable control programs
US11896443B2 (en) 2017-12-28 2024-02-13 Cilag Gmbh International Control of a surgical system through a surgical barrier
US11818052B2 (en) 2017-12-28 2023-11-14 Cilag Gmbh International Surgical network determination of prioritization of communication, interaction, or processing based on system or device needs
US11786251B2 (en) 2017-12-28 2023-10-17 Cilag Gmbh International Method for adaptive control schemes for surgical network control and interaction
US11253315B2 (en) 2017-12-28 2022-02-22 Cilag Gmbh International Increasing radio frequency to create pad-less monopolar loop
US11069012B2 (en) 2017-12-28 2021-07-20 Cilag Gmbh International Interactive surgical systems with condition handling of devices and data capabilities
US11659023B2 (en) * 2017-12-28 2023-05-23 Cilag Gmbh International Method of hub communication
US11446052B2 (en) 2017-12-28 2022-09-20 Cilag Gmbh International Variation of radio frequency and ultrasonic power level in cooperation with varying clamp arm pressure to achieve predefined heat flux or power applied to tissue
US11160605B2 (en) 2017-12-28 2021-11-02 Cilag Gmbh International Surgical evacuation sensing and motor control
US11464535B2 (en) 2017-12-28 2022-10-11 Cilag Gmbh International Detection of end effector emersion in liquid
US11864728B2 (en) 2017-12-28 2024-01-09 Cilag Gmbh International Characterization of tissue irregularities through the use of mono-chromatic light refractivity
US10943454B2 (en) 2017-12-28 2021-03-09 Ethicon Llc Detection and escalation of security responses of surgical instruments to increasing severity threats
US11266468B2 (en) 2017-12-28 2022-03-08 Cilag Gmbh International Cooperative utilization of data derived from secondary sources by intelligent surgical hubs
US11832840B2 (en) 2017-12-28 2023-12-05 Cilag Gmbh International Surgical instrument having a flexible circuit
US11678881B2 (en) 2017-12-28 2023-06-20 Cilag Gmbh International Spatial awareness of surgical hubs in operating rooms
US11529187B2 (en) 2017-12-28 2022-12-20 Cilag Gmbh International Surgical evacuation sensor arrangements
US11559308B2 (en) 2017-12-28 2023-01-24 Cilag Gmbh International Method for smart energy device infrastructure
US11424027B2 (en) 2017-12-28 2022-08-23 Cilag Gmbh International Method for operating surgical instrument systems
US11596291B2 (en) 2017-12-28 2023-03-07 Cilag Gmbh International Method of compressing tissue within a stapling device and simultaneously displaying of the location of the tissue within the jaws
US11576677B2 (en) 2017-12-28 2023-02-14 Cilag Gmbh International Method of hub communication, processing, display, and cloud analytics
US11903601B2 (en) 2017-12-28 2024-02-20 Cilag Gmbh International Surgical instrument comprising a plurality of drive systems
US11278281B2 (en) 2017-12-28 2022-03-22 Cilag Gmbh International Interactive surgical system
US11612444B2 (en) 2017-12-28 2023-03-28 Cilag Gmbh International Adjustment of a surgical device function based on situational awareness
US11771487B2 (en) 2017-12-28 2023-10-03 Cilag Gmbh International Mechanisms for controlling different electromechanical systems of an electrosurgical instrument
US11744604B2 (en) 2017-12-28 2023-09-05 Cilag Gmbh International Surgical instrument with a hardware-only control circuit
US11410259B2 (en) 2017-12-28 2022-08-09 Cilag Gmbh International Adaptive control program updates for surgical devices
US11147607B2 (en) 2017-12-28 2021-10-19 Cilag Gmbh International Bipolar combination device that automatically adjusts pressure based on energy modality
US11419630B2 (en) 2017-12-28 2022-08-23 Cilag Gmbh International Surgical system distributed processing
US11540855B2 (en) 2017-12-28 2023-01-03 Cilag Gmbh International Controlling activation of an ultrasonic surgical instrument according to the presence of tissue
US11076921B2 (en) 2017-12-28 2021-08-03 Cilag Gmbh International Adaptive control program updates for surgical hubs
US10966791B2 (en) 2017-12-28 2021-04-06 Ethicon Llc Cloud-based medical analytics for medical facility segmented individualization of instrument function
IT201800000673U1 (en) * 2018-01-11 2019-07-11 ROBOTIC APPARATUS FOR SURGICAL OPERATIONS
US20190254753A1 (en) 2018-02-19 2019-08-22 Globus Medical, Inc. Augmented reality navigation systems for use with robotic surgical systems and methods of their use
US11678927B2 (en) 2018-03-08 2023-06-20 Cilag Gmbh International Detection of large vessels during parenchymal dissection using a smart blade
US11259830B2 (en) 2018-03-08 2022-03-01 Cilag Gmbh International Methods for controlling temperature in ultrasonic device
US11464532B2 (en) 2018-03-08 2022-10-11 Cilag Gmbh International Methods for estimating and controlling state of ultrasonic end effector
WO2019190792A1 (en) * 2018-03-26 2019-10-03 Covidien Lp Telementoring control assemblies for robotic surgical systems
US11207067B2 (en) 2018-03-28 2021-12-28 Cilag Gmbh International Surgical stapling device with separate rotary driven closure and firing systems and firing member that engages both jaws while firing
US10973520B2 (en) 2018-03-28 2021-04-13 Ethicon Llc Surgical staple cartridge with firing member driven camming assembly that has an onboard tissue cutting feature
US11219453B2 (en) 2018-03-28 2022-01-11 Cilag Gmbh International Surgical stapling devices with cartridge compatible closure and firing lockout arrangements
US11096688B2 (en) 2018-03-28 2021-08-24 Cilag Gmbh International Rotary driven firing members with different anvil and channel engagement features
US11090047B2 (en) 2018-03-28 2021-08-17 Cilag Gmbh International Surgical instrument comprising an adaptive control system
US11471156B2 (en) 2018-03-28 2022-10-18 Cilag Gmbh International Surgical stapling devices with improved rotary driven closure systems
US11259806B2 (en) 2018-03-28 2022-03-01 Cilag Gmbh International Surgical stapling devices with features for blocking advancement of a camming assembly of an incompatible cartridge installed therein
US11197668B2 (en) 2018-03-28 2021-12-14 Cilag Gmbh International Surgical stapling assembly comprising a lockout and an exterior access orifice to permit artificial unlocking of the lockout
US11278280B2 (en) 2018-03-28 2022-03-22 Cilag Gmbh International Surgical instrument comprising a jaw closure lockout
JP7325173B2 (en) 2018-10-06 2023-08-14 シスメックス株式会社 REMOTE SUPPORT METHOD FOR SURGERY ASSIST ROBOT, AND REMOTE SUPPORT SYSTEM
US11291445B2 (en) 2019-02-19 2022-04-05 Cilag Gmbh International Surgical staple cartridges with integral authentication keys
US11357503B2 (en) 2019-02-19 2022-06-14 Cilag Gmbh International Staple cartridge retainers with frangible retention features and methods of using same
US11369377B2 (en) 2019-02-19 2022-06-28 Cilag Gmbh International Surgical stapling assembly with cartridge based retainer configured to unlock a firing lockout
US11751872B2 (en) 2019-02-19 2023-09-12 Cilag Gmbh International Insertable deactivator element for surgical stapler lockouts
US11317915B2 (en) 2019-02-19 2022-05-03 Cilag Gmbh International Universal cartridge based key feature that unlocks multiple lockout arrangements in different surgical staplers
US20200281675A1 (en) * 2019-03-04 2020-09-10 Covidien Lp Low cost dual console training system for robotic surgical system or robotic surgical simulator
USD952144S1 (en) 2019-06-25 2022-05-17 Cilag Gmbh International Surgical staple cartridge retainer with firing system authentication key
USD950728S1 (en) 2019-06-25 2022-05-03 Cilag Gmbh International Surgical staple cartridge
USD964564S1 (en) 2019-06-25 2022-09-20 Cilag Gmbh International Surgical staple cartridge retainer with a closure system authentication key
CN110572612A (en) * 2019-08-30 2019-12-13 南京图格医疗科技有限公司 Medical 3D image display system
US20220409324A1 (en) * 2019-12-30 2022-12-29 Intuitive Surgical Operations, Inc. Systems and methods for telestration with spatial memory
US11464581B2 (en) 2020-01-28 2022-10-11 Globus Medical, Inc. Pose measurement chaining for extended reality surgical navigation in visible and near infrared spectrums
US11382699B2 (en) 2020-02-10 2022-07-12 Globus Medical Inc. Extended reality visualization of optical tool tracking volume for computer assisted navigation in surgery
US11207150B2 (en) 2020-02-19 2021-12-28 Globus Medical, Inc. Displaying a virtual model of a planned instrument attachment to ensure correct selection of physical instrument attachment
US20230173681A1 (en) * 2020-04-10 2023-06-08 Kawasaki Jukogyo Kabushiki Kaisha Robot system and control method for robot system
CN115379815A (en) * 2020-04-10 2022-11-22 川崎重工业株式会社 Robot system and method for operating the same
US20230200921A1 (en) * 2020-04-10 2023-06-29 Kawasaki Jukogyo Kabushiki Kaisha Medical movable body system and method of operating same
US11607277B2 (en) 2020-04-29 2023-03-21 Globus Medical, Inc. Registration of surgical tool with reference array tracked by cameras of an extended reality headset for assisted navigation during surgery
US11153555B1 (en) 2020-05-08 2021-10-19 Globus Medical Inc. Extended reality headset camera system for computer assisted navigation in surgery
US11382700B2 (en) 2020-05-08 2022-07-12 Globus Medical Inc. Extended reality headset tool tracking and control
US11510750B2 (en) 2020-05-08 2022-11-29 Globus Medical, Inc. Leveraging two-dimensional digital imaging and communication in medicine imagery in three-dimensional extended reality applications
US11087557B1 (en) 2020-06-03 2021-08-10 Tovy Kamine Methods and systems for remote augmented reality communication for guided surgery
US11737831B2 (en) 2020-09-02 2023-08-29 Globus Medical Inc. Surgical object tracking template generation for computer assisted navigation during surgical procedure
CN111991084B (en) * 2020-10-08 2022-04-26 深圳市精锋医疗科技股份有限公司 Surgical robot, virtual imaging control method thereof and virtual imaging control device thereof
DE102022101524A1 (en) 2022-01-24 2023-07-27 Karl Storz Se & Co. Kg Method and measuring device for correcting a position of a measuring point
JP2024048960A (en) 2022-09-28 2024-04-09 株式会社メディカロイド Remote surgery support system and operating device for supervising surgeon
JP2024048946A (en) * 2022-09-28 2024-04-09 株式会社メディカロイド Remote surgery support system and operating device for supervising surgeon

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5808665A (en) * 1992-01-21 1998-09-15 Sri International Endoscopic surgical instrument and method for use
US5839441A (en) * 1996-06-03 1998-11-24 The Trustees Of The University Of Pennsylvania Marking tumors and solid objects in the body with ultrasound
US6108458A (en) * 1996-07-03 2000-08-22 Massachusetts Institute Of Technology Sparse array image correlation
US6856324B2 (en) * 2001-03-27 2005-02-15 Siemens Corporate Research, Inc. Augmented reality guided instrument positioning with guiding graphics

Family Cites Families (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4219842A (en) * 1978-08-24 1980-08-26 The Magnavox Company Video signal combiner having a common phase response and independent amplitude response
US4603231A (en) * 1983-03-31 1986-07-29 Interand Corporation System for sensing spatial coordinates
US5175616A (en) * 1989-08-04 1992-12-29 Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of National Defence Of Canada Stereoscopic video-graphic coordinate specification system
US5217003A (en) * 1991-03-18 1993-06-08 Wilk Peter J Automated surgical system and apparatus
US5432528A (en) * 1991-04-12 1995-07-11 Abekas Video Systems, Inc. Video combiner
US5417210A (en) * 1992-05-27 1995-05-23 International Business Machines Corporation System and method for augmentation of endoscopic surgery
US5404393A (en) * 1991-10-03 1995-04-04 Viscorp Method and apparatus for interactive television through use of menu windows
US6731988B1 (en) * 1992-01-21 2004-05-04 Sri International System and method for remote endoscopic surgery
JP3257640B2 (en) * 1992-06-09 2002-02-18 オリンパス光学工業株式会社 Stereoscopic endoscope device
US5428192A (en) * 1993-05-10 1995-06-27 Ace Cad Enterprise Co., Ltd. Method and apparatus for finding the location of a pointing instrument on a tablet
CA2164290A1 (en) * 1993-06-07 1994-12-22 David B. Burleson Display system for a subscriber terminal
JPH06350937A (en) * 1993-06-14 1994-12-22 Pioneer Electron Corp Picture synthesis reproduction device
US5583536A (en) * 1994-06-09 1996-12-10 Intel Corporation Method and apparatus for analog video merging and key detection
US5468921A (en) * 1994-08-11 1995-11-21 Boeckeler Instruments, Inc. Extended communication cable for a light pen or the like
US6304372B1 (en) * 1995-05-17 2001-10-16 Leica Microsystems Ag Microscope including a fade-in element and related method of using a microscope
JP3707830B2 (en) * 1995-07-04 2005-10-19 株式会社東芝 Image display device for surgical support
US5776050A (en) * 1995-07-24 1998-07-07 Medical Media Systems Anatomical visualization system
US6714841B1 (en) * 1995-09-15 2004-03-30 Computer Motion, Inc. Head cursor control interface for an automated endoscope system for optimal positioning
US5855583A (en) * 1996-02-20 1999-01-05 Computer Motion, Inc. Method and apparatus for performing minimally invasive cardiac procedures
US6139490A (en) * 1996-02-22 2000-10-31 Precision Optics Corporation Stereoscopic endoscope with virtual reality viewing
US6911916B1 (en) * 1996-06-24 2005-06-28 The Cleveland Clinic Foundation Method and apparatus for accessing medical data over a network
US6159016A (en) * 1996-12-20 2000-12-12 Lubell; Alan Method and system for producing personal golf lesson video
US6057833A (en) * 1997-04-07 2000-05-02 Shoreline Studios Method and apparatus for providing real time enhancements and animations over a video image
US6215898B1 (en) * 1997-04-15 2001-04-10 Interval Research Corporation Data processing system and method
US6714839B2 (en) 1998-12-08 2004-03-30 Intuitive Surgical, Inc. Master having redundant degrees of freedom
ES2180110T3 (en) * 1997-11-24 2003-02-01 Weiglhofer Gerhard COHERENCE DETECTOR.
US6659939B2 (en) * 1998-11-20 2003-12-09 Intuitive Surgical, Inc. Cooperative minimally invasive telesurgical system
US6720988B1 (en) * 1998-12-08 2004-04-13 Intuitive Surgical, Inc. Stereo imaging system and method for use in telerobotic systems
US6424885B1 (en) * 1999-04-07 2002-07-23 Intuitive Surgical, Inc. Camera referenced control in a minimally invasive surgical apparatus
US6317616B1 (en) * 1999-09-15 2001-11-13 Neil David Glossop Method and system to facilitate image guided surgery
US7075556B1 (en) * 1999-10-21 2006-07-11 Sportvision, Inc. Telestrator system
US6791601B1 (en) * 1999-11-11 2004-09-14 Stryker Corporation Multi-function image and video capture device for use in an endoscopic camera system
CN1203680C (en) * 1999-12-22 2005-05-25 杨振里 Method for implementing single-screen 3D television
US6864886B1 (en) * 2000-08-10 2005-03-08 Sportvision, Inc. Enhancing video using a virtual surface
JP2002336188A (en) * 2001-05-21 2002-11-26 Olympus Optical Co Ltd Endoscope system for measurement
JP3791907B2 (en) * 2002-02-12 2006-06-28 オリンパス株式会社 Observation device
WO2003096255A2 (en) * 2002-05-06 2003-11-20 The Johns Hopkins University Simulation system for medical procedures
AU2003238833A1 (en) * 2002-05-31 2003-12-19 The Texas A And M University System Deployable telemedicine system
JP2004309930A (en) * 2003-04-09 2004-11-04 Olympus Corp Stereoscopic observation system
JP2005118232A (en) * 2003-10-15 2005-05-12 Olympus Corp Surgery support system
US20050179702A1 (en) * 2004-02-13 2005-08-18 Video Delta, Inc. Embedded video processing system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5808665A (en) * 1992-01-21 1998-09-15 Sri International Endoscopic surgical instrument and method for use
US5839441A (en) * 1996-06-03 1998-11-24 The Trustees Of The University Of Pennsylvania Marking tumors and solid objects in the body with ultrasound
US6108458A (en) * 1996-07-03 2000-08-22 Massachusetts Institute Of Technology Sparse array image correlation
US6856324B2 (en) * 2001-03-27 2005-02-15 Siemens Corporate Research, Inc. Augmented reality guided instrument positioning with guiding graphics

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1965699A4 *

Also Published As

Publication number Publication date
US20070167702A1 (en) 2007-07-19
EP1965699A2 (en) 2008-09-10
JP5373263B2 (en) 2013-12-18
EP3107286B1 (en) 2019-02-06
KR20080089376A (en) 2008-10-06
DE102006059380A1 (en) 2007-08-30
EP1965699B1 (en) 2017-06-28
FR2898264A1 (en) 2007-09-14
WO2007120351A2 (en) 2007-10-25
CN102143706B (en) 2013-03-27
CN102143706A (en) 2011-08-03
EP3107286A1 (en) 2016-12-21
EP1965699A4 (en) 2014-04-09
KR101407986B1 (en) 2014-06-20
JP2007181670A (en) 2007-07-19

Similar Documents

Publication Publication Date Title
WO2007120351A3 (en) Medical robotic system providing three-dimensional telestration
EP2393300A3 (en) Image display apparatus and method for operating the same
EP2590416A3 (en) Image processing apparatus and method
EP2410490A3 (en) Displaying augmented reality information
WO2011133496A3 (en) System, method and apparatus for generation, transmission and display of 3d content
WO2012143885A3 (en) Mpr slice selection for visualization of catheter in three-dimensional ultrasound
WO2006111965A8 (en) System and method for producing an augmented image of an organ of a patient
EP2413225A3 (en) Mobile terminal with 3D display and method of controlling operation of the mobile terminal
TW200721803A (en) 3-D stereoscopic image display system
EP2309768A3 (en) Mobile terminal with 3D/2D display and controlling method thereof
EP2525580A3 (en) Dynamically configurable 3D display
MX2009009871A (en) System and method for combining text with three-dimensional content.
EP2469871A3 (en) Image display device, method and program
ATE470921T1 (en) METHOD AND DEVICE FOR RELATING MEDICAL 3D DATA IMAGE VIEW PLANES TO EACH OTHER
EP2299724A3 (en) Video processing system and video processing method
EP2365697A3 (en) Image display device and method for operating the same
EP2320668A3 (en) High density multi-view image display system and method with active sub-pixel rendering
EP2346264A3 (en) Method of providing 3D image and 3D display apparatus using the same
EP2395763A3 (en) Storage medium having stored therein stereoscopic image display program, stereoscopic image display device, stereoscopic image display system, and stereoscopic image display method
WO2010150976A3 (en) Receiving system and method of providing 3d image
EP2166402A3 (en) 2D/3D switchable autostereoscopic display apparatus and method
WO2015033253A3 (en) Generating a 3d interactive immersive experience from a 2d static image
WO2007017772A3 (en) System and method for selective blending of 2d x-ray images and 3d ultrasound images
EP2355526A3 (en) Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method
WO2011067713A3 (en) Method and system of generating a three-dimensional view of a real scene for military planning and operations

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200680047993.1

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 06851012

Country of ref document: EP

Kind code of ref document: A2

REEP Request for entry into the european phase

Ref document number: 2006851012

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2006851012

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 1020087016218

Country of ref document: KR