Hot device indication of video display

• US 10,537,394 B2
• Filed: 12/19/2016
• Issued: 01/21/2020
• Est. Priority Date: 12/19/2016
• Status: Active Grant

• Current Assignee: Cilag Gmbh International (Johnson & Johnson)
• Original Assignee: Ethicon, LLC (Johnson & Johnson)
• Inventors: Strobl, Geoffrey S.
• Primary Examiner(s): Stice, Paula J
• Application Number:
  US15/383,068
• Publication Number:
  US 20180168734A1
• Time in Patent Office: 1,128 Days
• CPC Class Codes: A61B 17/00234 for minimally invasive surgery A61B17/0218, A61B17/0469, A61B17/12013, A61B17/1285, A61B17/29, A61B17/320016 take precedence
• CPC Class Codes: A61B 18/12 by passing a current through the tissue to be heated, e.g. high-frequency current
• CPC Class Codes: A61B 18/1445 at the distal end of a shaft, e.g. forceps or scissors at the end of a rigid rod
• CPC Class Codes: A61B 2018/00791 Temperature
• CPC Class Codes: A61B 2018/00982 combined with or comprising means for visual or photographic inspections inside the body, e.g. endoscopes
• CPC Class Codes: A61B 2034/2051 Electromagnetic tracking systems
• CPC Class Codes: A61B 2034/2057 Details of tracking cameras
• CPC Class Codes: A61B 2034/2065 Tracking using image or pattern recognition
• CPC Class Codes: A61B 2034/741 Glove like input devices, e.g. "data gloves"
• CPC Class Codes: A61B 2034/742 Joysticks
• CPC Class Codes: A61B 2034/743 Keyboards
• CPC Class Codes: A61B 2034/744 Mouse
• CPC Class Codes: A61B 2090/3975 active
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 34/30 Surgical robots
• CPC Class Codes: A61B 34/35 for telesurgery
• CPC Class Codes: A61B 34/74 Manipulators with manual electric input means
• CPC Class Codes: A61B 34/76 Manipulators having means for providing feel, e.g. force or tactile feedback
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: A61B 5/064 using markers A61B5/062 takes precedence
• CPC Class Codes: A61B 5/065 : Determining position of the probe employing exclusively positioning means located on or in the probe, e.g. using position sensors arranged on the probe
• CPC Class Codes: A61B 90/39 : Markers, e.g. radio-opaque or breast lesions markers
• CPC Class Codes: A61N 7/02 : Localised ultrasound hyperthermia hyperthermia in general A61F7/00
• CPC Class Codes: G01J 2005/0077 : Imaging
• CPC Class Codes: G01J 5/0022 : for sensing the radiation of moving bodies
• CPC Class Codes: G01J 5/07 : Arrangements for adjusting the solid angle of collected radiation, e.g. adjusting or orienting field of view, tracking position or encoding angular position optical collimating elements G01J5/0806
• CPC Class Codes: G01J 5/0803 : Arrangements for time-dependent attenuation of radiation signals

Abstract

A surgical system includes a first detector that includes a first array of pixels configured to detect light reflected by a surgical instrument and generate a first signal comprising a first dataset representative of a visible image of the surgical instrument. The surgical system also includes a second detector, comprising a second array of pixels configured to detect infrared radiation produced by the surgical instrument during a procedure using the surgical instrument and generate a second signal comprising a second dataset representative of an infrared image of the surgical instrument. The surgical system further includes a processor configured to receive the first and second signals, identify from the first dataset data representative of the surgical instrument, and identify from the second dataset data representative of one or more regions of the surgical instrument above a predetermined threshold temperature. The processor is also configured to generate a modified image of the surgical instrument based on data identified from the first and second dataset. The modified image includes visible indicia in the one or more region of the surgical instrument at or above the predetermined temperature.

Claims

1. A surgical system comprising:

a first detector, comprising a first array of pixels configured to detect light reflected by a surgical instrument and generate a first signal comprising a first dataset representative of a visible image of the surgical instrument;

a second detector, comprising a second array of pixels configured to detect infrared radiation produced by the surgical instrument during a procedure using the surgical instrument and generate a second signal comprising a second dataset representative of an infrared image of the surgical instrument;

an optical system configured to direct at least a portion of the light reflected by the surgical instrument to the first detector and direct at least a portion of the infrared radiation produced by the surgical instrument to the second detector; and

a processor configured to;

receive the first and second signals,

identify from the first dataset data representative of the surgical instrument,

identify from the second dataset data representative of one or more regions of the surgical instrument above a predetermined threshold temperature, and

generate a modified image of the surgical instrument based on data identified from the first and second dataset, the modified image including visible indicia in the one or more regions of the surgical instrument at or above the predetermined temperature and the modified image configured to be displayed in a display screen.

2. The system of claim 1, comprising a lens to direct the visible light reflected by the surgical instrument and the infrared radiation produced by the surgical instrument to the optical element.

3. The system of claim 1, wherein the processor is configured to identify data representative of the surgical instrument based on position of the first detector with respect to the surgical instrument.

4. The system of claim 3, wherein the processor is configured to determine orientation of the surgical instrument based on the identified data representative of the surgical instrument and a database of one or more surgical instruments stored in memory.

5. The system of claim 1, wherein the surgical instrument includes one or more markers, each of the one or more markers configured to reflect a predetermined frequency of light.

6. The system of claim 1, wherein the processor is configured to identify from the second dataset data representative of one or more regions of the surgical instrument above the predetermined threshold temperature based on the frequency of the infrared radiation produced by the one or more regions of the surgical instrument.

7. The system of claim 1, wherein the surgical instrument comprises an energy delivering end effector configured to deliver at least one of ultrasonic energy and radio frequency energy to a tissue.

8. The system of claim 1, further comprising a display device to display the modified image.

9. The system of claim 1, wherein the surgical system is a robotic surgical system and the robotic surgical system comprises at least one robotic arm configured to hold and manipulate the surgical instrument.

10. The system of claim 1, wherein the predetermined threshold temperature is 50°

C.

11. The system of claim 1, wherein the visible indicia comprises pixels of a distinct color in the modified image that represent a temperature value at or above the predetermined threshold temperature.

12. The system of claim 11, wherein the color is red.