System and method for enhanced data analysis with specialized video enabled software tools for medical environments

• US 10,687,914 B2
• Filed: 08/21/2018
• Issued: 06/23/2020
• Est. Priority Date: 05/29/2009
• Status: Active Grant

• Current Assignee: Jack Wade
• Original Assignee: Jack Wade
• Inventors: Wade, Jack
• Primary Examiner(s): Bitar, Nancy
• Application Number:
  US16/107,071
• Publication Number:
  US 20190090976A1
• Time in Patent Office: 672 Days
• Field of Search: None
• CPC Class Codes: A61B 1/00009 of image signals during a use of endoscope
• CPC Class Codes: A61B 1/000095 for image enhancement
• CPC Class Codes: A61B 1/00011 characterised by signal transmission
• CPC Class Codes: A61B 1/3132 for laparoscopy
• CPC Class Codes: A61B 2034/252 indicating steps of a surgical procedure
• CPC Class Codes: A61B 2034/256 having a database of accessory information, e.g. including context sensitive help or scientific articles
• CPC Class Codes: A61B 2090/3612 with images taken automatically
• CPC Class Codes: A61B 34/25 User interfaces for surgical systems
• CPC Class Codes: A61B 90/30 Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
• CPC Class Codes: A61B 90/361 Image-producing devices, e.g. surgical cameras
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G16H 10/00 ICT specially adapted for the handling or processing of patient-related medical or healthcare data for medical reports G16H15/00; for therapies or health-improving plans G16H20/00; for the handling or processing of medical images G16H30/00
• CPC Class Codes: G16H 20/40 relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: H04L 67/125 : involving control of end-device applications over a network
• CPC Class Codes: H04N 7/147 : Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

Medical software tools platforms utilize a surgical display to provide access to specific medical software tools, such as medically-oriented applications or widgets, that can assist surgeons or surgical team in performing various procedures. In particular, an endoscopic camera may register the momentary rise in the optical signature reflected from a tissue surface and in turn transmit it to a medical image processing system which can also receive patient heart rate data and display relevant anomalies. Changes in various spectral components and the speed at which they change in relation to a source of stimulus (heartbeat, breathing, light source modulation, etc.) may indicate the arrival of blood, contrast agents or oxygen absorption. Combinations of these may indicate various states of differing disease or margins of tumors, and so forth. Also, changes in temperatures, physical dimensions, pressures, photoacoustic pressures and the rate of change may indicate tissue anomalies in comparison to historic values.

Claims

1. A system for medical software tools, comprising:

an image stream interface module configured to receive an image stream from a surgical camera wherein said image stream interface module includes a CPU and a GPU for processing said image stream;

a user interface overlay module configured to provide a user interface overlay adapted for presentation over the image stream by use of a video router providing a video stream to overlay an original video image;

an optical sensor located corresponding with said surgical camera for registering changes in spectral characteristics reflected from a tissue surface under inspection wherein said optical sensor provides a signal indicative of light energy detected;

a medical software tools module configured to provide a medical software tool through the user interface, the medical software tool being configured to perform an operation with respect to the image stream and provide an output adapted to be presented over the image stream, responsive to said light energy detected by said optical sensor;

a medical image processing system for processing patient medical data and corresponding said patient medical data with said momentary changes in spectral characteristics for generating optical signature data indicative of various patient conditions, wherein the medical software tool measures;

a. changes in color intensity and b. rates at which said color intensities change in response to;

heartbeat pushed blood, breathing pushed oxygen or light intensity or modulation from a light source;

image markers used to delineate tissue areas of interest;

annotation data input by said user indicative of quality of observed patient tissue;

digital zoom feature activated by location markers used to indicate an area wherein said image stream is processed digitally for presentation of a zoomed in image for presentation to said user; and

timers set by a user to facilitate the pace at which a medical procedure is performed.

2. A system according to claim 1 wherein said timers correspond to a blood vessel clamped within a patient to facilitate performing a medical procedure.

3. A system according to claim 1 wherein an optical signature module facilitates processing of said patient optical signature data including heart rate data and image data.

4. A system according to claim 3 wherein said optical signature module generates optical signature data.

5. A system according to claim 4 wherein optical signature data includes timer data.

6. A system according to claim 1 wherein said timer data may include countdown data to guide a user for performing a medical procedure.

7. A system according to claim 1 where in a height intensity map is used to analyze tissue.

8. A system according to claim 1 wherein a color map is generated in response to various said spectral components generated.

9. A system according to claim 1 wherein a user defined checklist is combined with said patient optical signature data so that a user is reminded not to miss medical procedure steps.

10. A system according to claim 1 wherein said patient optical signature data is combined with margin guide data so that a user may define and utilize a margin of clear tissue surrounding a tissue location of interest to said user.

11. A system according to claim 1 wherein said patient medical data includes images from a medical procedure and said images are securely stored for later reference.

12. A system according to claim 10 wherein said securely stored images are compared with later generated images resulting from said identical patient.

13. A system according to claim 10 wherein said securely stored images are compared with images resulting from other patients for comparison of corresponding tissue images between different patients.

14. A system according to claim 12 wherein said image comparisons may include a multitude of patient tissue image comparisons to form a model of what is considered healthy tissue.

15. A system according to claim 1 wherein said timers are controlled in part by optical signature values related said patient tissue condition.