INTRA-OPERATIVE MEDICAL IMAGE VIEWING SYSTEM AND METHOD

• US 20170042631A1
• Filed: 04/21/2015
• Published: 02/16/2017
• Est. Priority Date: 04/22/2014
• Status: Abandoned Application

• Current Assignee: Surgerati LLC
• Original Assignee: Surgerati LLC
• Inventors: Doo, Florence Xini, Bloom, David C.
• Application Number:
  US15/306,214
• Publication Number:
  US 20170042631A1
• Time in Patent Office: Days
• CPC Class Codes: A61B 2017/00203 with speech control or speech recognition
• CPC Class Codes: A61B 2017/00207 with hand gesture control or hand gesture recognition
• CPC Class Codes: A61B 2017/00212 using remote controls
• CPC Class Codes: A61B 2034/2048 using an accelerometer or inertia sensor
• CPC Class Codes: A61B 2034/2065 Tracking using image or pattern recognition
• CPC Class Codes: A61B 2090/366 using projection of images directly onto the body
• CPC Class Codes: A61B 2090/367 creating a 3D dataset from 2D images using position information
• CPC Class Codes: A61B 2090/371 with simultaneous use of two cameras
• CPC Class Codes: A61B 2090/372 Details of monitor hardware
• CPC Class Codes: A61B 2090/502 Headgear, e.g. helmet, spectacles
• CPC Class Codes: A61B 90/37 Surgical systems with images on a monitor during operation
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

An intra-operative medical image viewing system can allow a surgeon to maintain a viewing perspective on the patient while calling-up visual images on-the-fly. A digital image source has at least one image file representative of an anatomical or pathological feature of a patient. A display is worn by the surgeon or positioned between the surgeon and her patient during surgery. The display is selectively transparent, and exhibits to the surgeon an image derived from the image file. An image control unit retrieves the image file from the image source and controls the display so that at least a portion of the image depiction can be exhibited and modified at will by the surgeon. A plurality of peripheral devices are each configured to receive an image control input from the surgeon and, in response, generate an image control signal. Each peripheral accepts a different user-interface modality.

Claims

10. An intra-operative medical image viewing system comprising:

an image source having at least one image file representative of an anatomical feature of a patient;

a selectively transparent display positionable between a surgeon and the patient during surgery, said display being configured to exhibit at least one image to the surgeon overlaid on the patient;

an image control unit configured to retrieve the at least one image file from said image source and control said display to exhibit and modify at least a portion of the at least one image, the at least one image being a visual representation of the anatomical feature of the patient;

at least one peripheral device configured to receive an image control input from the surgeon and in response transmit an image control signal to said image control unit, the image control input representative of a desire by the surgeon to modify the at least one image exhibited by said display; and

wherein said image control unit is configured to modify the image in response to the image control signal in any one of a plurality of different three-dimensional modalities.

11. The intra-operative medical image viewing system of claim 10 wherein the image is further defined as two-dimensional and one of said plurality of different three-dimensional modalities is defined as changing an observable plane of the image to add the appearance of depth.

12. The intra-operative medical image viewing system of claim 10 wherein the image is further defined as two-dimensional and one of said plurality of different three-dimensional modalities is defined as wrapping the image around the anatomical feature of the patient.

13. The intra-operative medical image viewing system of claim 10 wherein the image is further defined as a series of three-dimensional tomographic slices of the anatomical feature of the patient and one of said plurality of different three-dimensional modalities is defined as sequentially exhibiting a series of three-dimensional tomographic slices.

14. The intra-operative medical image viewing system of claim 10 wherein the image is further defined as a three-dimensional holographic image generated by tomography of the anatomical feature of the patient.

15. The intra-operative medical image viewing system of claim 10 wherein the image is further defined as three-dimensional, wherein said display is further defined as a binocular viewer, and one of said plurality of different three-dimensional modalities is further defined as a stereoscopic feed present through said binocular viewer.

16. The intra-operative medical image viewing system of claim 10 wherein said at least one peripheral device is further defined as:

a plurality of peripheral devices each configured to receive an image control input from the surgeon and in response generate an image control signal in a respective user-interface modality, the image control input representative of a desire by the surgeon to modify the at least one image exhibited by said display, wherein each of said plurality of peripheral devices defines a different user-interface modality.

17-1. The intra-operative medical image viewing system of claim 18 wherein the image includes portions indicating a three-dimensional nature of the anatomical feature of the patient.

18. An intra-operative medical image viewing system comprising:

an image source having at least one image file representative of an anatomical feature of a patient;

a selectively transparent display positionable between a surgeon during surgery on the patient, said display being configured to exhibit an image to the surgeon overlaid on the patient;

an image control unit configured to retrieve the image file from said image source and control said display to exhibit and modify the image, the image being a visual representation of the anatomical feature of the patient, wherein said image control unit is responsive to inputs from the surgeon to modify the image to allow the surgeon to selectively position, size and orient the image exhibited on said display to a selectable first configuration; and

a station-keeping module including;

a position module configured to detect a first position of said display when the first configuration is selected and determine a change in position of said display from the first position;

an orientation module configured to detect a first orientation of said display when the first configuration is selected and determine a change in orientation of said display from the first orientation;

a registration module configured to determine a registration default condition defined by the first configuration, the first position, and the first orientation; and

an image recalibration module configured to determine one or more image modification commands to be applied by said display to change the image from the first configuration to a second configuration in response to at least one of the change in position and change in the orientation, said image recalibration module configured to transmit the one or more image modification commands to said image control unit and said image control unit to control said display, the second configuration different from the first configuration and consistent with the registration default condition.

1. An intra-operative medical image viewing system comprising:

an image source having at least one image file representative of an anatomical feature of a patient;

a display positionable between a surgeon and the patient during surgery, said display being configured to exhibit images to the surgeon overlaid on the patient;

an image control unit configured to retrieve the at least one image file from said image source and control said display to exhibit and modify at least a portion of the at least one image; and

a plurality of peripheral devices each configured to receive an image control input from the surgeon and in response generate an image control signal in a respective user-interface modality, the image control input representative of a desire by the surgeon to modify the at least one image exhibited by said display, wherein each of said plurality of peripheral devices defines a different user-interface modality.

2. The intra-operative medical image viewing system of claim 1 further comprising:

a translator module configured to receive the image control signals from said plurality of peripheral devices in different user-interface modalities, to convert the respective image control signals into an image manipulation command in a common operating room viewer language, and to transmit the image manipulation command to said image control unit, wherein said image control unit controls said display with the image manipulation command received from said translator module.

3. The intra-operative medical image viewing system of claim 2 wherein said image control unit and said translator module are further defined as part of a computing device comprising one or more processors and a non-transitory, computer readable medium storing instructions.

4. The intra-operative medical image viewing system of claim 3 wherein at least one of said one or more processors of said computing device is integral with each of said plurality of peripheral devices and is configured to convert the image control input into the image manipulation command in the common operating room viewer language and transmit the image manipulation command to another of said at least one of said one or more processors of said computing device.

5. The intra-operative medical image viewing system of claim 1 wherein said image control unit is further defined as configured to control said display to modify the at least one image overlaid on the patient by at least one of panning, zooming, rotating, and adjusting the transparency of the overlaid image.

6. The intra-operative medical image viewing system of claim 1 wherein said plurality of peripheral devices includes a microphone configured to receive voice inputs from the surgeon and a motion sensor configured to capture hand-gesture inputs from the surgeon.

7. The intra-operative medical image viewing system of claim 1 wherein said display is further defined as wearable by the surgeon.

8. The intra-operative medical image viewing system of claim 1 wherein said display is further defined as mounted on a frame and sized to be non-wearable by the surgeon.

9. The intra-operative medical image viewing system of claim 1 wherein said display is further defined as a projection directly onto the surface of the patient.

17. The intra-operative medical image viewing system of claim 10 wherein the image is further defined as a live stream of intra-operative fluoroscopic imagery.

21. The intra-operative medical image viewing system of claim 18 wherein said position module is wearable by surgeon.

22. The intra-operative medical image viewing system of claim 18 further comprising:

a plurality of peripheral devices each configured to receive an image control input from the surgeon and in response generate an image control signal in a respective user-interface modality, the image control input representative of a desire by the surgeon to modify the at least one image exhibited by said display, wherein each of said plurality of peripheral devices defines a different user-interface modality.