Loupe display

• US 10,433,814 B2
• Filed: 06/01/2017
• Issued: 10/08/2019
• Est. Priority Date: 02/17/2016
• Status: Active Grant

• Current Assignee: Inneroptic Technology, Inc.
• Original Assignee: Inneroptic Technology, Inc.
• Inventors: Razzaque, Sharif, Kohli, Luv, State, Andrei, Heaney, Brian, Keller, Kurtis, Green, Caroline
• Primary Examiner(s): Elahi, Towfiq
• Application Number:
  US15/611,454
• Publication Number:
  US 20170360395A1
• Time in Patent Office: 859 Days
• CPC Class Codes: A61B 5/0066 Optical coherence imaging
• CPC Class Codes: A61B 5/055 involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
• CPC Class Codes: A61B 5/066 Superposing sensor position on an image of the patient, e.g. obtained by ultrasound or x-ray imaging
• CPC Class Codes: A61B 6/032 Transmission computed tomography [CT]
• CPC Class Codes: A61B 6/037 Emission tomography
• CPC Class Codes: A61B 6/466 adapted to display 3D data
• CPC Class Codes: A61B 6/487 involving fluoroscopy
• CPC Class Codes: A61B 8/0841 for locating instruments
• CPC Class Codes: A61B 8/4245 involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient
• CPC Class Codes: A61B 8/466 adapted to display 3D data 3D imaging and stereoscopic displays in devices for short-range imaging with acoustic waves G01S15/8993 and G01S7/52068, respectively; 3D image rendering G06T15/00; manipulating 3D models for computer graphics G06T19/00
• CPC Class Codes: A61B 8/483 involving the acquisition of a 3D volume of data

Abstract

A system and method for providing image guidance for placement of one or more medical devices at a target location. The system can determine one or more intersections between a medical device and an image region based at least in part on first emplacement data and second emplacement data. Using the determined intersections, the system can cause one or more displays to display perspective views of image guidance cues, including an intersection indicator in a virtual 3D space.

Claims

1. A guidance system, comprising one or more processors, the guidance system configured to:

receive emplacement data associated with a first emplacement sensor with respect to a first coordinate system;

receive emplacement data associated with a second emplacement sensor with respect to the first coordinate system;

receive emplacement data associated with a third emplacement sensor with respect to a second coordinate system, the third emplacement sensor associated with a head mounted display;

determine an emplacement of a first virtual medical device with respect to a third coordinate system based at least in part on the received emplacement data associated with the first emplacement sensor, an offset, and the received emplacement data associated with the third emplacement sensor;

determine an emplacement of a second virtual medical device with respect to the third coordinate system based at least in part on the received emplacement data associated with the second emplacement sensor, the offset, and the received emplacement data associated with the third emplacement sensor;

receive a real-time medical imaging stream associated with the second virtual medical device;

determine an emplacement of the real-time medical imaging stream with respect to the third coordinate system based at least in part on the received emplacement data associated with the second emplacement sensor, the offset, and the received emplacement data associated with the third emplacement sensor; and

cause a display of the head mounted display to display a 3D rendered view of a virtual 3D volume including;

a 3D rendering of at least a portion of the first virtual medical device based at least in part on the determined emplacement of the first virtual medical device,

a 3D rendering of at least a portion of the second virtual medical device based at least in part on the determined emplacement of the second virtual medical device, and

a 3D rendering of the real-time medical imaging stream based at least in part on the determined emplacement of the real-time medical imaging stream,

wherein the 3D rendered view changes in relation to a change in the received emplacement data associated with the third emplacement sensor.

2. The guidance system of claim 1, wherein the first emplacement sensor is associated with a first real medical device and the second emplacement sensor is associated with a second real medical device.

3. The guidance system of claim 2, wherein the offset is configured to allow a viewer of the display to simultaneously view the 3D rendering of the at least a portion of the first virtual medical device and at least a portion of the 3D rendering of the real-time medical imaging stream on the display, and at least a portion of the first real medical device corresponding to the first virtual medical device above and/or below the display.

4. A guidance system, comprising one or more processors, the guidance system configured to:

receive emplacement data associated with a first emplacement sensor with respect to a first coordinate system;

receive emplacement data associated with a second emplacement sensor with respect to a second coordinate system, the second emplacement sensor associated with a head mounted display;

determine an emplacement of a medical image with respect to a third coordinate system based at least in part on the received emplacement data associated with the first emplacement sensor, the received emplacement data associated with the second emplacement sensor, and an offset;

and

cause a display to display a rendering of the medical image based at least in part on the determined emplacement of the medical image, wherein the rendering of the medical image varies in relation to a change in the received emplacement data associated with the second emplacement sensor.

5. The guidance system of claim 4, wherein the first emplacement sensor is associated with a real medical device.

6. The guidance system of claim 5, wherein the offset is configured to allow a viewer of the display to simultaneously view at least a portion of the rendering of the medical image on the display and at least one of a portion of the real medical device above the display or at least a portion of the real medical device below the display.

7. The guidance system of claim 4, wherein the guidance system is further configured to:

determine an emplacement of a medical device with respect to the third coordinate system based at least in part on emplacement data associated with a third emplacement sensor, the received emplacement data associated with the second emplacement sensor, and the offset; and

cause the display to display a rendering of at least a portion of the medical device based at least in part on the determined emplacement of the medical device, wherein the rendering of the at least a portion of the medical device varies in relation to a change in the emplacement data associated with the third emplacement sensor.

8. The guidance system of claim 4, wherein to cause the display to display a rendering of the medical image, the one or more processors are configured to cause the display to display a 3D rendered view of a scene including the rendering of the medical image.

9. The guidance system of claim 4, wherein the medical image comprises at least a portion of an ultrasound image.

10. The guidance system of claim 4, wherein the display comprises an opaque, stereoscopic display of the head mounted display.

11. The guidance system of claim 4, wherein the head mounted display comprises:

a frame configured to mount to a head of a user;

a first opaque display coupled to the frame and located within a portion of a field of view of a left eye of the user when the frame is mounted to the head of the user, the first opaque display comprising only a subset of the field of view of the left eye of the user; and

a second opaque display coupled to the frame and located within a field of view of a right eye of the user when the frame is mounted to the head of the user, the second opaque display comprising only a subset of the field of view of the right eye of the user.

12. A guidance system, comprising one or more processors, the guidance system configured to:

receive first emplacement data associated with a first emplacement sensor with respect to a first coordinate system;

receive second emplacement data associated with a second emplacement sensor with respect to a second coordinate system, the second emplacement sensor associated with a head mounted display;

determine an emplacement of a medical device with respect to a third coordinate system based at least in part on the received first emplacement data, the received second emplacement data, and an offset;

and

cause a display to display a rendering of at least a portion of the medical device based at least in part on the determined emplacement of the medical device, wherein the rendering of the at least a portion of the medical device varies in relation to a change in the received second emplacement data.

13. The guidance system of claim 12, wherein the second emplacement sensor is associated with a real medical device.

14. The guidance system of claim 13, wherein the offset is configured to allow a viewer of the display to simultaneously view the rendering of the at least a portion of the medical device on the display and at least one of at least a portion of the real medical device above below the display or at least a portion of the real medical device below the display.

15. The guidance system of claim 12, wherein the medical device is a first medical device, and wherein guidance system is further configured to:

receive third emplacement data associated with a third emplacement sensor with respect to the first coordinate system;

determine an emplacement of a second medical device with respect to the third coordinate system based at least in part on the received second emplacement data, the received third emplacement data, and the offset;

and

cause the display to display a rendering of at least a portion of the second medical device based at least in part on the determined emplacement of the second medical device, wherein the rendering of the at least a portion of the second medical device varies in relation to a change in the received third emplacement data.

16. The guidance system of claim 12, wherein the display comprises an opaque, stereoscopic display of the head mounted display.

17. The guidance system of claim 12, wherein the head mounted display comprises:

a frame configured to mount to a head of a user;

a first opaque display coupled to the frame and located within a portion of a field of view of a left eye of the user when the frame is mounted to the head of the user, the first opaque display comprising only a subset of the field of view of the left eye of the user; and

a second opaque display coupled to the frame and located within a field of view of a right eye of the user when the frame is mounted to the head of the user, the second opaque display comprising only a subset of the field of view of the right eye of the user.