Systems, methods, apparatuses, and computer-readable media for image guided surgery

• US 10,136,951 B2
• Filed: 06/14/2016
• Issued: 11/27/2018
• Est. Priority Date: 02/17/2009
• Status: Active Grant

• Current Assignee: Inneroptic Technology, Inc.
• Original Assignee: Inneroptic Technology, Inc.
• Inventors: Razzaque, Sharif, Martinie, John, Iannitti, David, State, Andrei, Heaney, Brian
• Primary Examiner(s): Luong, Peter
• Application Number:
  US15/182,346
• Publication Number:
  US 20170128139A1
• Time in Patent Office: 896 Days
• CPC Class Codes: A61B 18/02 by cooling, e.g. cryogenic techniques devices for cooling specific reflex points of the body within cell-life limits A61H39/06
• CPC Class Codes: A61B 18/082 Probes or electrodes therefor
• CPC Class Codes: A61B 18/1442 Probes having pivoting end effectors, e.g. forceps
• CPC Class Codes: A61B 18/1477 Needle-like probes
• CPC Class Codes: A61B 18/18 by applying electromagnetic radiation, e.g. microwaves radiation therapy A61N5/00
• CPC Class Codes: A61B 18/1815 using microwaves
• CPC Class Codes: A61B 18/20 using laser
• CPC Class Codes: A61B 2018/00577 Ablation
• CPC Class Codes: A61B 2018/1425 Needle
• CPC Class Codes: A61B 2018/1869 with an instrument interstitially inserted into the body, e.g. needles
• CPC Class Codes: A61B 2034/102 Modelling of surgical devices, implants or prosthesis
• CPC Class Codes: A61B 2034/104 Modelling the effect of the tool, e.g. the effect of an implanted prosthesis or for predicting the effect of ablation or burring
• CPC Class Codes: A61B 2034/107 Visualisation of planned trajectories or target regions
• CPC Class Codes: A61B 2034/2051 Electromagnetic tracking systems
• CPC Class Codes: A61B 2034/207 Divots for calibration
• CPC Class Codes: A61B 2034/2072 Reference field transducer attached to an instrument or patient
• CPC Class Codes: A61B 2090/368 changing the image on a display according to the operator's position
• CPC Class Codes: A61B 2090/378 using ultrasound
• CPC Class Codes: A61B 2090/3983 Reference marker arrangements for use with image guided surgery
• CPC Class Codes: A61B 2090/502 Headgear, e.g. helmet, spectacles
• CPC Class Codes: A61B 34/10 : Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: A61B 34/20 : Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 34/25 : User interfaces for surgical systems
• CPC Class Codes: A61B 8/4245 : involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient
• CPC Class Codes: A61B 90/37 : Surgical systems with images on a monitor during operation
• CPC Class Codes: B33Y 80/00 : Products made by additive manufacturing

Abstract

Presented herein are methods, systems, devices, and computer-readable media for image guided surgery. The systems herein allow a physician to use multiple instruments for a surgery and simultaneously provide image-guidance data for those instruments. Various embodiments disclosed herein provide information to physicians about procedures they are performing, the devices (such as ablation needles, ultrasound wands or probes, scalpels, cauterizers, etc.) they are using during the procedure, the relative emplacements or poses of these devices, prediction information for those devices, and other information. Some embodiments provide useful information about 3D data sets. Additionally, some embodiments provide for quickly calibratable surgical instruments or attachments for surgical instruments.

Claims

1. A method of displaying a perspective view of an image, the method comprising:

receiving emplacement data associated with a physical medical device;

determining an emplacement of a medical image slice based at least in part on the emplacement data;

determining a perspective view of the medical image slice in a virtual 3D space based at least in part on a relative orientation of the physical medical device with respect to an expected location of a user, wherein the expected location of the user is a fixed location in front of one or more displays; and

causing the one or more displays to display in real-time the perspective view of the medical image slice in the virtual 3D space.

2. The method of claim 1, further comprising:

determining an emplacement of a virtual medical device based at least in part on the emplacement data, wherein the virtual medical device corresponds to the physical medical device;

determining a perspective view of the virtual medical device in the virtual 3D space based at least in part on the relative orientation of the physical medical device with respect to the expected location of the user; and

causing the one or more displays to display a perspective view of at least a portion of the virtual medical device in the virtual 3D space.

3. The method of claim 2, wherein the virtual medical device is a first virtual medical device, the emplacement data is first emplacement data, and the physical medical device is a first physical medical device, the method further comprising:

receiving second emplacement data associated with a second physical medical device;

determining an emplacement of a second virtual medical device based at least in part on the second emplacement data, wherein the second virtual medical device corresponds to the second physical medical device;

determining a perspective view of the second virtual medical device in the virtual 3D space based at least in part on a relative orientation of the second physical medical device with respect to the expected location of the user; and

causing the one or more displays to display a perspective view of at least a portion of the second virtual medical device in the virtual 3D space.

4. The method of claim 3, wherein the second physical medical device comprises a needle and the first physical medical device comprises an imaging device.

5. The method of claim 1, further comprising:

receiving emplacement data associated with another physical medical device;

determining an emplacement of a virtual medical device based at least in part on the emplacement data associated with the another physical medical device, wherein the virtual medical device corresponds to the another physical medical device;

determining a perspective view of the virtual medical device in the virtual 3D space based at least in part on a relative orientation of the another physical medical device with respect to the expected location of the user; and

causing the one or more displays to display a perspective view of at least a portion of the virtual medical device in the virtual 3D space.

6. The method of claim 5, further comprising causing the one or more displays to display a graphic indicating an intersection between a trajectory of the virtual medical device and the medical image slice.

7. The method of claim 5, further comprising causing the one or more displays to display a graphic indicating an intersection between a trajectory of the virtual medical device and a location on a 2D plane corresponding to the medical image slice, wherein the location on the 2D plane is outside the medical image slice.

8. The method of claim 5, wherein the another physical medical device comprises an ablation needle, and wherein the method further comprises causing the one or more displays to display in real-time a perspective view of an ablation volume for the ablation needle in the virtual 3D space based at least in part on the relative orientation of the another physical medical device with respect to the expected location of the user.

9. The method of claim 5, further comprising:

receiving an indication of a point of interest;

marking, in an underlying 3D model, an intersection of a trajectory of the virtual medical device and a 2D plane corresponding to the medical image slice as the point of interest; and

causing the one or more displays to display a perspective view of the point of interest in the virtual 3D space based at least in part on the determined perspective view of the medical image slice.

10. A system, comprising:

a computing device comprising one or more processors, the computing device configured to;

receive emplacement data associated with a physical medical device;

determine an emplacement of a medical image slice based at least in part on the emplacement data;

determine a perspective view of the medical image slice in a virtual 3D space based at least in part on a relative orientation of the physical medical device with respect to an expected location of a user, wherein the expected location of the user is a fixed location in front of one or more displays; and

cause the one or more displays to display in real-time the perspective view of the medical image slice in the virtual 3D space.

11. The system of claim 10, wherein the computing device is further configured to:

determine an emplacement of a virtual medical device based at least in part on the emplacement data, wherein the virtual medical device corresponds to the physical medical device;

determine a perspective view of the virtual medical device in the virtual 3D space based at least in part on the relative orientation of the physical medical device with respect to the expected location of the user; and

cause the one or more displays to display a perspective view of at least a portion of the virtual medical device in the virtual 3D space.

12. The system, of claim 11, wherein the virtual medical device is a first virtual medical device, the emplacement data is first emplacement data, and the physical medical device is a first physical medical device, and wherein the computing device is further configured to:

receive second emplacement data associated with a second physical medical device;

determine an emplacement of a second virtual medical device based at least in part on the second emplacement data, wherein the second virtual medical device corresponds to the second physical medical device;

determine a perspective view of the second virtual medical device in the virtual 3D space based at least in part on a relative orientation of the second physical medical device with respect to the expected location of the user; and

cause the one or more displays to display a perspective view of at least a portion of the second virtual medical device in the virtual 3D space.

13. The system of claim 10, wherein the computing device is further configured to:

receive emplacement data associated with another physical medical device;

determine an emplacement of a virtual medical device based at least in part on the emplacement data associated with the another physical medical device, wherein the virtual medical device corresponds to the another physical medical device;

determine a perspective view of the virtual medical device in the virtual 3D space based at least in part on a relative orientation of the another physical medical device with respect to the expected location of the user; and

cause the one or more displays to display a perspective view of at least a portion of the virtual medical device in the virtual 3D space.

14. The system of claim 13, wherein the computing device is further configured to cause the one or more displays to display a graphic indicating an intersection between a trajectory of the virtual medical device and the medical image slice.

15. The system of claim 13, wherein the computing device is further configured to cause the one or more displays to display a graphic indicating an intersection between a trajectory of the virtual medical device and a location on a 2D plane corresponding to the medical image slice, wherein the location on the 2D plane is outside the medical image slice.

16. The system of claim 13, wherein the another physical medical device comprises an ablation needle, and wherein the computing device is further configured to cause the one or more displays to display a perspective view of an ablation volume for the ablation needle in the virtual 3D space based at least in part on the relative orientation of the another physical medical device with respect to the expected location of the user.

17. The system of claim 13, wherein the computing device is further configured to:

receive an indication of a point of interest;

mark, in an underlying 3D model, an intersection of a trajectory of the virtual medical device and a 2D plane corresponding to the medical image slice as the point of interest; and

cause the one or more displays to display a perspective view of the point of interest in the virtual 3D space based at least in part on the determined perspective view of the medical image slice.

18. A non-transitory computer-readable medium comprising computer-executable instructions, the instructions, when executed, cause one or more processors to:

receive emplacement data associated with a physical medical device;

determine an emplacement of a medical image slice based at least in part on the emplacement data;

determine a perspective view of the medical image slice in a virtual 3D space based at least in part on a relative orientation of the physical medical device with respect to an expected location of a user, wherein the expected location of the user is a fixed location in front of one or more displays; and

cause the one or more displays to display in real-time the perspective view of the medical image slice in the virtual 3D space.

19. The non-transitory computer-readable medium of claim 18, wherein the instructions, when executed, further cause one or more processors to:

receive emplacement data associated with another physical medical device;

determine an emplacement of a virtual medical device based at least in part on the emplacement data associated with the another physical medical device, wherein the virtual medical device corresponds to the another physical medical device;

receive an indication of a point of interest;

mark, in an underlying 3D model, an intersection of a trajectory of the virtual medical device and a 2D plane corresponding to the medical image slice as the point of interest; and

cause the one or more displays to display a perspective view of the point of interest in the virtual 3D space based at least in part on the determined perspective view of the medical image slice.

20. The non-transitory computer-readable medium of claim 18, wherein the instructions, when executed, further cause one or more processors to:

receive emplacement data associated with another physical medical device;

determine an emplacement of a virtual medical device based at least in part on the emplacement data associated with the another physical medical device, wherein the virtual medical device corresponds to the another physical medical device;

determine a perspective view of the virtual medical device in the virtual 3D space based at least in part on a relative orientation of the another physical medical device with respect to the expected location of the user; and

cause the one or more displays to display a perspective view of at least a portion of the virtual medical device in the virtual 3D space.