Videotactic and audiotactic assisted surgical methods and procedures

• US 20080243142A1
• Filed: 02/20/2008
• Published: 10/02/2008
• Est. Priority Date: 02/20/2007
• Status: Abandoned Application

• Current Assignee: Philip L. Gildenberg
• Original Assignee: Philip L. Gildenberg
• Inventors: Gildenberg, Philip L.
• Application Number:
  US12/070,595
• Publication Number:
  US 20080243142A1
• Time in Patent Office: Days
• US Class Current: 606/130
• CPC Class Codes: A61B 2017/00115 with audible or visual output
• CPC Class Codes: A61B 2017/00694 with means correcting for movement of or for synchronisation with the body
• CPC Class Codes: A61B 2017/00699 correcting for movement caused by respiration, e.g. by triggering
• CPC Class Codes: A61B 2034/105 Modelling of the patient, e.g. for ligaments or bones
• CPC Class Codes: A61B 2034/107 Visualisation of planned trajectories or target regions
• CPC Class Codes: A61B 2034/2051 Electromagnetic tracking systems
• CPC Class Codes: A61B 2034/2055 Optical tracking systems
• CPC Class Codes: A61B 2034/256 having a database of accessory information, e.g. including context sensitive help or scientific articles
• CPC Class Codes: A61B 2090/364 Correlation of different images or relation of image positions in respect to the body
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/392 Radioactive markers
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 90/36 Image-producing devices or illumination devices not otherwise provided for
• CPC Class Codes: A61B 90/361 Image-producing devices, e.g. surgical cameras
• CPC Class Codes: A61B 90/98 using electromagnetic means, e.g. transponders
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2210/41 Medical
• CPC Class Codes: G09B 23/285 for injections, endoscopy, bronchoscopy, sigmoidscopy, insertion of contraceptive devices or enemas
• CPC Class Codes: G16H 20/40 relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 30/40 : for processing medical images, e.g. editing
• CPC Class Codes: G16H 50/50 : for simulation or modelling of medical disorders

Abstract

The present invention provides video and audio assisted surgical techniques and methods. Novel features of the techniques and methods provided by the present invention include presenting a surgeon with a video compilation that displays an endoscopic-camera derived image, a reconstructed view of the surgical field (including fiducial markers indicative of anatomical locations on or in the patient), and/or a real-time video image of the patient. The real-time image can be obtained either with the video camera that is part of the image localized endoscope or with an image localized video camera without an endoscope, or both. In certain other embodiments, the methods of the present invention include the use of anatomical atlases related to pre-operative generated images derived from three-dimensional reconstructed CT, MRI, x-ray, or fluoroscopy. Images can furthermore be obtained from pre-operative imaging and spacial shifting of anatomical structures may be identified by intraoperative imaging and appropriate correction performed.

Claims

1. An endoscopic procedure viewing system, the system comprising:

(a) providing pre-operative scan data representative of a patient'"'"'s body or part of a patient'"'"'s body;

(b) creating a computer-generated reconstruction of an internal patient volume from the pre-operative scan data and/or digital atlases;

(c) creating a computer-generated real-time image from a camera on an endoscope of at least a portion of the internal patient volume;

(d) causing a computer to overlay the computer-generated real-time image and the computer-generated reconstruction with substantial spatial identity and substantial spatial fidelity; and

(e) creating computer-generated visual feedback, the computer-generated visual feedback showing position, trajectory and movement of the endoscope in a substantially real-time fashion on the overlay of the computer-generated reconstruction.

2. The system of claim 1, wherein (c) and (d) are performed using a system of fiducial markers.

3. The system of claim 2, wherein the fiducial markers are light emitting diodes.

4. The system of claim 2, wherein (c) and (d) are performed using a marker system selected from the group consisting of:

(1) spherical objects;

(2) radio frequency tags; and

(3) light emitting diodes.

5. The system of claim 1, wherein the computer-generated reconstruction is generated in part by resolving a series of layered images.

6. The system of claim 5, wherein the layered images are selected from the group consisting of:

(1) computerized tomography (CT);

(2) magnetic resonance imaging (MRI);

(3) x-ray;

(4) fluoroscopy;

(5) ultrasound; and

(6) proton beam imaging.

7. The system of claim 1, further comprising:

(f) creating a computer-generated reconstruction of an internal patient volume from the pre-operative scan data, the computer-generated reconstruction identifying at least one feature of interest within the overall volume; and

(g) causing the computer to track the endoscope-eye-view with substantial positional fidelity to the computer-generated real-time image.

8. The system of claim 1, further comprising incorporating intra-operative scan data into the computer-generated reconstruction.

9. The system of claim 1, the computer-generated reconstruction further includes data from a digital atlas.

10. The system of claim 1, further comprising a digital representation of an implantable device in the computer-generated reconstruction.

11. A method of use of the system of claim 10, wherein the system is used to display the digital representation of the implantable device in various positions or to display the path to insertion for the implantable device.

12. A method of use of the system of claim 10, wherein the system is used to determine proper size of the implantable device.

13. An endoscopic viewing system for providing visual and audible feedback, the system comprising:

(a) providing pre-operative scan data representative of a patient'"'"'s body;

(b) creating a computer-generated reconstruction of an internal patient volume from the pre-operative scan data and/or digital altases, the computer-generated reconstruction identifying at least one feature of interest within the overall volume;

(c) creating a computer-generated real-time image from a camera on an endoscope of at least a portion of the internal patient volume, the computer-generated real-time image further including at least one trackable point, the at least one trackable point movable in real-time with respect to the overall volume;

(d) causing a computer to overlay the computer-generated real-time image and the computer-generated reconstruction with substantial spatial identity and substantial spatial fidelity; and

(e) creating computer-generated visual feedback, the computer-generated visual feedback showing movement of the endoscope in a substantially real-time fashion on the overlay of the computer-generated reconstruction;

(f) causing the computer to track the at least one trackable point with substantial positional fidelity to the computer-generated real-time image; and

(g) creating computer-generated audible feedback, the computer-generated audible feedback describing movement of the at least one trackable point with respect to the at least one feature of interest.

14. The method of claim 13, wherein (d), (e) and (f) are performed using a system of fiducial markers.

15. The system of claim 13, wherein (d), (e) and (f) are performed using a marker system selected from the group consisting of:

(1) spherical objects;

(2) radio frequency tags; and

(3) light emitting diodes.

16. The method of claim 13, wherein the computer-generated audible feedback comprises at least one type of sound selected from the group consisting of:

(1) a tone;

(2) a buzz;

(3) a tune;

(4) white noise;

(5) a pre-recorded or computer generated utterance;

(6) substantial silence; and

(7) an intermittent pulsatile tone; and

(8) a variable vibrating signal.

17. The method of claim 13, wherein the computer-generated audible feedback comprises at least one variation selected from the group consisting of:

(1) pitch variation;

(2) volume variation;

(3) pulse variation;

(4) type of sound variation; and

(5) utterance variation.

18. The method of claim 13, wherein the at least one trackable point is a tip of a surgical instrument on the endoscope, and at least one other point so that the trajectory of the instrument can be determined, or the trajectory can be determined directly by relting it to the orientation of the localization fiducials.

19. The method of claim 13, wherein the computer-generated reconstruction is generated in part by resolving a series of layered images.

20. The method of claim 19, wherein the series of layered images is obtained using a process selected from the group of:

(1) computerized tomography (CT);

(2) magnetic resonance imaging (MRI);

(3) fluoroscopy and,

(4) ultrasound.

21. The system of claim 13, further comprising a digital representation of an implantable device in the computer-generated reconstruction.

22. The system of claim 13, further comprising creating and displaying at least a portion of the computer generated real time image that represents an instrument-eye-view.

23. The system of claim 22, wherein the instrument-eye-view is displayed as a highlighted area or cursor.