SYSTEM FOR REMOTE GUIDANCE BY EXPERT FOR IMAGING DEVICE

• US 20080218588A1
• Filed: 03/06/2008
• Published: 09/11/2008
• Est. Priority Date: 10/11/2000
• Status: Active Grant

• Current Assignee: University of Pittsburgh of The Commonwealth System of Higher Education
• Original Assignee: University of Pittsburgh of The Commonwealth System of Higher Education
• Inventors: STETTEN, George DeWitt
• Granted Patent: US 8,253,779 B2
• Time in Patent Office: Days
• US Class Current: 348/47
• CPC Class Codes: A61B 2034/107 Visualisation of planned trajectories or target regions
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/373 using light, e.g. by using optical scanners
• CPC Class Codes: A61B 2090/374 NMR or MRI
• CPC Class Codes: A61B 2090/378 using ultrasound
• CPC Class Codes: A61B 2090/502 Headgear, e.g. helmet, spectacles
• CPC Class Codes: A61B 34/35 for telesurgery
• CPC Class Codes: A61B 8/0833 involving detecting or locating foreign bodies or organic structures
• CPC Class Codes: A61B 8/0841 for locating instruments
• CPC Class Codes: A61B 8/462 characterised by constructional features of the display
• CPC Class Codes: A61B 8/467 characterised by special input means
• CPC Class Codes: A61B 8/5238 for combining image data of patient, e.g. merging several images from different acquisition modes into one image for image registration algorithms G06T7/30
• CPC Class Codes: A61B 8/587 Calibration phantoms models for medical purposes G09B23/28
• CPC Class Codes: A61B 90/11 with guides for needles or instruments, e.g. arcuate slides or ball joints
• CPC Class Codes: A61B 90/36 Image-producing devices or illumination devices not otherwise provided for
• CPC Class Codes: A61B 90/361 Image-producing devices, e.g. surgical cameras

Abstract

Systems and methods for combining tomographic images with human vision. The systems preferably include a first assembly located proximal to an object to be imaged and a second assembly remote from the target. The first assembly is preferably able to collect a tomographic image from a target object and superimpose that tomographic image onto a direct view of the target object. The first assembly also includes components that allow the transmission of the tomographic image to the remote assembly. At the remote location, a highly trained expert may interact with the captured image by placing electronic markers on the image via an electronic interface. The captured image plus electronic marker are then preferably transmitted back to the local site via a second transmitter-receiver. The local user may use the electronic marker to guide his actions during the appropriate task. The systems have particular utility in the medical field where a trained clinician at a remote location may provide guidance to an untrained individual in performing a medical procedure on a patient.

Claims

1. An imaging system, comprising:

a local assembly proximal to a target object to be imaged, comprising;

an image capture device for capturing an image of the internal structure of the target object;

a first display for displaying a captured image from the image capture device;

a partially reflective surface oriented to reflect the captured image to an operator of the imaging device, such that the reflected captured image is merged with a direct view of the target object independent of the viewing location of the operator when the angle between the surface and the display is equal to angle between the surface and the image plane; and

a first transmitter-receiver adapted to transmit said captured image to a second transmitter-receiver; and

a remote assembly distal from said target object, comprising;

said second transmitter-receiver adapted to receive said captured image;

a second display for displaying the captured image;

wherein said first transmitter-receiver and said second transmitter-receiver comprise a communication channel adapted to transmit information from a user at said remote assembly to said first assembly.

2. The system of claim 1, wherein said information is audio information, electronic information, or combinations thereof.

3. The system of claim 2, wherein said second assembly further comprises an electronic interface adapted to place an electronic marker onto said captured image, further wherein said second transmitter-receiver is adapted to transmit information about the location and nature of said electronic marker to said first transmitter-receiver over said communication channel.

4. The system of claim 3, wherein second transmitter-receiver is further adapted to transmit an altered captured image.

5. The system of claim 1, wherein said image capture device is selected from the group consisting of:

ultrasound-based probe, radar-based probe, LIDAR-based probe, and SONAR-based probe.

6. The system of claim 1, wherein said first assembly further comprises an electronic camera.

7. The system of claim 6, wherein said electronic camera is adapted to capture said merger of said reflected captured image and said direct view of the target object.

8. The system of claim 7, wherein said first transmitter/receiver is adapted to transmit both said captured image and said merger of said reflected capture image and said direct view of the target object to said second transmitter/receiver.

9. The system of claim 8, wherein said second display is adapted to display both said captured image and said merger of said reflected capture image and said direct view of the target object.

10. The system of claim 1, wherein said electronic marker is selected from the group consisting of cursor, arrow, writing, shapes, and highlighting.

11. A method of imaging a target object, comprising the steps of:

at a first location, capturing an image from said target object using an image capture device;

transmitting the captured image to a second location via a first transmitter/receiver;

at said second location, receiving said transmitted captured image;

displaying said captured image;

providing an individual at the second location with an interface, wherein said interface allows said individual to communicate information about said captured image to said first location;

at said first location, receiving said information about said captured image;

displaying said captured image on a electronic display; and

reflecting said captured image to an operator, such that the reflected captured image is merged with a direct view of the target object independent of the viewing location of the operator when the angle between the surface and the display is equal to angle between the surface and the image plane.

12. The method of claim 11, wherein said information about said captured image is audio information, electronic information, or combinations thereof.

13. The method of claim 12, wherein said interface is an electronic interface that allows said individual to place an electronic marker on said captured image.

14. The method of claim 13, wherein said electronic information is information about the location and nature of said electronic marker.

15. The method of claim 14, wherein said step of displaying said captured image on a electronic display further includes displaying said electronic marker on said captured image.

16. The method of claim 15, wherein said step of reflecting said captured image further includes reflecting said electronic marker on said captured image.

17. The method of claim 11, wherein said image capture device is selected from the group consisting of ultrasound-based probe, radar-based probe, LIDAR-based probe, and SONAR-based probe.

18. The method of claim 11, wherein said first assembly further comprises an electronic camera.

19. The method of claim 18, wherein said electronic camera captures said merger of said reflected captured image and said direct view of the target object.

20. The method of claim 19, wherein said first transmitter/receiver is adapted to transmit both said captured image and said merger of said reflected capture image and said direct view of the target object to said second transmitter/receiver.