System and method for simultaneously viewing a scene and an obscured object

• US 5,491,510 A
• Filed: 12/03/1993
• Issued: 02/13/1996
• Est. Priority Date: 12/03/1993
• Status: Expired due to Term

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Gove, Robert J.
• Primary Examiner(s): Kostak, Victor R.
• Assistant Examiner(s): Cohen, Cheryl
• Application Number:
  US08/161,831
• Time in Patent Office: 802 Days
• Field of Search: 345/7-9, 348/45, 348/65, 348/77, 348/129, 348/130, 348/161
• US Class Current: 348/77
• CPC Class Codes: A61B 90/36 Image-producing devices or illumination devices not otherwise provided for
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 5/64 Constructional details of receivers, e.g. cabinets or dust covers furniture aspects of television cabinets A47B81/06

Abstract

A visual information system to capture an input image using a camera 22, manipulate the image using processor 28, and project the processed image using optics 33 to superimpose the processed image on the actual object being observed by a viewer. Processing is done in real-time to allow the viewer to see both the actual and processed images while the viewer moves and changes viewing angles. Areas of interest in the displayed image may be highlighted or include graphical information for the viewer.

Claims

1. An imaging system comprising:

a sensor for producing an output representative of the distance between a viewer and a first object and of the relative position and perspective of the viewer with respect to the first object in real-time;

facilities for storing information representative of an image of a second object including nonobservable portions thereof;

a processor responsive to said output for manipulating said information and for generating signals representing the image of the second object as having a distance from the viewer and a relative position and perspective to the viewer which is the same as the distance, relative position, and perspective applicable to the first object; and

a display device for converting said signals into a virtual image and for permitting the viewer to simultaneously observe the first object and the virtual image.

2. The imaging system of claim 1, wherein said virtual image is superimposed on a direct view of said first object from the perspective of said viewer.

3. The imaging system of claim 1, wherein said virtual image is projected onto the lens of a pair of goggles.

4. The imaging system of claim 1, wherein said virtual image is projected onto a face shield.

5. The imaging system of claim 1 wherein said display device comprises a spatial light modulator, wherein said viewer looks through said spatial light modulator.

6. The imaging system of claim 1 wherein said display device comprises a digital micromirror device.

7. The imaging system of claim 1 wherein said display device comprises a liquid crystal display.

8. The imaging system of claim 1 wherein said display device comprises a partially silvered lens.

9. The imaging system of claim 1, wherein said display device is head-mounted on said viewer.

10. The imaging system of claim 1, wherein said processor manipulates said information in real-time.

11. The imaging system of claim 1, wherein said sensor is a camera for transmitting video information to said processor, said processor tracking features of said first object to determine the relative position of said viewer and said first object.

12. The imaging system of claim 1, wherein said sensor is at least one motion sensor in communication with said processor to allow said processor to compensate for the relative motion of said first object and said viewer.

13. The system of claim 1 wherein said display device converts said signals into a displayed image by attenuating light from said object.

14. The system of claim 1 wherein said virtual image is an image of an internal component of said first object.

15. The system of claim 1 wherein said viewer'"'"'s direct view of said second object is blocked by said first object.

16. An imaging system comprising:

a means for determining and outputting position information regarding the relative position of a viewer and a first object;

an image source for providing image information from a stored image of a second object, wherein said second object is obscured from said viewer by said first object;

a processor for receiving said image and position information and for performing image processing routines on said image information and outputting an image signal in accordance with said position information; and

a display device to receive said image signal and to convert said image signal into a displayed image, wherein said viewer may look through said display device and see the displayed image superimposed on a direct view of said first object.

17. The system of claim 16 wherein said second object is an internal component of said first object.

18. The system of claim 16 wherein said viewer'"'"'s view of said second object is blocked by said first object.

19. A method of displaying an image of an object comprising:

tracking the relative position of a first object and a viewer;

processing a stored image of a second object to obtain an image signal representative of said second object from the perspective of said viewer from said first object, wherein said second object is obscured from said viewer by said first object;

converting said processed image signal into an image; and

displaying said image such that said viewer sees said image superimposed on a direct view of said first object.

20. The method of claim 19 wherein tracking the relative position step comprises using at least one position sensor to track the relative position of said first object and said viewer.

21. the method of claim 19 wherein tracking the relative position step comprises using at least one position sensor to track the relative position of said first object and said viewer.