Face-mounted display apparatus for mixed reality environment

• US 7,804,507 B2
• Filed: 12/14/2006
• Issued: 09/28/2010
• Est. Priority Date: 07/27/2006
• Status: Active Grant

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: Hwang, Sun Yu, Lee, Gun Adven, Son, Wookho, Yang, Ung-Yeon
• Primary Examiner(s): Amini; Javid A
• Application Number:
  US11/638,438
• Publication Number:
  US 20080024597A1
• Time in Patent Office: 1,384 Days
• Field of Search: 345/633
• US Class Current: 345/633
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: A63F 13/53 involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player
• CPC Class Codes: A63F 13/98 Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/303 for displaying additional data, e.g. simulating a Head Up Display
• CPC Class Codes: A63F 2300/66 for rendering three dimensional images
• CPC Class Codes: A63F 2300/695 Imported photos, e.g. of the player
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

A display apparatus for a mixed reality environment includes an image processor for mixing an actual image of an object around a user and a artificial stereo images to produce multiple external image signals, a user information extractor for extracting the user'"'"'s sight line information including the user'"'"'s position his/her eye position, direction of a sight line and focal distance; an image creator for creating a stereo image signal based on the extracted user'"'"'s sight line information; an image mixer for synchronously mixing the multiple external image signals and the stereo image signal; and an image output unit for outputting the mixed image signal to the user.

Claims

1. A display apparatus for a mixed reality environment, comprising:

an external image processor for mixing an actual image of an object around a user and a single or plurality of artificial stereo images artificially created to provide a multiple external image signal;

a user information extractor for extracting the users visual information;

an image creator for creating a stereo image signal based on the extracted user'"'"'s visual information;

an image mixer for synchronizing the multiple external image signal and the stereo image signal; and

an image output unit for outputting the synchronized multiple external image signal and stereo image signal to the user for displaying thereof by use of a light source,

wherein the user information extractor tracks eyes of the user without having a separate light source by use of the light source of the image output unit for outputting the synchronized multiple external image signal and stereo image signal to the user.

2. The display apparatus of claim 1, wherein the user information extractor includes a photographing unit for photographing an eye portion in order to extract the visual information;

wherein the photographing unit directly photographs the eye portion or indirectly photographs the eye portion using light provided by an image capturing device.

3. The display apparatus of claim 1, wherein the image output unit separates the mixed image signal into left and right viewing channels and outputs separated signals.

4. The display apparatus of claim 1, wherein the display apparatus is a face-mounted display (FMD) apparatus.

5. The display apparatus of claim 1, wherein the external image processor separates the mixed signal into left and right viewing channels and outputs separated signals.

6. The display apparatus of claim 1, wherein the external image processor has a see-through scheme in which an external light corresponding to the actual image and the stereo images is transmitted therethrough.

7. The display apparatus of claim 6, wherein the external image processor further includes a light transmission amount regulator for selectively regulating a transmittance amount of the transmitted external light.

8. The display apparatus of claim 1, wherein the external image processor includes a camera for photographing the actual image of the object and the stereo images.

9. The display apparatus of claim 1, wherein the image mixer separates the external image signals into layered spaces, in a depth direction on the basis of the stereo image signal, in order to visualize the multiple external image signals and the stereo image signal, which have been visualized on different three-dimensional spaces, on one three-dimensional space.

10. The display apparatus of claim 1, wherein the display apparatus is used in a virtual work scenario and environment.

11. The display apparatus of claim 1, wherein the display apparatus is used for multiple user participation type virtual reality game contents.