Augmented reality apparatus and method

• US 7,817,104 B2
• Filed: 10/13/2006
• Issued: 10/19/2010
• Est. Priority Date: 01/18/2006
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Nam, Dong-kyung, Lea, Jong-ho, Ryu, Hee-seob, Lee, Sang-goog, Hong, Young-jin
• Primary Examiner(s): Hjerpe; Richard
• Assistant Examiner(s): HARRIS, DOROTHY H
• Application Number:
  US11/546,896
• Publication Number:
  US 20070164988A1
• Time in Patent Office: 1,467 Days
• Field of Search: 345/8, 396/51, 396/58, 348/208
• US Class Current: 345/7
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2320/028 by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction
• CPC Class Codes: G09G 2320/068 for control of viewing angle adjustment
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 2250/10 including a GPS signal receiver
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: Y02E 10/50 Photovoltaic [PV] energy
• CPC Class Codes: Y02E 70/30 Systems combining energy storage with energy generation of non-fossil origin

Abstract

An augmented reality apparatus and method in which the direction of a camera is adjusted to be consistent with a direction toward which a user faces and an augmented reality image is realized for a subject image incident from the adjusted camera direction. The augmented reality apparatus includes a viewing angle determination module which determines a viewing angle of a user, an image input module which receives an image of one or more subjects within the viewing angle of the user, an image synthesization module which generates a synthesized image by synthesizing the subject image with a digital image, and a display module which displays the synthesized image.

Claims

1. An augmented reality apparatus comprising:

a viewing angle determination module which determines a viewing angle of a user;

an attitude determination module which determines an attitude of the augmented reality apparatus using distances between the user and the augmented reality apparatus measured by at least two distance sensors;

an image input module which captures an image of one or more subjects;

a direction control module which controls a direction of the image input module based on the viewing angle of the user and the attitude of the augmented reality apparatus;

an image synthesization module which generates a synthesized image by synthesizing the captured image with a digital image; and

a display module which displays the synthesized image.

2. The augmented reality apparatus of claim 1, wherein the viewing angle determination module determines the viewing angle of the user by detecting the positions of the pupils of the eyes of the user.

3. The augmented reality apparatus of claim 1, wherein the at least two distance sensors include IR transceivers or ultrasound transceivers.

4. The augmented reality apparatus of claim 3, wherein the digital image comprises information regarding whichever of the subjects is deemed closest to the augmented reality apparatus according to the position of the user, an absolute azimuth of the direction of the image input module, and an attitude of the augmented reality apparatus.

5. The augmented reality apparatus of claim 4 further comprising an azimuth determination module which determines the absolute azimuth of the direction of the image input module.

6. The augmented reality apparatus of claim 1, wherein the digital image comprises information customized for the user.

7. The augmented reality apparatus of claim 1, wherein the synthesized image is a still image or a real-time image.

8. An augmented reality method comprising:

determining a viewing angle of a user;

determining an attitude of the augmented reality apparatus using distances between the user and the augmented reality apparatus measured by at least two distance sensors;

controlling a direction of image input of the augmented reality apparatus based on the viewing angle of the user and the attitude of the augmented reality apparatus;

capturing an image of one or more subjects in the direction of image input;

generating a synthesized image by synthesizing the subject image with a digital image; and

displaying the synthesized image.

9. The augmented reality method of claim 8, wherein the determining of the viewing angle of the user comprises determining the viewing angle of the user by detecting the positions of the pupils of the eyes of the user.

10. The augmented reality method of claim 8, wherein the at least two distance sensors include IR transceivers or ultrasound transceivers.

11. The augmented reality method of claim 10, wherein the digital image comprises information regarding whichever of the subjects is deemed closest to the augmented reality apparatus according to the position of the user, an absolute azimuth of the direction of the image input module, and an attitude of the augmented reality apparatus.

12. The augmented reality method of claim 11 further comprising determining the absolute azimuth of the direction of the image input module.

13. The augmented reality method of claim 8, wherein the digital image comprises information customized for the user.

14. The augmented reality method of claim 8, wherein the synthesized image is a still image or a real-time image.