Augmented reality apparatus and method

• US 20070164988A1
• Filed: 10/13/2006
• Published: 07/19/2007
• Est. Priority Date: 01/18/2006
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lea, Jong-ho, Ryu, Hee-seob, Lee, Sang-goog, Hong, Young-jin, Nam, Dong-kyung
• Granted Patent: US 7,817,104 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2320/028 by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction
• CPC Class Codes: G09G 2320/068 for control of viewing angle adjustment
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 2250/10 including a GPS signal receiver
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: Y02E 10/50 Photovoltaic [PV] energy
• CPC Class Codes: Y02E 70/30 Systems combining energy storage with energy generation of non-fossil origin

Abstract

An augmented reality apparatus and method in which the direction of a camera is adjusted to be consistent with a direction toward which a user faces and an augmented reality image is realized for a subject image incident from the adjusted camera direction. The augmented reality apparatus includes a viewing angle determination module which determines a viewing angle of a user, an image input module which receives an image of one or more subjects within the viewing angle of the user, an image synthesization module which generates a synthesized image by synthesizing the subject image with a digital image, and a display module which displays the synthesized image.

Claims

1. An augmented reality apparatus comprising:

a viewing angle determination module which determines a viewing angle of a user;

an image input module which receives an image of one or more subjects within the viewing angle of the user;

an image synthesization module which generates a synthesized image by synthesizing the subject image with a digital image; and

a display module which displays the synthesized image.

2. The augmented reality apparatus of claim 1, wherein the viewing angle determination module determines the viewing angle of the user by detecting the positions of the pupils of the eyes of the user.

3. The augmented reality apparatus of claim 1 further comprising a direction control module which controls a direction of the image input module to be consistent with the viewing angle of the user.

4. The augmented reality apparatus of claim 3, wherein the digital image comprises information regarding whichever of the subjects is deemed closest to the augmented reality apparatus according to the position of the user, an absolute azimuth of the direction of the image input module, and an attitude of the augmented reality apparatus.

5. The augmented reality apparatus of claim 4 further comprising a position determination module which determines the position of the user.

6. The augmented reality apparatus of claim 4 further comprising an azimuth determination module which determines the absolute azimuth of the direction of the image input module.

7. The augmented reality apparatus of claim 4 further comprising an attitude determination module which determines the attitude of the augmented reality apparatus.

8. The augmented reality apparatus of claim 1, wherein the digital image comprises information customized for the user.

9. The augmented reality apparatus of claim 1, wherein the synthesized image is a still image or a real-time image.

10. An augmented reality method comprising:

determining a viewing angle of a user;

receiving a subject image from the viewing angle of the user;

generating a synthesized image by synthesizing the subject image with a digital image; and

displaying the synthesized image.

11. The augmented reality method of claim 10, wherein the determining of the viewing angle of the user comprises determining the viewing angle of the user by detecting the positions of the pupils of the eyes of the user.

12. The augmented reality method of claim 10 further comprising controlling a direction of the image input module to be consistent with the viewing angle of the user.

13. The augmented reality method of claim 12, wherein the digital image comprises information regarding whichever of the subjects is deemed closest to the augmented reality apparatus according to the position of the user, an absolute azimuth of the direction of the image input module, and an attitude of the augmented reality apparatus.

14. The augmented reality method of claim 13 further comprising determining the position of the user.

15. The augmented reality method of claim 13 further comprising determining the absolute azimuth of the direction of the image input module.

16. The augmented reality method of claim 13 further determining the attitude of the augmented reality apparatus.

17. The augmented reality method of claim 10, wherein the digital image comprises information customized for the user.

18. The augmented reality method of claim 10, wherein the synthesized image is a still image or a real-time image.