APPARATUS AND METHOD FOR PROVIDING 3D AUGMENTED REALITY

• US 20120001901A1
• Filed: 02/15/2011
• Published: 01/05/2012
• Est. Priority Date: 06/30/2010
• Status: Abandoned Application

• Current Assignee: Pantech Corporation (Ideahub, Inc.)
• Original Assignee: Pantech Corporation (Ideahub, Inc.)
• Inventors: PARK, Sun-Hyung
• Application Number:
  US13/028,118
• Publication Number:
  US 20120001901A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: H04N 13/156 Mixing image signals

Abstract

An apparatus to provide three-dimensional (3D) augmented reality (AR) image includes an image obtainer to obtain an image including an object, and an image processor to calculate 3D position information about the object, obtain AR data corresponding to the object, covert the AR data according to the 3D position information, and generate a 3D AR image using the converted AR data and the obtained image. A method for providing 3D AR image includes obtaining an image including an object, calculating 3D position information of the object, obtaining AR data corresponding to the object, converting AR data according to the 3D position information, generating a 3D AR image using the converted AR data and the obtained image, and displaying the generated 3D AR image.

Claims

1. An apparatus to provide three-dimensional (3D) augmented reality (AR) image, comprising:

an image obtainer to obtain an image including an object; and

an image processor to calculate 3D position information of the object, to obtain AR data corresponding to the object, to convert the AR data according to the 3D position information, and to generate a 3D AR image using the converted AR data and the image.

2. The apparatus of claim 1, wherein the image obtainer comprises:

a first camera to obtain a first image of the object; and

a second camera to obtain a second image of the object.

3. The apparatus of claim 2, wherein the image processor obtains distance information of the object using the first image and the second image, and calculates the 3D position information using the distance information.

4. The apparatus of claim 2, wherein the image processor obtains distance information of the object using an auto-focusing function of the first camera or the second camera, and calculates the 3D position information using the distance information.

5. The apparatus of claim 2, wherein the image processor generates first AR data to be superimposed onto the first image and second AR data to be superimposed onto the second image on the basis of the 3D position information, superimposes the generated first AR data onto the first image to form an augmented first image and superimposes the generated second AR data onto the second image to form an augmented second image, and then generates the 3D AR image by combining the augmented first image and the augmented second image.

6. The apparatus of claim 5, wherein the generated 3D AR image comprises;

a first object and a second object, positioned farther than the first object.

7. The apparatus of claim 6, wherein the second AR data corresponding to the second object is positioned farther than the first AR data corresponding to the first object.

8. The apparatus of claim 1, further comprising a sensor, comprising:

a global positioning system (GPS) sensor, an acceleration sensor, or a terrestrial magnetism sensor.

9. The apparatus of claim 8, wherein the image processor designates an area in the obtained image using sensing information of the sensor and detects the object in the designated area.

10. The apparatus of claim 1, further comprising an image display to display the 3D AR image.

11. An image processor to provide three-dimensional (3D) augmented reality (AR) image, comprising:

a 3D position information calculator to calculate 3D position information of an object included in an image;

an AR data converter to obtain AR data corresponding to the object, and to covert the AR data according to the 3D position information; and

an AR image generator to generate a 3D AR image using the converted AR data and the obtained image.

12. The apparatus of claim 11, wherein the 3D position information calculator obtains distance information of the object using a first image of the object and a second image of the object, and calculates the 3D position information using the obtained distance information.

13. The apparatus of claim 11, wherein the 3D position information calculator obtains distance information of the object using an auto-focusing function, and calculates the 3D position information using the obtained distance information.

14. The apparatus of claim 11, wherein the AR data converter superimposes the converted first AR data onto a first image of the object and superimposes the converted second AR data onto a second image of the object on the basis of the 3D position information.

15. The apparatus of claim 14, wherein the AR image generator superimposes the first AR data onto the first image and the second AR data onto the second image, and generates the 3D AR image using the augmented first image and second image.

16. A method for providing three-dimensional (3D) augmented reality (AR) image, comprising:

obtaining an image including an object;

calculating 3D position information of the object;

obtaining AR data corresponding to the object;

converting the AR data according to the 3D position information;

generating a 3D AR image using the converted AR data and the obtained image; and

displaying the generated 3D AR image.

17. The method of claim 16, wherein the obtaining of the image comprises obtaining a first image and a second image of the object.

18. The method of claim 17, wherein calculating the 3D position information comprises obtaining distance information about the object using the first image and the second image, and calculating the 3D position information using the obtained distance information.

19. The method of claim 17, wherein calculating the 3D position information comprises obtaining distance information about the object using an auto-focusing function of a camera for obtaining the first image and the second image, and calculating the 3D position information using the obtained distance information.

20. The method of claim 17, wherein converting the AR data comprises superimposing the converted first AR data onto the first image and superimposing the converted second AR data onto the second image on the basis of the 3D position information.

21. The method of claim 20, wherein generating the 3D AR image comprises superimposing the first AR data onto the first image and the second AR data onto the second image, and generating the 3D AR image using the augmented first image and second image.

22. The method of claim 16, wherein displaying the AR image comprises displaying the 3D AR image so that AR data corresponding to the first object is displayed closer than AR data corresponding to the second object, if the generated AR image comprises a first object and a second object, where the second object is positioned farther than the first object.