Terminal and method for providing augmented reality

• US 8,879,784 B2
• Filed: 05/30/2014
• Issued: 11/04/2014
• Est. Priority Date: 12/13/2010
• Status: Active Grant

• Current Assignee: MEC Resources, LLC (Three Affiliated Tribes of the Fort Berthold Reservation, North Dakota)
• Original Assignee: Pantech Co. Ltd. (Pantech Incorporated)
• Inventors: Sung, Young Ju, HA, Yong Gu
• Primary Examiner(s): Mehta, Bhavesh
• Assistant Examiner(s): Harandi, Siamak
• Application Number:
  US14/292,085
• Publication Number:
  US 20140267421A1
• Time in Patent Office: 158 Days
• Field of Search: None
• US Class Current: 382/100
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information

Abstract

A method for providing augmented reality includes acquiring a real-world image including an object; transmitting terminal information, in which the terminal information includes a location information of a terminal and an original retrieval distance; receiving object information corresponding to the object, in which the object information is based on the transmitted terminal information; and overlapping the received object information over the corresponding object in the real-world image. A terminal to perform the methods described herein includes a location information providing unit, an information transmitting/receiving unit, an image processing unit, and a user view analyzing unit.

Claims

1. A terminal to provide augmented reality, the terminal comprising:

a transceiver to transmit first terminal information and to receive first object information based on the first terminal information, the first terminal information corresponding to a physical location of the terminal and comprises first location information of the terminal located at the physical location; and

a processor to overlap the first object information on a first real-world image, to calculate a virtual movement location of the terminal based on a zooming level, and to calculate second terminal information corresponding to the virtual movement location, the first real-world image comprising a first object corresponding to the first object information, and the second terminal information comprising second location information of the terminal virtually located at the virtual movement location,

wherein the transceiver transmits the second terminal information and receives second object information based on the second terminal information,

the processor overlaps the second object information on a second real-world image, and the second real-world image comprises a second object corresponding to the second object information.

2. The terminal of claim 1, wherein the first terminal information or the second terminal information further comprises at least one of an original retrieval distance, azimuth, and viewing angle information of the terminal.

3. The terminal of claim 1, wherein the processor provides at least one of the first location information and the second location information having at least one of cellular network-based location information and global positioning system (GPS) information based location information.

4. The terminal of claim 1, further comprising:

a camera having a zooming operation to obtain at least one of the first real-world image and the second real-world image, wherein, if the zooming level of the camera is changed,

the processor resets the first terminal information according to the virtual movement location corresponding to the changed zooming level, and a new retrieval distance is calculated based on the virtual movement location.

5. The terminal of claim 4, wherein the new retrieval distance is calculated by subtracting a virtual movement distance from an original retrieval distance and the first terminal information is reset based on the virtual movement location and the new retrieval distance.

6. The terminal of claim 4, wherein the processor extracts first feature information of the first object displayed on the first real-world image corresponding to the changed zooming level, transmits the first feature information along with the reset second terminal information corresponding to the virtual movement location, and receives the second object information based on the second terminal information and second feature information of the second object, and the processor matches the second object information to a location of the second object.

7. The terminal of claim 1, wherein a virtual movement distance is calculated according to a reference value, and wherein the reference value is obtained by dividing an original retrieval distance by a total number of zooming levels.

8. The terminal of claim 1, wherein the processor calculates a distance between a location of the terminal and the first or second object based on location information of the first or second object and sets the calculated distance as a reference distance, and

wherein the location of the terminal is an image capturing location or the virtual movement location, and the location information of the first or second object is comprised in the first or second object information, respectively.

9. The terminal of claim 1, wherein a virtual movement distance is calculated according to a reference value, and wherein the reference value is obtained by dividing an original retrieval distance by a number of the zoom levels.

10. The terminal of claim 1, wherein at least one of the first real-world image and the second real-world image is a real-time image.

11. The terminal of claim 8, wherein the processor calculates the virtual movement location of the terminal based on the reference distance and the zooming level,

the transceiver transmits the virtual movement location of the terminal and feature information of the first object extracted from the first real-world image and receives the second object information based on the feature information of the first object, and the processor matches the second object information to a location of the second object.

12. A method for providing augmented reality, the method comprising:

acquiring a first real-world image comprising an object;

transmitting first terminal information,

wherein the first terminal information comprises a location information of a terminal and a first retrieval distance;

receiving object information corresponding to the object,

wherein the object information is based on the transmitted first terminal information;

overlapping the received object information over the corresponding object in the first real-world image;

changing a zooming level of the first real-world image for providing a second real-world image,

wherein the second real-world image comprises a second object, and

wherein the size of the first real-world image is changed according to the change in the zooming level;

calculating a virtual movement location of the terminal, a virtual movement distance between the second object and the terminal, and a second retrieval distance according to the changed zooming level; and

resetting the first terminal information according to the virtual movement location for providing second terminal information.

13. A method for providing augmented reality, the method comprising:

overlapping first object information over a first object included in a first real-world image;

changing a zooming level of the first real-world image for providing a second real-world image,

wherein the second real-world image comprises a second object;

calculating a virtual movement location of a terminal, a virtual movement distance between the second object and the terminal, and a retrieval distance according to the changed zooming level; and

setting terminal information according to the virtual movement location.

14. The method of claim 13, further comprising:

transmitting the terminal information;

receiving second object information based on the terminal information; and

overlapping the second object information over the second object in the second real-world image.

15. The method of claim 13, further comprising:

extracting feature information of the second object displayed on the second real-world image;

transmitting the terminal information and the feature information;

receiving second object information based on the terminal information and the feature information;

overlapping the second object information over the second object in the second real-world image; and

displaying the overlapped image such that the second object information is matched with a location of the second object.

16. The method of claim 13, wherein at least one of the first real-world image and the second real-world image is a real-time image.

17. The method of claim 15, further comprising:

overlapping information of the retrieval distance over the second real-world image; and

displaying the overlapped image such that the information of the retrieval distance is matched with a location of the second object.

18. The method of claim 13, wherein the size of the first real-world image is changed according to the change in the zooming level.