Method for providing augmented reality, server for same, and portable terminal

• US 9,130,999 B2
• Filed: 06/29/2010
• Issued: 09/08/2015
• Est. Priority Date: 07/30/2009
• Status: Active Grant

• Current Assignee: SK Planet Co., Ltd. (SK Telecom Co., Ltd.)
• Original Assignee: SK Planet Co., Ltd. (SK Telecom Co., Ltd.)
• Inventors: Kim, Namhoon, Im, Jungbin
• Primary Examiner(s): Eng, George
• Assistant Examiner(s): HAMMONDS, MARCUS C
• Application Number:
  US13/387,472
• Publication Number:
  US 20120122491A1
• Time in Patent Office: 1,897 Days
• Field of Search: 4554561-457, 345629-633
• US Class Current: 1/1
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

The present disclosure provides a method for providing an augmented reality, to server and portable terminal for same. Augmented reality providing server provides an augmented reality with information overlaid on captured video and includes server communication unit for inter-working with portable terminal; and server control unit for receiving selected menu information from portable terminal, generating first menu information data attained by extracting data that matches selected menu information by comparing the selected menu information with pre-stored location-associated information, and transmitting first menu information data to portable terminal, wherein the server control unit generates the first menu information data by selecting menus that match the selected menu information among a plurality of menus included in the location-associated information. In an embodiment, fast augmented reality operation can be obtained since portable terminal may receive and output information corresponding to menu selection immediately with a composition onto acquired image information.

Claims

1. An augmented reality providing server for providing an augmented reality with information overlaid on a captured video, the server comprising:

a server communication unit for inter-working with a portable terminal;

a server control unit for

receiving selected menu information from the portable terminal,

comparing the selected menu information with location-associated information that has been stored in the server control unit,

extracting, from the location-associated information, data that matches the selected menu information based on a result of the comparing,

generating a first menu based on the extracted data, and

transmitting the generated first menu information to the portable terminal; and

an augmented reality database (AR DB) for

comparing a feature point received from the portable terminal with pre-stored location-based information in the AR DB, to search for a feature point identical to or matching with the received feature point,

delivering at least one kind of information among a corresponding point-of-interest (POI), advertisement, promotion, internet link, and tagging information, to the portable terminal, the at least one kind of information associated with the feature point found to be identical to or matching with the received feature point,

wherein the extracted data comprises a menu that matches the selected menu information among a plurality of menus included in the location-associated information,

wherein the server control unit

calculates first current location information of the portable terminal by using position information received from the portable terminal,

generates third menu information data by extracting data, which matches to the first current location information and the selected menu information, from the location-associated information that is related with a range within a preset radius from the first current location information, and

sends the third menu information data to the portable terminal, and

wherein the server control unit further

calculates second current location information of the portable terminal based on location information of a base station synchronized with the portable terminal,

generates fourth menu information data by extracting data, which matches to the second current location information and the selected menu information, among the location-associated information that is related with a range within the preset radius from the second current location information, and

sends the fourth menu information data to the portable terminal.

2. The augmented reality providing server of claim 1, wherein the server control unit transmits a real picture image information included in the location-associated information to the portable terminal.

3. The augmented reality providing server of claim 2, wherein the server control unit transmits the first menu attained by extracting one or more kinds of information that matches the selected menu information among a latitude-longitude coordinate information corresponding to the real picture image information, point of interest (POI) information, advertisement information, name information, phone number information, promotion information, Internet link information, and tagging information, to the portable terminal.

4. The augmented reality providing server of claim 1, wherein the server control unit compares the feature point received from the portable terminal with pre-stored location-associated information for extracting local information data matched with the received feature point, and further transmits the extracted local information data to the portable terminal.

5. The augmented reality providing server of claim 4, wherein the server control unit transmits the local information data containing one or more kinds of information including a name information, phone number information, POI information, advertisement information, promotion information, Internet link information, and tagging information, to the portable terminal.

6. The augmented reality providing server of claim 4, further comprising a server storage unit for storing the location-associated information including one or more kinds of information including real picture image information, latitude-longitude coordinate information corresponding to the real picture image information, POI information, and advertisement information.

7. The augmented reality providing server of claim 1, wherein

the server control unit extracts the feature point from image information received from the portable terminal, extracts local information data matched with the extracted feature point by comparing the extracted feature point to the location-associated information, and further transmits the extracted local information data to the portable terminal, and

the portable terminal transmits the image information to the server communication unit by sending only a part of the captured video as the image information.

8. The augmented reality providing server of claim 7, wherein the image information is information attained from extracting selected one or more frames including initial frame 1 or frame 2, a key fame, and a video frame upon occurrence of a specific event deviating from a preset condition.

9. The augmented reality providing server of claim 7, wherein the server control unit extracts the feature point based on one or more kinds of information selected from a color information, edge information, outline information, texture information, text information, and contour information depending on a specified angle with respect to a specific object, which are contained in the image information.

10. An augmented reality providing server for providing an augmented reality with information overlaid on a captured video, the server comprising:

a server communication unit for inter-working with a portable terminal;

a server control unit for

receiving selected local information from the portable terminal,

comparing the received selected local information with location-associated information that have been stored,

extracting, from the location-associated information, data that matches the selected local information based on the comparing,

generating a first local menu based on the extracted data, and

transmitting the first local menu information data to the portable terminal; and

an augmented reality database (AR DB) for

comparing a feature point received from the portable terminal with pre-stored location-based information in the AR DB, to search for a feature point identical to or matching with the received feature point,

delivering at least one kind of information among a corresponding point-of-interest (POI), advertisement, promotion, internet link, and tagging information, to the portable terminal, the at least one kind of information associated with the feature point found to be identical to or matching with the received feature point,

wherein the extracted data comprises a local menu containing all of a plurality of menus included in a specified locale after specifying the selected local information from a plurality of locales contained in the location-associated information,

wherein the server control unit

calculates first current location information of the portable terminal by using a position information received from the portable terminal,

generates third menu information data by extracting data, which matches to the first current location information and the selected menu information, from the location-associated information that is related with a range within a preset radius from the first current location information, and

sends the third menu information data to the portable terminal, and

wherein the server control unit further

calculates second current location information of the portable terminal based on location information of a base station synchronized with the portable terminal,

generates fourth menu information data by extracting data, which matches to the second current location information and the selected menu information, among the location-associated information that is related with a range within the preset radius from the second current location information, and

sends the fourth menu information data to the portable terminal.

11. The augmented reality providing server of claim 10, wherein the server control unit transmits a real picture image information of a locale corresponding to the selected local information from the location-associated information to the portable terminal.

12. The augmented reality providing server of claim 10, wherein the server control unit transmits the first local menu containing one or more kinds of information from a latitude-longitude coordinate information corresponding to the real picture image information of the locale corresponding to the selected local information, point of interest (POI) information, advertisement information, name information, phone number information, promotion information, internet link information, and tagging information, to the portable terminal.