Method and apparatus for generating augmented reality content

• US 9,317,133 B2
• Filed: 10/08/2010
• Issued: 04/19/2016
• Est. Priority Date: 10/08/2010
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Korah, Thommen, Azuma, Ronald
• Primary Examiner(s): Johnson, M Good
• Application Number:
  US12/900,990
• Publication Number:
  US 20120086727A1
• Time in Patent Office: 2,020 Days
• Field of Search: 345/633, 345/632, 345/629
• US Class Current: 1/1
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

An approach is provided for providing augmented reality based on tracking. Information, including location information, orientation information, or a combination thereof of a device is determined. A representation of a location indicated based, at least in part, on the information is determined. One or more items are selected to associate with one or more points within the representation. Display information is determined to be generated, the display information including the one or more items overlaid on the representation based, at least in part, on the one or more points.

Claims

1. A method comprising:

determining information including location information, orientation information, or a combination thereof of a device;

determining a representation of a location indicated based on the information and pre-processed world data;

selecting one or more items to associate with one or more points within the representation;

determining to generate display information including the one or more items overlaid on the representation based, at least in part, on the one or more points;

determining to capture one or more images of the location;

determining one or more elements of the one or more captured images; and

determining to generate one or more other representations of the one or more elements for inclusion in the display information,

wherein the representation is a model and includes a real-time moving object blended into the model, and

wherein the selecting one or more items selected comprises a user selecting a category or a keyword regarding a point-of-interest.

2. A method of claim 1, wherein the representation is preprocessed to determine a spatial layout including, at least in part, the one or more points, the one or more points being associated with the one or more symmetrical or repetitive physical features.

3. A method of claim 2, further comprising:

determining to cause at least in part a tracking of the location, the orientation, or a combination thereof in relation to the spatial layout; and

determining to update the display information based, at least in part, on the tracking.

4. A method of claim 3, further comprising:

determining one or more portions of the spatial layout; and

determining to filter the one or more items based, at least in part, on whether the respective one or more points are within the one or more portions,

wherein filtered ones of the one or more items are not processed for inclusion in the display information.

5. A method of claim 1, further comprising:

determining to generate the display information based, at least in part, on a semantic blending of the one or more elements, the one or more other representations, the representation, or a combination.

6. A method of claim 1, further comprising:

determining a time parameter and a weather parameter associated with location; and

determining to augment the displaying information based on the time parameter and the weather parameter,

wherein the spatial layout is a rendering of the representation of the location indicated, and

wherein the rendering is augmented to match current lighting/shadowing and weather based on the time parameter.

7. A method of claim 1, wherein the representation substitutes for a real-time image of the location, and wherein the representation is at least an approximation of the location, the one or more items, tracking information of the device or the one or more items relative to the location, or a combination thereof.

8. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

determine information including location information, orientation information, or a combination thereof of a device;

determine a representation of a location indicated based on the information and pre-processed world data;

select one or more items to associate with one or more points within representation;

determine to generate display information including the one or more items overlaid on the representation based, at least in part, on the one or more points;

determine to capture one or more images of the location;

determine one or more elements of the one or more captured images; and

determine to generate one or more other representations of the one or more elements for inclusion in the display information,

wherein the representation is a model and includes a real-time moving object blended into the model, and

wherein the selecting one or more items selected comprises a user selecting a category or a keyword regarding a point-of-interest.

9. An apparatus of claim 8, wherein the representation is preprocessed to determine a spatial layout including, at least in part, the one or more points, the one or more points being associated with the one or more symmetrical or repetitive physical features.

10. An apparatus of claim 9, wherein the apparatus is further caused to:

determine to cause at least in part a tracking of the location, the orientation, or a combination thereof in relation to the spatial layout; and

determine to update the display information based, at least in part, on the tracking.

11. An apparatus of claim 10, wherein the apparatus is further caused to:

determine one or more portions of the spatial layout; and

determine to filter the one or more items based, at least in part, on whether the respective one or more points are within the one or more portions,

wherein filtered ones of the one or more items are not processed for inclusion in the display information.

12. An apparatus of claim 8, wherein the apparatus is further caused to:

determine to generate the display information based, at least in part, on a semantic blending of the one or more elements, the one or more other representations, the representation, or a combination.

13. An apparatus of claim 8, wherein the apparatus is further caused to:

determine a time parameter and a weather parameter associated with location; and

determine to augment the displaying information based on the time parameter and the weather parameter,

wherein the spatial layout is a rendering of the representation of the location indicated, and

wherein the rendering is augmented to match current lighting/shadowing and weather based on the time parameter.

14. An apparatus of claim 8, wherein the representation substitutes for a real-time image of the location, and wherein the representation is at least an approximation of the location, the one or more items, tracking information of the device or the one or more items relative to the location, or a combination thereof.

15. A non-transitory computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the following steps:

determining information including location information, orientation information, or a combination thereof of a device;

determining a representation of a location indicated based on the information and pre-processed world data;

selecting one or more items to associate with one or more points within the representation;

determining to generate display information including the one or more items overlaid on the representation based, at least in part, on the one or more points;

determining to capture one or more images of the location;

determining one or more elements of the one or more captured images; and

determining to generate one or more other representations of the one or more elements for inclusion in the display information,

wherein the representation is a model and includes a real-time moving object blended into the model, and

wherein the selecting one or more items selected comprises a user selecting a category or a keyword regarding a point-of-interest.

16. A computer-readable storage medium of claim 15, wherein the representation is preprocessed to determine a spatial layout including, at least in part, the one or more points, the one or more points being associated with the one or more symmetrical or repetitive physical features.