METHOD AND APPARATUS FOR GENERATING AUGMENTED REALITY CONTENT

• US 20120086727A1
• Filed: 10/08/2010
• Published: 04/12/2012
• Est. Priority Date: 10/08/2010
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Azuma, Ronald, Korah, Thommen
• Granted Patent: US 9,317,133 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

An approach is provided for providing augmented reality based on tracking. Information, including location information, orientation information, or a combination thereof of a device is determined. A representation of a location indicated based, at least in part, on the information is determined. One or more items are selected to associate with one or more points within the representation. Display information is determined to be generated, the display information including the one or more items overlaid on the representation based, at least in part, on the one or more points.

Claims

1. A method comprising:

determining information including location information, orientation information, or a combination thereof of a device;

determining a representation of a location indicated based, at least in part, on the information;

selecting one or more items to associate with one or more points within the representation; and

determining to generate display information including the one or more items overlaid on the representation based, at least in part, on the one or more points.

2. A method of claim 1, wherein the representation is preprocessed to determine a spatial layout including, at least in part, the one or more points.

3. A method of claim 2, further comprising:

determining to cause at least in part a tracking of the location, the orientation, or a combination thereof in relation to the spatial layout; and

determining to update the display information based, at least in part, on the tracking.

4. A method of claim 3, further comprising:

determining one or more portions of the spatial layout; and

determining to filter the one or items based, at least in part, on whether the respective one or more points are within the one or more portions,

wherein filtered ones of the one or more items are not processed for inclusion in the display information.

5. A method of claim 1, further comprising:

determining to capture one or more images of the location;

determining one or more elements of the one or more captured images; and

determining to generate one or more other representations of the one or more elements for inclusion in the display information.

6. A method of claim 2, further comprising:

determining to generate the display information based, at least in part, on a semantic blending of the one or more elements, the one or more other representations, the representation, or a combination.

7. A method of claim 1, further comprising:

determining a time parameter, a weather parameter, or a combination thereof associated with location; and

determining to augment the displaying information based, at least in part, on the time parameter, the weather parameter, or a combination thereof.

8. A method of claim 1, wherein the representation substitutes for a real-time image of the location, and wherein the representation is at least an approximation of the location, the one or more items, tracking information of the device or the one or more items relative to the location, or a combination thereof.

9. A method of claim 1, wherein the representation is a model, a panorama, an image, or a combination thereof.

10. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

determine information including location information, orientation information, or a combination thereof of a device;

determine a representation of a location indicated based, at least in part, on the information;

select one or more items to associate with one or more points within the representation; and

determine to generate display information including the one or more items overlaid on the representation based, at least in part, on the one or more points.

11. An apparatus of claim 10, wherein the representation is preprocessed to determine a spatial layout including, at least in part, the one or more points.

12. An apparatus of claim 11, wherein the apparatus is further caused to:

determine to cause at least in part a tracking of the location, the orientation, or a combination thereof in relation to the spatial layout; and

determine to update the display information based, at least in part, on the tracking.

13. An apparatus of claim 12, wherein the apparatus is further caused to:

determine one or more portions of the spatial layout; and

determine to filter the one or items based, at least in part, on whether the respective one or more points are within the one or more portions,

wherein filtered ones of the one or more items are not processed for inclusion in the display information.

14. An apparatus of claim 10, wherein the apparatus is further caused to:

determine to capture one or more images of the location;

determine one or more elements of the one or more captured images; and

determine to generate one or more other representations of the one or more elements for inclusion in the display information.

15. An apparatus of claim 11, wherein the apparatus is further caused to:

determine to generate the display information based, at least in part, on a semantic blending of the one or more elements, the one or more other representations, the representation, or a combination.

16. An apparatus of claim 10, wherein the apparatus is further caused to:

determine a time parameter, a weather parameter, or a combination thereof associated with location; and

determine to augment the displaying information based, at least in part, on the time parameter, the weather parameter, or a combination thereof.

17. An apparatus of claim 10, wherein the representation substitutes for a real-time image of the location, and wherein the representation is at least an approximation of the location, the one or more items, tracking information of the device or the one or more items relative to the location, or a combination thereof.

18. An apparatus of claim 10, wherein the representation is a model, a panorama, an image, or a combination thereof.

19. A computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the following steps:

determining information including location information, orientation information, or a combination thereof of a device;

determining a representation of a location indicated based, at least in part, on the information;

selecting one or more items to associate with one or more points within the representation; and

determining to generate display information including the one or more items overlaid on the representation based, at least in part, on the one or more points.

20. A computer-readable storage medium of claim 19, wherein the representation is preprocessed to determine a spatial layout including, at least in part, the one or more points.