Geometrically and semanitically aware proxy for content placement

• US 9,672,659 B2
• Filed: 12/27/2011
• Issued: 06/06/2017
• Est. Priority Date: 12/27/2011
• Status: Active Grant

• Current Assignee: HERE Global B.V. (Nokia Corporation)
• Original Assignee: HERE Global B.V. (Nokia Corporation)
• Inventors: Velkavrh, Urban, Aanjaneya, Mridul, Pylvninen, Timo Pekka, Vedantham, Ramakrishna, Grzeszczuk, Radek
• Primary Examiner(s): Tseng, Charles
• Application Number:
  US13/337,930
• Publication Number:
  US 20130162644A1
• Time in Patent Office: 1,988 Days
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/40 Hidden part removal
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

An approach is provided for providing perspective-based content placement. A content placement platform processes and/or facilitates a processing of one or more models of one or more objects associated with a geographical area to cause, at least in part, a decomposition of the one or more models into one or more simplified surfaces. The content placement platform further causes, at least in part, a selection of one or more portions of the one or more simplified surfaces as one or more content placement layers based, at least in part, on one or more viewpoints, with the one or more content placement layers supporting a perspective-based rendering of one or more content items associated with the one or more objects.

Claims

1. A method comprising facilitating a processing of and/or processing (1) data and/or (2) information and/or (3) at least one signal, the (1) data and/or (2) information and/or (3) at least one signal based, at least in part, on the following:

a processing of one or more models of one or more objects associated with a geographical area to cause, at least in part, a decomposition of the one or more models into one or more simplified surfaces;

a processing of the one or more simplified surfaces with respect to various viewpoints to determine visibility statistics with respect to the one or more simplified surfaces;

wherein the visibility statistics rank visibility of the one or more simplified surfaces based on the various viewpoints; and

a selection of one or more portions of the one or more simplified surfaces as one or more content placement layers based, at least in part, on the visibility statistics of the various viewpoints of the one or more simplified surfaces,

wherein the one or more content placement layers support a perspective-based rendering of one or more content items associated with the one or more objects to display an augmented reality.

2. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

at least one determination of the one or more simplified surfaces based, at least in part, on a mesh segmentation,

wherein the mesh segmentation is based, at least in part, on one or more surface primitives.

3. A method of claim 2, wherein the one or more surface primitives include, at least in part, one or more planes.

4. A method of claim 2, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

at least one determination of the one or more content placement layers based, at least in part, on a clustering of the one or more surface primitives, the one or more simplified surfaces, or a combination thereof.

5. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a processing the one or more models, the one or more objects, or a combination thereof to determine one or more representational locations associated with the one or more simplified surfaces; and

at least one determination of the one or more content placement layers based, at least in part, on the one or more representational locations.

6. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a segmentation of one or more of the one or more simplified surfaces into one or more segmented surfaces based, at least in part, on the visibility statistics; and

at least one determination of the one or more content placement layers based, at least in part, on the one or more segmented surfaces.

7. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a processing of the one or more simplified surfaces with respect to the various viewpoints to determine one or more non-occluded surfaces; and

at least one determination of the one or more content placement layers based, at least in part, on the one or more non-occluded surfaces.

8. A method of claim 7, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

one or more occluding objects associated with the various viewpoints;

a segmentation of one or more of the one or more simplified surfaces into one or more segmented surfaces based, at least in part, on the one or more occluding objects; and

at least one determination of the one or more content placement layers based, at least in part, on the one or more segmented surfaces.

9. A method of claim 1, wherein the one or more content items rendered within the one or more content placement layers maintain the perspectives of the one or more content placement layers.

10. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

process and/or facilitate a processing of one or more models of one or more objects associated with a geographical area to cause, at least in part, a decomposition of the one or more models into one or more simplified surfaces;

process and/or facilitate a processing of the one or more simplified surfaces with respect to various viewpoints to determine visibility statistics with respect to the one or more simplified surfaces, wherein the visibility statistics rank visibility of the one or more simplified surfaces based on the various viewpoints;

and cause, at least in part, a selection of one or more portions of the one or more simplified surfaces as one or more content placement layers based, at least in part, on the visibility statistics of the various viewpoints of the one or more simplified surfaces,

wherein the one or more content placement layers support a perspective-based rendering of one or more content items associated with the one or more objects to display an augmented reality.

11. An apparatus of claim 10, wherein the apparatus is further caused to:

determine the one or more simplified surfaces based, at least in part, on a mesh segmentation, wherein the mesh segmentation is based, at least in part, on one or more surface primitives.

12. An apparatus of claim 11, wherein the one or more surface primitives include, at least in part, one or more planes.

13. An apparatus of claim 11, wherein the apparatus is further caused to:

determine the one or more content placement layers based, at least in part, on a clustering of the one or more surface primitives, the one or more simplified surfaces, or a combination thereof.

14. An apparatus of claim 10, wherein the apparatus is further caused to:

process and/or facilitate a processing the one or more models, the one or more objects, or a combination thereof to determine one or more representational locations associated with the one or more simplified surfaces; and

determine the one or more content placement layers based, at least in part, on the one or more representational locations.

15. An apparatus of claim 10, wherein the apparatus is further caused to:

cause, at least in part, a segmentation of one or more of the one or more simplified surfaces into one or more segmented surfaces based, at least in part, on the visibility statistics; and

determine the one or more content placement layers based, at least in part, on the one or more segmented surfaces.

16. An apparatus of claim 10, wherein the apparatus is further caused to:

process and/or facilitate a processing of the one or more simplified surfaces with respect to the various viewpoints to determine one or more non-occluded surfaces; and

determine the one or more content placement layers based, at least in part, on the one or more non-occluded surfaces.

17. An apparatus of claim 16, wherein the apparatus is further caused to:

determine one or more occluding objects associated with the various viewpoints;

cause, at least in part, a segmentation of one or more of the one or more simplified surfaces into one or more segmented surfaces based, at least in part, on the one or more occluding objects; and

determine the one or more content placement layers based, at least in part, on the one or more segmented surfaces.

18. An apparatus of claim 10, wherein the one or more content items rendered within the one or more content placement layers maintain the perspectives of the one or more content placement layers.