Digital signage for immersive views

• US 9,530,197 B2
• Filed: 04/30/2015
• Issued: 12/27/2016
• Est. Priority Date: 04/30/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Cabrera-Cordon, Luis Eduardo, Bojorquez Alfaro, Roberto Javier, Lee, Hae-jin, Chen, Jason, Kim, Doyop
• Primary Examiner(s): THOMAS, ASHISH
• Application Number:
  US14/701,489
• Publication Number:
  US 20160321791A1
• Time in Patent Office: 607 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 30/0259 based on store location
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2219/004 Annotating, labelling
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes

Abstract

Techniques for generating and superimposing digital signage onto an immersive view. In an exemplary embodiment, certain entities are occluded or otherwise unviewable in an immersive view of an environment. For such entities, digital signage may be generated and superimposed in a suitable area of the immersive view, and further indicating, e.g., directions to such entities from a viewing location, as well as other metadata, such as business name, website, etc. To determine whether a nearby entity is displayed in the immersive view, a planar layout storing geometrical data associated with entities in the vicinity may be loaded and processed.

Claims

1. An apparatus comprising:

a memory storing an immersive view corresponding to viewing parameters comprising a viewing location, and data associated with a preferred entity not displayed in the immersive view, the memory further storing a planar layout corresponding to the viewing location;

a digital signage generation block configured to;

based on the planar layout, determine a presence of a blocking entity between the viewing location and the preferred entity; and

generate digital signage comprising the data associated with the preferred entity, the digital signage further comprising an indication that the preferred entity is not displayed in the immersive view if the presence of a blocking entity is determined;

the apparatus further comprising a superimposition block configured to superimpose the digital signage onto the immersive view to generate an annotated immersive view.

2. The apparatus of claim 1, said viewing parameters comprising a field of view, the preferred entity lying outside the field of view.

3. The apparatus of claim 2, the planar layout comprising area and vertical height occupied by each of a plurality of entities, the plurality of entities comprising the preferred entity.

4. The apparatus of claim 3, the digital signage generation block further configured to determine the presence of the blocking entity by determining whether a direct line between the viewing location and the preferred entity intersects at least one of the plurality of entities.

5. The apparatus of claim 3, the plurality of entities comprising buildings on a street and sections of a building interior.

6. The apparatus of claim 2, the indication that the preferred entity is not displayed in the immersive view comprising directions from the viewing location to the preferred entity.

7. The apparatus of claim 1, the superimposition block configured to superimpose the digital signage onto the immersive view at a portion of the immersive view designated as blank space.

8. The apparatus of claim 3, the planar layout further comprising a vertical position occupied by each of the plurality of entities, the viewing parameters comprising a vertical viewing position.

9. The apparatus of claim 1, the superimposition block further configured to superimpose the digital signage onto a canvas area of the immersive view, the canvas area calculated to be non-overlapping with at least one dynamic occlusion present in the immersive view.

10. The apparatus of claim 1, the digital signage further comprising a link to a second immersive view, the digital signage generation block further configured to receive user selection of the link, the apparatus further comprising a display for displaying the second immersive view responsive to user selection of the link.

11. A method comprising:

retrieving an immersive view corresponding to viewing parameters comprising a viewing location, and data associated with a preferred entity not displayed in the immersive view;

retrieving a planar layout corresponding to the viewing location;

based on the planar layout, determining a presence of a blocking entity between the viewing location and the preferred entity;

generating digital signage comprising the data associated with the preferred entity, the digital signage further comprising an indication that the preferred entity is not displayed in the immersive view if the presence of a blocking entity is determined; and

superimposing the digital signage onto the immersive view to generate an annotated immersive view.

12. The method of claim 11, further comprising displaying the annotated immersive view on a digital display.

13. The method of claim 12, the planar layout comprising area and vertical height occupied by each of a plurality of entities, the plurality of entities comprising the preferred entity.

14. The method of claim 13, the determining the presence of the blocking entity comprising determining whether a direct line between the viewing location and the preferred entity intersects at least one of the plurality of entities.

15. The method of claim 13, the plurality of entities comprising buildings on a street and sections of a building interior.

16. The method of claim 12, the indication that the preferred entity is not displayed in the immersive view comprising directions from the viewing location to the preferred entity.

17. The method of claim 11, the superimposing comprising superimposing the digital signage onto the immersive view at a portion of the immersive view designated as blank space.

18. The method of claim 13, the planar layout further comprising a vertical position occupied by each of the plurality of entities, the viewing parameters comprising a vertical viewing position.

19. The method of claim 11, the superimposition block further configured to superimpose onto the immersive view digital signage comprising data associated with an entity displayed in the immersive view.

20. A computing device including a processor and a memory holding instructions executable by the processor to:

retrieve from the memory an immersive view corresponding to viewing parameters comprising a viewing location, and data associated with a preferred entity not displayed in the immersive view;

retrieve from the memory a planar layout corresponding to the viewing location;

based on the planar layout, determine a presence of a blocking entity between the viewing location and the preferred entity; and

generate digital signage comprising the data associated with the preferred entity, the digital signage further comprising an indication that the preferred entity is not displayed in the immersive view if the presence of a blocking entity is determined; and

superimpose the digital signage onto the immersive view to generate an annotated immersive view.