Inconspicuous tag for generating augmented reality experiences

• US 10,163,049 B2
• Filed: 03/08/2013
• Issued: 12/25/2018
• Est. Priority Date: 03/08/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Tout, Nigel David, Goteti, Aditya, Clevenger, Jack
• Primary Examiner(s): Lee, Michael G
• Assistant Examiner(s): Tardif, David
• Application Number:
  US13/789,943
• Publication Number:
  US 20140253589A1
• Time in Patent Office: 2,118 Days
• Field of Search: 235492
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06K 19/06046 Constructional details
• CPC Class Codes: G06K 19/0614 the marking being selective to wavelength, e.g. color barcode or barcodes only visible under UV or IR methods or arrangements for sensing record carriers using a selected wavelength, see G06K7/12
• CPC Class Codes: G06K 19/06159 the marking being relief type, e.g. three-dimensional bar codes engraved in a support

Abstract

A system and method for generating virtual objects, the data for the virtual object is retrieved at least in part from a tag. The tag comprises a transparent physical surface and a visually imperceptible structure constructed in the transparent physical surface. The tag encodes the data for the virtual objects in the visually imperceptible structure. When detected by the appropriately configured capture devices, the visually imperceptible structure produces a depth pattern that is reflected in phase shifts between regions in the tag.

Claims

1. A method for generating a virtual object on a display device, the method comprising:

scanning a physical environment;

detecting a physical tag associated with a physical object in the physical environment;

obtaining data relating to display of the virtual object from the detecting of the physical tag; and

rendering the virtual object on the display device as at least a partial overlay to the physical object.

2. The method of claim 1, wherein the physical tag comprises a depth pattern reflected in a phase shift between regions, the method further comprising decoding the depth pattern to obtain the data relating to the display of the virtual object.

3. The method of claim 1, wherein the rendering of the virtual object comprises adjusting colors of the virtual object to improve visibility of the virtual object against a viewing location.

4. The method of claim 1, wherein the rendering of virtual object comprises displaying the virtual object in accordance with user interactions.

5. The method of claim 1, further comprising determining a rendering location for the virtual object relative to an image of the physical environment.

6. The method of claim 5, wherein the determining the rendering location comprises:

acquiring a three-dimensional map of the physical environment;

identifying one or more regions in the acquired three-dimensional map;

associating the physical tag with the one or more regions; and

associating the virtual object corresponding to the physical tag with the rendering location relative to the one or more regions.

7. The method of claim 6, wherein the one or more regions comprise one or more objects in the physical environment.

8. The method of claim 5, wherein the determining the rendering location comprises:

acquiring a three-dimensional map of the physical environment;

identifying a location of the physical tag within the acquired three-dimensional map;

associating the virtual object corresponding to the physical tag with the rendering location relative to the location of the physical tag.

9. The method of claim 6, wherein the rendering location comprises a location relative to a location of the physical tag.

10. The method of claim 6, wherein the rendering location comprises a location relative to a feature of the physical environment.

11. The method of claim 1, wherein the rendering of the virtual object on the display device as at least the partial overlay to the physical object comprises rendering the virtual object within a predefined area of the physical object.

12. The method of claim 1, further comprising:

accessing a user profile that includes user interests; and

selecting content for the virtual object based at least in part on the user interests.

13. A method implemented by a processor and a depth sensing capture device, comprising

scanning a physical environment using the depth sensing capture device;

detecting, in the physical environment, a static tag associated with a physical object, the static tag including a transparent physical surface, and a visually imperceptible depth pattern constructed in the transparent physical surface, the visually imperceptible depth pattern encoding data related to a display of a virtual object;

obtaining the data related to the display of the virtual object based on the detecting of the static tag;

retrieving a virtual object definition associated with the virtual object; and

rendering, based at least in part on the virtual object definition, the virtual object on a display device as at least a partial overlay to the physical object.

14. The method of claim 13, wherein the static tag is attached to one or more surfaces in the physical environment.

15. The method of claim 13, wherein the detecting includes detecting the visually imperceptible depth pattern by determining a phase shift to electromagnetic waves reflected by materials.

16. The method of claim 13, wherein the rendering the virtual object includes determining a rendering location by:

acquiring a three-dimensional map of the physical environment;

identifying one or more regions in the acquired three-dimensional map;

associating the static tag with the one or more regions; and

associating the virtual object with the rendering location relative to the one or more regions associated with the static tag.

17. The method of claim 13 wherein the rendering the virtual object includes determining a rendering location by:

acquiring a three-dimensional map of the physical environment;

identifying a location of the static tag within the acquired three-dimensional map;

associating the virtual object with the rendering location relative to the location of the static tag.

18. A device comprising:

a display;

a processor; and

memory storing instructions that, when executed by the processor, cause the device to perform operations comprising;

scanning a physical environment;

detecting a physical tag associated with a physical object in the physical environment;

obtaining, from the physical tag, data describing a display of a virtual object; and

rendering the virtual object on the display as at least a partial overlay to the physical object based at least in part on the obtained data.

19. The device of claim 18, wherein the rendering of the virtual object on the display as at least the partial overlay to the physical object comprises rendering the virtual object within a predefined area of the physical object.

20. The device of claim 18, wherein the operations further comprise:

accessing a user profile that includes user interests; and

selecting content for the virtual object based at least in part on the user interests.