Overlay emphasis modification in augmented reality displays

• US 10,152,815 B2
• Filed: 01/17/2017
• Issued: 12/11/2018
• Est. Priority Date: 01/17/2017
• Status: Active Grant

• Current Assignee: OpenTV, Inc. (Kudelski SA)
• Original Assignee: OpenTV, Inc. (Kudelski SA)
• Inventors: Tinsman, John
• Primary Examiner(s): Lett, Thomas
• Application Number:
  US15/407,435
• Publication Number:
  US 20180204361A1
• Time in Patent Office: 693 Days
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/537 using indicators, e.g. showing the condition of a game character on screen
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

Example embodiments provide systems and methods for emphasis modification of an informational overlay in augmented reality displays. In an example method, an informational overlay is presented atop a scene on a display device. The informational overlay includes at least one of a graphical element or a textual element to partially obscure the scene. Scene change data indicating a change in the scene is accessed. Based on the scene change data, a visual emphasis on the display device of at least a portion of the informational overlay relative to the scene is modified.

Claims

1. A computerized method comprising:

causing presentation of an informational overlay atop a scene on a display device, the informational overlay comprising at least one of a graphical element or a textual element to partially obscure the scene;

accessing, using at least one of one or more hardware processors, scene change data indicating a change in the scene and comprising an indication of a portion of the scene;

identifying at least a portion of the informational overlay based on the indication of the portion of the scene; and

modifying, using at least one of the one or more hardware processors, based on the scene change data, a visual emphasis of the at least a portion of the informational overlay on the display device relative to the scene.

2. The computerized method of claim 1, further comprising:

causing presentation of the scene on the display device.

3. The computerized method of claim 1, the modifying of the visual emphasis of the at least a portion of the informational overlay comprising altering a brightness of the at least a portion of the informational overlay.

4. The computerized method of claim 1, the modifying of the visual emphasis of the at least a portion of the informational overlay comprising altering a sharpness of the at least a portion of the informational overlay.

5. The computerized method of claim 1, the at least a portion of the informational overlay comprising text, the modifying of the visual emphasis of the at least a portion of the informational overlay comprising altering a font of the text.

6. The computerized method of claim 1, the modifying of the visual emphasis of the at least a portion of the informational overlay comprising modifying a color of the at least a portion of the informational overlay.

7. The computerized method of claim 1, the at least a portion of the informational overlay at least partially overlapping the indicated portion of the scene.

8. The computerized method of claim 1, the indication of the portion of the scene comprising an indication of an object of interest in the scene.

9. The computerized method of claim 8, the modifying of the visual emphasis of the at least a portion of the informational overlay occurring in response to the object of interest entering a particular area of the scene.

10. The computerized method of claim 8, the modifying of the visual emphasis of the at least a portion of the informational overlay occurring in response to the object of interest exiting a particular area of the scene.

11. The computerized method of claim 8, the modifying of the visual emphasis of the at least a portion of the informational overlay occurring in response to the object of interest encroaching within a particular perceived distance to a vantage point of the scene.

12. The computerized method of claim 8, the modifying of the visual emphasis of the at least a portion of the informational overlay occurring in response to the object of interest exiting from a particular perceived distance to a vantage point of the scene.

13. The computerized method of claim 1, the modifying of the visual emphasis of the at least a portion of the informational overlay occurring in response to the scene change data indicating a magnitude of the change in the scene exceeding a particular level during a period of time.

14. The computerized method of claim 1, the modifying of the visual emphasis of the at least a portion of the informational overlay occurring in response to the scene change data indicating a magnitude of the change in the scene falling below a particular level during a period of time.

15. The computerized method of claim 1, the at least a portion of the informational overlay comprising an entirety of the informational overlay.

16. The computerized method of claim 1, further comprising:

comparing a current version of the scene to a previous version of the scene; and

generating the scene change data based on the comparing of the current version of the scene to the previous version of the scene.

17. The computerized method of claim 1, further comprising:

accessing movement data indicating movement of the display device; and

generating the scene change data based on the movement data.

18. The computerized method of claim 17, the movement data indicating translational movement of the display device.

19. The computerized method of claim 17, the movement data indicating rotational movement of the display device.

20. A display system comprising:

one or more hardware processors; and

a memory having stored therein instructions that, when executed by at least one of the one or more hardware processors, cause the display system to perform operations comprising;

causing presentation of an informational overlay atop a scene on a display device, the informational overlay comprising at least one of a graphical element or a textual element to partially obscure the scene;

accessing scene change data indicating a change in the scene and comprising an indication of a portion of the scene;

identifying at least a portion of the informational overlay based on the indication of the portion of the scene; and

modifying, based on the scene change data, a visual emphasis of the at least a portion of the informational overlay relative to the scene on the display device.

21. The display system of claim 20, further comprising the display device.

22. The display system of claim 20, further comprising a motion detection device coupled to the display device, the motion detection device configured to generate movement data indicating movement of the display device, the operations further comprising generating the scene change data based on the movement data.

23. The display system of claim 20, the operations further comprising:

comparing a current version of the scene to a previous version of the scene; and

generating the scene change data based on the comparing of the current version of the scene to the previous version of the scene.

24. The display system of claim 20, the operations further comprising causing presentation of the scene on the display device.

25. The display system of claim 20, wherein:

the scene comprises a view of a physical environment;

the display device comprises a transparent material through which the physical environment is viewed;

the system further comprises a projection device; and

the causing of the presentation of the informational overlay atop the scene on the display device comprises projecting the informational overlay using the projection device onto the transparent material.

26. The display system of claim 20, wherein:

the scene comprises a view of a physical environment;

the display device comprises a transparent material through which the physical environment is viewed, and a light-emitting system coupled to the transparent material; and

the causing of the presentation of the informational overlay atop the scene on the display device comprises causing the presentation of the informational overlay using the light-emitting system.

27. The display system of claim 20, the operations further comprising generating one or more signals including information describing the scene and the informational overlay, and the display device configured to emit light representing the scene and the informational overlay based on the one or more signals.

28. A non-transitory computer-readable storage medium comprising instructions that, when executed by one or more hardware processors of a machine, cause the machine to perform operations comprising:

causing presentation of an informational overlay atop a scene on a display device, the informational overlay comprising at least one of a graphical element or a textual element to partially obscure the scene;

accessing scene change data indicating a change in the scene and comprising an indication of a portion of the scene;

identifying at least a portion of the informational overlay based on the indication of the portion of the scene; and

modifying;

based on the scene change data, a visual emphasis of the at least a portion of the informational overlay relative to the scene on the display device.

29. The non-transitory computer-readable storage medium of claim 28, wherein the modifying of the visual emphasis of the at least a portion of the informational overlay comprises altering a sharpness of the at least a portion of the informational overlay.