Virtual and augmented reality systems and methods using display system control information embedded in image data

• US 10,735,649 B2
• Filed: 02/22/2018
• Issued: 08/04/2020
• Est. Priority Date: 02/22/2018
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Rodriguez, Jose Felix, Perez, Ricardo Martinez, Nourai, Reza
• Primary Examiner(s): Polo, Gustavo
• Application Number:
  US15/902,710
• Publication Number:
  US 20190260931A1
• Time in Patent Office: 894 Days
• CPC Class Codes: G02B 2027/0112 comprising device for genereting colour display
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/1046 for use with transmissive spatial light modulators
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 23/65 Control of camera operation in relation to power supply

Abstract

A virtual or augmented reality display system that controls power inputs to the display system as a function of image data. Image data itself is made of a plurality of image data frames, each with constituent color components of, and depth planes for displaying on, rendered content. Light sources or spatial light modulators to relay illumination from the light sources may receive signals from a display controlled to adjust a power setting to the light source or spatial light modulator based on control information embedded in an image data frame.

Claims

1. A display system comprising:

a display configured to display image data, wherein the image data comprises a plurality of current image data frames, each current image data frame comprising a plurality of color components and a plurality of depth planes;

at least one light source configured to illuminate the display;

at least one spatial light modulator configured to relay illumination from the at least one light source to the display; and

a display system controller configured to;

receive at least one current image data frame, and

control at least one control input for the at least one light source or the at least one spatial light modulator based on control information embedded in the current image data frame, wherein the control information comprises an inactivation of at least one color component or at least one depth plane within the current image data frame.

2. The display system of claim 1, wherein the at least one control input is a reduced power setting of the at least one light source.

3. The display system of claim 2, wherein the reduced power setting is a complete power shut off to the at least one light source.

4. The display system of claim 1, wherein the at least one control input is a reduced power setting of the at least one spatial light modulator.

5. The display system of claim 1, wherein the image data further comprises subsequent image data frames.

6. The display system of claim 1, wherein the embedded control information comprises a substituted row or column in at least one image data frame.

7. The display system of claim 1, wherein the embedded control information comprises one or more substituted values in one or more pixels of at least one image data frame.

8. The display system of claim 1, wherein the plurality of depth planes of each image data frame are associated with a respective plurality of different wavefront curvatures.

9. A display system comprising:

a display configured to display image data, wherein the image data comprises a plurality of current image data frames, each current image data frame comprising a plurality of color components and a plurality of depth planes;

at least one light source configured to illuminate the display;

at least one spatial light modulator configured to relay illumination from the at least one light source to the display; and

a display system controller configured to;

receive at least one current image data frame, and

control at least one input to the display system based on control information embedded in the current image data frame, wherein the control information comprises an inactivation of at least one color component or at least one depth plane within the current image data frame.

10. The display system of claim 9, wherein the control information further comprises an advance frame display information indicating activation at a subsequent image data frame of the at least one inactive depth plane in the current frame.

11. The display system of claim 10, wherein the display system controller is further configured to control at least one input to the display system based on the advance frame display information.

12. The display system of claim 11, wherein the at least one input to the display system is an increased power setting to the at least one light source.

13. The display system of claim 11, wherein the at least one input to the display system is an increased power setting to the at least one spatial light modulator.

14. The display system of claim 9, wherein the control information further comprises an advance frame display information indicating activation at a subsequent frame of the at least one inactive color component in the current frame.

15. The display system of claim 14, wherein the display system controller is further configured to control at least one input to the display system based on the advance frame display information.

16. The display system of claim 15, wherein the at least one input to the display system is an increased power setting to the at least one light source.

17. The display system of claim 15, wherein the at least one input to the display system is an increased power setting to the at least one spatial light modulator.