Depth and Focus Discrimination for a Head-mountable device using a Light-Field Display System
First Claim
Patent Images
1. A head-mountable device (HMD) comprising:
- a light-producing display engine;
a viewing element;
a microlens array coupled to the light-producing display engine in a manner such that light emitted from one or more pixels of the light-producing display engine is configured to follow an optical path through the microlens array to the viewing element;
at least one processor coupled to the light-producing display engine; and
a storage medium that provides instructions that, when executed by the at least one processor, will cause the HMD to perform operations including;
identifying a first feature of interest in a field-of-view associated with the HMD in an environment, wherein the first feature of interest is associated with a first location and perceived depth to the HMD in the environment, and wherein the first feature of interest is visible at the viewing element;
obtaining lightfield data indicative of the environment and the first feature of interest;
rendering, based on the lightfield data, a first lightfield comprising a first synthetic image that is related to the first feature of interest at a first focal point that corresponds to the first location and perceived depth for display at the viewing element;
identifying a second feature of interest in the field-of-view associated with the HMD in the environment, wherein the second feature of interest is associated with a second location and a second perceived depth to the HMD in the environment, and wherein the second feature of interest is visible at the viewing element;
obtaining lightfield data indicative of the environment and the second feature of interest; and
rendering, based on the lightfield data, simultaneous to the first lightfield, a second lightfield comprising a second synthetic image that is related to the second feature of interest at a second focal point that corresponds to the second location and perceived depth for display at the viewing element,wherein rendering the first and second lightfields further comprises emitting light from the light-producing display engine along the optical path passing through the microlens array to the viewing element.
1 Assignment
0 Petitions
Accused Products
Abstract
A head-mountable device (HMD) is provided for augmenting a contemporaneously viewed “real image” of an object in a real-world environment using a light-field display system that allows for depth and focus discrimination. The HMD may include a light-producing display engine, a viewing location element, and a microlens array. The microlens array may be coupled to the light-producing display engine in a manner such that light emitted from the light-producing display engine is configured to follow an optical path through the microlens array to the viewing location element. The HMD may also include a processor configured to identify a feature of interest in a field-of-view associated with the HMD in an environment, obtain lightfield data, and render, based on the lightfield data, a lightfield that includes a synthetic image related to the feature of interest using depth and focus discrimination.
-
Citations
20 Claims
-
1. A head-mountable device (HMD) comprising:
-
a light-producing display engine; a viewing element; a microlens array coupled to the light-producing display engine in a manner such that light emitted from one or more pixels of the light-producing display engine is configured to follow an optical path through the microlens array to the viewing element; at least one processor coupled to the light-producing display engine; and a storage medium that provides instructions that, when executed by the at least one processor, will cause the HMD to perform operations including; identifying a first feature of interest in a field-of-view associated with the HMD in an environment, wherein the first feature of interest is associated with a first location and perceived depth to the HMD in the environment, and wherein the first feature of interest is visible at the viewing element; obtaining lightfield data indicative of the environment and the first feature of interest; rendering, based on the lightfield data, a first lightfield comprising a first synthetic image that is related to the first feature of interest at a first focal point that corresponds to the first location and perceived depth for display at the viewing element; identifying a second feature of interest in the field-of-view associated with the HMD in the environment, wherein the second feature of interest is associated with a second location and a second perceived depth to the HMD in the environment, and wherein the second feature of interest is visible at the viewing element; obtaining lightfield data indicative of the environment and the second feature of interest; and rendering, based on the lightfield data, simultaneous to the first lightfield, a second lightfield comprising a second synthetic image that is related to the second feature of interest at a second focal point that corresponds to the second location and perceived depth for display at the viewing element, wherein rendering the first and second lightfields further comprises emitting light from the light-producing display engine along the optical path passing through the microlens array to the viewing element. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method comprising:
-
identifying, using at least one processor of a head-mountable device (HMD), a first feature of interest in a field-of-view view associated with the HMD in an environment, wherein; the HMD comprises a light-producing display engine, a viewing element, and a microlens array coupled to the light-producing display engine in a manner such that light emitted from the light-producing display engine follows an optical path through the microlens array to the viewing element; and the first feature of interest is associated with a first location and perceived depth to the HMD in the environment and visible at the viewing element; obtaining lightfield data indicative of the environment and the first feature of interest; rendering, based on the lightfield data, a first lightfield comprising a first synthetic image that is related to the first feature of interest at a first focal point that corresponds to the first location and perceived depth for display at the viewing element; identifying, using at least one processor of the head-mountable device (HMD), a second feature of interest in a field-of-view view associated with the HMD in the environment, wherein; the second feature of interest is associated with a second location and perceived depth to the HMD in the environment and visible at the viewing element; obtaining second lightfield data indicative of the environment and the second feature of interest; and rendering, based on the second lightfield data, simultaneous to the first lightfield, a second lightfield comprising a second synthetic image that is related to the second feature of interest at a second focal point that corresponds to the second location and perceived depth for display at the viewing element, wherein rendering the first and second lightfields further comprises emitting light from the light-producing display engine along the optical path passing through the microlens array to the viewing element. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification
-
- Resources
Litigation Campaign Assessment
Thank you for your request. You will receive a custom alert email when the Litigation Campaign Assessment is available.
×
-
Current AssigneeGoogle Inc. (Alphabet Inc.)
-
Original AssigneeGoogle Inc. (Alphabet Inc.)
-
InventorsTABAKA, Corey, STRONG, Jasmine
-
Application NumberUS13/755,392Publication NumberTime in Patent OfficeDaysField of SearchUS Class Current1/1CPC Class CodesG02B 2027/0138 comprising image capture sy...G02B 2027/0178 Eyeglass type eyeglass deta...G02B 27/0075 with means for altering, e....G02B 27/0172 characterised by optical fe...
