Automatic variable virtual focus for augmented reality displays
First Claim
1. A method for displaying virtual objects with variable focus by an augmented reality system comprising:
- identifying by one or more processors a three dimensional location of one or more virtual objects within a user field of view of a near-eye display device of the augmented reality system, the near-eye display device comprising a microdisplay assembly and a display unit optically coupled to receive one or more images from the microdisplay assembly;
determining by the one or more processors a three dimensional focal region of a user wearing the near-eye display device within the user field of view;
identifying which of the one or more virtual objects are in the focal region of the user based on the three dimensional locations of the one or more virtual objects within the user field of view;
generating a series of layered image data at different user focal regions, by the microdisplay assembly, for each of the one or more virtual objects, such that the one or more virtual objects are identified as being in the user focal region; and
receiving from the microdisplay assembly and displaying by the display unit the generated image data of the one or more virtual objects.
2 Assignments
0 Petitions
Accused Products
Abstract
The technology provides an augmented reality display system for displaying a virtual object to be in focus when viewed by a user. In one embodiment, the focal region of the user is tracked, and a virtual object within the user focal region is displayed to appear in the focal region. As the user changes focus between virtual objects, they appear to naturally move in and out of focus as real objects in a physical environment would. The change of focus for the virtual object images is caused by changing a focal region of light processing elements in an optical path of a microdisplay assembly of the augmented reality display system. In some embodiments, a range of focal regions are swept through at a sweep rate by adjusting the elements in the optical path of the microdisplay assembly.
74 Citations
20 Claims
-
1. A method for displaying virtual objects with variable focus by an augmented reality system comprising:
-
identifying by one or more processors a three dimensional location of one or more virtual objects within a user field of view of a near-eye display device of the augmented reality system, the near-eye display device comprising a microdisplay assembly and a display unit optically coupled to receive one or more images from the microdisplay assembly; determining by the one or more processors a three dimensional focal region of a user wearing the near-eye display device within the user field of view; identifying which of the one or more virtual objects are in the focal region of the user based on the three dimensional locations of the one or more virtual objects within the user field of view; generating a series of layered image data at different user focal regions, by the microdisplay assembly, for each of the one or more virtual objects, such that the one or more virtual objects are identified as being in the user focal region; and receiving from the microdisplay assembly and displaying by the display unit the generated image data of the one or more virtual objects. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. An augmented reality system providing variable focus of virtual objects comprising:
-
a near-eye support structure; one or more processors; a see-through display unit positioned by the near-eye support structure to be seen through by a user eye; a microdisplay assembly for generating one or more images, supported by the near-eye support structure and optically coupled to the see-through display unit for outputting image data for a user focal region to the see-through display unit, the microdisplay assembly includes one or more light processing elements including a microdisplay and at least one optical element movable to place one or more virtual objects in the user focal region by actuating the one or more light processing elements in an optical path, in which the microdisplay is aligned, under control of the one or more processors; an armature for supporting the at least one light processing element of the microdisplay assembly and stabilizing movement of the at least one light processing element in the optical path; the one or more processors controlling the microdisplay assembly for generating the image data for the one or more virtual objects in the user focal region; the display unit receiving the generated image data from the microdisplay assembly and displaying the generated image data and including a driver to control the at least one optical element, the processor directing the microdisplay to include at least one of the one or more virtual objects in the user focal region; and a display optically coupled to the microdisplay assembly via the optical path for displaying three dimensional virtual images. - View Dependent Claims (8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. One or more computer readable non-volatile storage media having encoded thereon instructions for causing a processor to perform a method for displaying virtual objects with variable focus by an augmented reality system, the method comprising:
-
identifying by one or more processors a three dimensional location of one or more virtual objects within a user field of view of a near-eye display device of the augmented reality system, the near-eye display device comprising a microdisplay assembly and a display unit optically coupled to receive one or more images from the microdisplay assembly; determining by the one or more processors a three dimensional focal region of a user wearing the near-eye display device within the user field of view; identifying which of the one or more virtual objects are in the focal region of the user based on the three dimensional locations of the one or more virtual objects within the user field of view; generating a series of layered image data at different user focal regions, by the microdisplay assembly, for each of the one or more virtual objects, such that the one or more virtual objects are identified as being in the user focal region; and receiving from the microdisplay assembly and displaying by the display unit the generated image data of the one or more virtual objects. - View Dependent Claims (19, 20)
-
Specification