Automatic focus improvement for augmented reality displays
First Claim
Patent Images
1. An augmented reality system providing improved focus of objects comprising:
- a see-through display device having a support structure, the see-through display positioned by the support structure and one or more physical environment facing cameras positioned by the support structure for capturing depth images of a space in which the see-through display device is located;
a memory storing software and data;
a processor determining a three-dimensional current field of view as seen through the see-through display based on a three dimensional model of the space in which the see-through display device is located and the captured depth images under the control of software, the processor having access to the memory and being communicatively coupled to a microdisplay assembly;
the processor being operable to determine a current focal region in the three dimensional current field of view;
the microdisplay assembly attached to the see-through display device, the microdisplay assembly including a microdisplay, one or more optical elements, and a variable virtual focus adjuster for changing an optical path between the microdisplay and the one or more optical elements of the microdisplay assembly;
the processor causing the microdisplay assembly to generate an in-focus virtual image which will display in-focus in the determined current focal region by controlling the variable virtual focus adjuster to adjust a focal region of the microdisplay assembly based on detected edges of the objects to identify distinct objects for enhancement; and
the see-through display of the see-through display device being optically coupled to receive and to display the in-focus virtual image generated for the determined current focal region.
2 Assignments
0 Petitions
Accused Products
Abstract
An augmented reality system provides improved focus of real and virtual objects. A see-through display device includes a variable focus lens a user looks through. A focal region adjustment unit automatically focuses the variable focus lens in a current user focal region. A microdisplay assembly attached to the see-through display device generates a virtual object for display in the user'"'"'s current focal region by adjusting its focal region. The variable focus lens may also be adjusted to provide one or more zoom features. Visual enhancement of an object may also be provided to improve a user'"'"'s perception of an object.
-
Citations
13 Claims
-
1. An augmented reality system providing improved focus of objects comprising:
-
a see-through display device having a support structure, the see-through display positioned by the support structure and one or more physical environment facing cameras positioned by the support structure for capturing depth images of a space in which the see-through display device is located; a memory storing software and data; a processor determining a three-dimensional current field of view as seen through the see-through display based on a three dimensional model of the space in which the see-through display device is located and the captured depth images under the control of software, the processor having access to the memory and being communicatively coupled to a microdisplay assembly; the processor being operable to determine a current focal region in the three dimensional current field of view; the microdisplay assembly attached to the see-through display device, the microdisplay assembly including a microdisplay, one or more optical elements, and a variable virtual focus adjuster for changing an optical path between the microdisplay and the one or more optical elements of the microdisplay assembly; the processor causing the microdisplay assembly to generate an in-focus virtual image which will display in-focus in the determined current focal region by controlling the variable virtual focus adjuster to adjust a focal region of the microdisplay assembly based on detected edges of the objects to identify distinct objects for enhancement; and the see-through display of the see-through display device being optically coupled to receive and to display the in-focus virtual image generated for the determined current focal region. - View Dependent Claims (2, 3, 4)
-
-
5. In an augmented reality system, a method for providing improved focus of objects comprising:
-
determining a field of view of a see-through display of an augmented reality (AR) display device based on a three dimensional model of a space in which the AR display device is located, the space including a real object, and depth images of the space captured by one or more physical environment facing cameras supported by the AR display device; determining a current focal region in the field of view; and displaying a virtual object at its real world focal distance in the field of view by identifying each virtual object which is in the current focal region based on its location in the three dimensional model, placing each virtual object identified as being in the current focal region by a variable virtual focus adjuster for changing the focal region of a microdisplay assembly by changing an optical path between the microdisplay and one or more optical elements of the microdisplay assembly, the variable virtual focus adjuster rotating a rotable lens system, generating an in-focus image including each identified virtual object in the current focal region by the microdisplay assembly, optically receiving the in-focus image including each identified virtual object in the current focal region by the see-through display, and displaying the in-focus image including each identified virtual object in the current focal region by the see-through display. - View Dependent Claims (6, 7, 8, 9, 10, 11, 12, 13)
-
Specification