HYBRID DISPLAY SYSTEM

• US 20160370855A1
• Filed: 06/17/2015
• Published: 12/22/2016
• Est. Priority Date: 06/17/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Lanier, Jaron, Kollin, Joel S.
• Granted Patent: US 9,977,493 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 7/55 from multiple images
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 23/58 Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
• CPC Class Codes: H04N 25/00 Circuitry of solid-state image sensors [SSIS]; Control thereof
• CPC Class Codes: H04N 9/3173 wherein the projection device is specially adapted for enhanced portability

Abstract

Embodiments are disclosed for a display system having multiple fields of view. An example display system comprises a first display configured to produce images across a first field of view, a second display configured to produce images across a second field of view, the second field of view being larger than the first field of view, and a controller configured to selectively present a virtual object via one or more of the first display and the second display based on a feature of the virtual object as displayed within a user'"'"'s viewspace.

Claims

1. A display system comprising:

a first display configured to produce images across a first field of view;

a second display configured to produce images across a second field of view, the second field of view being larger than the first field of view; and

a controller configured to selectively present a virtual object via one or more of the first display and the second display based on a feature of the virtual object as displayed within a user'"'"'s viewspace.

2. The display system of claim 1, wherein the first display comprises a waveguide-type or birdbath display, and wherein the second display comprises a compressed lightfield or Maxwellian-view display.

3. The display system of claim 2, wherein the first display comprises microprojector that projects into a waveguide and a plurality of gratings for replicating a pupil in a plurality of directions, and wherein the second display comprises a pinlight display.

4. The display system of claim 1, wherein the feature includes a location of the virtual object in the user'"'"'s viewspace and wherein selectively presenting the virtual object via one or more of the first and the second display configurations includes presenting the virtual object via only the second display responsive to determining that the location of the virtual object is outside of the first field of view.

5. The display system of claim 1, wherein the first display has a field of view that is less than or equal to 60 degrees, and wherein the second display has a field of view that is greater than 60 degrees.

6. The display system of claim 5, wherein the field of view of the first display is between 30 and 60 degrees, inclusive, wherein the field of view of the second display is above 60 degrees, and wherein the second display provides selective occlusion of a real-world environment as viewed through the second display.

7. The display system of claim 1, wherein the first display has a higher resolution than the second display.

8. The display system of claim 1, wherein selectively presenting the virtual object via the first and second display comprises displaying at least a portion of the virtual object via the second display responsive to determining that a transparency of the virtual object is below a threshold.

9. The display system of claim 1, wherein the display system comprises, in order along an optical axis extending from a user'"'"'s eye, the first display, an air gap, and the second display.

10. A method of producing an image in a display device, the method comprising:

directing light from a first light source to a waveguide to selectively present virtual objects via a first display, the first display having a first field of view;

directing light from one or more second light sources to a user'"'"'s eye to selectively present virtual objects via a second display, the second display having a second field of view that is larger than the first field of view;

generating a virtual object for display in a user'"'"'s viewspace;

determining a location for the virtual object within the user'"'"'s viewspace and a feature of the virtual object;

if the location for the virtual object is outside of the first field of view, displaying the virtual object with the second display; and

if the location for the virtual object is within the first field of view, selectively displaying the virtual object with one or more of the first display and the second display based on the feature of the virtual object.

11. The method of claim 10, wherein the feature includes a transparency of the virtual object, and wherein selectively displaying the virtual object with one or more of the first display and the second display comprises displaying the virtual object with one or more of the first display and the second display if the transparency of the virtual object is above a threshold and displaying the virtual object with at least the second display if the transparency of the virtual object is below the threshold.

12. The method of claim 10, wherein the feature includes a designation of the virtual object as an interactive object for a user interface such that the virtual object corresponds to a virtual or real-world element that is used to provide a gesture input to the user interface.

13. The method of claim 10, wherein the feature includes a resolution of the virtual object, and wherein selectively displaying the virtual object with the first display comprises displaying the virtual object with the first display if the resolution of the virtual object is above a threshold and displaying the virtual object with the second display if the resolution of the virtual object is below the threshold.

14. The method of claim 10, further comprising displaying at least a first portion of the virtual object with the first display and at least a second portion of the virtual object with the second display responsive to determining that the virtual object is located within the first field of view and that a transparency of the virtual object is above a threshold.

15. The method of claim 10, wherein the second display comprises a pinlight display or a Maxwellian-view display.

16. A head-mounted display device comprising:

a first display configured to produce images across a first field of view, the first display comprising a waveguide;

a second display configured to produce images across a second field of view, the second field of view being larger than the first field of view, the second display comprising an aperture mask display and being separated from the first display by an air gap; and

a circuit configured to;

present a virtual object to a wearer of the head-mounted display device via a selected one of a plurality of display modes based on a feature of the virtual object as displayed within a user'"'"'s viewspace, the display modes including a first display mode in which the virtual object is displayed via only the first display, a second display mode in which the virtual object is displayed via only the second display, and a third display mode in which the virtual object is displayed via the first display and the second display.

17. The head-mounted display device of claim 16, wherein the first display and the second display form a stacked display in which the first display is positioned nearer to an eye of a wearer of the head-mounted display device than the second display.

18. The head-mounted display device of claim 16, wherein the first display has a field of view that is less than or equal to 60 degrees, wherein the second display has a field of view that is greater than 60 degrees, and wherein the second display provides selective occlusion of a real-world environment as viewed through the second display.

19. The head-mounted display device of claim 16, wherein presenting the virtual object to a wearer of the head-mounted display device via a selected one of a plurality of display modes comprises displaying at least a portion of the virtual object via the second display mode responsive to determining that a transparency of the virtual object is below a threshold.

20. The head-mounted display device of claim 16, wherein presenting the virtual object to a wearer of the head-mounted display device via a selected one of a plurality of display modes comprises displaying at least a portion of the virtual object via the second display mode responsive to determining that the virtual object is to be presented in a peripheral region of the user'"'"'s viewspace and displaying at least a portion of the virtual object via the first display mode responsive to determining that the virtual object is to be presented in a central region of the user'"'"'s viewspace.

21. The head-mounted display device of claim 16, wherein the first display has a higher resolution than second display.

22. The head-mounted display device of claim 16 wherein the aperture mask display comprises a pinlight display or a Maxwellian-view display.