Display apparatus and method of displaying using context and focus image renderers and optical combiners

• US 9,983,413 B1
• Filed: 07/14/2017
• Issued: 05/29/2018
• Est. Priority Date: 12/01/2016
• Status: Active Grant

• Current Assignee: Varjo Technologies Oy
• Original Assignee: Varjo Technologies Oy
• Inventors: Sahlsten, Oiva Arvo Oskari, Ollila, Mikko
• Primary Examiner(s): Faragalla, Michael
• Application Number:
  US15/650,796
• Publication Number:
  US 20180157051A1
• Time in Patent Office: 319 Days
• CPC Class Codes: G02B 2027/013 comprising a combiner of particular shape, e.g. curvature
• CPC Class Codes: G02B 2027/0147 comprising a device modifying the resolution of the displayed image
• CPC Class Codes: G02B 2027/0159 with mechanical means other than scaning means for positioning the whole image
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 26/0816 by means of one or more reflecting elements
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G02B 27/1066 for enhancing image performance, like resolution, pixel numbers, dual magnifications or dynamic range, by tiling, slicing or overlapping fields of view
• CPC Class Codes: G02B 27/145 having sequential partially reflecting surfaces
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

A display apparatus and method of displaying, via the display apparatus. The display apparatus includes context image renderer for rendering context image; focus image renderer for rendering focus image; exit optical element; and optical combiner for optically combining projection of the rendered context image with projection of the rendered focus image to create visual scene. The optical combiner includes first semi-transparent reflective element; and a second semi-transparent reflective element. The context image renderer is arranged in a manner that projection of rendered context image is incident upon first semi-transparent reflective element and reflected towards exit optical element therefrom. The focus image renderer is arranged in a manner that projection of rendered focus image is incident upon first semi-transparent reflective element and reflected towards second semi-transparent reflective element, and then reflected towards first semi-transparent reflective element, from where projection thereof is allowed to pass through towards exit optical element.

Claims

1. A display apparatus comprising:

at least one context image renderer for rendering a context image;

at least one focus image renderer for rendering a focus image;

an exit optical element; and

at least one optical combiner for optically combining a projection of the rendered context image with a projection of the rendered focus image to create a visual scene, an angular width of the projection of the rendered context image being greater than an angular width of the projection of the rendered focus image, the at least one optical combiner comprising;

a first semi-transparent reflective element having a first side and a second side, the first side facing the exit optical element; and

a second semi-transparent reflective element facing the second side of the first semi-transparent reflective element,

wherein the at least one context image renderer is arranged in a manner that the projection of the rendered context image emanating therefrom is incident upon the first side of the first semi-transparent reflective element and reflected towards the exit optical element therefrom, and

wherein the at least one focus image renderer is arranged in a manner that the projection of the rendered focus image emanating therefrom is incident upon the second side of the first semi-transparent reflective element and reflected towards the second semi-transparent reflective element therefrom, and is then reflected from the second semi-transparent reflective element towards the first semi-transparent reflective element, from where the projection of the rendered focus image is allowed to pass through towards the exit optical element.

2. The display apparatus of claim 1, wherein the first semi-transparent reflective element is static.

3. The display apparatus of claim 1, wherein the at least one optical combiner further comprises at least one first actuator for moving the second semi-transparent reflective element, the display apparatus further comprising a processor coupled to the at least one first actuator, the processor being configured to control the at least one first actuator to adjust a tilt of the second semi-transparent reflective element to change a location of the projection of the rendered focus image incident upon the exit optical element.

4. The display apparatus of claim 3, wherein the at least one optical combiner further comprises at least one second actuator for moving the at least one focus image renderer, the processor being coupled to the at least one second actuator, the processor being configured to control the at least one second actuator to adjust a tilt of the at least one focus image renderer to change the location of the projection of the rendered focus image incident upon the exit optical element.

5. The display apparatus of claim 1, wherein at least one of the first side and/or the second side of the first semi-transparent reflective element has polarizing properties.

6. The display apparatus of claim 5, further comprising a polarization retarder or retardation layer positioned between the first semi-transparent reflective element and the second semi-transparent reflective element.

7. The display apparatus of claim 1, further comprising a gaze-tracking unit comprising at least one photo sensor for sensing reflections of light from a user'"'"'s eye when the display apparatus is worn by the user, wherein the at least one photo sensor is positioned behind the second semi-transparent reflective element.

8. The display apparatus of claim 1, wherein the second semi-transparent reflective element is curved in shape.

9. The display apparatus of claim 1, wherein the second semi-transparent reflective element is arranged to allow a projection of a real-world image to pass through towards the first semi-transparent reflective element, whereat the projection of the real-world image is optically combined with the projection of the rendered context image and the projection of the rendered focus image to create the visual scene.

10. The display apparatus of claim 9, further comprising at least one optical filter for adjusting light transmittance of the projection of the real-world image passing through the at least one optical filter, wherein the at least one optical filter is positioned behind the second semi-transparent reflective element.

11. A method of displaying, via a display apparatus comprising at least one context image renderer, at least one focus image renderer, an exit optical element and at least one optical combiner, the at least one optical combiner comprising a first semi-transparent reflective element and a second semi-transparent reflective element, the first semi-transparent reflective element having a first side facing the exit optical element and a second side facing the second semi-transparent reflective element, the method comprising:

rendering a context image at the at least one context image renderer;

rendering a focus image at the at least one focus image renderer; and

using the at least one optical combiner to optically combine a projection of the rendered context image with a projection of the rendered focus image to create a visual scene, an angular width of the projection of the rendered context image being greater than an angular width of the projection of the rendered focus image,

wherein the at least one context image renderer is arranged in a manner that the projection of the rendered context image emanating therefrom is incident upon the first side of the first semi-transparent reflective element and reflected towards the exit optical element therefrom, and

wherein the at least one focus image renderer is arranged in a manner that the projection of the rendered focus image emanating therefrom is incident upon the second side of the first semi-transparent reflective element and reflected towards the second semi-transparent reflective element therefrom, and is then reflected from the second semi-transparent reflective element towards the first semi-transparent reflective element, from where the projection of the rendered focus image is allowed to pass through towards the exit optical element.

12. The method of claim 11, further comprising controlling at least one first actuator of the at least one optical combiner to adjust a tilt of the second semi-transparent reflective element, so as to change a location of the projection of the rendered focus image incident upon the exit optical element.

13. The method of claim 12, further comprising controlling at least one second actuator of the at least one optical combiner to adjust a tilt of the at least one focus image renderer, so as to change the location of the projection of the rendered focus image incident upon the exit optical element.

14. The method of claim 11, wherein the display apparatus further comprises a gaze-tracking unit comprising at least one photo sensor positioned behind the second semi-transparent reflective element, and wherein the method further comprises using the at least one photo sensor to sense reflections of light from a user'"'"'s eye when the display apparatus is worn by the user.

15. The method of claim 11, further comprising arranging for the second semi-transparent reflective element to allow a projection of a real-world image to pass through towards the first semi-transparent reflective element, whereat the projection of the real-world image is optically combined with the projection of the rendered context image and the projection of the rendered focus image to create the visual scene.

16. The method of claim 15, wherein the display apparatus further comprises at least one optical filter positioned behind the second semi-transparent reflective element, and the method further comprises using the at least one optical filter to adjust light transmittance of the projection of the real-world image passing through the at least one optical filter.