See-through type display apparatus and method of operating the same

• US 10,353,212 B2
• Filed: 09/19/2017
• Issued: 07/16/2019
• Est. Priority Date: 01/11/2017
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Seo, Juwon, Kim, Yuntae, Seo, Wontaek, Sung, Geeyoung, Lee, Hongseok
• Primary Examiner(s): Matt, Marnie A
• Application Number:
  US15/708,330
• Publication Number:
  US 20180196274A1
• Time in Patent Office: 665 Days
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/022 Viewing apparatus G02B27/04, G02B27/06, G02B27/08 take precedence
• CPC Class Codes: G02B 30/52 the 3D volume being constructed from a stack or sequence of 2D planes, e.g. depth sampling systems
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2380/10 Automotive applications
• CPC Class Codes: G09G 3/003 to produce spatial visual effects

Abstract

A see-through type display apparatus and a method of operating the see-through type display apparatus are provided. The see-through type display apparatus simultaneously outputs a plurality of two-dimensional (2D) images having different depth information onto different regions, produces a multi-layered depth image by sequentially arranging the plurality of 2D images according to the depth information, and causes the multi-layered depth image and a reality environment to converge onto one region.

Claims

1. A see-through type display apparatus comprising:

a spatial light modulator configured to simultaneously output a first two-dimensional (2D) image onto a first region and a second 2D image onto a second region that is different from the first region, the first 2D image having first depth information and the second 2D image having second depth information that is different from the first depth information;

a depth generation member configured to produce a multi-layered depth image by sequentially arranging the first 2D image and the at least second 2D image based on the first depth information and the second depth information; and

an image convergence member configured to cause the multi-layered depth image and a reality environment to converge onto a single region by changing at least one from among a light path of the multi-layered depth image and a light path of the reality environment,

wherein the depth generation member comprises;

a first depth generation member configured to reflect the first 2D image to the image convergence member; and

a second depth generation member configured to reflect the second 2D image to the image convergence member, and

wherein the second depth generation member is further configured to transmit the first 2D image reflected by the first depth generation member to the image convergence member.

2. The see-through type display apparatus of claim 1, wherein the depth generation member comprises at least one from among a mirror and a half-mirror.

3. The see-through type display apparatus of claim 1, wherein the first 2D image and the at least second 2D image are sequentially arranged on an optical axis of the depth generation member.

4. The see-through type display apparatus of claim 1, wherein for each respective 2D image from among the first 2D image and the at least second 2D image, a corresponding distance from the image convergence member varies directly with a level of depth information associated with the respective 2D image.

5. The see-through type display apparatus of claim 1, wherein at least two 2D images from among the first 2D image and the at least second 2D image have different brightnesses.

6. The see-through type display apparatus of claim 5, wherein for each respective 2D image from among the first 2D image and the at least second 2D image, a corresponding brightness varies directly with a level of depth information associated with the respective 2D image.

7. The see-through type display apparatus of claim 1, wherein at least two 2D images from among the first 2D image and the at least second 2D image have different sizes.

8. The see-through type display apparatus of claim 7, wherein for each respective 2D image from among the first 2D image and the at least second 2D image, a corresponding size varies directly with a level of depth information associated with the respective 2D image.

9. The see-through type display apparatus of claim 1, wherein each of the first 2D image and the at least second 2D image comprises a respective left-eye image and a respective right-eye image.

10. The see-through type display apparatus of claim 9, wherein for each respective 2D image from among the first 2D image and the at least second 2D image, the respective left-eye image and the respective right-eye image are simultaneously output onto different regions.

11. The see-through type display apparatus of claim 1, further comprising an expansion optical device configured to expand the multi-layered depth image, the expansion optical device being arranged between the depth generation member and the image convergence member.

12. The see-through type display apparatus of claim 1, wherein the image convergence member comprises at least one from among a beam splitter and a transflective film.

13. The see-through type display apparatus of claim 1, wherein the image convergence member comprises:

a first region; and

a second region having a curved interface which is in contact with the first region.

14. The see-through type display apparatus of claim 13, wherein a reflecting material is coated onto the interface of the second region.

15. A method of operating a see-through type display apparatus, the method comprising:

simultaneously outputting a first two-dimensional (2D) image onto a first region and at least a second 2D image onto a second region that is different from the first region, the first 2D image having first depth information and the second 2D image having second depth information that is different from the first depth information;

producing a multi-layered depth image by sequentially arranging the first 2D image and the at least second 2D image based on the first depth information and the second depth information; and

converging the multi-layered depth image and a reality environment onto a single region by changing at least one from among a light path of the multi-layered depth image and a light path of the reality environment,

wherein the producing of the multi-layered depth image comprises;

reflecting the first 2D image; and

reflecting the second 2D image while transmitting the first 2D image.

16. The method of claim 15, wherein the first depth information has a value that is greater than a value of the second depth information.

17. The method of claim 15, further comprising expanding the multi-layered depth image.