Display system and image display method

• US 10,690,924 B2
• Filed: 12/12/2017
• Issued: 06/23/2020
• Est. Priority Date: 04/28/2017
• Status: Active Grant

• Current Assignee: BOE Technology Group Co., Ltd.
• Original Assignee: BOE Technology Group Co., Ltd.
• Inventors: Hong, Tao
• Primary Examiner(s): Eisen, Alexander
• Assistant Examiner(s): Almeida, Cory A
• Application Number:
  US16/063,723
• Publication Number:
  US 20190331918A1
• Time in Patent Office: 924 Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/145 having sequential partially reflecting surfaces
• CPC Class Codes: G02B 6/0015 provided on the surface of the light guide or in the bulk of it
• CPC Class Codes: G02B 6/003 Lens or lenticular sheet or layer
• CPC Class Codes: G02B 6/0035 provided on the surface of the light guide or in the bulk of it
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2370/20 Details of the management of multiple sources of image data
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence

Abstract

A display system and an image display method are disclosed. The display system includes an image display device, an optical waveguide element, an image acquisition device and a calibration device. The image acquisition device is provided at the display side of the image display device, and is configured to be capable of simultaneously acquiring the surrounding image and the first image acquired by, the image acquisition device; and the calibration device is configured to obtain matching information based on the surrounding image and the first image.

Claims

1. A display system comprising:

an image display device, an image acquisition device and a calibration device,

wherein at least part of the image display device is configured to be at least partially transparent, so as to at least partially receive a surrounding image for an opposite side of the image display device at a display side of the image display device;

the image display device is further configured to display a first image received by the image display device at the display side;

the image acquisition device is provided at the display side of the image display device, and is configured to be capable of simultaneously acquiring the surrounding image and the first image;

the calibration device is configured to obtain matching information based on the surrounding image and the first image acquired by the image acquisition device;

the display system further comprises an optical waveguide element; and

the optical waveguide element is configured to receive light of the first image, transmit the light of the first image to the image display device, so as to allow the image display device to display the first image at the display side; and

the calibration device is configured to obtain information regarding scene object in the surrounding image and information regarding image object in the first image, and obtain the matching information based on the information regarding the scene object and the information regarding the image object.

2. The display system according to claim 1, further comprising a projection device, wherein the projection device is configured to transmit the first image so as to allow the light of the first image is outputted into the optical waveguide element.

3. The display system according to claim 2, further comprising a display element, wherein the projection device is configured to collimate the light of the first image outputted by the display element into parallel light, and then transmit the light of the first image into the optical waveguide element.

4. The display system according to claim 3, further comprising an image processing device, wherein the image processing device is configured to output an image display signal for the display element.

5. The display system according to claim 4, wherein the image processing device is configured to drive the display element to display the first image, and is further configured to drive the display element to refresh the first image based on the matching information.

6. The display system according to claim 4, further comprising a controller, wherein the controller is configured to control the first image outputted into the optical waveguide element according to the matching information.

7. The display system according to claim 6, wherein the controller is configured to control the image display signal outputted by the image processing device according to the matching information, and to control the first image displayed by the display element according to the image display signal, so as to control the first image outputted into the optical waveguide element.

8. The display system according to claim 1, wherein

the optical waveguide element and the image display device are combined with each other, or integrally formed, so as to obtain an optical waveguide body;

the optical waveguide element comprises an image import structure, the image display device comprises an image export structure; and

the optical waveguide body comprises a first end and a second end, and the image import structure and the image export structure are arranged in the optical waveguide body.

9. The display system according to claim 8, wherein the image import structure is configured to allow a propagation angle of the light of the first image to satisfy total reflection condition of the optical waveguide body.

10. The display system according to claim 8, wherein the image import structure is arranged in the first end of the optical waveguide body, and is configured to import the light of the first image into the optical waveguide body by reflection.

11. The display system according to claim 8, wherein the image export structure comprises a plurality of half-transparent and half-reflective surfaces arranged in parallel.

12. The display system according to claim 11, wherein reflectivity of the plurality of half-transparent and half-reflective surfaces are increased sequentially, and reflectivity of the half-transparent and half-reflective surface closer to the second end is larger than reflectivity of the half-transparent and half-reflective surface closer to the first end.

13. The display system according to claim 12, wherein the image acquisition device is arranged a position at the display side and corresponding to the second end of the optical waveguide body, and is opposite to the half-transparent and half-reflective surface closer to the second end.

14. The display system according to claim 1, further comprising a second image display device and a second optical waveguide element,

wherein at least part of the second image display device is configured to be at least partially transparent, so as to at least partially receive a surrounding image for an opposite side of the second image display device;

and

the second optical waveguide element is configured to receive light of the second image, and transmit the light of the second image to the second image display device, so as to allow the second image display device to display the second image at the display side.

15. The display system according to claim 14, wherein the image display device and the second image display device are adjacent to each other and arranged in parallel.

16. The display system according to claim 14, further comprising a second image acquisition device, wherein the second image acquisition device is arranged at a display side of the second image display device, and is configured to be capable of simultaneously acquiring the surrounding image and the second image, which are outputted to the display side of the second image display device.

17. An image display method, comprising:

receiving light of a first image, and transmitting the light of the first image to a display side;

allowing light of a surrounding image for an opposite side to be capable of being outputted at the display side through transmission of light;

simultaneously acquiring the surrounding image and the first image at the display side;

obtaining information regarding scene object in the surrounding image and information regarding image object in the first image;

obtaining matching information bases on the information regarding the scene object and the information regarding the image object; and

controlling the first image based on the matching information.

18. A display system, comprising:

an image display device, an image acquisition device and a calibration device,

wherein at least part of the image display device is configured to be at least partially transparent, so as to at least partially receive a surrounding image for an opposite side of the image display device at a display side of the image display device;

the image display device is further configured to display a first image received by the image display device at the display side;

the image acquisition device is provided at the display side of the image display device, and is configured to be capable of simultaneously acquiring the surrounding image and the first image;

the calibration device is configured to obtain matching information based on the surrounding image and the first image acquired by the image acquisition device;

the display system further comprises an optical waveguide element;

the optical waveguide element is configured to receive light of the first image, and transmit the light of the first image to the image display device, so as to allow the image display device to display the first image at the display side;

the optical waveguide element and the image display device are combined with each other, or integrally formed, so as to obtain an optical waveguide body;

the optical waveguide element comprises an image import structure, the image display device comprises an image export structure;

the optical waveguide body comprises a first end and a second end, and the image import structure and the image export structure are arranged in the optical waveguide body;

the image export structure comprises a plurality of half-transparent and half-reflective surfaces arranged in parallel;

the image acquisition device is arranged a position at the display side and corresponding to the second end of the optical waveguide body, and is opposite to the half-transparent and half-reflective surface closer to the second end; and

the calibration device is configured to obtain information regarding scene object in the surrounding image and information regarding image object in the first image, and obtain the matching information based on the information regarding the scene object and the information regarding the image object.