System for adaptive displays

• US 8,547,421 B2
• Filed: 08/13/2010
• Issued: 10/01/2013
• Est. Priority Date: 08/13/2010
• Status: Active Grant

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Yuan, Chang, Daly, Scott J.
• Primary Examiner(s): Rao, Andy
• Application Number:
  US12/856,184
• Publication Number:
  US 20120038751A1
• Time in Patent Office: 1,145 Days
• Field of Search: 348 42- 60, 348162-171
• US Class Current: 348/51
• CPC Class Codes: G06T 7/571 from focus
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio

Abstract

A display includes an integrated imaging sensor and a plurality of pixels. The imaging sensor integrated within the display includes a plurality of individual sensors each of which provides an output. The content of the display is modified based upon the sensed content.

Claims

1. A display with an integrated imaging sensor comprising:

(a) said display including a plurality of pixels;

(b) said imaging sensor integrated within said display and including a plurality of individual sensors each of which provides an output;

(c) processing said output of each of said individual sensors to generate an image;

(d) differentiating between a direct light source of said image from light originating external to said display having a visible light spectrum and a reflected light source of said image from light originating internal to said display having an infra red light spectrum;

(e) wherein a display image displayed on said display is modified based upon said output.

2. The display of claim 1 wherein said displayed image displayed on said display is modified in accordance with said differentiating.

3. The display of claim 2 wherein only a part of said displayed image is modified in accordance with said differentiating.

4. The display of claim 1 wherein said imaging sensor includes a photoreceptor, a filter, and a micro lens per each imaging sensor element.

5. The display of claim 4 wherein said filter is a visible light filter.

6. The display of claim 4 wherein said filter is an infra-red light filter.

7. The display of claim 6 wherein said display further includes an infra-red light source.

8. The display of claim 1 wherein said imaging sensors are interspersed in said display pixel array.

9. The display of claim 1 wherein said sensor includes a lens constructed from liquid crystal material.

10. The display of claim 1 wherein said sensors are arranged in such a manner to sense a three dimensional structure in front of said display.

11. The display of claim 10 wherein said sensors have a different focal length based upon different voltages applied to a liquid crystal layer of said display.

12. The display of claim 10 wherein said display generates a three dimensional depth image of the scene.

13. The display of claim 1 wherein a viewing environment associated with said display includes direct light sources.

14. The display of claim 1 wherein a viewing environment associated with said display includes light reflective surfaces.

15. The display of claim 1 wherein a viewing environment associated with said display includes a viewer.

16. The display of claim 15 wherein said depth image is a color image.

17. A display with an integrated imaging sensor comprising;

(a) said display including a plurality of pixels;

(b) said imaging sensor integrated within said display and including a plurality of individual sensors each of which provides an output, and said sensors differentiating between a direct light source of a sensed image from light originating external to said display having a visible light spectrum and a reflected light source of said sensed image from light originating internal to said display having an infra red light spectrum;

(c) processing said output of each of said individual sensors to generate a three-dimensional image including color and depth;

(d) modifying different portions of said displayed image on said display differently based upon said color and said depth.

18. The display of claim 17 wherein said modifying includes modification of the colors of said displayed image.

19. The display of claim 17 wherein said processing includes color image normalization.

20. The display of claim 19 wherein said processing includes color image reconstruction.

21. The display of claim 20 wherein said processing includes direct light source estimation.

22. The display of claim 21 wherein said processing includes three dimensional depth reconstruction.

23. The display of claim 22 wherein said processing includes reflective lighting estimation.