Camera integrated into a display

• US 9,870,024 B2
• Filed: 08/08/2016
• Issued: 01/16/2018
• Est. Priority Date: 10/30/2015
• Status: Expired due to Fees

• Current Assignee: Essential Products, Inc.
• Original Assignee: Essential Products, Inc.
• Inventors: Evans, V, David John, Jiang, Xinrui, Rubin, Andrew E., Hershenson, Matthew, Miao, Xiaoyu, Tate, Joseph Anthony, Gagne-Keats, Jason Sean
• Primary Examiner(s): Kim, Dennis Y
• Application Number:
  US15/231,664
• Publication Number:
  US 20170123454A1
• Time in Patent Office: 526 Days
• Field of Search: None
• CPC Class Codes: G02F 1/133305 Flexible substrates, e.g. plastics, organic film
• CPC Class Codes: G02F 1/13338 Input devices, e.g. touch panels
• CPC Class Codes: G02F 1/133514 Colour filters
• CPC Class Codes: G02F 1/133526 Lenses, e.g. microlenses or Fresnel lenses
• CPC Class Codes: G02F 1/1368 in which the switching element is a three-electrode device G02F1/136277 takes precedence
• CPC Class Codes: G06F 1/1605 Multimedia displays, e.g. with integrated or attached speakers, cameras, microphones
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: H01L 27/14621 Colour filter arrangements
• CPC Class Codes: H01L 27/14623 Optical shielding
• CPC Class Codes: H01L 27/14627 Microlenses
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H10K 50/858 comprising refractive means, e.g. lenses
• CPC Class Codes: H10K 59/1201 Manufacture or treatment
• CPC Class Codes: H10K 59/1213 the pixel elements being TFTs
• CPC Class Codes: H10K 59/124 Insulating layers formed between TFT elements and OLED elements
• CPC Class Codes: H10K 59/126 Shielding, e.g. light-blocking means over the TFTs
• CPC Class Codes: H10K 59/38 : comprising colour filters or colour changing media [CCM]
• CPC Class Codes: H10K 59/40 : OLEDs integrated with touch screens
• CPC Class Codes: H10K 59/60 : OLEDs integrated with inorganic light-sensitive elements, e.g. with inorganic solar cells or inorganic photodiodes
• CPC Class Codes: H10K 59/879 : comprising refractive means, e.g. lenses

Abstract

Certain aspects of the technology disclosed herein integrate a camera with an electronic display. An electronic display includes several layers, such as a cover layer, a color filter layer, a display layer including light emitting diodes or organic light emitting diodes, a thin film transistor layer, etc. In one embodiment, the layers include a substantially transparent region disposed above the camera. The substantially transparent region allows light from outside to reach the camera, enabling the camera to record an image. In another embodiment, the color filter layer does not include a substantially transparent region, and the camera records the light from the outside colored by the color filter layer. According to another embodiment, while none of the layers include a substantially transparent region, the layers are all substantially transparent, and the camera disposed beneath the layers records light reaching the camera from outside.

Claims

1. A display including a camera integrated into the display, the camera configured to record an image, and the camera configured to represent a camera icon associated with the display, the display comprising:

a substantially transparent cover layer defining an outside surface associated with the display;

a color filter (CF) layer disposed beneath the substantially transparent cover layer, the CF layer comprising a CF substrate and a plurality of color regions disposed on the CF substrate, wherein each of the plurality of color regions corresponds to one of red, green, and blue, the plurality of color regions having a first size and a second size, wherein the first size corresponds to a size of a pixel associated with the camera;

a liquid crystal display (LCD) layer disposed beneath the CF layer, the LCD layer comprising an LCD substrate and a plurality of liquid crystals disposed on the LCD substrate, the plurality of liquid crystals configured to assume a first arrangement and a second arrangement, wherein the first arrangement transmits light, and wherein the second arrangement blocks light;

a thin film transistor (TFT) layer disposed beneath the LCD layer, the TFT layer comprising a TFT substrate and a plurality of TFTs disposed on the TFT substrate; and

the camera disposed beneath the CF layer, the LCD layer and the TFT layer, the camera configured to record the image through the CF layer, the LCD layer and the TFT layer, the camera comprising a plurality of pixels corresponding to the plurality of color regions having the first size and associated with the CF layer, wherein each pixel in the plurality of pixels comprises a separate lens and a separate photodetector, wherein each lens associated with each pixel is optimized to focus a colored light beam received through the CF layer above the camera; and

wherein each color region associated with the CF layer and disposed above the camera is smaller than a color region associated with the CF layer and not disposed above the camera.

2. The display of claim 1, the plurality of pixels comprising a plurality of noncontiguous pixel regions.

3. A display including a camera integrated into the display, the display comprising:

a substantially transparent cover layer defining an outside surface associated with the display;

a color filter (CF) layer disposed beneath the substantially transparent cover layer, the CF layer comprising a CF substrate and a plurality of color regions disposed on the CF substrate, the plurality of color regions having a first size and a second size, wherein the first size corresponds to a size of a pixel associated with the camera;

a display layer disposed beneath the CF layer, the display layer comprising a display substrate and a plurality of display elements disposed on the display substrate, the plurality of display elements configured to transmit light;

a thin film transistor (TFT) layer disposed beneath the substantially transparent cover layer, the TFT layer comprising a TFT substrate and a plurality of TFTs disposed on the TFT substrate; and

the camera disposed beneath the CF layer, the display layer and the TFT layer, the camera configured to record an image through the CF layer, the display layer and the TFT layer, the camera comprising a plurality of pixels corresponding to the plurality of color regions having the first size and associated with the CF layer, the plurality of pixels corresponding to the plurality of TFTs, wherein each pixel in the plurality of pixels comprises a separate lens and a separate photodetector, wherein each lens associated with each pixel is optimized to focus a colored light beam received through the CF layer above the camera; and

wherein each color region associated with the CF layer and disposed above the camera is smaller than a color region associated with the CF layer and not disposed above the camera.

4. The display of claim 3, the display layer comprising an organic light emitting diode (OLED) layer disposed beneath the CF layer, the OLED layer comprising an OLED substrate and a plurality of OLEDs disposed on the OLED substrate.

5. The display of claim 3, the display configured to stop emitting light for a period of time when the plurality of pixels is recording the image, wherein the period of time comprises less than 1/60 second.

6. The display of claim 3, the display layer comprising a liquid crystal display (LCD) layer disposed beneath the CF layer, the LCD layer comprising an LCD substrate and a plurality of liquid crystals disposed on the LCD substrate, the plurality of liquid crystals configured to assume a first arrangement and a second arrangement, wherein the first arrangement transmits light, and wherein the second arrangement blocks light.

7. The display of claim 3, when the photodetector is within a saturation threshold, the plurality of TFTs configured to block the light.

8. The display of claim 3, comprising a processor configured to:

when the plurality of pixels is recording the image, cause a subset of TFTs to block light, wherein the subset of TFTs corresponds to the pixel recording a particular section of the electromagnetic spectrum.

9. The display of claim 3, further comprising a plurality of lenses corresponding to the plurality of pixels, the plurality of lenses comprising at least one of:

a substantially transparent cover layer lens disposed on the substantially transparent cover layer;

a CF layer lens disposed on the CF substrate;

a display layer lens disposed on the display substrate;

or

a TFT layer lens disposed on the TFT substrate.

10. The display of claim 9, the plurality of lenses comprising a plurality of effective focal lengths.

11. The display of claim 10, further comprising a processor configured to gather a plurality of images corresponding to the plurality of pixels, and to produce the image comprising depth information.

12. The display of claim 3, the plurality of pixels grouped into a plurality of noncontiguous groups.

13. The display of claim 3, the CF layer comprising a red color region, a green color region, a blue color region, and a white color region, wherein the white color region can transmit substantially the full electromagnetic spectrum.

14. The display of claim 13, wherein any of an infrared (IR) sensor, an ambient sensor, or the pixel associated with the camera are placed beneath the white color region.

15. A display including a camera integrated into the display, the display comprising:

a substantially transparent cover layer defining an outside surface associated with the display;

a color filter (CF) layer disposed beneath the substantially transparent cover layer, the CF layer comprising a CF substrate and a plurality of color regions disposed on the CF substrate, the plurality of color regions having a first size and a second size, wherein the first size corresponds to a size of a pixel associated with the camera;

a display layer disposed beneath the substantially transparent cover layer, the display layer comprising a display substrate and a plurality of display elements disposed on the display substrate, the plurality of display elements configured to transmit light;

a thin film transistor (TFT) layer disposed beneath the substantially transparent cover layer, the TFT layer comprising a TFT substrate and a plurality of TFTs disposed on the TFT substrate; and

the camera disposed beneath the display layer, and the TFT layer, the camera configured to record an image through the CF layer, the display layer and the TFT layer, the camera comprising a plurality of pixels corresponding to the plurality of color regions having the first size and associated with the CF layer, wherein each pixel in the plurality of pixels comprises a separate lens and a separate photodetector, wherein each lens associated with each pixel is optimized to focus a colored light beam received through the CF layer above the camera; and

wherein each color region associated with the CF layer and disposed above the camera is smaller than a color region associated with the CF layer and not disposed above the camera.

16. The display of claim 15, further comprising a plurality of lenses corresponding to the plurality of pixels, the plurality of lenses comprising at least one of:

a substantially transparent cover layer lens disposed on the substantially transparent cover layer;

a display layer lens disposed on the display substrate;

or

a TFT layer lens disposed on the TFT substrate.

17. The display of claim 16, the plurality of lenses comprising a plurality of effective focal lengths.

18. The display of claim 16, further comprising a processor configured to gather a plurality of images corresponding to the plurality of pixels, and to produce the image comprising depth information.

19. The display of claim 15, the plurality of pixels grouped into a plurality of noncontiguous groups.

20. The display of claim 15, the plurality of pixels comprising an IR sensor, or ambient sensor.

21. The display of claim 15, the display configured to stop emitting light, when the plurality of pixels is recording the image.

22. The display of claim 15, the display layer comprising an organic light emitting diode (OLED) layer disposed beneath the substantially transparent cover layer, the OLED layer comprising an OLED substrate and a plurality of OLEDs disposed on the OLED substrate.

23. The display of claim 15, the display substrate, and the TFT substrate formed into a half round shape.

24. The display of claim 15, the display substrate, and the TFT substrate formed into an ellipsoid shape.

25. The display of claim 15, comprising a touch sensor layer disposed proximate to the camera, the touch sensor layer activating the camera when the touch sensor layer is activated.

26. The display of claim 25, the touch sensor layer comprising a plurality of noncontiguous touch sensor regions.

27. The display of claim 25, when the touch sensor layer is activated, the camera is configured to record the image of an object activating the touch sensor layer.

28. A method to integrate a camera into a display, the method comprising:

providing a substantially transparent cover layer defining an outside surface associated with the display;

providing a color filter (CF) layer disposed beneath the substantially transparent cover layer, the CF layer comprising a CF substrate and a plurality of color regions disposed on the CF substrate, the plurality of color regions having a first size and a second size, wherein the first size corresponds to a size of a pixel associated with the camera;

providing a display layer disposed beneath the substantially transparent cover layer, the display layer comprising a display substrate and a plurality of display elements disposed on the display substrate, the plurality of display elements configured to transmit light;

providing a transparent thin film transistor (TFT) layer disposed beneath the substantially transparent cover layer, the TFT layer comprising a TFT substrate and a plurality of TFTs disposed on the TFT substrate; and

providing the camera disposed beneath the display layer, and the TFT layer, the camera configured to record an image through the CF layer, the display layer and the TFT layer, the camera comprising a plurality of pixels corresponding to the plurality of color regions having the first size and associated with the CF layer, wherein the plurality of pixels are disposed in a plurality of noncontiguous regions, wherein each pixel in the plurality of pixels comprises a separate lens and a separate photodetector, wherein each lens associated with each pixel is optimized to focus a colored light beam received through the CF layer above the camera; and

wherein each color region associated with the CF layer and disposed above the camera is smaller than a color region associated with the CF layer and not disposed above the camera.

29. The method of claim 28, comprising providing a plurality of lenses corresponding to the plurality of pixels, the plurality of lenses comprising at least one of:

a substantially transparent cover layer lens disposed on the substantially transparent cover layer;

a display layer lens disposed on the display substrate; and

a TFT layer lens disposed on the TFT substrate.

30. The method of claim 29, comprising based on a plurality of images corresponding to the plurality of pixels, producing, by a processor, the image comprising depth information.

31. A system comprising:

a substantially transparent cover layer defining an outside surface associated with a display;

a display layer disposed beneath the substantially transparent cover layer, the display layer comprising a display substrate and a plurality of display elements disposed on the display substrate, the plurality of display elements configured to transmit light;

a color filter (CF) layer disposed beneath the substantially transparent cover layer, the CF layer comprising a CF substrate and a plurality of color regions disposed on the CF substrate, the plurality of color regions having a first size and a second size, wherein the first size corresponds to a size of a pixel associated with the camera;

a thin film transistor (TFT) layer disposed beneath the substantially transparent cover layer, the TFT layer comprising a TFT substrate and a plurality of TFTs disposed on the TFT substrate, the TFT layer configured to act as a shutter controlling exposure of a light sensor;

the light sensor disposed beneath the display layer, the CF layer and the TFT layer, the light sensor configured to detect light passing through the display layer, CF layer and TFT layer, the light sensor comprising a plurality of pixels corresponding to the plurality of color regions having the first size and associated with the CF layer, wherein each pixel in the plurality of pixels comprises a separate lens and a separate photodetector, the light sensor comprising a plurality of lenses, wherein each lens in the plurality of lenses associated with each pixel is optimized to focus a colored light beam received through the CF layer above the light sensor; and

wherein each color region associated with the CF layer and disposed above the light sensor is smaller than a color region associated with the CF layer and not disposed above the light sensor.