Integrated sensing display

• US 7,535,468 B2
• Filed: 06/21/2004
• Issued: 05/19/2009
• Est. Priority Date: 06/21/2004
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Uy, Michael
• Primary Examiner(s): Nguyen; Kevin M
• Application Number:
  US10/873,575
• Publication Number:
  US 20060007222A1
• Time in Patent Office: 1,793 Days
• Field of Search: 345/104, 345/207, 345/107, 345/214, 348/14.07, 348/211.12, 348/333.1, 348/294
• US Class Current: 345/207
• CPC Class Codes: G02F 1/13312 Circuits comprising photodetectors for purposes other than feedback
• CPC Class Codes: G02F 1/13338 Input devices, e.g. touch panels
• CPC Class Codes: H01L 27/14601 Structural or functional details thereof
• CPC Class Codes: H01L 27/14603 Special geometry or disposition of pixel-elements, address-lines or gate-electrodes
• CPC Class Codes: H04N 25/702 SSIS architectures characterised by non-identical, non-equidistant or non-planar pixel layout

Abstract

An integrated sensing display is disclosed. The sensing display includes display elements integrated with image sensing elements. As a result, the integrated sensing device can not only output images (e.g., as a display) but also input images (e.g., as a camera).

Claims

1. A device comprising:

a display panel;

an array of display elements located within the display panel, each display element capable of displaying a pixel of information, either alone or in combination with other display elements; and

an array of image elements located within the display panel, each image element being capable of capturing visual information from a source in front of the display panel simultaneously with each display element displaying the pixel of information, each image element corresponding to a single pixel, each image element being shielded from light coming from the array of display elements, wherein the array of image elements is a two-dimensional array distributed among the array of display elements,

wherein each image element has an individual sensor and an individual lens that is specific to the individual sensor, the individual lens for each individual sensor being placed over the individual sensor, and wherein each individual lens does not interfere with any display elements.

2. The device of claim 1, wherein the image elements are located in a housing that isolates the image elements from the display elements and blocks the light coming from the array of display elements.

3. The device of claim 2, wherein each image element is in its own housing.

4. The device of claim 3, wherein a row of image elements share a housing.

5. The device of claim 4, wherein the array of display elements is formed in a deep encased cell structure.

6. The device of claim 1, wherein the array of display elements is formed in a deep encased cell structure.

7. The device of claim 1, wherein the array of image elements is formed in a plurality of deep wells or channels.

8. The device of claim 1 further comprising an image assembler that modifies the data that is received by the array of image elements, the image assembler being arranged to compensate for distortion associated with the array of image elements.

9. The device of claim 1, wherein the image elements are dispersed within the display panel such that they do not block any display elements.

10. The device of claim 1, wherein the image elements are dispersed within the display panel in such a way that they prevent some pixels of information from being displayed.

11. The device of claim 1, wherein the device is used in a portable communication device.

12. The device of claim 11, wherein the portable communication device is a telephone.

13. The device of claim 11, wherein the portable communication device is personal digital assistant.

14. The device of claim 1, wherein the device is used in a computer monitor or a television.

15. The device of claim 1 wherein the display panel is a liquid crystal display (LCD) panel.

16. The device of claim 1 wherein the array of image elements includes a first image element and a second image element, the first image element having a first associated fixed focal length, the second image element having a second associated fixed focal length.

17. A device comprising:

a display panel;

an array of display elements located within the display panel, each display element capable of displaying a pixel of information, either alone or in combination with other display elements;

an array of image elements located within the display panel, each image element being capable of capturing visual information from a source in front of the display panel, wherein the array of image elements is dispersed amongst the array of display elements and light coming from the array of display elements is blocked from each image element, wherein the display panel is an embedded macro charge-coupled device (CCD); and

an image assembler, the image assembler being arranged to compensate for distortion associated with the array of image elements.

18. The device of claim 17, wherein the image elements are located in a housing that isolates the image elements from the display elements and blocks the light from the image elements.

19. The device of claim 18, wherein each image element is in its own housing.

20. The device of claim 18, wherein a row of image elements share a housing.

21. The device of claim 17 wherein each image element corresponds to a single pixel.

22. A device comprising:

a display panel;

an array of display elements located within the display panel, each display element of the array of display elements capable of displaying a pixel of information either individually or in combination with other display elements of the array of display elements; and

an array of image elements located within the display panel, the array of image elements being a two-dimensional array distributed among the array of display elements, the array of image elements including at least a first image element and a second image element, the first image element and the second image element each being capable of capturing visual information from a source in front of the display panel simultaneously with each display element of the array of display elements displaying the pixel of information, the first image element corresponding to a first pixel and being shielded from light coming from the array of display elements, the second image element corresponding to a second pixel and being shielded from light coming from the array of display elements,

wherein the first image element has a first sensor and a first lens that is specific to the first sensor, wherein the second image element has a second sensor and a second lens that is specific to the second sensor, the first lens and the second lens being arranged not to interfere with the array of display elements.