LED/OLED array approach to integrated display, lensless-camera, and touch-screen user interface devices and associated processors

• US 9,626,023 B2
• Filed: 07/11/2011
• Issued: 04/18/2017
• Est. Priority Date: 07/09/2010
• Status: Active Grant

• Current Assignee: NRI R&D Patent Licensing, LLC (Advanced Touchscreen and Gesture Technologies, LLC)
• Original Assignee: Lester F. Ludwig
• Inventors: Ludwig, Lester F.
• Primary Examiner(s): LUU, THANH X
• Application Number:
  US13/180,345
• Publication Number:
  US 20120006978A1
• Time in Patent Office: 2,108 Days
• Field of Search: 250221, 345 82, 345 83
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G09G 2300/023 Display panel composed of stacked panels
• CPC Class Codes: G09G 2300/0452 Details of colour pixel setup, e.g. pixel composed of a red, a blue and two green components
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 3/3216 using a passive matrix

Abstract

A system for implementing a display which also serves as one or more of a tactile user interface touchscreen, light field sensor, proximate hand gesture sensor, and lensless imaging camera. In an implementation, an OLED array can be used for light sensing as well as light emission functions. In one implementation a single OLED array is used as the only optoelectronic user interface element in the system. In another implementation two OLED arrays are used, each performing and/or optimized from different functions. In another implementation, an LCD and an OLED array are used in various configurations. The resulting arrangements allow for sharing of both optoelectric devices as well as associated electronics and computational processors, and are accordingly advantageous for use in handheld devices such as cellphone, smartphones, PDAs, tablet computers, and other such devices.

Claims

1. A system for implementing the function of a visual display, light field sensor, and a user interface, the system comprising:

an organic light emitting diode (OLED) array comprising at least a plurality of OLEDs;

an optical vignetting arrangement overlaid on the OLED array to provide a plurality of distinct vignettes of a distant incoming light field structured by the vignetting arrangement, wherein the vignetting arrangement is configured to implement a lensless imaging camera, wherein each distinct vignette of the incoming light field is directed to an associated individual OLED from the plurality of OLEDs, wherein each of the individual OLED performs a light detection function at least for an interval of time, the light detection function comprising a photoelectric effect;

a light emitting arrangement associated with the OLED array, the light emitting arrangement to provide the visual display; and

a processor operatively coupled to an electrical interface and configured to;

receive, via the electrical interface, the photoelectric effect; and

obtain light field measurement information responsive to the incoming light field based on the photoelectric effect.

2. The system of claim 1 wherein the light emitting arrangement is provided by OLEDs in the OLED array.

3. The system of claim 1 wherein the light emitting arrangement is provided by another OLED array.

4. The system of claim 1 wherein the organic light emitting diode (OLED) array is transparent and the light emitting arrangement is provided by a liquid crystal display (LCD).

5. The system of claim 1 wherein the light field measurement information is used to create light field sensor output information.

6. The system of claim 5 wherein the light field sensor output information is used to implement a proximity hand gesture user interface.

7. The system of claim 5 wherein light field sensor output information is used to implement a tactile user interface.

8. The system of claim 1 wherein the light emitting arrangement comprises a plurality of OLEDs, wherein each OLED is operated in at least two of:

a light emission state, a light detection state, and an idle state.

9. The system of claim 1 wherein the system is configured to operate as both an image display and light-field sensor.

10. The system of claim 1 where the system is configured to implement a tactile user interface.

11. The system of claim 1 where the system is configured to implement a user interface touch screen.

12. The system of claim 1 wherein the system is configured to implement a proximate image user interface sensor.

13. The system of claim 1 where the system is configured to implement a lensless imaging camera.

14. The system of claim 1 where the system is comprised within a cellphone.

15. The system of claim 1 where the system is comprised within a smartphone.

16. The system of claim 1 where the system is comprised within a Personal Digital Assistant (“

PDA”

).

17. The system of claim 1 where the system is comprised within a tablet computer.

18. The system of claim 1 wherein the system is configured to operate simultaneously as a camera and as a display.

19. The system of claim 18 wherein the system is further configured to provide improved eye-contact in video conferencing applications.

20. The system of claim 1 wherein the system is configured to operate simultaneously as a video camera.