Use of LED or OLED array to implement integrated combinations of touch screen tactile, touch gesture sensor, color image display, hand-image gesture sensor, document scanner, secure optical data exchange, and fingerprint processing capabilities

• US 9,632,344 B2
• Filed: 08/07/2013
• Issued: 04/25/2017
• Est. Priority Date: 07/09/2010
• Status: Expired due to Fees

• Current Assignee: NRI R&D Patent Licensing, LLC (Advanced Touchscreen and Gesture Technologies, LLC)
• Original Assignee: Lester F. Ludwig
• Inventors: Ludwig, Lester F.
• Primary Examiner(s): Luu, Thanh
• Application Number:
  US13/961,611
• Publication Number:
  US 20140036168A1
• Time in Patent Office: 1,357 Days
• Field of Search: 250221, 345 82, 345 83
• CPC Class Codes: G02F 1/13338 Input devices, e.g. touch panels
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0446 using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 40/1353 Extracting features related to minutiae or pores
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H10K 2102/3031 Two-side emission, e.g. transparent OLEDs [TOLED]
• CPC Class Codes: H10K 59/40 OLEDs integrated with touch screens
• CPC Class Codes: H10K 59/50 OLEDs integrated with light modulating elements, e.g. with electrochromic elements, photochromic elements or liquid crystal elements
• CPC Class Codes: H10K 59/60 OLEDs integrated with inorganic light-sensitive elements, e.g. with inorganic solar cells or inorganic photodiodes

Abstract

A system and method for implementing a display which also serves as one or more of a tactile user interface touchscreen, proximate hand gesture sensor, light field sensor, lensless imaging camera, document scanner, fingerprint scanner, and secure optical communications interface. In an implementation, an OLED array can be used for light sensing as well as light emission functions. In one implementation a single OLED array is used as the only optoelectronic user interface element in the system. In another implementation two OLED arrays are used, each performing and/or optimized from different functions. In another implementation, an LCD and an OLED array are used in various configurations. The resulting arrangements allow for sharing of both optoelectric devices as well as associated electronics and computational processors, and are accordingly advantageous for use in handheld devices such as cellphone, smartphones, PDAs, tablet computers, and other such devices.

Claims

1. A system for implementing integrated combinations of a touch screen tactile sensor, a touch gesture sensor, a color image display, and one or more of a hand-image gesture sensor, a document scanner, a secure optical data exchange, and fingerprint processing capabilities, the system comprising:

a display comprising an organic light emitting diode (OLED) array, the OLED array comprising a plurality of individual OLEDs, the OLED array configured for both light-emitting and light sensing capabilities, wherein each OLED can emit modulated light and the system is responsive to reflection of modulated light from at least a human finger to the OLED array, the modulated light being used for the selective detection of reflected modulated light and the rejection of non-reflected light;

a controller operatively coupled to an electrical interface, the controller interfaced to the OLED array via the electrical interface, the controller further comprising software implementing at least one reflected-light image-formation operation and software implementing at least one non-reflected-light image-formation operation;

wherein the OLED array is to selectively operate as a color image display with touch screen tactile sensor implementing touch sensing suitable for touch gesture processing and selectively operate at least one non-reflected light imaging application,

wherein the touch screen tactile sensor operation implementing touch sensing when selectively active employs the reflected-light image-formation operation, and

wherein the at least one non-reflected light imaging application when selectively active employs the non-reflected-light image-formation operation.

2. The system of claim 1, wherein the controller is a processor operatively coupled to a memory storing one or more algorithms implemented as software for executing on the controller.

3. The system of claim 1, wherein at least some of the individual OLEDs perform a light detection function at least for an interval of time, the light detection function comprising a photoelectric effect that is communicated to the controller via the electrical interface of the processor.

4. The system of claim 1, wherein the system further comprises software implementing gesture user interface recognition and parameter extraction functions.

5. The system of claim 1, wherein the OLED array is further configured to comprise a vignetting arrangement designed to impose a specific structure on an incoming light field to create a structured light field suitable for image formation of non-reflected light by the non-reflected-light image-formation operation.

6. The system of claim 1, wherein the OLED array is further provided with a vignetting arrangement designed to impose a specific structure on an incoming light field to create a structured light field suitable for image formation of non-reflected light by the non-reflected-light image-formation operation.

7. The system of claim 5, wherein the resulting system is further configured to selectively operated as a light-field sensor utilizing the non-reflected-light image-formation operation.

8. The system of claim 6, wherein the resulting system is further configured to selectively operated as a light-field sensor utilizing the non-reflected-light image-formation operation.

9. The system of claim 7, wherein the system is further configured to implement a lensless imaging camera.

10. The system of claim 8, wherein the controller is further configured to implement a lensless imaging camera.

11. The system of claim 1, wherein the controller is further configured to execute image formation functions utilizing the non-reflected-light image-operation.

12. The system of claim 1, wherein the system is further configured to operate as a proximate hand gesture sensor utilizing the non-reflected-light image-formation operation.

13. The system of claim 1, wherein the non-reflected-light image-formation operation comprises proximate hand gesture processing functions.

14. The system of claim 1, wherein the system is further configured to operate as a document scanner utilizing the reflected-light image-formation operation.

15. The system of claim 14, the system further comprising software implementing document scanner processing functions.

16. The system of claim 1, wherein the optical image sensing resolution of the OLED array is sufficient for the system to operate as a fingerprint scanner.

17. The system of claim 1, wherein the system is further configured to operate as a fingerprint scanner utilizing the reflected-light image-formation operation.

18. The system of claim 1, the system further comprising software implementing fingerprint processing functions.

19. The system of claim 1, wherein the system is further configured to operate as a secure optical communications interface utilizing at least the OLED sensing capability of the OLED array.

20. The system of claim 1, the system further comprising software implementing optical communications processing functions facilitating optical communications exchange with at least a display of another system.