Integrated light emitting display and sensors for detecting biologic characteristics

• US 10,713,458 B2
• Filed: 06/08/2017
• Issued: 07/14/2020
• Est. Priority Date: 05/23/2016
• Status: Active Grant

• Current Assignee: Qualcomm Technologies Incorporated (Qualcomm, Inc.)
• Original Assignee: InSyte Systems
• Inventors: Bhat, Jerome Chandra, Olsen, Richard Ian
• Primary Examiner(s): Osinski, Michael S
• Application Number:
  US15/618,043
• Publication Number:
  US 20170337413A1
• Time in Patent Office: 1,132 Days
• CPC Class Codes: A61B 2562/0233 Special features of optical sensors or probes classified in A61B5/00
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: A61B 5/1172 using fingerprinting
• CPC Class Codes: G02B 6/0035 provided on the surface of the light guide or in the bulk of it
• CPC Class Codes: G02B 6/0036 2-D arrangement of prisms, protrusions, indentations or roughened surfaces
• CPC Class Codes: G02B 6/0093 Means for protecting the light guide
• CPC Class Codes: G06F 2218/00 Aspects of pattern recognition specially adapted for signal processing
• CPC Class Codes: G06V 40/1306 non-optical, e.g. ultrasonic or capacitive sensing
• CPC Class Codes: G06V 40/1318 using electro-optical elements or layers, e.g. electroluminescent sensing
• CPC Class Codes: G06V 40/1347 Preprocessing; Feature extraction
• CPC Class Codes: G06V 40/1365 Matching; Classification
• CPC Class Codes: G06V 40/1394 using acquisition arrangements
• CPC Class Codes: G06V 40/145 Sensors therefor
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities

Abstract

A bio-sensor device, integrated with a display portion, includes a surface for touching by a body part, such as a finger. A light source, such as an array of LEDs, emit light through the surface so as to be reflected and partially absorbed by the body part An array of photodetectors detects light reflected back by the body part and generates signals corresponding to an image of the light reflection, which corresponds to the light absorption pattern in the body part. The light absorption pattern may correlate to a fingerprint, a blood vessel pattern, blood movement within the blood vessels, combinations thereof, or other biometric feature. A processor receives the signals from the photodetectors and analyzes the signals to determine a characteristic of the body part. The characteristic may be used to authenticate the user of the bio-sensor device by comparing the detected characteristic to a stored characteristic.

Claims

1. A bio-sensor device comprising:

a display portion having a light passing panel, wherein the display portion comprises a two-dimensional pixel array containing light emitting diodes emitting a first set of peak wavelengths and configured to display a full color image;

a two-dimensional array of light sources, distributed within the pixel array, configured to emit light through the light passing panel so as to be partially reflected and absorbed by blood in a person'"'"'s finger overlying the display portion, the light sources being co-planer with the pixels and emitting light having at least a peak wavelength not within the first set of peak wavelengths;

a two-dimensional array of photodetectors distributed within the pixel array and arranged to detect light reflected back by a surface of the finger and the blood in the finger, the photodetectors generating first signals corresponding to the light reflected back, the photodetectors being co-planer with the pixels;

a controller coupled to the display portion and the array of light sources,

the controller being configured to control pixels in the display portion to emit light of one or more peak wavelengths during a first period of time to detect a fingerprint of the finger and capture a first image of the fingerprint, wherein the array of light sources do not emit light during the first period of time, and

the controller bring configured to control the array of light sources during a second period of time to detect the blood in the finger and capture a second image of the blood in the finger; and

detection circuitry coupled to the photodetectors configured for analyzing the first signals to detect the fingerprint using only the pixels energized in the display portion during the first period of time and to detect the blood in the finger using light emitted by at least the array of light sources during the second period of time.

2. The device of claim 1 wherein the pixels generate red, green, and blue light, and the light sources generate infrared light.

3. The device of claim 1 wherein the light sources are laterally spaced from the pixels in the display portion.

4. The device of claim 1 wherein the light sources comprise light emitting diodes.

5. The device of claim 1 wherein the light sources comprise light emitting diodes emitting different peak wavelengths of light.

6. The device of claim 1 wherein the light sources emit light of a wavelength that is absorbed by blood vessels.

7. The device of claim 1 further comprising lenses over the photodetectors for limiting an angular range of reflected light from the finger.

8. The device of claim 1 further comprising lenses over the photodetectors for focusing reflected light from the finger onto the photodetectors from only a certain distance into the finger.

9. The device of claim 1 further comprising a non-optical sensor integrated into the device.

10. The device of claim 9 wherein the non-optical sensor comprises electrodes for touching by the finger.

11. The device of claim 1 wherein the device is configured to detect blood vessels in the finger.

12. The device of claim 1 wherein the controller comprises a processor integrated into the device, the processor controlling energization of the light source and detection of the reflected light received by the photodetectors.

13. The device of claim 1 wherein the controller comprises a processor, the processor being configured to process data from the photodetectors, compare the data to stored data, and indicate authentication of a user of the device.

14. The device of claim 1 wherein the controller comprises a processor, wherein the light sources comprise a plurality of light emitting diodes, wherein the processor is configured to control the light emitting diodes to be sequentially illuminated while signals from the photodetectors are read and processed by the processor.

15. The device of claim 1 wherein the controller comprises a processor, wherein the processor is configured to detect a light reflection image of the finger to determine areas of absorption of the light in the finger.

16. The device of claim 1 wherein the controller comprises a processor configured to process data from the photodetectors, wherein the processor detects movement of the body part for detecting a gesture.

17. The device of claim 1 wherein the controller is configured to control the array of light sources during the second period of time, while also controlling one or more pixels in the display portion to emit light during the second period of time, to detect the blood in the finger and capture the second image of the blood in the finger.

18. The device of claim 1 wherein the controller is configured to control the array of light sources during the second period of time, while also controlling at least one of red emitting or green emitting pixels in the display portion to emit light during the second period of time, to detect the blood in the finger and capture the second image of the blood in the finger.

19. The device of claim 1 wherein the detection circuitry is configured for generating a difference between the first image and the second image to obtain a resulting image at a desired depth into the finger.

20. The device of claim 1 wherein the detector subtracts the first signals generated by some photodetectors from the first signals generated by other ones of the photodetectors so that the differences correlate to absorption of the wavelengths of interest.