Under-screen optical sensor module for on-screen fingerprint sensing implementing imaging lens, extra illumination or optical collimator array

• US 10,410,037 B2
• Filed: 06/07/2017
• Issued: 09/10/2019
• Est. Priority Date: 06/18/2015
• Status: Active Grant

• Current Assignee: Shenzhen Goodix Technology Co., Ltd.
• Original Assignee: Shenzhen Goodix Technology Co., Ltd.
• Inventors: He, Yi, Pi, Bo
• Primary Examiner(s): Strege, John B
• Application Number:
  US15/616,856
• Publication Number:
  US 20170270342A1
• Time in Patent Office: 825 Days
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 2221/2133 Verifying human interaction, e.g., Captcha
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/0443 using a single layer of sensing electrodes
• CPC Class Codes: G06V 10/141 Control of illumination
• CPC Class Codes: G06V 40/1306 non-optical, e.g. ultrasonic or capacitive sensing
• CPC Class Codes: G06V 40/1318 using electro-optical elements or layers, e.g. electroluminescent sensing
• CPC Class Codes: G06V 40/1324 by using geometrical optics, e.g. using prisms G06V40/1312 takes precedence
• CPC Class Codes: G06V 40/1341 Sensing with light passing through the finger
• CPC Class Codes: G06V 40/1365 Matching; Classification
• CPC Class Codes: G06V 40/1394 using acquisition arrangements

Abstract

Devices and optical sensor modules are provided for provide on-screen optical sensing of fingerprints by using a under-screen optical sensor module that captures and detects returned light that is emitted by the display screen for displaying images and that is reflected back by the top surface of the screen assembly. Optical collimators are provided in the under-screen optical sensor module to enhance the optical imaging performance.

Claims

1. An electronic device capable of detecting a fingerprint by optical sensing, comprising:

a display panel that includes light emitting display pixels, each pixel operable to emit light for forming a portion of a display image;

a top transparent layer formed over the display panel as an interface for being touched by a user and for transmitting the light from the display panel to display images;

an optical sensor module located below the display panel to receive light that is emitted by at least a portion of the light emitting display pixels and is returned from the top transparent layer to detect a fingerprint, the optical sensor module including an optical sensor array of optical detectors that terminate received light and generate from terminated received light electrical sensor signals containing image information of a fingerprint; and

one or more extra illumination light sources placed below the display panel and near the optical sensor module to provide illumination probe light to illuminate a sensing area on the top transparent layer to cause returned probe light from the sensing area to the optical sensor module for optically sensing a touch by the optical sensor module without turning on the light emitting display pixels of the display panel to save power, and to provide additional illumination to the sensing area when the light emitting display pixels of the display panel are turned on to enhance optical sensing sensitivity of optical sensing at the optical sensor module.

2. The device as in claim 1, wherein:

the optical sensor module includes an array of optical collimators located between the display panel and the optical sensor array to collect the returned light from the display panel for sensing by the optical sensor array, and the array of optical collimators and spacing between the array of optical collimators and the optical sensor array are structured to cause images of a field of view of the optical collimators at the optical sensor array to be spatially separated.

3. The device as in claim 1, wherein:

the optical sensor module includes one or more optical filters in an optical path to the optical sensor module to reduce light at wavelengths different from the light emitted by the light emitting display pixels.

4. The device as in claim 3, wherein the one or more optical filters are designed to filter out IR light.

5. The device as in claim 1, wherein:

the optical sensor module includes an array of optical collimators located between the display panel and the optical sensor array to collect the returned light from the display panel for sensing by the optical sensor array, and the optical sensor module includes an optically absorbing material between the optical collimators in the array of optical collimators to absorb light that are not collected by the optical collimators.

6. The device as in claim 1, wherein:

the optical sensor module includes an array of optical collimators located between the display panel and the optical sensor array to collect the returned light from the display panel for sensing by the optical sensor array, and the array of optical collimators includes a substrate having an array of through holes formed in the substrate as the optical collimators.

7. The device as in claim 1, wherein:

the optical sensor module includes an array of optical collimators located between the display panel and the optical sensor array to collect the returned light from the display panel for sensing by the optical sensor array, and the array of optical collimators includes an array of optical waveguides or optical fibers.

8. The device as in claim 1, wherein:

the optical sensor module includes an array of optical collimators located between the display panel and the optical sensor array to collect the returned light from the display panel for sensing by the optical sensor array, and the array of optical collimators includes a micro lens array of micro lenses and each micro lens focus received light without imaging the received light.

9. The device as in claim 1, wherein:

the optical sensor module includes an array of optical collimators located between the display panel and the optical sensor array to collect the returned light from the display panel for sensing by the optical sensor array, and each optical collimator in the array of optical collimators is structured to transmit light in directions along or close an axis of the optical collimator while blocking light in other directions and to have a small transmission numerical aperture to achieve a high spatial resolution by the array of optical collimators.

10. The device as in claim 1, wherein the optical sensor module further includes an array of optical collimators located between the display panel and the optical sensor array to collect the returned light from the display panel for sensing by the optical sensor array, and an optical layer between the optical collimators and the display panel to select angled probe light returned from the display panel to enter the optical collimators while reducing an amount of the returned probe light that is perpendicular to the display panel and enters the optical collimators.

11. The device as in claim 1, wherein the one or more extra illumination light sources emit light that includes invisible light that can be detected by the optical sensor array.

12. The device as in claim 1, wherein the optical sensor module is structured to measure returned probe light at two or more different wavelengths emitted by light emitting display pixels in the display panel to compare an extinction ratio of the probe light at the two or more different wavelengths as the second signal indicative of whether the received contact is from a live person.

13. The device as in claim 1, wherein the display panel operates in a flash mode to cause a portion of the light emitting display pixels in the display panel under the sensing area on the top transparent layer to flash at a light emission level higher than a light emission level in displaying images to detect a presence of a finger and to obtain a fingerprint of the finger.

14. An electronic device capable of detecting a fingerprint by optical sensing, comprising:

a display panel that includes light emitting display pixels, each pixel operable to emit light for forming a portion of a display image;

a top transparent layer formed over the display panel as an interface for being touched by a user and for transmitting the light from the display panel to display images; and

an optical sensor module located below the display panel to receive light that is emitted by at least a portion of the light emitting display pixels and is returned from the top transparent layer to detect a fingerprint, the optical sensor module including an optical sensor array of optical detectors and an array of optical collimators located between the display panel and the optical sensor array to collect the returned light from the display panel for optical sensing by the optical sensor array to enhance an optical imaging resolution at the optical sensing by the optical sensor array,

wherein the optical sensor module further includes an optical layer between the optical collimators and the display panel to select angled probe light returned from the display panel to enter the optical collimators while reducing an amount of the returned probe light that is perpendicular to the display panel and enters the optical collimators and

wherein the optical layer includes an optical diffraction pattern that diffracts the returned probe light to direct the angled probe light returned from the display panel to enter the optical collimators.

15. The device as in claim 14, wherein:

the array of optical collimators includes a substrate having an array of through holes formed in the substrate as the optical collimators.

16. The device as in claim 14, wherein:

the array of optical collimators includes an array of optical waveguides or optical fibers.

17. The device as in claim 14, wherein:

the array of optical collimators includes a micro lens array of micro lenses and each micro lens focus received light without imaging the received light.

18. An electronic device capable of detecting a fingerprint by optical sensing, comprising:

a display panel that includes light emitting display pixels, each pixel operable to emit light for forming a portion of a display image;

a top transparent layer formed over the display panel as an interface for being touched by a user and for transmitting the light from the display panel to display images; and

an optical sensor module located below the display panel to receive light that is emitted by at least a portion of the light emitting display pixels and is returned from the top transparent layer to detect a fingerprint, the optical sensor module including an optical sensor array of optical detectors and an array of optical collimators located between the display panel and the optical sensor array to collect the returned light from the display panel for optical sensing by the optical sensor array,

wherein the optical sensor module further includes an optical layer between the optical collimators and the display panel to select angled probe light returned from the display panel to enter the optical collimators while reducing an amount of the returned probe light that is perpendicular to the display panel and enters the optical collimators and

wherein the optical collimators are elongated channels in a direction perpendicular to the display panel and the optical layer between the optical collimators and the display is structured to direct the angled probe light from the display panel to be substantially perpendicular to the display panel to enter the optical collimators while directing a portion of the probe light from the display panel that is perpendicular to the display panel to be away from the direction of the optical collimators.

19. The device as in claim 18, wherein:

the array of optical collimators includes a substrate having an array of through holes formed in the substrate as the optical collimators.

20. The device as in claim 18, wherein:

the array of optical collimators includes an array of optical waveguides or optical fibers.

21. The device as in claim 18, wherein:

the array of optical collimators includes a micro lens array of micro lenses and each micro lens focus received light without imaging the received light.

22. An electronic device capable of detecting a fingerprint by optical sensing, comprising:

a display panel that includes light emitting display pixels, each pixel operable to emit light for forming a portion of a display image;

a top transparent layer formed over the display panel as an interface for being touched by a user and for transmitting the light from the display panel to display images; and

an optical sensor module located below the display panel to receive light that is emitted by at least a portion of the light emitting display pixels and is returned from the top transparent layer to detect a fingerprint, the optical sensor module including an optical sensor array of optical detectors to receive light and to terminate received light to generate electrical detector signals containing image information of a fingerprint and an array of optical collimators located between the display panel and the optical sensor array to collect the returned light from the display panel for optical sensing by the optical sensor array,

wherein the optical sensor module is structured to measure returned probe light at two or more different wavelengths emitted by light emitting display pixels in the display panel to compare an extinction ratio of the probe light at the two or more different wavelengths as the second signal indicative of whether the received contact is from a live person.

23. The device as in claim 22, wherein:

the array of optical collimators includes a substrate having an array of through holes formed in the substrate as the optical collimators.

24. The device as in claim 22, wherein:

the array of optical collimators includes an array of optical waveguides or optical fibers.

25. The device as in claim 22, wherein:

the array of optical collimators includes a micro lens array of micro lenses and each micro lens focus received light without imaging the received light.

26. An electronic device capable of detecting a fingerprint by optical sensing, comprising:

a display panel that includes light emitting display pixels, each pixel operable to emit light for forming a portion of a display image;

a top transparent layer formed over the display panel as an interface for being touched by a user and for transmitting the light from the display panel to display images; and

an optical sensor module located below the display panel to receive light that is emitted by at least a portion of the light emitting display pixels and is returned from the top transparent layer to detect a fingerprint, the optical sensor module including an optical sensor array of optical detectors to collect the returned light from the display panel for optical sensing of the fingerprint,

wherein the optical sensor module captures different fingerprint patterns at different times to monitor time-domain evolution of the fingerprint ridge pattern deformation that indicates time-domain evolution of a press force from the contact input.

27. The device as in claim 26, wherein the optical sensor module includes an optical lens that directs the returned light from the display panel onto the optical sensor array for optical sensing of the fingerprint.

28. The device as in claim 26, wherein the optical sensor module is structured to direct the returned light from the display panel through the optical lens into the optical sensor array for optical sensing of the fingerprint via a bent optical path that is slanted with respect to the display panel.

29. The device as in claim 28, wherein the optical sensor module includes an optical wedge in the bent optical path.

30. The device as in claim 28, wherein the optical sensor module includes an optical spacer block in the bent optical path.

31. An electronic device capable of detecting a fingerprint by optical sensing, comprising:

a display panel that includes light emitting display pixels, each pixel operable to emit light for forming a portion of a display image;

a top transparent layer formed over the display panel as an interface for being touched by a user and for transmitting the light from the display panel to display images; and

an optical sensor module located below the display panel to receive light that is emitted by at least a portion of the light emitting display pixels and is returned from the top transparent layer to detect a fingerprint, the optical sensor module including an optical sensor array of optical detectors to capture an optical image of the fingerprint,

wherein the display panel operates in a flash mode to cause a portion of the light emitting display pixels in the display panel to flash at a light emission level higher than a light emission level in displaying images to detect a presence of a finger and to obtain a fingerprint of the finger.

32. The device as in claim 31, wherein the optical sensor module includes an optical lens that directs the returned light from the display panel onto the optical sensor array for optical sensing of the fingerprint.

33. The device as in claim 32, wherein the optical sensor module is structured to direct the returned light from the display panel through the optical lens into the optical sensor array for optical sensing of the fingerprint via a bent optical path that is slanted with respect to the display panel.

34. The device as in claim 32, wherein the optical sensor module includes an optical wedge in the bent optical path.

35. The device as in claim 32, wherein the optical sensor module includes an optical spacer block in the bent optical path.

36. An electronic device capable of detecting a fingerprint by optical sensing, comprising:

a display panel that includes light emitting display pixels, each pixel operable to emit light for forming a portion of a display image;

a top transparent layer formed over the display panel as an interface for being touched by a user and for transmitting the light from the display panel to display images; and

an optical sensor module located below the display panel to receive light that is emitted by at least a portion of the light emitting display pixels and is returned from the top transparent layer to detect a fingerprint, the optical sensor module including an optical sensor array of optical detectors that terminate received light and generate from the terminated received light electrical detector signals containing image information of a fingerprint, an array of optical collimators located between the display panel and the optical sensor array to collect the returned light from the display panel and to separate light from different locations in the top transparent layer while directing the collected returned light to the optical sensor array, and an optical layer between the optical collimators and the display panel to select angled probe light returned from the display panel to enter the optical collimators while reducing an amount of the returned probe light that is perpendicular to the display panel and enters the optical collimators,

wherein the optical layer includes an optical diffraction pattern that diffracts the returned probe light to direct the angled probe light returned from the display panel to enter the optical collimators.

37. The device as in claim 36, wherein:

the array of optical collimators includes a substrate having an array of through holes formed in the substrate as the optical collimators.

38. The device as in claim 36, wherein:

the array of optical collimators includes an array of optical waveguides or optical fibers.

39. The device as in claim 36, wherein:

the array of optical collimators includes a micro lens array of micro lenses and each micro lens focus received light without imaging the received light.

40. An electronic device capable of detecting a fingerprint by optical sensing, comprising:

a display panel that includes light emitting display pixels, each pixel operable to emit light for forming a portion of a display image;

a top transparent layer formed over the display panel as an interface for being touched by a user and for transmitting the light from the display panel to display images; and

an optical sensor module located below the display panel to receive light that is emitted by at least a portion of the light emitting display pixels and is returned from the top transparent layer to detect a fingerprint, the optical sensor module including an optical sensor array of optical detectors that terminate received light and generate from the terminated received light electrical detector signals containing image information of a fingerprint, an array of optical collimators located between the display panel and the optical sensor array to collect the returned light from the display panel and to separate light from different locations in the top transparent layer while directing the collected returned light to the optical sensor array, and an optical layer between the optical collimators and the display panel to select angled probe light returned from the display panel to enter the optical collimators while reducing an amount of the returned probe light that is perpendicular to the display panel and enters the optical collimators,

wherein the optical collimators are elongated channels in a direction perpendicular to the display panel and the optical layer between the optical collimators and the display is structured to direct the angled probe light from the display panel to be substantially perpendicular to the display panel to enter the optical collimators while directing a portion of the probe light from the display panel that is perpendicular to the display panel to be away from the direction of the optical collimators.

41. The device as in claim 40

wherein the electronic control module is configured to wake up the display panel from the sleep mode by turning on other light emitting display pixels of the display panel that are not below the fingerprint sensing area on the top transparent layer when the optical sensor module detects the presence of a person'"'"'s skin.

42. The device as in claim 40, wherein:

the array of optical collimators includes a substrate having an array of through holes formed in the substrate as the optical collimators.

43. The device as in claim 40, wherein:

the array of optical collimators includes an array of optical waveguides or optical fibers.

44. The device as in claim 40, wherein:

the array of optical collimators includes a micro lens array of micro lenses and each micro lens focus received light without imaging the received light.

45. An electronic device capable of detecting a fingerprint by optical sensing, comprising:

an optical sensor module to receive light that is returned from a top transparent layer of a touch sensing display panel to detect a fingerprint, the optical sensor module including an optical sensor array of optical detectors and an array of optical collimators located between the touch sensing display panel and the optical sensor array to collect the returned light from the touch sensing display panel for optical sensing by the optical sensor array to enhance an optical imaging resolution at the optical sensing of the fingerprint by the optical sensor array,

wherein the optical sensor module further includes an optical layer between the optical collimators and the display panel to select angled probe light returned from the display panel to enter the optical collimators while reducing an amount of the returned probe light that is perpendicular to the display panel and enters the optical collimators and

wherein the optical layer includes an optical diffraction pattern that diffracts the returned probe light to direct the angled probe light returned from the display panel to enter the optical collimators.

46. The device as in claim 45, wherein:

the array of optical collimators includes a substrate having an array of through holes formed in the substrate as the optical collimators.

47. The device as in claim 45, wherein:

the array of optical collimators includes an array of optical waveguides or optical fibers.

48. The device as in claim 45, wherein:

the array of optical collimators includes a micro lens array of micro lenses and each micro lens focus received light without imaging the received light.